2024-05-08T22:53:26.201 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T22:53:26.201 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_pdonnell@teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsync-tester}} --name pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698146 -- /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698146/orig.config.yaml 2024-05-08T22:53:26.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T22:53:26.354 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698146 branch: wip-pdonnell-testing-20240508.150423-reef description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsync-tester}} email: pdonnell@redhat.com first_in_suite: false job_id: '7698146' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-pdonnell-testing-20240508.150423-reef ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt dry_run: true install: ceph: flavor: default sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.150423-reef sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 2738 sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 sleep_before_teardown: 0 subset: 17/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.150423-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD4C4373lgwJwBDcnuyCgpAfOHyJ46kFYEau3Vbdw7b3VEkq8yXxYVGdawfiA/4voGRQ2mAPeU4rf5muaHE/7dY= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLTzkeX61rfOlgCVMSyeczVzMlpMineni1tpX8Mkiuz7mizQLmxM0G2GN2Gy7dYLbQCnDm9h8MqNNeASV7VnsWM= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDNUqB0nO90mw2H7G1BKuP+0lIbIHDubGG3bSaH0ZHXFSk5P7E8Vciv/UJGnNZCQ3r419NCiF9FEQfZexWdMaZw= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_19:22:21 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T22:53:26.354 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa; will attempt to use it 2024-05-08T22:53:26.355 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa/tasks 2024-05-08T22:53:26.355 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T22:53:26.357 INFO:teuthology.task.internal:Checking packages... 2024-05-08T22:53:26.382 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'd21e4f961318b56f0d915caa2490c3711bf13c34' 2024-05-08T22:53:26.382 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T22:53:26.382 INFO:teuthology.packaging:ref: None 2024-05-08T22:53:26.382 INFO:teuthology.packaging:tag: None 2024-05-08T22:53:26.382 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.150423-reef 2024-05-08T22:53:26.382 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T22:53:26.382 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20240508.150423-reef 2024-05-08T22:53:26.613 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1322.gd21e4f96 2024-05-08T22:53:26.614 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T22:53:26.621 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T22:53:26.621 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T22:53:26.703 INFO:teuthology.task.internal:Saving configuration 2024-05-08T22:53:26.724 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T22:53:26.817 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T22:53:26.841 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698146', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 22:48:17.592391', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD4C4373lgwJwBDcnuyCgpAfOHyJ46kFYEau3Vbdw7b3VEkq8yXxYVGdawfiA/4voGRQ2mAPeU4rf5muaHE/7dY='} 2024-05-08T22:53:26.863 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698146', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 22:48:17.594069', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLTzkeX61rfOlgCVMSyeczVzMlpMineni1tpX8Mkiuz7mizQLmxM0G2GN2Gy7dYLbQCnDm9h8MqNNeASV7VnsWM='} 2024-05-08T22:53:26.888 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698146', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 22:48:17.595622', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDNUqB0nO90mw2H7G1BKuP+0lIbIHDubGG3bSaH0ZHXFSk5P7E8Vciv/UJGnNZCQ3r419NCiF9FEQfZexWdMaZw='} 2024-05-08T22:53:26.889 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T22:53:26.895 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-08T22:53:26.895 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-08T22:53:26.895 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-08T22:53:26.895 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T22:53:27.047 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa2e3c49160>, signals=[15]) 2024-05-08T22:53:27.048 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T22:53:27.054 INFO:teuthology.task.internal:Opening connections... 2024-05-08T22:53:27.054 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T22:53:27.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T22:53:27.137 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2024-05-08T22:53:27.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T22:53:27.213 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T22:53:27.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T22:53:27.289 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T22:53:27.296 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-05-08T22:53:27.317 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-05-08T22:53:27.317 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-05-08T22:53:27.376 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T22:53:27.376 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T22:53:27.376 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2024-05-08T22:53:27.376 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2024-05-08T22:53:27.377 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6" 2024-05-08T22:53:27.377 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2024-05-08T22:53:27.377 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T22:53:27.377 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-05-08T22:53:27.377 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T22:53:27.377 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T22:53:27.377 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T22:53:27.377 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T22:53:27.377 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T22:53:27.377 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T22:53:27.377 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T22:53:27.377 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T22:53:27.378 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T22:53:27.378 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-05-08T22:53:27.405 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-05-08T22:53:27.425 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-05-08T22:53:27.425 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-05-08T22:53:27.486 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T22:53:27.486 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T22:53:27.486 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2024-05-08T22:53:27.486 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2024-05-08T22:53:27.487 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6" 2024-05-08T22:53:27.487 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2024-05-08T22:53:27.487 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T22:53:27.487 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-05-08T22:53:27.487 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T22:53:27.487 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T22:53:27.487 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T22:53:27.487 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T22:53:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-05-08T22:53:27.487 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T22:53:27.487 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T22:53:27.487 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T22:53:27.487 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T22:53:27.488 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-05-08T22:53:27.513 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-05-08T22:53:27.533 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-05-08T22:53:27.534 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-05-08T22:53:27.593 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T22:53:27.593 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T22:53:27.593 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2024-05-08T22:53:27.593 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2024-05-08T22:53:27.593 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.6" 2024-05-08T22:53:27.593 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2024-05-08T22:53:27.593 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T22:53:27.594 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-05-08T22:53:27.594 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T22:53:27.594 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T22:53:27.594 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T22:53:27.594 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T22:53:27.594 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T22:53:27.594 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T22:53:27.594 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T22:53:27.594 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T22:53:27.594 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T22:53:27.595 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-05-08T22:53:27.735 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T22:53:27.746 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T22:53:27.789 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T22:53:27.789 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-05-08T22:53:27.792 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2024-05-08T22:53:27.794 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-05-08T22:53:27.813 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T22:53:27.819 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T22:53:27.819 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-05-08T22:53:27.851 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2024-05-08T22:53:27.853 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-05-08T22:53:27.880 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T22:53:27.956 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T22:53:27.972 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-08T22:53:27.972 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-05-08T22:53:27.972 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-05-08T22:53:27.972 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T22:53:27.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T22:53:27.992 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-05-08T22:53:28.052 INFO:teuthology.orchestra.run.smithi135.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-05-08T22:53:28.052 INFO:teuthology.task.kernel:Running kernel on smithi135: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T22:53:28.052 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum install -y kernel 2024-05-08T22:53:29.552 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2024-05-08T22:53:29.552 INFO:teuthology.orchestra.run.smithi135.stdout:Unable to read consumer identity 2024-05-08T22:53:29.808 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T22:53:29.808 INFO:teuthology.orchestra.run.smithi135.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T22:53:29.808 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T22:53:31.665 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2024-05-08T22:53:32.412 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2024-05-08T22:53:36.041 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 272 kB/s | 24 kB 00:00 2024-05-08T22:53:36.777 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-05-08T22:53:36.777 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-05-08T22:53:36.855 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T22:53:36.856 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-08T22:53:36.856 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T22:53:37.008 DEBUG:teuthology.orchestra.run.smithi135:> echo no | sudo yum reinstall kernel || true 2024-05-08T22:53:37.344 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2024-05-08T22:53:37.344 INFO:teuthology.orchestra.run.smithi135.stdout:Unable to read consumer identity 2024-05-08T22:53:37.589 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T22:53:37.590 INFO:teuthology.orchestra.run.smithi135.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T22:53:37.590 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T22:53:37.899 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:02 ago on Wed 08 May 2024 10:53:35 PM UTC. 2024-05-08T22:53:37.970 INFO:teuthology.orchestra.run.smithi135.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T22:53:37.978 INFO:teuthology.orchestra.run.smithi135.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T22:53:38.017 INFO:teuthology.orchestra.run.smithi135.stderr:Error: No packages marked for reinstall. 2024-05-08T22:53:38.065 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum reinstall -y kernel || true 2024-05-08T22:53:38.399 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2024-05-08T22:53:38.399 INFO:teuthology.orchestra.run.smithi135.stdout:Unable to read consumer identity 2024-05-08T22:53:38.658 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T22:53:38.658 INFO:teuthology.orchestra.run.smithi135.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T22:53:38.658 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T22:53:38.958 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:03 ago on Wed 08 May 2024 10:53:35 PM UTC. 2024-05-08T22:53:39.020 INFO:teuthology.orchestra.run.smithi135.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T22:53:39.020 INFO:teuthology.orchestra.run.smithi135.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T22:53:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:Error: No packages marked for reinstall. 2024-05-08T22:53:39.105 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T22:53:39.276 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-05-08T22:53:39.277 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T22:53:39.277 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-08T22:53:39.277 DEBUG:teuthology.parallel:result is None 2024-05-08T22:53:39.277 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T22:53:39.289 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T22:53:39.289 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T22:53:39.291 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T22:53:39.294 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T22:53:39.316 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T22:53:39.323 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T22:53:39.418 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T22:53:39.418 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T22:53:39.420 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T22:53:39.423 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T22:53:39.465 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T22:53:39.520 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T22:53:39.520 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T22:53:39.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T22:53:39.540 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T22:53:39.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T22:53:39.559 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T22:53:39.564 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T22:53:39.583 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T22:53:39.597 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T22:53:39.614 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T22:53:39.628 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T22:53:39.644 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T22:53:39.651 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T22:53:39.663 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T22:53:39.665 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T22:53:39.676 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T22:53:39.676 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T22:53:39.678 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T22:53:39.681 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T22:53:39.710 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T22:53:39.783 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T22:53:39.784 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T22:53:39.786 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T22:53:39.789 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T22:53:39.807 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T22:53:39.884 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T22:53:39.967 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T22:53:40.011 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T22:53:40.052 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T22:53:40.052 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T22:53:40.119 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T22:53:40.169 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T22:53:40.224 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T22:53:40.310 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T22:53:40.355 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-05-08T22:53:40.355 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T22:53:40.423 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T22:53:40.469 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T22:53:40.523 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T22:53:40.612 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T22:53:40.657 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T22:53:40.657 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T22:53:40.727 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-05-08T22:53:40.729 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2024-05-08T22:53:40.731 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-05-08T22:53:40.777 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T22:53:40.820 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T22:53:40.869 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T22:53:41.215 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T22:53:41.223 INFO:teuthology.task.internal:Starting timer... 2024-05-08T22:53:41.223 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T22:53:41.348 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T22:53:41.463 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2024-05-08T22:53:41.463 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-05-08T22:53:41.530 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-05-08T22:53:41.531 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2024-05-08T22:53:41.586 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: 2024-05-08T22:53:41.588 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2024-05-08T22:53:41.658 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2024-05-08T22:53:41.659 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T22:53:41.659 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-05-08T22:53:41.689 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-05-08T22:53:41.690 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2024-05-08T22:53:41.714 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2024-05-08T22:53:41.714 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2024-05-08T22:53:41.744 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2024-05-08T22:53:41.744 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi135.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi179.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2024-05-08T22:53:41.745 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T22:53:41.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T22:53:41.772 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T22:53:41.799 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T22:53:41.800 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T22:53:41.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T22:53:41.829 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T22:53:41.829 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-05-08T22:53:41.858 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2024-05-08T22:53:42.345 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2024-05-08T22:53:42.375 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T22:53:42.394 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T22:53:42.412 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T22:53:42.413 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi135.front.sepia.ceph.com,smithi179.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T23:03:54.517 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi135.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-05-08T23:03:54.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-08T23:03:54.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:03:54.623 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-05-08T23:03:54.696 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-08T23:03:54.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-05-08T23:03:54.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:03:54.774 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-05-08T23:03:54.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-05-08T23:03:54.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-05-08T23:03:54.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:03:54.925 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-05-08T23:03:54.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-05-08T23:03:54.998 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T23:03:55.011 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T23:03:55.011 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T23:03:55.011 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T23:03:55.014 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T23:03:55.014 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T23:03:55.016 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T23:03:55.016 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T23:03:55.048 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T23:03:55.050 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T23:03:55.064 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T23:03:55.068 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T23:03:55.075 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T23:03:55.091 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T23:03:55.133 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-05-08T23:03:55.141 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2024-05-08T23:03:55.146 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-05-08T23:03:55.153 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2024-05-08T23:03:55.161 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T23:03:55.166 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2024-05-08T23:03:55.169 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T23:03:55.176 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T23:03:55.178 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2024-05-08T23:03:55.184 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T23:03:55.194 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T23:03:55.208 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T23:03:55.249 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2024-05-08T23:03:55.252 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T23:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-05-08T23:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:03:55.253 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:03:55.264 INFO:teuthology.orchestra.run.smithi179.stderr:bash: ntpq: command not found 2024-05-08T23:03:55.269 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T23:03:55.269 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-05-08T23:03:55.269 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:03:55.269 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:03:55.269 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:03:55.269 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:03:55.297 INFO:teuthology.orchestra.run.smithi195.stderr:bash: ntpq: command not found 2024-05-08T23:03:55.301 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T23:03:55.301 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-05-08T23:03:55.302 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:03:55.302 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:03:55.302 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:03:55.302 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:03:55.302 INFO:teuthology.run_tasks:Running task pexec... 2024-05-08T23:03:55.313 INFO:teuthology.task.pexec:Executing custom commands... 2024-05-08T23:03:55.313 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T23:03:55.314 DEBUG:teuthology.orchestra.run.smithi135:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-05-08T23:03:55.314 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi179.front.sepia.ceph.com 2024-05-08T23:03:55.314 DEBUG:teuthology.orchestra.run.smithi179:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-05-08T23:03:55.315 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T23:03:55.315 DEBUG:teuthology.orchestra.run.smithi195:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-05-08T23:03:55.691 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2024-05-08T23:03:55.693 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2024-05-08T23:03:55.719 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2024-05-08T23:03:57.563 INFO:teuthology.orchestra.run.smithi195.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 38 kB/s | 4.5 kB 00:00 2024-05-08T23:03:57.564 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 34 kB/s | 4.5 kB 00:00 2024-05-08T23:03:57.695 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 26 kB/s | 4.1 kB 00:00 2024-05-08T23:03:58.035 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 34 kB/s | 4.5 kB 00:00 2024-05-08T23:03:58.189 INFO:teuthology.orchestra.run.smithi195.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 28 kB/s | 4.1 kB 00:00 2024-05-08T23:03:58.218 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 24 kB/s | 4.1 kB 00:00 2024-05-08T23:04:01.074 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:04:01.075 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:04:01.075 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-05-08T23:04:01.075 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:04:01.076 INFO:teuthology.orchestra.run.smithi135.stdout:Resetting modules: 2024-05-08T23:04:01.076 INFO:teuthology.orchestra.run.smithi135.stdout: container-tools 2024-05-08T23:04:01.076 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:04:01.076 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:04:01.076 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:04:01.076 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:04:01.170 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-05-08T23:04:01.171 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-05-08T23:04:01.171 INFO:teuthology.orchestra.run.smithi179.stdout: Package Architecture Version Repository Size 2024-05-08T23:04:01.171 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-05-08T23:04:01.171 INFO:teuthology.orchestra.run.smithi179.stdout:Resetting modules: 2024-05-08T23:04:01.172 INFO:teuthology.orchestra.run.smithi179.stdout: container-tools 2024-05-08T23:04:01.172 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-05-08T23:04:01.172 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-05-08T23:04:01.172 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-05-08T23:04:01.172 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-05-08T23:04:01.297 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-05-08T23:04:01.298 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-05-08T23:04:01.298 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-05-08T23:04:01.298 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-05-08T23:04:01.298 INFO:teuthology.orchestra.run.smithi195.stdout:Resetting modules: 2024-05-08T23:04:01.298 INFO:teuthology.orchestra.run.smithi195.stdout: container-tools 2024-05-08T23:04:01.298 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T23:04:01.298 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-05-08T23:04:01.299 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-05-08T23:04:01.299 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T23:04:14.150 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-05-08T23:04:14.664 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2024-05-08T23:04:14.997 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:04:15.453 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2024-05-08T23:04:15.636 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-05-08T23:04:16.119 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2024-05-08T23:04:16.462 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 26 kB/s | 4.1 kB 00:00 2024-05-08T23:04:16.827 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 29 kB/s | 4.5 kB 00:00 2024-05-08T23:04:17.402 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 40 kB/s | 4.5 kB 00:00 2024-05-08T23:04:18.019 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 29 kB/s | 4.1 kB 00:00 2024-05-08T23:04:18.079 INFO:teuthology.orchestra.run.smithi195.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 30 kB/s | 4.5 kB 00:00 2024-05-08T23:04:18.750 INFO:teuthology.orchestra.run.smithi195.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 21 kB/s | 4.1 kB 00:00 2024-05-08T23:04:19.710 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-05-08T23:04:19.874 INFO:teuthology.orchestra.run.smithi179.stdout:========================================================================================================== 2024-05-08T23:04:19.874 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2024-05-08T23:04:19.874 INFO:teuthology.orchestra.run.smithi179.stdout:========================================================================================================== 2024-05-08T23:04:19.874 INFO:teuthology.orchestra.run.smithi179.stdout:Installing group/module packages: 2024-05-08T23:04:19.874 INFO:teuthology.orchestra.run.smithi179.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-05-08T23:04:19.875 INFO:teuthology.orchestra.run.smithi179.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-05-08T23:04:19.875 INFO:teuthology.orchestra.run.smithi179.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-05-08T23:04:19.875 INFO:teuthology.orchestra.run.smithi179.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-05-08T23:04:19.875 INFO:teuthology.orchestra.run.smithi179.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T23:04:19.875 INFO:teuthology.orchestra.run.smithi179.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-05-08T23:04:19.875 INFO:teuthology.orchestra.run.smithi179.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-05-08T23:04:19.875 INFO:teuthology.orchestra.run.smithi179.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-05-08T23:04:19.875 INFO:teuthology.orchestra.run.smithi179.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-05-08T23:04:19.875 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-05-08T23:04:19.875 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-05-08T23:04:19.875 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-05-08T23:04:19.875 INFO:teuthology.orchestra.run.smithi179.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-05-08T23:04:19.875 INFO:teuthology.orchestra.run.smithi179.stdout:Installing weak dependencies: 2024-05-08T23:04:19.876 INFO:teuthology.orchestra.run.smithi179.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T23:04:19.876 INFO:teuthology.orchestra.run.smithi179.stdout:Installing module profiles: 2024-05-08T23:04:19.876 INFO:teuthology.orchestra.run.smithi179.stdout: container-tools/common 2024-05-08T23:04:19.876 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-05-08T23:04:19.876 INFO:teuthology.orchestra.run.smithi179.stdout:Enabling module streams: 2024-05-08T23:04:19.876 INFO:teuthology.orchestra.run.smithi179.stdout: container-tools rhel8 2024-05-08T23:04:19.876 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-05-08T23:04:19.876 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-05-08T23:04:19.876 INFO:teuthology.orchestra.run.smithi179.stdout:========================================================================================================== 2024-05-08T23:04:19.876 INFO:teuthology.orchestra.run.smithi179.stdout:Install 13 Packages 2024-05-08T23:04:19.876 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-05-08T23:04:19.877 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 26 M 2024-05-08T23:04:19.877 INFO:teuthology.orchestra.run.smithi179.stdout:Installed size: 87 M 2024-05-08T23:04:19.877 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-05-08T23:04:20.111 INFO:teuthology.orchestra.run.smithi179.stdout:(1/13): criu-libs-3.18-4.module+el8.9.0+20326+3 168 kB/s | 39 kB 00:00 2024-05-08T23:04:20.169 INFO:teuthology.orchestra.run.smithi179.stdout:(2/13): python3-pyxdg-0.25-16.el8.noarch.rpm 321 kB/s | 94 kB 00:00 2024-05-08T23:04:20.195 INFO:teuthology.orchestra.run.smithi179.stdout:(3/13): python3-pytoml-0.1.14-5.git7dea353.el8. 78 kB/s | 25 kB 00:00 2024-05-08T23:04:20.287 INFO:teuthology.orchestra.run.smithi179.stdout:(4/13): yajl-2.1.0-12.el8.x86_64.rpm 233 kB/s | 41 kB 00:00 2024-05-08T23:04:20.537 INFO:teuthology.orchestra.run.smithi179.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 2.7 MB/s | 1.0 MB 00:00 2024-05-08T23:04:20.570 INFO:teuthology.orchestra.run.smithi179.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2169 2.5 MB/s | 739 kB 00:00 2024-05-08T23:04:20.737 INFO:teuthology.orchestra.run.smithi179.stdout:(7/13): buildah-1.31.5-1.module+el8.9.0+21697+6 16 MB/s | 8.8 MB 00:00 2024-05-08T23:04:20.788 INFO:teuthology.orchestra.run.smithi179.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 954 kB/s | 239 kB 00:00 2024-05-08T23:04:20.865 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:04:20.909 INFO:teuthology.orchestra.run.smithi179.stdout:(9/13): netavark-1.7.0-2.module+el8.9.0+21697+6 11 MB/s | 3.7 MB 00:00 2024-05-08T23:04:20.938 INFO:teuthology.orchestra.run.smithi179.stdout:(10/13): python3-podman-4.6.0-2.module+el8.9.0+ 765 kB/s | 154 kB 00:00 2024-05-08T23:04:21.030 INFO:teuthology.orchestra.run.smithi135.stdout:========================================================================================================== 2024-05-08T23:04:21.031 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-08T23:04:21.031 INFO:teuthology.orchestra.run.smithi135.stdout:========================================================================================================== 2024-05-08T23:04:21.031 INFO:teuthology.orchestra.run.smithi135.stdout:Installing group/module packages: 2024-05-08T23:04:21.031 INFO:teuthology.orchestra.run.smithi135.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-05-08T23:04:21.031 INFO:teuthology.orchestra.run.smithi135.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-05-08T23:04:21.031 INFO:teuthology.orchestra.run.smithi135.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-05-08T23:04:21.031 INFO:teuthology.orchestra.run.smithi135.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-05-08T23:04:21.031 INFO:teuthology.orchestra.run.smithi135.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T23:04:21.031 INFO:teuthology.orchestra.run.smithi135.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-05-08T23:04:21.031 INFO:teuthology.orchestra.run.smithi135.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-05-08T23:04:21.031 INFO:teuthology.orchestra.run.smithi135.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-05-08T23:04:21.031 INFO:teuthology.orchestra.run.smithi135.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-05-08T23:04:21.031 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-08T23:04:21.032 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-05-08T23:04:21.032 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-05-08T23:04:21.032 INFO:teuthology.orchestra.run.smithi135.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-05-08T23:04:21.032 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2024-05-08T23:04:21.032 INFO:teuthology.orchestra.run.smithi135.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T23:04:21.032 INFO:teuthology.orchestra.run.smithi135.stdout:Installing module profiles: 2024-05-08T23:04:21.032 INFO:teuthology.orchestra.run.smithi135.stdout: container-tools/common 2024-05-08T23:04:21.032 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:04:21.032 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling module streams: 2024-05-08T23:04:21.032 INFO:teuthology.orchestra.run.smithi135.stdout: container-tools rhel8 2024-05-08T23:04:21.032 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:04:21.032 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:04:21.032 INFO:teuthology.orchestra.run.smithi135.stdout:========================================================================================================== 2024-05-08T23:04:21.032 INFO:teuthology.orchestra.run.smithi135.stdout:Install 13 Packages 2024-05-08T23:04:21.033 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:04:21.033 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 26 M 2024-05-08T23:04:21.033 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 87 M 2024-05-08T23:04:21.033 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:04:21.105 INFO:teuthology.orchestra.run.smithi179.stdout:(11/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 26 MB/s | 8.1 MB 00:00 2024-05-08T23:04:21.189 INFO:teuthology.orchestra.run.smithi135.stdout:(1/13): python3-pytoml-0.1.14-5.git7dea353.el8. 160 kB/s | 25 kB 00:00 2024-05-08T23:04:21.222 INFO:teuthology.orchestra.run.smithi135.stdout:(2/13): python3-pyxdg-0.25-16.el8.noarch.rpm 498 kB/s | 94 kB 00:00 2024-05-08T23:04:21.230 INFO:teuthology.orchestra.run.smithi179.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+21697+6a 169 kB/s | 49 kB 00:00 2024-05-08T23:04:21.247 INFO:teuthology.orchestra.run.smithi135.stdout:(3/13): criu-libs-3.18-4.module+el8.9.0+20326+3 184 kB/s | 39 kB 00:00 2024-05-08T23:04:21.297 INFO:teuthology.orchestra.run.smithi179.stdout:(13/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 6.5 MB/s | 2.5 MB 00:00 2024-05-08T23:04:21.298 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:04:21.298 INFO:teuthology.orchestra.run.smithi179.stdout:Total 18 MB/s | 26 MB 00:01 2024-05-08T23:04:21.323 INFO:teuthology.orchestra.run.smithi135.stdout:(4/13): yajl-2.1.0-12.el8.x86_64.rpm 306 kB/s | 41 kB 00:00 2024-05-08T23:04:21.456 INFO:teuthology.orchestra.run.smithi135.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 4.3 MB/s | 1.0 MB 00:00 2024-05-08T23:04:21.498 INFO:teuthology.orchestra.run.smithi135.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2169 4.1 MB/s | 739 kB 00:00 2024-05-08T23:04:21.575 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-05-08T23:04:21.581 INFO:teuthology.orchestra.run.smithi135.stdout:(7/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 1.9 MB/s | 239 kB 00:00 2024-05-08T23:04:21.596 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-05-08T23:04:21.596 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-05-08T23:04:21.620 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-05-08T23:04:21.657 INFO:teuthology.orchestra.run.smithi135.stdout:(8/13): python3-podman-4.6.0-2.module+el8.9.0+2 2.0 MB/s | 154 kB 00:00 2024-05-08T23:04:21.757 INFO:teuthology.orchestra.run.smithi135.stdout:(9/13): buildah-1.31.5-1.module+el8.9.0+21697+6 17 MB/s | 8.8 MB 00:00 2024-05-08T23:04:21.787 INFO:teuthology.orchestra.run.smithi195.stdout:========================================================================================================== 2024-05-08T23:04:21.787 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-05-08T23:04:21.787 INFO:teuthology.orchestra.run.smithi195.stdout:========================================================================================================== 2024-05-08T23:04:21.787 INFO:teuthology.orchestra.run.smithi195.stdout:Installing group/module packages: 2024-05-08T23:04:21.787 INFO:teuthology.orchestra.run.smithi195.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-05-08T23:04:21.787 INFO:teuthology.orchestra.run.smithi195.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-05-08T23:04:21.787 INFO:teuthology.orchestra.run.smithi195.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-05-08T23:04:21.787 INFO:teuthology.orchestra.run.smithi195.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-05-08T23:04:21.787 INFO:teuthology.orchestra.run.smithi195.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T23:04:21.788 INFO:teuthology.orchestra.run.smithi195.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-05-08T23:04:21.788 INFO:teuthology.orchestra.run.smithi195.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-05-08T23:04:21.788 INFO:teuthology.orchestra.run.smithi195.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-05-08T23:04:21.788 INFO:teuthology.orchestra.run.smithi195.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-05-08T23:04:21.788 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-05-08T23:04:21.788 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-05-08T23:04:21.788 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-05-08T23:04:21.788 INFO:teuthology.orchestra.run.smithi195.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-05-08T23:04:21.788 INFO:teuthology.orchestra.run.smithi195.stdout:Installing weak dependencies: 2024-05-08T23:04:21.788 INFO:teuthology.orchestra.run.smithi195.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T23:04:21.788 INFO:teuthology.orchestra.run.smithi195.stdout:Installing module profiles: 2024-05-08T23:04:21.788 INFO:teuthology.orchestra.run.smithi195.stdout: container-tools/common 2024-05-08T23:04:21.788 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T23:04:21.788 INFO:teuthology.orchestra.run.smithi195.stdout:Enabling module streams: 2024-05-08T23:04:21.789 INFO:teuthology.orchestra.run.smithi195.stdout: container-tools rhel8 2024-05-08T23:04:21.789 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T23:04:21.789 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-05-08T23:04:21.789 INFO:teuthology.orchestra.run.smithi195.stdout:========================================================================================================== 2024-05-08T23:04:21.789 INFO:teuthology.orchestra.run.smithi195.stdout:Install 13 Packages 2024-05-08T23:04:21.789 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T23:04:21.789 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 26 M 2024-05-08T23:04:21.789 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 87 M 2024-05-08T23:04:21.790 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-05-08T23:04:21.826 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-05-08T23:04:21.835 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-05-08T23:04:21.841 INFO:teuthology.orchestra.run.smithi135.stdout:(10/13): netavark-1.7.0-2.module+el8.9.0+21697+ 11 MB/s | 3.7 MB 00:00 2024-05-08T23:04:21.925 INFO:teuthology.orchestra.run.smithi135.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 15 MB/s | 2.5 MB 00:00 2024-05-08T23:04:21.959 INFO:teuthology.orchestra.run.smithi195.stdout:(1/13): python3-pyxdg-0.25-16.el8.noarch.rpm 554 kB/s | 94 kB 00:00 2024-05-08T23:04:22.007 INFO:teuthology.orchestra.run.smithi195.stdout:(2/13): criu-libs-3.18-4.module+el8.9.0+20326+3 181 kB/s | 39 kB 00:00 2024-05-08T23:04:22.035 INFO:teuthology.orchestra.run.smithi195.stdout:(3/13): python3-pytoml-0.1.14-5.git7dea353.el8. 101 kB/s | 25 kB 00:00 2024-05-08T23:04:22.041 INFO:teuthology.orchestra.run.smithi135.stdout:(12/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 21 MB/s | 8.1 MB 00:00 2024-05-08T23:04:22.066 INFO:teuthology.orchestra.run.smithi135.stdout:(13/13): udica-0.2.6-20.module+el8.9.0+21697+6a 220 kB/s | 49 kB 00:00 2024-05-08T23:04:22.067 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:04:22.067 INFO:teuthology.orchestra.run.smithi135.stdout:Total 25 MB/s | 26 MB 00:01 2024-05-08T23:04:22.110 INFO:teuthology.orchestra.run.smithi195.stdout:(4/13): yajl-2.1.0-12.el8.x86_64.rpm 272 kB/s | 41 kB 00:00 2024-05-08T23:04:22.194 INFO:teuthology.orchestra.run.smithi195.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 5.4 MB/s | 1.0 MB 00:00 2024-05-08T23:04:22.302 INFO:teuthology.orchestra.run.smithi195.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2169 3.8 MB/s | 739 kB 00:00 2024-05-08T23:04:22.337 INFO:teuthology.orchestra.run.smithi195.stdout:(7/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 1.6 MB/s | 239 kB 00:00 2024-05-08T23:04:22.348 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:04:22.369 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:04:22.369 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:04:22.490 INFO:teuthology.orchestra.run.smithi195.stdout:(8/13): python3-podman-4.6.0-2.module+el8.9.0+2 1.0 MB/s | 154 kB 00:00 2024-05-08T23:04:22.562 INFO:teuthology.orchestra.run.smithi195.stdout:(9/13): netavark-1.7.0-2.module+el8.9.0+21697+6 14 MB/s | 3.7 MB 00:00 2024-05-08T23:04:22.588 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-05-08T23:04:22.598 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:04:22.607 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:04:22.711 INFO:teuthology.orchestra.run.smithi195.stdout:(10/13): buildah-1.31.5-1.module+el8.9.0+21697+ 13 MB/s | 8.8 MB 00:00 2024-05-08T23:04:22.796 INFO:teuthology.orchestra.run.smithi195.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 11 MB/s | 2.5 MB 00:00 2024-05-08T23:04:22.821 INFO:teuthology.orchestra.run.smithi195.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+21697+6a 450 kB/s | 49 kB 00:00 2024-05-08T23:04:22.957 INFO:teuthology.orchestra.run.smithi195.stdout:(13/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 17 MB/s | 8.1 MB 00:00 2024-05-08T23:04:22.957 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:04:22.957 INFO:teuthology.orchestra.run.smithi195.stdout:Total 22 MB/s | 26 MB 00:01 2024-05-08T23:04:23.090 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-05-08T23:04:23.241 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-05-08T23:04:23.262 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-05-08T23:04:23.263 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-05-08T23:04:23.314 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-05-08T23:04:23.330 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:04:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-05-08T23:04:23.494 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-05-08T23:04:23.503 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-05-08T23:04:23.591 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-05-08T23:04:23.811 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-05-08T23:04:23.827 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-05-08T23:04:24.021 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-05-08T23:04:24.021 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-05-08T23:04:24.199 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-05-08T23:04:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-05-08T23:04:24.305 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-05-08T23:04:24.368 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-05-08T23:04:24.546 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-05-08T23:04:24.755 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-05-08T23:04:24.816 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-05-08T23:04:24.982 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-05-08T23:04:24.987 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-05-08T23:04:25.169 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T23:04:25.171 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-05-08T23:04:25.364 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-05-08T23:04:25.435 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T23:04:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-05-08T23:04:25.804 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-05-08T23:04:25.824 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-05-08T23:04:25.894 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T23:04:26.046 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-05-08T23:04:26.151 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T23:04:26.534 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-05-08T23:04:26.772 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-05-08T23:04:26.963 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T23:04:26.968 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-05-08T23:04:27.193 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T23:04:27.225 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T23:04:27.408 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-05-08T23:04:27.611 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T23:04:27.611 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-05-08T23:04:27.611 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-05-08T23:04:27.611 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-05-08T23:04:27.611 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-05-08T23:04:27.611 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-05-08T23:04:27.611 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-05-08T23:04:27.612 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-05-08T23:04:27.612 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T23:04:27.612 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T23:04:27.612 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-05-08T23:04:27.612 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-05-08T23:04:27.612 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-05-08T23:04:27.620 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-05-08T23:04:27.631 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-05-08T23:04:27.911 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T23:04:28.341 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T23:04:28.341 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-05-08T23:04:28.341 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-05-08T23:04:28.341 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-05-08T23:04:28.341 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-05-08T23:04:28.341 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-05-08T23:04:28.342 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-05-08T23:04:28.342 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-05-08T23:04:28.342 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T23:04:28.342 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T23:04:28.342 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-05-08T23:04:28.342 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-05-08T23:04:28.342 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-05-08T23:04:28.537 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-05-08T23:04:28.775 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-05-08T23:04:28.983 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T23:04:29.410 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T23:04:29.410 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-05-08T23:04:29.410 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-05-08T23:04:29.410 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-05-08T23:04:29.410 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-05-08T23:04:29.410 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-05-08T23:04:29.411 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-05-08T23:04:29.411 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-05-08T23:04:29.411 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T23:04:29.411 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T23:04:29.411 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-05-08T23:04:29.411 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-05-08T23:04:29.411 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-05-08T23:04:40.930 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-05-08T23:04:40.930 INFO:teuthology.orchestra.run.smithi179.stdout:Installed products updated. 2024-05-08T23:04:41.496 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-05-08T23:04:41.496 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-05-08T23:04:41.496 INFO:teuthology.orchestra.run.smithi179.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:41.496 INFO:teuthology.orchestra.run.smithi179.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:41.496 INFO:teuthology.orchestra.run.smithi179.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:04:41.497 INFO:teuthology.orchestra.run.smithi179.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-05-08T23:04:41.497 INFO:teuthology.orchestra.run.smithi179.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:41.497 INFO:teuthology.orchestra.run.smithi179.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:41.497 INFO:teuthology.orchestra.run.smithi179.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:04:41.497 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-05-08T23:04:41.497 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-05-08T23:04:41.497 INFO:teuthology.orchestra.run.smithi179.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:41.497 INFO:teuthology.orchestra.run.smithi179.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:41.497 INFO:teuthology.orchestra.run.smithi179.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:04:41.497 INFO:teuthology.orchestra.run.smithi179.stdout: yajl-2.1.0-12.el8.x86_64 2024-05-08T23:04:41.497 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-05-08T23:04:41.497 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-05-08T23:04:41.662 DEBUG:teuthology.parallel:result is None 2024-05-08T23:04:42.521 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-05-08T23:04:42.521 INFO:teuthology.orchestra.run.smithi135.stdout:Installed products updated. 2024-05-08T23:04:43.102 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:04:43.103 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:04:43.103 INFO:teuthology.orchestra.run.smithi135.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:43.103 INFO:teuthology.orchestra.run.smithi135.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:43.103 INFO:teuthology.orchestra.run.smithi135.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:04:43.103 INFO:teuthology.orchestra.run.smithi135.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-05-08T23:04:43.103 INFO:teuthology.orchestra.run.smithi135.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:43.103 INFO:teuthology.orchestra.run.smithi135.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:43.103 INFO:teuthology.orchestra.run.smithi135.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:04:43.103 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-05-08T23:04:43.103 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-05-08T23:04:43.103 INFO:teuthology.orchestra.run.smithi135.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:43.103 INFO:teuthology.orchestra.run.smithi135.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:43.103 INFO:teuthology.orchestra.run.smithi135.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:04:43.104 INFO:teuthology.orchestra.run.smithi135.stdout: yajl-2.1.0-12.el8.x86_64 2024-05-08T23:04:43.104 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:04:43.104 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:04:43.269 DEBUG:teuthology.parallel:result is None 2024-05-08T23:04:44.110 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-05-08T23:04:44.110 INFO:teuthology.orchestra.run.smithi195.stdout:Installed products updated. 2024-05-08T23:04:44.697 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T23:04:44.697 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-05-08T23:04:44.697 INFO:teuthology.orchestra.run.smithi195.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:44.697 INFO:teuthology.orchestra.run.smithi195.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:44.697 INFO:teuthology.orchestra.run.smithi195.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:04:44.697 INFO:teuthology.orchestra.run.smithi195.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-05-08T23:04:44.697 INFO:teuthology.orchestra.run.smithi195.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:44.697 INFO:teuthology.orchestra.run.smithi195.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:44.697 INFO:teuthology.orchestra.run.smithi195.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:04:44.698 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-05-08T23:04:44.698 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-05-08T23:04:44.698 INFO:teuthology.orchestra.run.smithi195.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:44.698 INFO:teuthology.orchestra.run.smithi195.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:04:44.698 INFO:teuthology.orchestra.run.smithi195.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:04:44.698 INFO:teuthology.orchestra.run.smithi195.stdout: yajl-2.1.0-12.el8.x86_64 2024-05-08T23:04:44.698 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T23:04:44.698 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-05-08T23:04:44.896 DEBUG:teuthology.parallel:result is None 2024-05-08T23:04:44.896 INFO:teuthology.run_tasks:Running task install... 2024-05-08T23:04:44.906 DEBUG:teuthology.task.install:project ceph 2024-05-08T23:04:44.906 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}} 2024-05-08T23:04:44.906 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'} 2024-05-08T23:04:44.906 INFO:teuthology.task.install:Using flavor: default 2024-05-08T23:04:44.914 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T23:04:44.915 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-05-08T23:04:44.915 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T23:04:44.915 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:04:44.918 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T23:04:44.918 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:04:44.919 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T23:04:44.919 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:04:45.152 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T23:04:45.152 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T23:04:45.157 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T23:04:45.157 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T23:04:45.158 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T23:04:45.158 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T23:04:45.494 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T23:04:45.495 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T23:04:45.495 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T23:04:45.500 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T23:04:45.500 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-05-08T23:04:45.500 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T23:04:45.525 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T23:04:45.526 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T23:04:45.533 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T23:04:45.533 DEBUG:teuthology.orchestra.run.smithi179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T23:04:45.559 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T23:04:45.559 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:04:45.559 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T23:04:45.593 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T23:04:45.593 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T23:04:45.595 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T23:04:45.605 DEBUG:teuthology.orchestra.run.smithi179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T23:04:45.665 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T23:04:45.674 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T23:04:45.687 DEBUG:teuthology.orchestra.run.smithi179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T23:04:45.741 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2024-05-08T23:04:45.743 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2024-05-08T23:04:45.747 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T23:04:45.755 INFO:teuthology.orchestra.run.smithi179.stdout:check_obsoletes = 1 2024-05-08T23:04:45.757 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum clean all 2024-05-08T23:04:45.816 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-05-08T23:04:45.817 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-05-08T23:04:46.120 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2024-05-08T23:04:46.134 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2024-05-08T23:04:46.199 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2024-05-08T23:04:47.423 INFO:teuthology.orchestra.run.smithi179.stdout:63 files removed 2024-05-08T23:04:47.474 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T23:04:47.509 INFO:teuthology.orchestra.run.smithi135.stdout:63 files removed 2024-05-08T23:04:47.542 INFO:teuthology.orchestra.run.smithi195.stdout:63 files removed 2024-05-08T23:04:47.560 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T23:04:47.593 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T23:04:47.811 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2024-05-08T23:04:47.897 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2024-05-08T23:04:47.929 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2024-05-08T23:04:49.595 INFO:teuthology.orchestra.run.smithi179.stdout:ceph packages for x86_64 254 kB/s | 80 kB 00:00 2024-05-08T23:04:49.744 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 264 kB/s | 80 kB 00:00 2024-05-08T23:04:49.921 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 192 kB/s | 80 kB 00:00 2024-05-08T23:04:49.957 INFO:teuthology.orchestra.run.smithi179.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-05-08T23:04:50.003 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 51 kB/s | 11 kB 00:00 2024-05-08T23:04:50.254 INFO:teuthology.orchestra.run.smithi179.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2024-05-08T23:04:50.255 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 38 kB/s | 11 kB 00:00 2024-05-08T23:04:50.405 INFO:teuthology.orchestra.run.smithi179.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-05-08T23:04:50.428 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 3.7 kB/s | 1.5 kB 00:00 2024-05-08T23:04:50.572 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 5.1 kB/s | 1.5 kB 00:00 2024-05-08T23:04:50.579 INFO:teuthology.orchestra.run.smithi195.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-05-08T23:04:50.723 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-05-08T23:04:51.172 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 29 MB/s | 16 MB 00:00 2024-05-08T23:04:51.172 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2024-05-08T23:04:52.665 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 8.5 MB/s | 16 MB 00:01 2024-05-08T23:04:54.740 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 454 kB/s | 24 kB 00:00 2024-05-08T23:04:54.755 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 404 kB/s | 24 kB 00:00 2024-05-08T23:04:55.399 INFO:teuthology.orchestra.run.smithi195.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 15 MB/s | 8.8 MB 00:00 2024-05-08T23:04:55.516 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 13 MB/s | 8.8 MB 00:00 2024-05-08T23:04:56.258 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 395 kB/s | 24 kB 00:00 2024-05-08T23:04:56.959 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-05-08T23:04:58.317 INFO:teuthology.orchestra.run.smithi195.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 43 MB/s | 61 MB 00:01 2024-05-08T23:04:58.434 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 48 MB/s | 67 MB 00:01 2024-05-08T23:05:00.152 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 38 MB/s | 61 MB 00:01 2024-05-08T23:05:09.269 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 MB/s | 61 MB 00:01 2024-05-08T23:05:09.910 INFO:teuthology.orchestra.run.smithi195.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 47 MB/s | 67 MB 00:01 2024-05-08T23:05:11.986 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 47 MB/s | 67 MB 00:01 2024-05-08T23:05:24.966 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T23:05:24.967 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T23:05:24.986 INFO:teuthology.orchestra.run.smithi195.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T23:05:24.988 INFO:teuthology.orchestra.run.smithi195.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T23:05:24.990 INFO:teuthology.orchestra.run.smithi195.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T23:05:24.991 INFO:teuthology.orchestra.run.smithi195.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T23:05:24.994 INFO:teuthology.orchestra.run.smithi195.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T23:05:24.998 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T23:05:25.000 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T23:05:25.058 INFO:teuthology.orchestra.run.smithi179.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T23:05:25.059 INFO:teuthology.orchestra.run.smithi179.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T23:05:25.078 INFO:teuthology.orchestra.run.smithi179.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T23:05:25.079 INFO:teuthology.orchestra.run.smithi179.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T23:05:25.081 INFO:teuthology.orchestra.run.smithi179.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T23:05:25.082 INFO:teuthology.orchestra.run.smithi179.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T23:05:25.085 INFO:teuthology.orchestra.run.smithi179.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T23:05:25.089 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T23:05:25.091 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T23:05:25.222 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-05-08T23:05:25.236 INFO:teuthology.orchestra.run.smithi195.stdout:=================================================================================================================================== 2024-05-08T23:05:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-05-08T23:05:25.236 INFO:teuthology.orchestra.run.smithi195.stdout:=================================================================================================================================== 2024-05-08T23:05:25.236 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-05-08T23:05:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T23:05:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T23:05:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T23:05:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T23:05:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T23:05:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T23:05:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T23:05:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T23:05:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T23:05:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T23:05:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T23:05:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T23:05:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T23:05:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T23:05:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T23:05:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T23:05:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T23:05:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T23:05:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T23:05:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T23:05:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T23:05:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T23:05:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T23:05:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T23:05:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T23:05:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T23:05:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T23:05:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T23:05:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T23:05:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T23:05:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T23:05:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T23:05:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T23:05:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T23:05:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T23:05:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T23:05:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T23:05:25.239 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2024-05-08T23:05:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T23:05:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T23:05:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T23:05:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T23:05:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T23:05:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T23:05:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T23:05:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T23:05:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T23:05:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T23:05:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T23:05:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T23:05:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T23:05:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T23:05:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T23:05:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T23:05:25.241 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-05-08T23:05:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T23:05:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T23:05:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T23:05:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T23:05:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T23:05:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T23:05:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T23:05:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T23:05:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T23:05:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T23:05:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T23:05:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T23:05:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T23:05:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T23:05:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T23:05:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T23:05:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T23:05:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T23:05:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T23:05:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T23:05:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T23:05:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T23:05:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T23:05:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T23:05:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T23:05:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T23:05:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T23:05:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T23:05:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T23:05:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T23:05:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T23:05:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T23:05:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T23:05:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T23:05:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T23:05:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T23:05:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T23:05:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T23:05:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T23:05:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T23:05:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T23:05:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T23:05:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T23:05:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T23:05:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T23:05:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T23:05:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T23:05:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T23:05:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T23:05:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T23:05:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T23:05:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T23:05:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T23:05:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T23:05:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T23:05:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T23:05:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T23:05:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T23:05:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T23:05:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T23:05:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T23:05:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T23:05:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T23:05:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T23:05:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T23:05:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T23:05:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T23:05:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T23:05:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T23:05:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T23:05:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T23:05:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T23:05:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T23:05:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T23:05:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T23:05:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T23:05:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T23:05:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T23:05:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T23:05:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T23:05:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T23:05:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T23:05:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T23:05:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T23:05:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T23:05:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T23:05:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T23:05:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T23:05:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T23:05:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T23:05:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T23:05:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T23:05:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T23:05:25.247 INFO:teuthology.orchestra.run.smithi195.stdout:Enabling module streams: 2024-05-08T23:05:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql 10 2024-05-08T23:05:25.248 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T23:05:25.248 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-05-08T23:05:25.248 INFO:teuthology.orchestra.run.smithi195.stdout:=================================================================================================================================== 2024-05-08T23:05:25.248 INFO:teuthology.orchestra.run.smithi195.stdout:Install 130 Packages 2024-05-08T23:05:25.248 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 16 Packages 2024-05-08T23:05:25.248 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T23:05:25.248 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 215 M 2024-05-08T23:05:25.248 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-05-08T23:05:25.309 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-05-08T23:05:25.323 INFO:teuthology.orchestra.run.smithi179.stdout:=================================================================================================================================== 2024-05-08T23:05:25.323 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2024-05-08T23:05:25.323 INFO:teuthology.orchestra.run.smithi179.stdout:=================================================================================================================================== 2024-05-08T23:05:25.323 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2024-05-08T23:05:25.324 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T23:05:25.324 INFO:teuthology.orchestra.run.smithi179.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T23:05:25.324 INFO:teuthology.orchestra.run.smithi179.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T23:05:25.324 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T23:05:25.324 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T23:05:25.324 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T23:05:25.324 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T23:05:25.324 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T23:05:25.324 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T23:05:25.325 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T23:05:25.325 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T23:05:25.325 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T23:05:25.325 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T23:05:25.325 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T23:05:25.325 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T23:05:25.325 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T23:05:25.325 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T23:05:25.325 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T23:05:25.325 INFO:teuthology.orchestra.run.smithi179.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T23:05:25.325 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T23:05:25.325 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T23:05:25.325 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T23:05:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T23:05:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T23:05:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T23:05:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T23:05:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T23:05:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T23:05:25.326 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T23:05:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T23:05:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T23:05:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T23:05:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T23:05:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T23:05:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T23:05:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T23:05:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T23:05:25.327 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2024-05-08T23:05:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T23:05:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T23:05:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T23:05:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T23:05:25.327 INFO:teuthology.orchestra.run.smithi179.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T23:05:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T23:05:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T23:05:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T23:05:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T23:05:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T23:05:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T23:05:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T23:05:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T23:05:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T23:05:25.328 INFO:teuthology.orchestra.run.smithi179.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T23:05:25.329 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T23:05:25.329 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-05-08T23:05:25.329 INFO:teuthology.orchestra.run.smithi179.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T23:05:25.329 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T23:05:25.329 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T23:05:25.329 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T23:05:25.329 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T23:05:25.329 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T23:05:25.329 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T23:05:25.329 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T23:05:25.329 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T23:05:25.329 INFO:teuthology.orchestra.run.smithi179.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T23:05:25.330 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T23:05:25.330 INFO:teuthology.orchestra.run.smithi179.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T23:05:25.330 INFO:teuthology.orchestra.run.smithi179.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T23:05:25.330 INFO:teuthology.orchestra.run.smithi179.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T23:05:25.330 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T23:05:25.330 INFO:teuthology.orchestra.run.smithi179.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T23:05:25.330 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T23:05:25.330 INFO:teuthology.orchestra.run.smithi179.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T23:05:25.330 INFO:teuthology.orchestra.run.smithi179.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T23:05:25.331 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T23:05:25.331 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T23:05:25.331 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T23:05:25.331 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T23:05:25.331 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T23:05:25.331 INFO:teuthology.orchestra.run.smithi179.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T23:05:25.331 INFO:teuthology.orchestra.run.smithi179.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T23:05:25.331 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T23:05:25.331 INFO:teuthology.orchestra.run.smithi179.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T23:05:25.331 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T23:05:25.331 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T23:05:25.331 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T23:05:25.331 INFO:teuthology.orchestra.run.smithi179.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T23:05:25.332 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T23:05:25.332 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T23:05:25.332 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T23:05:25.332 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T23:05:25.332 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T23:05:25.332 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T23:05:25.332 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T23:05:25.332 INFO:teuthology.orchestra.run.smithi179.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T23:05:25.332 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T23:05:25.332 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T23:05:25.332 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T23:05:25.332 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T23:05:25.332 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T23:05:25.332 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T23:05:25.333 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T23:05:25.334 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T23:05:25.334 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T23:05:25.334 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T23:05:25.334 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T23:05:25.334 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T23:05:25.334 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T23:05:25.334 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T23:05:25.334 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T23:05:25.334 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T23:05:25.334 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T23:05:25.334 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T23:05:25.334 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T23:05:25.334 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T23:05:25.335 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T23:05:25.335 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T23:05:25.335 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T23:05:25.335 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T23:05:25.335 INFO:teuthology.orchestra.run.smithi179.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T23:05:25.335 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T23:05:25.335 INFO:teuthology.orchestra.run.smithi179.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T23:05:25.335 INFO:teuthology.orchestra.run.smithi179.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T23:05:25.335 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T23:05:25.335 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T23:05:25.335 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T23:05:25.335 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T23:05:25.335 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T23:05:25.335 INFO:teuthology.orchestra.run.smithi179.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T23:05:25.335 INFO:teuthology.orchestra.run.smithi179.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T23:05:25.336 INFO:teuthology.orchestra.run.smithi179.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T23:05:25.336 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T23:05:25.336 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T23:05:25.336 INFO:teuthology.orchestra.run.smithi179.stdout:Enabling module streams: 2024-05-08T23:05:25.336 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql 10 2024-05-08T23:05:25.336 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-05-08T23:05:25.336 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-05-08T23:05:25.336 INFO:teuthology.orchestra.run.smithi179.stdout:=================================================================================================================================== 2024-05-08T23:05:25.336 INFO:teuthology.orchestra.run.smithi179.stdout:Install 130 Packages 2024-05-08T23:05:25.336 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 16 Packages 2024-05-08T23:05:25.336 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-05-08T23:05:25.337 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 215 M 2024-05-08T23:05:25.337 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-05-08T23:05:25.517 INFO:teuthology.orchestra.run.smithi195.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 27 kB/s | 6.4 kB 00:00 2024-05-08T23:05:25.685 INFO:teuthology.orchestra.run.smithi179.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 23 kB/s | 6.4 kB 00:00 2024-05-08T23:05:26.743 INFO:teuthology.orchestra.run.smithi195.stdout:(2/146): ceph-common-18.2.2-1322.gd21e4f96.el8. 15 MB/s | 22 MB 00:01 2024-05-08T23:05:26.744 INFO:teuthology.orchestra.run.smithi179.stdout:(2/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 4.1 MB/s | 5.5 MB 00:01 2024-05-08T23:05:26.769 INFO:teuthology.orchestra.run.smithi179.stdout:(3/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 794 kB/s | 860 kB 00:01 2024-05-08T23:05:26.801 INFO:teuthology.orchestra.run.smithi195.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 2.8 MB/s | 166 kB 00:00 2024-05-08T23:05:26.802 INFO:teuthology.orchestra.run.smithi179.stdout:(4/146): ceph-immutable-object-cache-18.2.2-132 2.8 MB/s | 166 kB 00:00 2024-05-08T23:05:26.907 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T23:05:26.908 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T23:05:26.925 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T23:05:26.926 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T23:05:26.928 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T23:05:26.929 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T23:05:26.938 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T23:05:26.939 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T23:05:26.939 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T23:05:27.052 INFO:teuthology.orchestra.run.smithi195.stdout:(4/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 9.1 MB/s | 2.3 MB 00:00 2024-05-08T23:05:27.078 INFO:teuthology.orchestra.run.smithi179.stdout:(5/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 5.7 MB/s | 1.6 MB 00:00 2024-05-08T23:05:27.161 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:05:27.175 INFO:teuthology.orchestra.run.smithi135.stdout:=================================================================================================================================== 2024-05-08T23:05:27.175 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-08T23:05:27.175 INFO:teuthology.orchestra.run.smithi135.stdout:=================================================================================================================================== 2024-05-08T23:05:27.175 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:05:27.176 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T23:05:27.176 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T23:05:27.176 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T23:05:27.176 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T23:05:27.176 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T23:05:27.176 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T23:05:27.176 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T23:05:27.176 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T23:05:27.176 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T23:05:27.176 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T23:05:27.176 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T23:05:27.176 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T23:05:27.176 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T23:05:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T23:05:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T23:05:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T23:05:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T23:05:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T23:05:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T23:05:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T23:05:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T23:05:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T23:05:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T23:05:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T23:05:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T23:05:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T23:05:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T23:05:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T23:05:27.178 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T23:05:27.178 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T23:05:27.178 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T23:05:27.178 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T23:05:27.178 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T23:05:27.178 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T23:05:27.178 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T23:05:27.178 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T23:05:27.178 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T23:05:27.178 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-05-08T23:05:27.178 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T23:05:27.178 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T23:05:27.178 INFO:teuthology.orchestra.run.smithi135.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T23:05:27.179 INFO:teuthology.orchestra.run.smithi135.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T23:05:27.179 INFO:teuthology.orchestra.run.smithi135.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T23:05:27.179 INFO:teuthology.orchestra.run.smithi135.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T23:05:27.179 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T23:05:27.179 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T23:05:27.179 INFO:teuthology.orchestra.run.smithi135.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T23:05:27.179 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T23:05:27.179 INFO:teuthology.orchestra.run.smithi135.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T23:05:27.179 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T23:05:27.179 INFO:teuthology.orchestra.run.smithi135.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T23:05:27.179 INFO:teuthology.orchestra.run.smithi135.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T23:05:27.179 INFO:teuthology.orchestra.run.smithi135.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T23:05:27.179 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T23:05:27.179 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-08T23:05:27.179 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T23:05:27.180 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T23:05:27.180 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T23:05:27.180 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T23:05:27.180 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T23:05:27.180 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T23:05:27.180 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T23:05:27.180 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T23:05:27.180 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T23:05:27.180 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T23:05:27.180 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T23:05:27.180 INFO:teuthology.orchestra.run.smithi135.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T23:05:27.181 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T23:05:27.181 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T23:05:27.181 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T23:05:27.181 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T23:05:27.181 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T23:05:27.181 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T23:05:27.181 INFO:teuthology.orchestra.run.smithi135.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T23:05:27.181 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T23:05:27.181 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T23:05:27.181 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T23:05:27.181 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T23:05:27.181 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T23:05:27.182 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T23:05:27.182 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T23:05:27.182 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T23:05:27.182 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T23:05:27.182 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T23:05:27.182 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T23:05:27.182 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T23:05:27.182 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T23:05:27.182 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T23:05:27.182 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T23:05:27.182 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T23:05:27.183 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T23:05:27.183 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T23:05:27.183 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T23:05:27.183 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T23:05:27.183 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T23:05:27.183 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T23:05:27.183 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T23:05:27.183 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T23:05:27.183 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T23:05:27.183 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T23:05:27.183 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T23:05:27.183 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T23:05:27.183 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T23:05:27.184 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T23:05:27.184 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T23:05:27.184 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T23:05:27.184 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T23:05:27.184 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T23:05:27.184 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T23:05:27.184 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T23:05:27.184 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T23:05:27.184 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T23:05:27.184 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T23:05:27.184 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T23:05:27.184 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T23:05:27.184 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T23:05:27.184 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T23:05:27.185 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T23:05:27.185 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T23:05:27.185 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T23:05:27.185 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T23:05:27.185 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T23:05:27.185 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T23:05:27.185 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T23:05:27.185 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T23:05:27.185 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T23:05:27.185 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T23:05:27.185 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T23:05:27.185 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T23:05:27.185 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T23:05:27.185 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T23:05:27.185 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T23:05:27.186 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T23:05:27.186 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T23:05:27.186 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T23:05:27.186 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T23:05:27.186 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T23:05:27.186 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T23:05:27.186 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T23:05:27.186 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T23:05:27.186 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T23:05:27.186 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T23:05:27.186 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T23:05:27.186 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T23:05:27.186 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T23:05:27.186 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T23:05:27.187 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T23:05:27.187 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T23:05:27.187 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling module streams: 2024-05-08T23:05:27.187 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql 10 2024-05-08T23:05:27.187 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:05:27.187 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:05:27.187 INFO:teuthology.orchestra.run.smithi135.stdout:=================================================================================================================================== 2024-05-08T23:05:27.187 INFO:teuthology.orchestra.run.smithi135.stdout:Install 130 Packages 2024-05-08T23:05:27.187 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 16 Packages 2024-05-08T23:05:27.187 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:05:27.188 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 215 M 2024-05-08T23:05:27.188 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:05:27.344 INFO:teuthology.orchestra.run.smithi195.stdout:(5/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 5.4 MB/s | 1.6 MB 00:00 2024-05-08T23:05:27.552 INFO:teuthology.orchestra.run.smithi135.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2024-05-08T23:05:27.778 INFO:teuthology.orchestra.run.smithi179.stdout:(6/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 6.9 MB/s | 4.8 MB 00:00 2024-05-08T23:05:28.102 INFO:teuthology.orchestra.run.smithi135.stdout:(2/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.5 MB/s | 860 kB 00:00 2024-05-08T23:05:28.127 INFO:teuthology.orchestra.run.smithi195.stdout:(6/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 6.2 MB/s | 4.8 MB 00:00 2024-05-08T23:05:28.128 INFO:teuthology.orchestra.run.smithi179.stdout:(7/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 1.7 MB/s | 2.3 MB 00:01 2024-05-08T23:05:28.169 INFO:teuthology.orchestra.run.smithi195.stdout:(7/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 324 kB/s | 860 kB 00:02 2024-05-08T23:05:28.194 INFO:teuthology.orchestra.run.smithi135.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 1.8 MB/s | 166 kB 00:00 2024-05-08T23:05:28.653 INFO:teuthology.orchestra.run.smithi195.stdout:(8/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 1.6 MB/s | 5.5 MB 00:03 2024-05-08T23:05:28.753 INFO:teuthology.orchestra.run.smithi195.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 243 kB/s | 24 kB 00:00 2024-05-08T23:05:28.812 INFO:teuthology.orchestra.run.smithi179.stdout:(8/146): ceph-common-18.2.2-1322.gd21e4f96.el8. 6.4 MB/s | 22 MB 00:03 2024-05-08T23:05:28.862 INFO:teuthology.orchestra.run.smithi135.stdout:(4/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 3.4 MB/s | 2.3 MB 00:00 2024-05-08T23:05:28.879 INFO:teuthology.orchestra.run.smithi179.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 364 kB/s | 24 kB 00:00 2024-05-08T23:05:29.370 INFO:teuthology.orchestra.run.smithi135.stdout:(5/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 3.1 MB/s | 1.6 MB 00:00 2024-05-08T23:05:30.328 INFO:teuthology.orchestra.run.smithi195.stdout:(10/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el 6.1 MB/s | 13 MB 00:02 2024-05-08T23:05:30.420 INFO:teuthology.orchestra.run.smithi195.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 2.8 MB/s | 261 kB 00:00 2024-05-08T23:05:30.544 INFO:teuthology.orchestra.run.smithi195.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 251 kB/s | 31 kB 00:00 2024-05-08T23:05:30.737 INFO:teuthology.orchestra.run.smithi195.stdout:(13/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 3.9 MB/s | 782 kB 00:00 2024-05-08T23:05:30.821 INFO:teuthology.orchestra.run.smithi195.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 1.7 MB/s | 142 kB 00:00 2024-05-08T23:05:30.896 INFO:teuthology.orchestra.run.smithi195.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 1.8 MB/s | 139 kB 00:00 2024-05-08T23:05:31.038 INFO:teuthology.orchestra.run.smithi195.stdout:(16/146): libradosstriper1-18.2.2-1322.gd21e4f9 3.3 MB/s | 474 kB 00:00 2024-05-08T23:05:31.153 INFO:teuthology.orchestra.run.smithi135.stdout:(6/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 2.7 MB/s | 4.8 MB 00:01 2024-05-08T23:05:31.537 INFO:teuthology.orchestra.run.smithi179.stdout:(10/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el 3.8 MB/s | 13 MB 00:03 2024-05-08T23:05:31.683 INFO:teuthology.orchestra.run.smithi179.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 1.7 MB/s | 261 kB 00:00 2024-05-08T23:05:31.804 INFO:teuthology.orchestra.run.smithi179.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 257 kB/s | 31 kB 00:00 2024-05-08T23:05:32.022 INFO:teuthology.orchestra.run.smithi195.stdout:(17/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 6.7 MB/s | 6.5 MB 00:00 2024-05-08T23:05:32.122 INFO:teuthology.orchestra.run.smithi179.stdout:(13/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x8 4.2 MB/s | 18 MB 00:04 2024-05-08T23:05:32.139 INFO:teuthology.orchestra.run.smithi195.stdout:(18/146): python3-ceph-argparse-18.2.2-1322.gd2 383 kB/s | 45 kB 00:00 2024-05-08T23:05:32.155 INFO:teuthology.orchestra.run.smithi179.stdout:(14/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 2.2 MB/s | 782 kB 00:00 2024-05-08T23:05:32.230 INFO:teuthology.orchestra.run.smithi195.stdout:(19/146): python3-ceph-common-18.2.2-1322.gd21e 1.4 MB/s | 129 kB 00:00 2024-05-08T23:05:32.280 INFO:teuthology.orchestra.run.smithi179.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 1.1 MB/s | 139 kB 00:00 2024-05-08T23:05:32.305 INFO:teuthology.orchestra.run.smithi179.stdout:(16/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 773 kB/s | 142 kB 00:00 2024-05-08T23:05:32.337 INFO:teuthology.orchestra.run.smithi135.stdout:(7/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 1.1 MB/s | 5.5 MB 00:05 2024-05-08T23:05:32.366 INFO:teuthology.orchestra.run.smithi195.stdout:(20/146): python3-cephfs-18.2.2-1322.gd21e4f96. 1.4 MB/s | 197 kB 00:00 2024-05-08T23:05:32.480 INFO:teuthology.orchestra.run.smithi179.stdout:(17/146): libradosstriper1-18.2.2-1322.gd21e4f9 2.3 MB/s | 474 kB 00:00 2024-05-08T23:05:32.481 INFO:teuthology.orchestra.run.smithi195.stdout:(21/146): python3-rados-18.2.2-1322.gd21e4f96.e 3.2 MB/s | 370 kB 00:00 2024-05-08T23:05:32.606 INFO:teuthology.orchestra.run.smithi195.stdout:(22/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 2.9 MB/s | 365 kB 00:00 2024-05-08T23:05:32.614 INFO:teuthology.orchestra.run.smithi179.stdout:(18/146): python3-ceph-argparse-18.2.2-1322.gd2 334 kB/s | 45 kB 00:00 2024-05-08T23:05:32.748 INFO:teuthology.orchestra.run.smithi195.stdout:(23/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 753 kB/s | 107 kB 00:00 2024-05-08T23:05:32.798 INFO:teuthology.orchestra.run.smithi179.stdout:(19/146): python3-ceph-common-18.2.2-1322.gd21e 704 kB/s | 129 kB 00:00 2024-05-08T23:05:32.832 INFO:teuthology.orchestra.run.smithi195.stdout:(24/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.1 MB/s | 95 kB 00:00 2024-05-08T23:05:32.898 INFO:teuthology.orchestra.run.smithi179.stdout:(20/146): python3-cephfs-18.2.2-1322.gd21e4f96. 1.9 MB/s | 197 kB 00:00 2024-05-08T23:05:33.007 INFO:teuthology.orchestra.run.smithi179.stdout:(21/146): python3-rados-18.2.2-1322.gd21e4f96.e 3.3 MB/s | 370 kB 00:00 2024-05-08T23:05:33.116 INFO:teuthology.orchestra.run.smithi179.stdout:(22/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 3.3 MB/s | 365 kB 00:00 2024-05-08T23:05:33.216 INFO:teuthology.orchestra.run.smithi179.stdout:(23/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 1.0 MB/s | 107 kB 00:00 2024-05-08T23:05:33.316 INFO:teuthology.orchestra.run.smithi179.stdout:(24/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 950 kB/s | 95 kB 00:00 2024-05-08T23:05:33.399 INFO:teuthology.orchestra.run.smithi195.stdout:(25/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 6.1 MB/s | 3.5 MB 00:00 2024-05-08T23:05:33.499 INFO:teuthology.orchestra.run.smithi195.stdout:(26/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 1.8 MB/s | 181 kB 00:00 2024-05-08T23:05:33.583 INFO:teuthology.orchestra.run.smithi195.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1322.g 291 kB/s | 24 kB 00:00 2024-05-08T23:05:33.666 INFO:teuthology.orchestra.run.smithi195.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 1.6 MB/s | 138 kB 00:00 2024-05-08T23:05:34.183 INFO:teuthology.orchestra.run.smithi179.stdout:(25/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 4.0 MB/s | 3.5 MB 00:00 2024-05-08T23:05:34.267 INFO:teuthology.orchestra.run.smithi179.stdout:(26/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 3.3 MB/s | 6.5 MB 00:01 2024-05-08T23:05:34.292 INFO:teuthology.orchestra.run.smithi179.stdout:(27/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 1.6 MB/s | 181 kB 00:00 2024-05-08T23:05:34.293 INFO:teuthology.orchestra.run.smithi195.stdout:(29/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 5.6 MB/s | 3.5 MB 00:00 2024-05-08T23:05:34.309 INFO:teuthology.orchestra.run.smithi179.stdout:(28/146): ceph-grafana-dashboards-18.2.2-1322.g 580 kB/s | 24 kB 00:00 2024-05-08T23:05:34.376 INFO:teuthology.orchestra.run.smithi179.stdout:(29/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 1.6 MB/s | 138 kB 00:00 2024-05-08T23:05:35.262 INFO:teuthology.orchestra.run.smithi135.stdout:(8/146): ceph-common-18.2.2-1322.gd21e4f96.el8. 2.7 MB/s | 22 MB 00:08 2024-05-08T23:05:35.353 INFO:teuthology.orchestra.run.smithi135.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 266 kB/s | 24 kB 00:00 2024-05-08T23:05:35.426 INFO:teuthology.orchestra.run.smithi179.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 3.2 MB/s | 3.5 MB 00:01 2024-05-08T23:05:35.493 INFO:teuthology.orchestra.run.smithi179.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 3.6 MB/s | 245 kB 00:00 2024-05-08T23:05:35.517 INFO:teuthology.orchestra.run.smithi195.stdout:(30/146): ceph-mgr-diskprediction-local-18.2.2- 6.0 MB/s | 7.4 MB 00:01 2024-05-08T23:05:35.537 INFO:teuthology.orchestra.run.smithi135.stdout:(10/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x8 4.2 MB/s | 18 MB 00:04 2024-05-08T23:05:35.560 INFO:teuthology.orchestra.run.smithi179.stdout:(32/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 740 kB/s | 49 kB 00:00 2024-05-08T23:05:35.584 INFO:teuthology.orchestra.run.smithi195.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 3.6 MB/s | 245 kB 00:00 2024-05-08T23:05:35.635 INFO:teuthology.orchestra.run.smithi179.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1322.gd 217 kB/s | 16 kB 00:00 2024-05-08T23:05:35.646 INFO:teuthology.orchestra.run.smithi135.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 2.4 MB/s | 261 kB 00:00 2024-05-08T23:05:35.659 INFO:teuthology.orchestra.run.smithi195.stdout:(32/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 657 kB/s | 49 kB 00:00 2024-05-08T23:05:35.721 INFO:teuthology.orchestra.run.smithi135.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 413 kB/s | 31 kB 00:00 2024-05-08T23:05:35.744 INFO:teuthology.orchestra.run.smithi179.stdout:(34/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 2.4 MB/s | 263 kB 00:00 2024-05-08T23:05:35.751 INFO:teuthology.orchestra.run.smithi195.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1322.gd 178 kB/s | 16 kB 00:00 2024-05-08T23:05:35.826 INFO:teuthology.orchestra.run.smithi195.stdout:(34/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 3.4 MB/s | 263 kB 00:00 2024-05-08T23:05:35.852 INFO:teuthology.orchestra.run.smithi179.stdout:(35/146): ceph-mgr-diskprediction-local-18.2.2- 5.0 MB/s | 7.4 MB 00:01 2024-05-08T23:05:35.869 INFO:teuthology.orchestra.run.smithi179.stdout:(36/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 1.3 MB/s | 170 kB 00:00 2024-05-08T23:05:35.877 INFO:teuthology.orchestra.run.smithi195.stdout:(35/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 3.3 MB/s | 170 kB 00:00 2024-05-08T23:05:35.904 INFO:teuthology.orchestra.run.smithi135.stdout:(13/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 4.2 MB/s | 782 kB 00:00 2024-05-08T23:05:35.919 INFO:teuthology.orchestra.run.smithi195.stdout:(36/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 436 kB/s | 18 kB 00:00 2024-05-08T23:05:35.927 INFO:teuthology.orchestra.run.smithi179.stdout:(37/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 241 kB/s | 18 kB 00:00 2024-05-08T23:05:35.971 INFO:teuthology.orchestra.run.smithi135.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 2.1 MB/s | 142 kB 00:00 2024-05-08T23:05:36.047 INFO:teuthology.orchestra.run.smithi135.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 1.8 MB/s | 139 kB 00:00 2024-05-08T23:05:36.164 INFO:teuthology.orchestra.run.smithi135.stdout:(16/146): libradosstriper1-18.2.2-1322.gd21e4f9 4.0 MB/s | 474 kB 00:00 2024-05-08T23:05:36.211 INFO:teuthology.orchestra.run.smithi179.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 211 kB/s | 59 kB 00:00 2024-05-08T23:05:36.253 INFO:teuthology.orchestra.run.smithi179.stdout:(39/146): gperftools-libs-2.7-9.el8.x86_64.rpm 798 kB/s | 306 kB 00:00 2024-05-08T23:05:36.312 INFO:teuthology.orchestra.run.smithi179.stdout:(40/146): libunwind-1.3.1-3.el8.x86_64.rpm 748 kB/s | 75 kB 00:00 2024-05-08T23:05:36.344 INFO:teuthology.orchestra.run.smithi195.stdout:(37/146): gperftools-libs-2.7-9.el8.x86_64.rpm 721 kB/s | 306 kB 00:00 2024-05-08T23:05:36.404 INFO:teuthology.orchestra.run.smithi179.stdout:(41/146): python3-asyncssh-2.7.0-2.el8.noarch.r 3.1 MB/s | 476 kB 00:00 2024-05-08T23:05:36.429 INFO:teuthology.orchestra.run.smithi179.stdout:(42/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 373 kB/s | 44 kB 00:00 2024-05-08T23:05:36.436 INFO:teuthology.orchestra.run.smithi195.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 642 kB/s | 59 kB 00:00 2024-05-08T23:05:36.496 INFO:teuthology.orchestra.run.smithi179.stdout:(43/146): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2024-05-08T23:05:36.522 INFO:teuthology.orchestra.run.smithi179.stdout:(44/146): python3-cachetools-3.1.1-4.el8.noarch 358 kB/s | 33 kB 00:00 2024-05-08T23:05:36.545 INFO:teuthology.orchestra.run.smithi195.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 692 kB/s | 75 kB 00:00 2024-05-08T23:05:36.572 INFO:teuthology.orchestra.run.smithi179.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2024-05-08T23:05:36.664 INFO:teuthology.orchestra.run.smithi179.stdout:(46/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2024-05-08T23:05:36.689 INFO:teuthology.orchestra.run.smithi179.stdout:(47/146): python3-cherrypy-18.4.0-1.el8.noarch. 3.2 MB/s | 384 kB 00:00 2024-05-08T23:05:36.737 INFO:teuthology.orchestra.run.smithi195.stdout:(40/146): python3-asyncssh-2.7.0-2.el8.noarch.r 2.4 MB/s | 476 kB 00:00 2024-05-08T23:05:36.790 INFO:teuthology.orchestra.run.smithi179.stdout:(48/146): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2024-05-08T23:05:36.807 INFO:teuthology.orchestra.run.smithi179.stdout:(49/146): python3-google-auth-1.1.1-10.el8.noar 571 kB/s | 81 kB 00:00 2024-05-08T23:05:36.890 INFO:teuthology.orchestra.run.smithi179.stdout:(50/146): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2024-05-08T23:05:36.966 INFO:teuthology.orchestra.run.smithi179.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 652 kB/s | 49 kB 00:00 2024-05-08T23:05:37.041 INFO:teuthology.orchestra.run.smithi179.stdout:(52/146): python3-kubernetes-11.0.0-6.el8.noarc 5.0 MB/s | 1.2 MB 00:00 2024-05-08T23:05:37.053 INFO:teuthology.orchestra.run.smithi195.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 138 kB/s | 44 kB 00:00 2024-05-08T23:05:37.066 INFO:teuthology.orchestra.run.smithi179.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 587 kB/s | 59 kB 00:00 2024-05-08T23:05:37.117 INFO:teuthology.orchestra.run.smithi179.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 803 kB/s | 60 kB 00:00 2024-05-08T23:05:37.159 INFO:teuthology.orchestra.run.smithi179.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2024-05-08T23:05:37.184 INFO:teuthology.orchestra.run.smithi179.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2024-05-08T23:05:37.216 INFO:teuthology.orchestra.run.smithi135.stdout:(17/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 6.2 MB/s | 6.5 MB 00:01 2024-05-08T23:05:37.234 INFO:teuthology.orchestra.run.smithi179.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 447 kB/s | 34 kB 00:00 2024-05-08T23:05:37.259 INFO:teuthology.orchestra.run.smithi179.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 2.6 MB/s | 196 kB 00:00 2024-05-08T23:05:37.263 INFO:teuthology.orchestra.run.smithi195.stdout:(42/146): python3-beautifulsoup4-4.6.3-2.el8.1. 926 kB/s | 185 kB 00:00 2024-05-08T23:05:37.281 INFO:teuthology.orchestra.run.smithi135.stdout:(18/146): python3-ceph-argparse-18.2.2-1322.gd2 672 kB/s | 45 kB 00:00 2024-05-08T23:05:37.342 INFO:teuthology.orchestra.run.smithi135.stdout:(19/146): python3-ceph-common-18.2.2-1322.gd21e 2.2 MB/s | 129 kB 00:00 2024-05-08T23:05:37.406 INFO:teuthology.orchestra.run.smithi135.stdout:(20/146): python3-cephfs-18.2.2-1322.gd21e4f96. 2.9 MB/s | 197 kB 00:00 2024-05-08T23:05:37.481 INFO:teuthology.orchestra.run.smithi135.stdout:(21/146): python3-rados-18.2.2-1322.gd21e4f96.e 4.8 MB/s | 370 kB 00:00 2024-05-08T23:05:37.557 INFO:teuthology.orchestra.run.smithi135.stdout:(22/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 4.8 MB/s | 365 kB 00:00 2024-05-08T23:05:37.587 INFO:teuthology.orchestra.run.smithi195.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 99 kB/s | 33 kB 00:00 2024-05-08T23:05:37.624 INFO:teuthology.orchestra.run.smithi135.stdout:(23/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 1.6 MB/s | 107 kB 00:00 2024-05-08T23:05:37.671 INFO:teuthology.orchestra.run.smithi195.stdout:(44/146): python3-certifi-2018.10.15-7.el8.noar 196 kB/s | 16 kB 00:00 2024-05-08T23:05:37.682 INFO:teuthology.orchestra.run.smithi135.stdout:(24/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.6 MB/s | 95 kB 00:00 2024-05-08T23:05:37.760 INFO:teuthology.orchestra.run.smithi179.stdout:(59/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 5.3 MB/s | 47 MB 00:08 2024-05-08T23:05:37.776 INFO:teuthology.orchestra.run.smithi179.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 36 kB/s | 19 kB 00:00 2024-05-08T23:05:37.783 INFO:teuthology.orchestra.run.smithi195.stdout:(45/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.5 MB/s | 173 kB 00:00 2024-05-08T23:05:37.802 INFO:teuthology.orchestra.run.smithi179.stdout:(61/146): python3-rsa-4.9-2.el8.noarch.rpm 113 kB/s | 64 kB 00:00 2024-05-08T23:05:37.860 INFO:teuthology.orchestra.run.smithi179.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 350 kB/s | 29 kB 00:00 2024-05-08T23:05:37.877 INFO:teuthology.orchestra.run.smithi179.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 366 kB/s | 27 kB 00:00 2024-05-08T23:05:37.969 INFO:teuthology.orchestra.run.smithi179.stdout:(64/146): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2024-05-08T23:05:37.994 INFO:teuthology.orchestra.run.smithi179.stdout:(65/146): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2024-05-08T23:05:38.011 INFO:teuthology.orchestra.run.smithi179.stdout:(66/146): python3-singledispatch-3.4.0.3-18.el8 95 kB/s | 24 kB 00:00 2024-05-08T23:05:38.029 INFO:teuthology.orchestra.run.smithi195.stdout:(46/146): python3-cherrypy-18.4.0-1.el8.noarch. 1.5 MB/s | 384 kB 00:00 2024-05-08T23:05:38.036 INFO:teuthology.orchestra.run.smithi179.stdout:(67/146): python3-websocket-client-0.56.0-5.el8 914 kB/s | 61 kB 00:00 2024-05-08T23:05:38.070 INFO:teuthology.orchestra.run.smithi179.stdout:(68/146): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2024-05-08T23:05:38.095 INFO:teuthology.orchestra.run.smithi179.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-05-08T23:05:38.121 INFO:teuthology.orchestra.run.smithi179.stdout:(70/146): python3-zc-lockfile-2.0-2.el8.noarch. 210 kB/s | 23 kB 00:00 2024-05-08T23:05:38.158 INFO:teuthology.orchestra.run.smithi135.stdout:(25/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 7.3 MB/s | 3.5 MB 00:00 2024-05-08T23:05:38.189 INFO:teuthology.orchestra.run.smithi195.stdout:(47/146): python3-google-auth-1.1.1-10.el8.noar 510 kB/s | 81 kB 00:00 2024-05-08T23:05:38.212 INFO:teuthology.orchestra.run.smithi179.stdout:(71/146): thrift-0.13.0-2.el8.x86_64.rpm 9.9 MB/s | 1.7 MB 00:00 2024-05-08T23:05:38.225 INFO:teuthology.orchestra.run.smithi135.stdout:(26/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 2.7 MB/s | 181 kB 00:00 2024-05-08T23:05:38.272 INFO:teuthology.orchestra.run.smithi179.stdout:(72/146): python3-packaging-16.8-9.el8.noarch.r 275 kB/s | 48 kB 00:00 2024-05-08T23:05:38.280 INFO:teuthology.orchestra.run.smithi195.stdout:(48/146): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2024-05-08T23:05:38.313 INFO:teuthology.orchestra.run.smithi179.stdout:(73/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 93 kB/s | 18 kB 00:00 2024-05-08T23:05:38.364 INFO:teuthology.orchestra.run.smithi179.stdout:(74/146): python3-jwt-1.6.1-2.el8.noarch.rpm 281 kB/s | 43 kB 00:00 2024-05-08T23:05:38.383 INFO:teuthology.orchestra.run.smithi135.stdout:(27/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el 2.2 MB/s | 13 MB 00:06 2024-05-08T23:05:38.397 INFO:teuthology.orchestra.run.smithi195.stdout:(49/146): python3-jaraco-functools-2.0-4.el8.no 151 kB/s | 18 kB 00:00 2024-05-08T23:05:38.400 INFO:teuthology.orchestra.run.smithi135.stdout:(28/146): ceph-grafana-dashboards-18.2.2-1322.g 138 kB/s | 24 kB 00:00 2024-05-08T23:05:38.405 INFO:teuthology.orchestra.run.smithi179.stdout:(75/146): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2024-05-08T23:05:38.450 INFO:teuthology.orchestra.run.smithi135.stdout:(29/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 2.0 MB/s | 138 kB 00:00 2024-05-08T23:05:38.498 INFO:teuthology.orchestra.run.smithi179.stdout:(76/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 204 kB/s | 19 kB 00:00 2024-05-08T23:05:38.526 INFO:teuthology.orchestra.run.smithi179.stdout:(77/146): python3-pycparser-2.14-14.el8.noarch. 521 kB/s | 109 kB 00:00 2024-05-08T23:05:38.548 INFO:teuthology.orchestra.run.smithi179.stdout:(78/146): python3-requests-oauthlib-1.0.0-1.el8 232 kB/s | 43 kB 00:00 2024-05-08T23:05:38.764 INFO:teuthology.orchestra.run.smithi195.stdout:(50/146): python3-kubernetes-11.0.0-6.el8.noarc 3.2 MB/s | 1.2 MB 00:00 2024-05-08T23:05:38.865 INFO:teuthology.orchestra.run.smithi179.stdout:(79/146): pcre2-devel-10.32-2.el8.x86_64.rpm 1.7 MB/s | 605 kB 00:00 2024-05-08T23:05:38.873 INFO:teuthology.orchestra.run.smithi195.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 451 kB/s | 49 kB 00:00 2024-05-08T23:05:38.899 INFO:teuthology.orchestra.run.smithi179.stdout:(80/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 109 kB/s | 44 kB 00:00 2024-05-08T23:05:38.924 INFO:teuthology.orchestra.run.smithi179.stdout:(81/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 609 kB/s | 229 kB 00:00 2024-05-08T23:05:38.925 INFO:teuthology.orchestra.run.smithi135.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 6.7 MB/s | 3.5 MB 00:00 2024-05-08T23:05:38.974 INFO:teuthology.orchestra.run.smithi195.stdout:(52/146): python3-more-itertools-7.2.0-3.el8.no 587 kB/s | 59 kB 00:00 2024-05-08T23:05:39.000 INFO:teuthology.orchestra.run.smithi179.stdout:(82/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.6 MB/s | 220 kB 00:00 2024-05-08T23:05:39.009 INFO:teuthology.orchestra.run.smithi135.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 2.9 MB/s | 245 kB 00:00 2024-05-08T23:05:39.041 INFO:teuthology.orchestra.run.smithi179.stdout:(83/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.4 MB/s | 200 kB 00:00 2024-05-08T23:05:39.057 INFO:teuthology.orchestra.run.smithi195.stdout:(53/146): python3-natsort-7.1.1-2.el8.noarch.rp 724 kB/s | 60 kB 00:00 2024-05-08T23:05:39.067 INFO:teuthology.orchestra.run.smithi179.stdout:(84/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 338 kB/s | 48 kB 00:00 2024-05-08T23:05:39.084 INFO:teuthology.orchestra.run.smithi135.stdout:(32/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 656 kB/s | 49 kB 00:00 2024-05-08T23:05:39.117 INFO:teuthology.orchestra.run.smithi179.stdout:(85/146): libsepol-devel-2.9-3.el8.x86_64.rpm 744 kB/s | 87 kB 00:00 2024-05-08T23:05:39.151 INFO:teuthology.orchestra.run.smithi135.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1322.gd 245 kB/s | 16 kB 00:00 2024-05-08T23:05:39.191 INFO:teuthology.orchestra.run.smithi195.stdout:(54/146): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2024-05-08T23:05:39.218 INFO:teuthology.orchestra.run.smithi135.stdout:(34/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 3.9 MB/s | 263 kB 00:00 2024-05-08T23:05:39.242 INFO:teuthology.orchestra.run.smithi179.stdout:(86/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 288 kB/s | 58 kB 00:00 2024-05-08T23:05:39.274 INFO:teuthology.orchestra.run.smithi195.stdout:(55/146): python3-portend-2.6-1.el8.noarch.rpm 188 kB/s | 16 kB 00:00 2024-05-08T23:05:39.277 INFO:teuthology.orchestra.run.smithi135.stdout:(35/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 2.9 MB/s | 170 kB 00:00 2024-05-08T23:05:39.292 INFO:teuthology.orchestra.run.smithi179.stdout:(87/146): fuse-2.9.7-17.el8.x86_64.rpm 473 kB/s | 83 kB 00:00 2024-05-08T23:05:39.318 INFO:teuthology.orchestra.run.smithi179.stdout:(88/146): libcom_err-devel-1.45.6-4.el8.x86_64. 154 kB/s | 39 kB 00:00 2024-05-08T23:05:39.341 INFO:teuthology.orchestra.run.smithi195.stdout:(56/146): python3-repoze-lru-0.7-6.el8.noarch.r 505 kB/s | 34 kB 00:00 2024-05-08T23:05:39.352 INFO:teuthology.orchestra.run.smithi135.stdout:(36/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 241 kB/s | 18 kB 00:00 2024-05-08T23:05:39.376 INFO:teuthology.orchestra.run.smithi179.stdout:(89/146): libquadmath-8.5.0-20.el8.x86_64.rpm 2.0 MB/s | 172 kB 00:00 2024-05-08T23:05:39.410 INFO:teuthology.orchestra.run.smithi179.stdout:(90/146): libgfortran-8.5.0-20.el8.x86_64.rpm 3.8 MB/s | 645 kB 00:00 2024-05-08T23:05:39.433 INFO:teuthology.orchestra.run.smithi195.stdout:(57/146): python3-routes-2.4.1-12.el8.noarch.rp 2.1 MB/s | 196 kB 00:00 2024-05-08T23:05:39.469 INFO:teuthology.orchestra.run.smithi179.stdout:(91/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2024-05-08T23:05:39.502 INFO:teuthology.orchestra.run.smithi179.stdout:(92/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 579 kB/s | 73 kB 00:00 2024-05-08T23:05:39.508 INFO:teuthology.orchestra.run.smithi195.stdout:(58/146): python3-rsa-4.9-2.el8.noarch.rpm 857 kB/s | 64 kB 00:00 2024-05-08T23:05:39.569 INFO:teuthology.orchestra.run.smithi179.stdout:(93/146): elfutils-libelf-devel-0.189-3.el8.x86 388 kB/s | 62 kB 00:00 2024-05-08T23:05:39.617 INFO:teuthology.orchestra.run.smithi195.stdout:(59/146): python3-simplegeneric-0.8.1-17.el8.no 173 kB/s | 19 kB 00:00 2024-05-08T23:05:39.636 INFO:teuthology.orchestra.run.smithi179.stdout:(94/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 3.3 MB/s | 562 kB 00:00 2024-05-08T23:05:39.661 INFO:teuthology.orchestra.run.smithi179.stdout:(95/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 514 kB/s | 47 kB 00:00 2024-05-08T23:05:39.709 INFO:teuthology.orchestra.run.smithi195.stdout:(60/146): python3-singledispatch-3.4.0.3-18.el8 261 kB/s | 24 kB 00:00 2024-05-08T23:05:39.745 INFO:teuthology.orchestra.run.smithi179.stdout:(96/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 9.6 MB/s | 2.3 MB 00:00 2024-05-08T23:05:39.770 INFO:teuthology.orchestra.run.smithi179.stdout:(97/146): NetworkManager-initscripts-updown-1.4 1.3 MB/s | 144 kB 00:00 2024-05-08T23:05:39.785 INFO:teuthology.orchestra.run.smithi195.stdout:(61/146): python3-tempora-1.14.1-5.el8.noarch.r 389 kB/s | 29 kB 00:00 2024-05-08T23:05:39.795 INFO:teuthology.orchestra.run.smithi179.stdout:(98/146): python3-cryptography-3.2.1-7.el8_9.x8 3.4 MB/s | 559 kB 00:00 2024-05-08T23:05:39.846 INFO:teuthology.orchestra.run.smithi179.stdout:(99/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 995 kB/s | 100 kB 00:00 2024-05-08T23:05:39.868 INFO:teuthology.orchestra.run.smithi195.stdout:(62/146): python3-trustme-0.6.0-4.el8.noarch.rp 331 kB/s | 27 kB 00:00 2024-05-08T23:05:39.952 INFO:teuthology.orchestra.run.smithi195.stdout:(63/146): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2024-05-08T23:05:39.963 INFO:teuthology.orchestra.run.smithi179.stdout:(100/146): python3-jsonpointer-1.10-11.el8.noar 104 kB/s | 20 kB 00:00 2024-05-08T23:05:39.980 INFO:teuthology.orchestra.run.smithi179.stdout:(101/146): python3-pyasn1-modules-0.3.7-6.el8.n 824 kB/s | 110 kB 00:00 2024-05-08T23:05:39.994 INFO:teuthology.orchestra.run.smithi135.stdout:(37/146): gperftools-libs-2.7-9.el8.x86_64.rpm 477 kB/s | 306 kB 00:00 2024-05-08T23:05:40.021 INFO:teuthology.orchestra.run.smithi179.stdout:(102/146): python3-prettytable-0.7.2-14.el8.noa 195 kB/s | 44 kB 00:00 2024-05-08T23:05:40.077 INFO:teuthology.orchestra.run.smithi195.stdout:(64/146): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2024-05-08T23:05:40.113 INFO:teuthology.orchestra.run.smithi179.stdout:(103/146): python3-jsonpatch-1.21-2.el8.noarch. 176 kB/s | 27 kB 00:00 2024-05-08T23:05:40.119 INFO:teuthology.orchestra.run.smithi135.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 471 kB/s | 59 kB 00:00 2024-05-08T23:05:40.139 INFO:teuthology.orchestra.run.smithi179.stdout:(104/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 795 kB/s | 126 kB 00:00 2024-05-08T23:05:40.152 INFO:teuthology.orchestra.run.smithi195.stdout:(65/146): python3-websocket-client-0.56.0-5.el8 816 kB/s | 61 kB 00:00 2024-05-08T23:05:40.172 INFO:teuthology.orchestra.run.smithi179.stdout:(105/146): python3-werkzeug-0.12.2-4.el8.noarch 3.0 MB/s | 457 kB 00:00 2024-05-08T23:05:40.214 INFO:teuthology.orchestra.run.smithi179.stdout:(106/146): bison-3.0.4-10.el8.x86_64.rpm 6.7 MB/s | 688 kB 00:00 2024-05-08T23:05:40.245 INFO:teuthology.orchestra.run.smithi135.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 602 kB/s | 75 kB 00:00 2024-05-08T23:05:40.248 INFO:teuthology.orchestra.run.smithi179.stdout:(107/146): flex-2.6.1-9.el8.x86_64.rpm 2.9 MB/s | 320 kB 00:00 2024-05-08T23:05:40.332 INFO:teuthology.orchestra.run.smithi179.stdout:(108/146): python3-markupsafe-0.23-19.el8.x86_6 332 kB/s | 39 kB 00:00 2024-05-08T23:05:40.353 INFO:teuthology.orchestra.run.smithi135.stdout:(40/146): ceph-mgr-diskprediction-local-18.2.2- 3.9 MB/s | 7.4 MB 00:01 2024-05-08T23:05:40.361 INFO:teuthology.orchestra.run.smithi195.stdout:(66/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x8 1.5 MB/s | 18 MB 00:12 2024-05-08T23:05:40.365 INFO:teuthology.orchestra.run.smithi179.stdout:(109/146): libtool-2.4.6-25.el8.x86_64.rpm 3.6 MB/s | 709 kB 00:00 2024-05-08T23:05:40.386 INFO:teuthology.orchestra.run.smithi195.stdout:(67/146): python3-webtest-2.0.33-1.el8.noarch.r 365 kB/s | 85 kB 00:00 2024-05-08T23:05:40.407 INFO:teuthology.orchestra.run.smithi179.stdout:(110/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.6 MB/s | 259 kB 00:00 2024-05-08T23:05:40.483 INFO:teuthology.orchestra.run.smithi179.stdout:(111/146): uuid-1.6.2-43.el8.x86_64.rpm 426 kB/s | 64 kB 00:00 2024-05-08T23:05:40.508 INFO:teuthology.orchestra.run.smithi179.stdout:(112/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 728 kB/s | 103 kB 00:00 2024-05-08T23:05:40.520 INFO:teuthology.orchestra.run.smithi195.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 145 kB/s | 23 kB 00:00 2024-05-08T23:05:40.578 INFO:teuthology.orchestra.run.smithi195.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 70 kB 00:00 2024-05-08T23:05:40.616 INFO:teuthology.orchestra.run.smithi179.stdout:(113/146): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2024-05-08T23:05:40.637 INFO:teuthology.orchestra.run.smithi195.stdout:(70/146): thrift-0.13.0-2.el8.x86_64.rpm 6.9 MB/s | 1.7 MB 00:00 2024-05-08T23:05:40.658 INFO:teuthology.orchestra.run.smithi179.stdout:(114/146): python3-jinja2-2.10.1-3.el8.noarch.r 3.0 MB/s | 538 kB 00:00 2024-05-08T23:05:40.759 INFO:teuthology.orchestra.run.smithi179.stdout:(115/146): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2024-05-08T23:05:40.771 INFO:teuthology.orchestra.run.smithi195.stdout:(71/146): python3-packaging-16.8-9.el8.noarch.r 251 kB/s | 48 kB 00:00 2024-05-08T23:05:40.784 INFO:teuthology.orchestra.run.smithi179.stdout:(116/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.8 MB/s | 225 kB 00:00 2024-05-08T23:05:40.792 INFO:teuthology.orchestra.run.smithi135.stdout:(41/146): python3-asyncssh-2.7.0-2.el8.noarch.r 869 kB/s | 476 kB 00:00 2024-05-08T23:05:40.809 INFO:teuthology.orchestra.run.smithi179.stdout:(117/146): socat-1.7.4.1-1.el8.x86_64.rpm 1.6 MB/s | 323 kB 00:00 2024-05-08T23:05:40.829 INFO:teuthology.orchestra.run.smithi195.stdout:(72/146): python3-jsonpointer-1.10-11.el8.noarc 104 kB/s | 20 kB 00:00 2024-05-08T23:05:40.846 INFO:teuthology.orchestra.run.smithi195.stdout:(73/146): python3-prettytable-0.7.2-14.el8.noar 585 kB/s | 44 kB 00:00 2024-05-08T23:05:40.912 INFO:teuthology.orchestra.run.smithi135.stdout:(42/146): python3-beautifulsoup4-4.6.3-2.el8.1. 1.6 MB/s | 185 kB 00:00 2024-05-08T23:05:40.917 INFO:teuthology.orchestra.run.smithi179.stdout:(118/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.2 MB/s | 354 kB 00:00 2024-05-08T23:05:40.968 INFO:teuthology.orchestra.run.smithi179.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 989 kB/s | 157 kB 00:00 2024-05-08T23:05:40.997 INFO:teuthology.orchestra.run.smithi195.stdout:(74/146): python3-pyasn1-modules-0.3.7-6.el8.no 660 kB/s | 110 kB 00:00 2024-05-08T23:05:41.037 INFO:teuthology.orchestra.run.smithi135.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 264 kB/s | 33 kB 00:00 2024-05-08T23:05:41.047 INFO:teuthology.orchestra.run.smithi195.stdout:(75/146): python3-jsonpatch-1.21-2.el8.noarch.r 132 kB/s | 27 kB 00:00 2024-05-08T23:05:41.102 INFO:teuthology.orchestra.run.smithi179.stdout:(120/146): openblas-threads-0.3.15-6.el8.x86_64 16 MB/s | 5.2 MB 00:00 2024-05-08T23:05:41.122 INFO:teuthology.orchestra.run.smithi195.stdout:(76/146): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2024-05-08T23:05:41.144 INFO:teuthology.orchestra.run.smithi179.stdout:(121/146): automake-1.16.1-8.el8.noarch.rpm 4.0 MB/s | 714 kB 00:00 2024-05-08T23:05:41.154 INFO:teuthology.orchestra.run.smithi135.stdout:(44/146): python3-certifi-2018.10.15-7.el8.noar 140 kB/s | 16 kB 00:00 2024-05-08T23:05:41.180 INFO:teuthology.orchestra.run.smithi135.stdout:(45/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 53 kB/s | 44 kB 00:00 2024-05-08T23:05:41.189 INFO:teuthology.orchestra.run.smithi195.stdout:(77/146): python3-werkzeug-0.12.2-4.el8.noarch. 3.1 MB/s | 457 kB 00:00 2024-05-08T23:05:41.202 INFO:teuthology.orchestra.run.smithi179.stdout:(122/146): libpq-13.11-1.el8.x86_64.rpm 1.9 MB/s | 198 kB 00:00 2024-05-08T23:05:41.263 INFO:teuthology.orchestra.run.smithi135.stdout:(46/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2024-05-08T23:05:41.269 INFO:teuthology.orchestra.run.smithi179.stdout:(123/146): openblas-0.3.15-6.el8.x86_64.rpm 14 MB/s | 5.0 MB 00:00 2024-05-08T23:05:41.298 INFO:teuthology.orchestra.run.smithi195.stdout:(78/146): bison-3.0.4-10.el8.x86_64.rpm 3.8 MB/s | 688 kB 00:00 2024-05-08T23:05:41.319 INFO:teuthology.orchestra.run.smithi179.stdout:(124/146): jq-1.6-7.el8.x86_64.rpm 1.1 MB/s | 202 kB 00:00 2024-05-08T23:05:41.353 INFO:teuthology.orchestra.run.smithi179.stdout:(125/146): python3-pytz-2017.2-11.el8.noarch.rp 361 kB/s | 54 kB 00:00 2024-05-08T23:05:41.380 INFO:teuthology.orchestra.run.smithi135.stdout:(47/146): python3-google-auth-1.1.1-10.el8.noar 697 kB/s | 81 kB 00:00 2024-05-08T23:05:41.381 INFO:teuthology.orchestra.run.smithi195.stdout:(79/146): flex-2.6.1-9.el8.x86_64.rpm 1.6 MB/s | 320 kB 00:00 2024-05-08T23:05:41.436 INFO:teuthology.orchestra.run.smithi179.stdout:(126/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-05-08T23:05:41.440 INFO:teuthology.orchestra.run.smithi195.stdout:(80/146): libtool-2.4.6-25.el8.x86_64.rpm 4.9 MB/s | 709 kB 00:00 2024-05-08T23:05:41.470 INFO:teuthology.orchestra.run.smithi179.stdout:(127/146): postgresql-10.23-4.module+el8.9.0+21 13 MB/s | 1.5 MB 00:00 2024-05-08T23:05:41.507 INFO:teuthology.orchestra.run.smithi195.stdout:(81/146): python3-markupsafe-0.23-19.el8.x86_64 310 kB/s | 39 kB 00:00 2024-05-08T23:05:41.591 INFO:teuthology.orchestra.run.smithi195.stdout:(82/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.7 MB/s | 259 kB 00:00 2024-05-08T23:05:41.687 INFO:teuthology.orchestra.run.smithi179.stdout:(128/146): python3-scipy-1.0.0-21.module+el8.9. 33 MB/s | 14 MB 00:00 2024-05-08T23:05:41.711 INFO:teuthology.orchestra.run.smithi195.stdout:(83/146): uuid-1.6.2-43.el8.x86_64.rpm 314 kB/s | 64 kB 00:00 2024-05-08T23:05:41.720 INFO:teuthology.orchestra.run.smithi179.stdout:(129/146): postgresql-contrib-10.23-4.module+el 2.8 MB/s | 812 kB 00:00 2024-05-08T23:05:41.741 INFO:teuthology.orchestra.run.smithi195.stdout:(84/146): python3-pyOpenSSL-19.0.0-1.el8.noarch 689 kB/s | 103 kB 00:00 2024-05-08T23:05:41.821 INFO:teuthology.orchestra.run.smithi179.stdout:(130/146): postgresql-server-10.23-4.module+el8 14 MB/s | 5.1 MB 00:00 2024-05-08T23:05:41.858 INFO:teuthology.orchestra.run.smithi195.stdout:(85/146): python3-jinja2-2.10.1-3.el8.noarch.rp 4.5 MB/s | 538 kB 00:00 2024-05-08T23:05:41.872 INFO:teuthology.orchestra.run.smithi135.stdout:(48/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 7.2 MB/s | 47 MB 00:06 2024-05-08T23:05:41.897 INFO:teuthology.orchestra.run.smithi135.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 21 kB/s | 11 kB 00:00 2024-05-08T23:05:41.922 INFO:teuthology.orchestra.run.smithi135.stdout:(50/146): python3-cherrypy-18.4.0-1.el8.noarch. 518 kB/s | 384 kB 00:00 2024-05-08T23:05:41.946 INFO:teuthology.orchestra.run.smithi179.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.8 MB/s | 232 kB 00:00 2024-05-08T23:05:41.981 INFO:teuthology.orchestra.run.smithi135.stdout:(51/146): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2024-05-08T23:05:42.032 INFO:teuthology.orchestra.run.smithi135.stdout:(52/146): python3-logutils-0.3.5-11.el8.noarch. 447 kB/s | 49 kB 00:00 2024-05-08T23:05:42.071 INFO:teuthology.orchestra.run.smithi179.stdout:(132/146): elfutils-libs-0.189-3.el8.x86_64.rpm 2.4 MB/s | 303 kB 00:00 2024-05-08T23:05:42.084 INFO:teuthology.orchestra.run.smithi195.stdout:(86/146): python3-numpy-1.14.3-10.el8.x86_64.rp 17 MB/s | 3.7 MB 00:00 2024-05-08T23:05:42.090 INFO:teuthology.orchestra.run.smithi135.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 562 kB/s | 59 kB 00:00 2024-05-08T23:05:42.141 INFO:teuthology.orchestra.run.smithi135.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 555 kB/s | 60 kB 00:00 2024-05-08T23:05:42.211 INFO:teuthology.orchestra.run.smithi195.stdout:(87/146): python3-babel-2.5.1-7.el8.noarch.rpm 9.6 MB/s | 4.8 MB 00:00 2024-05-08T23:05:42.216 INFO:teuthology.orchestra.run.smithi135.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2024-05-08T23:05:42.222 INFO:teuthology.orchestra.run.smithi179.stdout:(133/146): iproute-6.2.0-5.el8_9.x86_64.rpm 5.6 MB/s | 854 kB 00:00 2024-05-08T23:05:42.241 INFO:teuthology.orchestra.run.smithi135.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2024-05-08T23:05:42.242 INFO:teuthology.orchestra.run.smithi195.stdout:(88/146): socat-1.7.4.1-1.el8.x86_64.rpm 2.0 MB/s | 323 kB 00:00 2024-05-08T23:05:42.301 INFO:teuthology.orchestra.run.smithi195.stdout:(89/146): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.4 MB/s | 225 kB 00:00 2024-05-08T23:05:42.342 INFO:teuthology.orchestra.run.smithi135.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 267 kB/s | 34 kB 00:00 2024-05-08T23:05:42.375 INFO:teuthology.orchestra.run.smithi135.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2024-05-08T23:05:42.389 INFO:teuthology.orchestra.run.smithi179.stdout:(134/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 4.2 MB/s | 711 kB 00:00 2024-05-08T23:05:42.435 INFO:teuthology.orchestra.run.smithi195.stdout:(90/146): librdkafka-0.11.4-3.el8.x86_64.rpm 1.8 MB/s | 354 kB 00:00 2024-05-08T23:05:42.442 INFO:teuthology.orchestra.run.smithi135.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 645 kB/s | 64 kB 00:00 2024-05-08T23:05:42.476 INFO:teuthology.orchestra.run.smithi135.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 187 kB/s | 19 kB 00:00 2024-05-08T23:05:42.531 INFO:teuthology.orchestra.run.smithi179.stdout:(135/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 10 MB/s | 1.5 MB 00:00 2024-05-08T23:05:42.545 INFO:teuthology.orchestra.run.smithi135.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 239 kB/s | 24 kB 00:00 2024-05-08T23:05:42.576 INFO:teuthology.orchestra.run.smithi135.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 291 kB/s | 29 kB 00:00 2024-05-08T23:05:42.577 INFO:teuthology.orchestra.run.smithi195.stdout:(91/146): openblas-threads-0.3.15-6.el8.x86_64. 19 MB/s | 5.2 MB 00:00 2024-05-08T23:05:42.636 INFO:teuthology.orchestra.run.smithi195.stdout:(92/146): python3-mako-1.0.6-14.el8.noarch.rpm 783 kB/s | 157 kB 00:00 2024-05-08T23:05:42.651 INFO:teuthology.orchestra.run.smithi135.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 254 kB/s | 27 kB 00:00 2024-05-08T23:05:42.698 INFO:teuthology.orchestra.run.smithi179.stdout:(136/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.0 MB/s | 333 kB 00:00 2024-05-08T23:05:42.701 INFO:teuthology.orchestra.run.smithi135.stdout:(64/146): python3-kubernetes-11.0.0-6.el8.noarc 1.4 MB/s | 1.2 MB 00:00 2024-05-08T23:05:42.727 INFO:teuthology.orchestra.run.smithi135.stdout:(65/146): python3-waitress-1.4.3-1.el8.noarch.r 1.7 MB/s | 255 kB 00:00 2024-05-08T23:05:42.769 INFO:teuthology.orchestra.run.smithi135.stdout:(66/146): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2024-05-08T23:05:42.811 INFO:teuthology.orchestra.run.smithi135.stdout:(67/146): python3-websocket-client-0.56.0-5.el8 563 kB/s | 61 kB 00:00 2024-05-08T23:05:42.815 INFO:teuthology.orchestra.run.smithi179.stdout:(137/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 9.2 MB/s | 1.1 MB 00:00 2024-05-08T23:05:42.836 INFO:teuthology.orchestra.run.smithi135.stdout:(68/146): python3-webtest-2.0.33-1.el8.noarch.r 785 kB/s | 85 kB 00:00 2024-05-08T23:05:42.853 INFO:teuthology.orchestra.run.smithi135.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2024-05-08T23:05:42.873 INFO:teuthology.orchestra.run.smithi179.stdout:(138/146): librados2-18.2.2-1322.gd21e4f96.el8. 3.1 MB/s | 3.7 MB 00:01 2024-05-08T23:05:42.878 INFO:teuthology.orchestra.run.smithi135.stdout:(70/146): python3-zc-lockfile-2.0-2.el8.noarch. 210 kB/s | 23 kB 00:00 2024-05-08T23:05:42.957 INFO:teuthology.orchestra.run.smithi179.stdout:(139/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.5 MB/s | 221 kB 00:00 2024-05-08T23:05:43.007 INFO:teuthology.orchestra.run.smithi179.stdout:(140/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.9 MB/s | 254 kB 00:00 2024-05-08T23:05:43.012 INFO:teuthology.orchestra.run.smithi135.stdout:(71/146): python3-packaging-16.8-9.el8.noarch.r 304 kB/s | 48 kB 00:00 2024-05-08T23:05:43.037 INFO:teuthology.orchestra.run.smithi135.stdout:(72/146): python3-jsonpointer-1.10-11.el8.noarc 126 kB/s | 20 kB 00:00 2024-05-08T23:05:43.071 INFO:teuthology.orchestra.run.smithi135.stdout:(73/146): thrift-0.13.0-2.el8.x86_64.rpm 6.7 MB/s | 1.7 MB 00:00 2024-05-08T23:05:43.099 INFO:teuthology.orchestra.run.smithi179.stdout:(141/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 2.6 MB/s | 3.6 MB 00:01 2024-05-08T23:05:43.124 INFO:teuthology.orchestra.run.smithi179.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.4 MB/s | 237 kB 00:00 2024-05-08T23:05:43.138 INFO:teuthology.orchestra.run.smithi135.stdout:(74/146): python3-prettytable-0.7.2-14.el8.noar 350 kB/s | 44 kB 00:00 2024-05-08T23:05:43.153 INFO:teuthology.orchestra.run.smithi195.stdout:(93/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 3.3 MB/s | 47 MB 00:14 2024-05-08T23:05:43.175 INFO:teuthology.orchestra.run.smithi179.stdout:(143/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.0 MB/s | 180 kB 00:00 2024-05-08T23:05:43.179 INFO:teuthology.orchestra.run.smithi135.stdout:(75/146): python3-pyasn1-modules-0.3.7-6.el8.no 774 kB/s | 110 kB 00:00 2024-05-08T23:05:43.194 INFO:teuthology.orchestra.run.smithi195.stdout:(94/146): automake-1.16.1-8.el8.noarch.rpm 1.2 MB/s | 714 kB 00:00 2024-05-08T23:05:43.200 INFO:teuthology.orchestra.run.smithi179.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 988 kB/s | 99 kB 00:00 2024-05-08T23:05:43.263 INFO:teuthology.orchestra.run.smithi135.stdout:(76/146): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2024-05-08T23:05:43.270 INFO:teuthology.orchestra.run.smithi195.stdout:(95/146): openblas-0.3.15-6.el8.x86_64.rpm 7.3 MB/s | 5.0 MB 00:00 2024-05-08T23:05:43.288 INFO:teuthology.orchestra.run.smithi135.stdout:(77/146): python3-jsonpatch-1.21-2.el8.noarch.r 122 kB/s | 27 kB 00:00 2024-05-08T23:05:43.300 INFO:teuthology.orchestra.run.smithi179.stdout:(145/146): util-linux-user-2.32.1-44.el8_9.1.x8 822 kB/s | 103 kB 00:00 2024-05-08T23:05:43.320 INFO:teuthology.orchestra.run.smithi195.stdout:(96/146): jq-1.6-7.el8.x86_64.rpm 1.7 MB/s | 202 kB 00:00 2024-05-08T23:05:43.364 INFO:teuthology.orchestra.run.smithi135.stdout:(78/146): python3-werkzeug-0.12.2-4.el8.noarch. 2.4 MB/s | 457 kB 00:00 2024-05-08T23:05:43.367 INFO:teuthology.orchestra.run.smithi179.stdout:(146/146): util-linux-2.32.1-44.el8_9.1.x86_64. 10 MB/s | 2.5 MB 00:00 2024-05-08T23:05:43.370 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:05:43.370 INFO:teuthology.orchestra.run.smithi179.stdout:Total 12 MB/s | 215 MB 00:18 2024-05-08T23:05:43.378 INFO:teuthology.orchestra.run.smithi195.stdout:(97/146): libpq-13.11-1.el8.x86_64.rpm 878 kB/s | 198 kB 00:00 2024-05-08T23:05:43.412 INFO:teuthology.orchestra.run.smithi195.stdout:(98/146): python3-pytz-2017.2-11.el8.noarch.rpm 382 kB/s | 54 kB 00:00 2024-05-08T23:05:43.430 INFO:teuthology.orchestra.run.smithi135.stdout:(79/146): bison-3.0.4-10.el8.x86_64.rpm 4.0 MB/s | 688 kB 00:00 2024-05-08T23:05:43.481 INFO:teuthology.orchestra.run.smithi135.stdout:(80/146): flex-2.6.1-9.el8.x86_64.rpm 1.6 MB/s | 320 kB 00:00 2024-05-08T23:05:43.514 INFO:teuthology.orchestra.run.smithi135.stdout:(81/146): libtool-2.4.6-25.el8.x86_64.rpm 4.6 MB/s | 709 kB 00:00 2024-05-08T23:05:43.546 INFO:teuthology.orchestra.run.smithi195.stdout:(99/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-05-08T23:05:43.556 INFO:teuthology.orchestra.run.smithi135.stdout:(82/146): python3-markupsafe-0.23-19.el8.x86_64 309 kB/s | 39 kB 00:00 2024-05-08T23:05:43.582 INFO:teuthology.orchestra.run.smithi135.stdout:(83/146): uuid-1.6.2-43.el8.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-05-08T23:05:43.607 INFO:teuthology.orchestra.run.smithi135.stdout:(84/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 MB/s | 259 kB 00:00 2024-05-08T23:05:43.638 INFO:teuthology.orchestra.run.smithi195.stdout:(100/146): postgresql-10.23-4.module+el8.9.0+21 6.7 MB/s | 1.5 MB 00:00 2024-05-08T23:05:43.700 INFO:teuthology.orchestra.run.smithi135.stdout:(85/146): python3-jinja2-2.10.1-3.el8.noarch.rp 5.7 MB/s | 538 kB 00:00 2024-05-08T23:05:43.705 INFO:teuthology.orchestra.run.smithi195.stdout:(101/146): postgresql-contrib-10.23-4.module+el 5.0 MB/s | 812 kB 00:00 2024-05-08T23:05:43.724 INFO:teuthology.orchestra.run.smithi135.stdout:(86/146): python3-pyOpenSSL-19.0.0-1.el8.noarch 618 kB/s | 103 kB 00:00 2024-05-08T23:05:43.850 INFO:teuthology.orchestra.run.smithi135.stdout:(87/146): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2024-05-08T23:05:43.875 INFO:teuthology.orchestra.run.smithi135.stdout:(88/146): socat-1.7.4.1-1.el8.x86_64.rpm 2.1 MB/s | 323 kB 00:00 2024-05-08T23:05:43.888 INFO:teuthology.orchestra.run.smithi195.stdout:(102/146): python3-scipy-1.0.0-21.module+el8.9. 24 MB/s | 14 MB 00:00 2024-05-08T23:05:43.906 INFO:teuthology.orchestra.run.smithi195.stdout:(103/146): libverto-devel-0.3.0-5.el8.x86_64.rp 89 kB/s | 18 kB 00:00 2024-05-08T23:05:43.958 INFO:teuthology.orchestra.run.smithi135.stdout:(89/146): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2024-05-08T23:05:44.001 INFO:teuthology.orchestra.run.smithi135.stdout:(90/146): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.5 MB/s | 225 kB 00:00 2024-05-08T23:05:44.014 INFO:teuthology.orchestra.run.smithi195.stdout:(104/146): postgresql-server-10.23-4.module+el8 13 MB/s | 5.1 MB 00:00 2024-05-08T23:05:44.034 INFO:teuthology.orchestra.run.smithi135.stdout:(91/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.2 MB/s | 354 kB 00:00 2024-05-08T23:05:44.083 INFO:teuthology.orchestra.run.smithi195.stdout:(105/146): python3-jwt-1.6.1-2.el8.noarch.rpm 219 kB/s | 43 kB 00:00 2024-05-08T23:05:44.114 INFO:teuthology.orchestra.run.smithi195.stdout:(106/146): python3-oauthlib-2.1.0-1.el8.noarch. 741 kB/s | 155 kB 00:00 2024-05-08T23:05:44.134 INFO:teuthology.orchestra.run.smithi135.stdout:(92/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2024-05-08T23:05:44.148 INFO:teuthology.orchestra.run.smithi195.stdout:(107/146): python3-pycparser-2.14-14.el8.noarch 815 kB/s | 109 kB 00:00 2024-05-08T23:05:44.174 INFO:teuthology.orchestra.run.smithi195.stdout:(108/146): libaio-devel-0.3.112-1.el8.x86_64.rp 320 kB/s | 19 kB 00:00 2024-05-08T23:05:44.215 INFO:teuthology.orchestra.run.smithi195.stdout:(109/146): python3-requests-oauthlib-1.0.0-1.el 324 kB/s | 43 kB 00:00 2024-05-08T23:05:44.260 INFO:teuthology.orchestra.run.smithi135.stdout:(93/146): openblas-threads-0.3.15-6.el8.x86_64. 17 MB/s | 5.2 MB 00:00 2024-05-08T23:05:44.301 INFO:teuthology.orchestra.run.smithi135.stdout:(94/146): automake-1.16.1-8.el8.noarch.rpm 4.2 MB/s | 714 kB 00:00 2024-05-08T23:05:44.332 INFO:teuthology.orchestra.run.smithi195.stdout:(110/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 238 kB/s | 44 kB 00:00 2024-05-08T23:05:44.366 INFO:teuthology.orchestra.run.smithi195.stdout:(111/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.5 MB/s | 229 kB 00:00 2024-05-08T23:05:44.384 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-05-08T23:05:44.385 INFO:teuthology.orchestra.run.smithi135.stdout:(95/146): openblas-0.3.15-6.el8.x86_64.rpm 14 MB/s | 5.0 MB 00:00 2024-05-08T23:05:44.399 INFO:teuthology.orchestra.run.smithi195.stdout:(112/146): pcre2-devel-10.32-2.el8.x86_64.rpm 2.6 MB/s | 605 kB 00:00 2024-05-08T23:05:44.435 INFO:teuthology.orchestra.run.smithi135.stdout:(96/146): libpq-13.11-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2024-05-08T23:05:44.461 INFO:teuthology.orchestra.run.smithi135.stdout:(97/146): jq-1.6-7.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2024-05-08T23:05:44.491 INFO:teuthology.orchestra.run.smithi195.stdout:(113/146): libselinux-devel-2.9-5.el8.x86_64.rp 1.6 MB/s | 200 kB 00:00 2024-05-08T23:05:44.550 INFO:teuthology.orchestra.run.smithi195.stdout:(114/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2024-05-08T23:05:44.569 INFO:teuthology.orchestra.run.smithi135.stdout:(98/146): python3-pytz-2017.2-11.el8.noarch.rpm 295 kB/s | 54 kB 00:00 2024-05-08T23:05:44.575 INFO:teuthology.orchestra.run.smithi195.stdout:(115/146): keyutils-libs-devel-1.5.10-9.el8.x86 274 kB/s | 48 kB 00:00 2024-05-08T23:05:44.667 INFO:teuthology.orchestra.run.smithi195.stdout:(116/146): libsepol-devel-2.9-3.el8.x86_64.rpm 496 kB/s | 87 kB 00:00 2024-05-08T23:05:44.701 INFO:teuthology.orchestra.run.smithi195.stdout:(117/146): zlib-devel-1.2.11-18.el8_5.x86_64.rp 382 kB/s | 58 kB 00:00 2024-05-08T23:05:44.776 INFO:teuthology.orchestra.run.smithi195.stdout:(118/146): libcom_err-devel-1.45.6-4.el8.x86_64 192 kB/s | 39 kB 00:00 2024-05-08T23:05:44.780 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-05-08T23:05:44.780 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-05-08T23:05:44.786 INFO:teuthology.orchestra.run.smithi135.stdout:(99/146): python3-scipy-1.0.0-21.module+el8.9.0 39 MB/s | 14 MB 00:00 2024-05-08T23:05:44.812 INFO:teuthology.orchestra.run.smithi135.stdout:(100/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 537 kB/s | 188 kB 00:00 2024-05-08T23:05:44.860 INFO:teuthology.orchestra.run.smithi195.stdout:(119/146): fuse-2.9.7-17.el8.x86_64.rpm 432 kB/s | 83 kB 00:00 2024-05-08T23:05:44.861 INFO:teuthology.orchestra.run.smithi135.stdout:(101/146): postgresql-10.23-4.module+el8.9.0+21 5.2 MB/s | 1.5 MB 00:00 2024-05-08T23:05:44.885 INFO:teuthology.orchestra.run.smithi195.stdout:(120/146): libgfortran-8.5.0-20.el8.x86_64.rpm 3.4 MB/s | 645 kB 00:00 2024-05-08T23:05:44.935 INFO:teuthology.orchestra.run.smithi195.stdout:(121/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.1 MB/s | 172 kB 00:00 2024-05-08T23:05:44.962 INFO:teuthology.orchestra.run.smithi135.stdout:(102/146): postgresql-contrib-10.23-4.module+el 4.5 MB/s | 812 kB 00:00 2024-05-08T23:05:44.987 INFO:teuthology.orchestra.run.smithi135.stdout:(103/146): libverto-devel-0.3.0-5.el8.x86_64.rp 143 kB/s | 18 kB 00:00 2024-05-08T23:05:45.002 INFO:teuthology.orchestra.run.smithi195.stdout:(122/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.6 MB/s | 238 kB 00:00 2024-05-08T23:05:45.036 INFO:teuthology.orchestra.run.smithi195.stdout:(123/146): xfsprogs-devel-5.0.0-12.el8.x86_64.r 483 kB/s | 73 kB 00:00 2024-05-08T23:05:45.079 INFO:teuthology.orchestra.run.smithi135.stdout:(104/146): postgresql-server-10.23-4.module+el8 19 MB/s | 5.1 MB 00:00 2024-05-08T23:05:45.103 INFO:teuthology.orchestra.run.smithi195.stdout:(124/146): elfutils-libelf-devel-0.189-3.el8.x8 369 kB/s | 62 kB 00:00 2024-05-08T23:05:45.104 INFO:teuthology.orchestra.run.smithi135.stdout:(105/146): python3-jwt-1.6.1-2.el8.noarch.rpm 300 kB/s | 43 kB 00:00 2024-05-08T23:05:45.154 INFO:teuthology.orchestra.run.smithi135.stdout:(106/146): python3-oauthlib-2.1.0-1.el8.noarch. 926 kB/s | 155 kB 00:00 2024-05-08T23:05:45.180 INFO:teuthology.orchestra.run.smithi135.stdout:(107/146): python3-pycparser-2.14-14.el8.noarch 1.1 MB/s | 109 kB 00:00 2024-05-08T23:05:45.228 INFO:teuthology.orchestra.run.smithi195.stdout:(125/146): krb5-devel-1.18.2-26.el8_9.x86_64.rp 2.4 MB/s | 562 kB 00:00 2024-05-08T23:05:45.263 INFO:teuthology.orchestra.run.smithi135.stdout:(108/146): python3-requests-oauthlib-1.0.0-1.el 269 kB/s | 43 kB 00:00 2024-05-08T23:05:45.278 INFO:teuthology.orchestra.run.smithi195.stdout:(126/146): openssl-devel-1.1.1k-12.el8_9.x86_64 9.6 MB/s | 2.3 MB 00:00 2024-05-08T23:05:45.288 INFO:teuthology.orchestra.run.smithi135.stdout:(109/146): libaio-devel-0.3.112-1.el8.x86_64.rp 140 kB/s | 19 kB 00:00 2024-05-08T23:05:45.304 INFO:teuthology.orchestra.run.smithi195.stdout:(127/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 235 kB/s | 47 kB 00:00 2024-05-08T23:05:45.313 INFO:teuthology.orchestra.run.smithi135.stdout:(110/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 328 kB/s | 44 kB 00:00 2024-05-08T23:05:45.346 INFO:teuthology.orchestra.run.smithi195.stdout:(128/146): python3-cryptography-3.2.1-7.el8_9.x 4.7 MB/s | 559 kB 00:00 2024-05-08T23:05:45.372 INFO:teuthology.orchestra.run.smithi135.stdout:(111/146): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2024-05-08T23:05:45.428 INFO:teuthology.orchestra.run.smithi195.stdout:(129/146): NetworkManager-initscripts-updown-1. 968 kB/s | 144 kB 00:00 2024-05-08T23:05:45.456 INFO:teuthology.orchestra.run.smithi135.stdout:(112/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.3 MB/s | 229 kB 00:00 2024-05-08T23:05:45.481 INFO:teuthology.orchestra.run.smithi135.stdout:(113/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.3 MB/s | 220 kB 00:00 2024-05-08T23:05:45.513 INFO:teuthology.orchestra.run.smithi195.stdout:(130/146): libuuid-devel-2.32.1-44.el8_9.1.x86_ 478 kB/s | 100 kB 00:00 2024-05-08T23:05:45.532 INFO:teuthology.orchestra.run.smithi135.stdout:(114/146): libselinux-devel-2.9-5.el8.x86_64.rp 1.2 MB/s | 200 kB 00:00 2024-05-08T23:05:45.640 INFO:teuthology.orchestra.run.smithi135.stdout:(115/146): zlib-devel-1.2.11-18.el8_5.x86_64.rp 532 kB/s | 58 kB 00:00 2024-05-08T23:05:45.658 INFO:teuthology.orchestra.run.smithi195.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.6 MB/s | 232 kB 00:00 2024-05-08T23:05:45.665 INFO:teuthology.orchestra.run.smithi135.stdout:(116/146): keyutils-libs-devel-1.5.10-9.el8.x86 230 kB/s | 48 kB 00:00 2024-05-08T23:05:45.691 INFO:teuthology.orchestra.run.smithi135.stdout:(117/146): libsepol-devel-2.9-3.el8.x86_64.rpm 415 kB/s | 87 kB 00:00 2024-05-08T23:05:45.716 INFO:teuthology.orchestra.run.smithi135.stdout:(118/146): libcom_err-devel-1.45.6-4.el8.x86_64 524 kB/s | 39 kB 00:00 2024-05-08T23:05:45.730 INFO:teuthology.orchestra.run.smithi195.stdout:(132/146): elfutils-libs-0.189-3.el8.x86_64.rpm 4.1 MB/s | 303 kB 00:00 2024-05-08T23:05:45.799 INFO:teuthology.orchestra.run.smithi135.stdout:(119/146): fuse-2.9.7-17.el8.x86_64.rpm 620 kB/s | 83 kB 00:00 2024-05-08T23:05:45.833 INFO:teuthology.orchestra.run.smithi135.stdout:(120/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.4 MB/s | 172 kB 00:00 2024-05-08T23:05:45.867 INFO:teuthology.orchestra.run.smithi135.stdout:(121/146): libgfortran-8.5.0-20.el8.x86_64.rpm 3.6 MB/s | 645 kB 00:00 2024-05-08T23:05:45.913 INFO:teuthology.orchestra.run.smithi195.stdout:(133/146): iproute-6.2.0-5.el8_9.x86_64.rpm 4.6 MB/s | 854 kB 00:00 2024-05-08T23:05:45.950 INFO:teuthology.orchestra.run.smithi135.stdout:(122/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2024-05-08T23:05:45.975 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-05-08T23:05:45.984 INFO:teuthology.orchestra.run.smithi135.stdout:(123/146): elfutils-libelf-devel-0.189-3.el8.x8 528 kB/s | 62 kB 00:00 2024-05-08T23:05:45.985 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-05-08T23:05:46.009 INFO:teuthology.orchestra.run.smithi135.stdout:(124/146): xfsprogs-devel-5.0.0-12.el8.x86_64.r 413 kB/s | 73 kB 00:00 2024-05-08T23:05:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:(134/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.3 MB/s | 711 kB 00:00 2024-05-08T23:05:46.126 INFO:teuthology.orchestra.run.smithi135.stdout:(125/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 404 kB/s | 47 kB 00:00 2024-05-08T23:05:46.160 INFO:teuthology.orchestra.run.smithi135.stdout:(126/146): krb5-devel-1.18.2-26.el8_9.x86_64.rp 2.6 MB/s | 562 kB 00:00 2024-05-08T23:05:46.218 INFO:teuthology.orchestra.run.smithi135.stdout:(127/146): openssl-devel-1.1.1k-12.el8_9.x86_64 9.9 MB/s | 2.3 MB 00:00 2024-05-08T23:05:46.269 INFO:teuthology.orchestra.run.smithi135.stdout:(128/146): python3-cryptography-3.2.1-7.el8_9.x 3.8 MB/s | 559 kB 00:00 2024-05-08T23:05:46.364 INFO:teuthology.orchestra.run.smithi195.stdout:(135/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 6.1 MB/s | 1.5 MB 00:00 2024-05-08T23:05:46.385 INFO:teuthology.orchestra.run.smithi135.stdout:(129/146): libuuid-devel-2.32.1-44.el8_9.1.x86_ 598 kB/s | 100 kB 00:00 2024-05-08T23:05:46.402 INFO:teuthology.orchestra.run.smithi135.stdout:(130/146): NetworkManager-initscripts-updown-1. 595 kB/s | 144 kB 00:00 2024-05-08T23:05:46.506 INFO:teuthology.orchestra.run.smithi195.stdout:(136/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.3 MB/s | 333 kB 00:00 2024-05-08T23:05:46.569 INFO:teuthology.orchestra.run.smithi135.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.4 MB/s | 232 kB 00:00 2024-05-08T23:05:46.690 INFO:teuthology.orchestra.run.smithi195.stdout:(137/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.8 MB/s | 1.1 MB 00:00 2024-05-08T23:05:46.711 INFO:teuthology.orchestra.run.smithi135.stdout:(132/146): elfutils-libs-0.189-3.el8.x86_64.rpm 2.1 MB/s | 303 kB 00:00 2024-05-08T23:05:46.775 INFO:teuthology.orchestra.run.smithi195.stdout:(138/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 2.6 MB/s | 3.6 MB 00:01 2024-05-08T23:05:46.840 INFO:teuthology.orchestra.run.smithi195.stdout:(139/146): librados2-18.2.2-1322.gd21e4f96.el8. 2.5 MB/s | 3.7 MB 00:01 2024-05-08T23:05:46.865 INFO:teuthology.orchestra.run.smithi195.stdout:(140/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.2 MB/s | 221 kB 00:00 2024-05-08T23:05:46.912 INFO:teuthology.orchestra.run.smithi135.stdout:(133/146): iproute-6.2.0-5.el8_9.x86_64.rpm 4.2 MB/s | 854 kB 00:00 2024-05-08T23:05:46.933 INFO:teuthology.orchestra.run.smithi195.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.6 MB/s | 254 kB 00:00 2024-05-08T23:05:46.966 INFO:teuthology.orchestra.run.smithi195.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.8 MB/s | 237 kB 00:00 2024-05-08T23:05:47.033 INFO:teuthology.orchestra.run.smithi195.stdout:(143/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.0 MB/s | 180 kB 00:00 2024-05-08T23:05:47.045 INFO:teuthology.orchestra.run.smithi135.stdout:(134/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 5.2 MB/s | 711 kB 00:00 2024-05-08T23:05:47.100 INFO:teuthology.orchestra.run.smithi195.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 593 kB/s | 99 kB 00:00 2024-05-08T23:05:47.142 INFO:teuthology.orchestra.run.smithi195.stdout:(145/146): util-linux-2.32.1-44.el8_9.1.x86_64. 14 MB/s | 2.5 MB 00:00 2024-05-08T23:05:47.250 INFO:teuthology.orchestra.run.smithi195.stdout:(146/146): util-linux-user-2.32.1-44.el8_9.1.x8 474 kB/s | 103 kB 00:00 2024-05-08T23:05:47.253 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:05:47.254 INFO:teuthology.orchestra.run.smithi195.stdout:Total 9.8 MB/s | 215 MB 00:22 2024-05-08T23:05:47.320 INFO:teuthology.orchestra.run.smithi135.stdout:(135/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 5.4 MB/s | 1.5 MB 00:00 2024-05-08T23:05:47.437 INFO:teuthology.orchestra.run.smithi135.stdout:(136/146): librados2-18.2.2-1322.gd21e4f96.el8. 3.2 MB/s | 3.7 MB 00:01 2024-05-08T23:05:47.487 INFO:teuthology.orchestra.run.smithi135.stdout:(137/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.0 MB/s | 333 kB 00:00 2024-05-08T23:05:47.538 INFO:teuthology.orchestra.run.smithi135.stdout:(138/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-05-08T23:05:47.563 INFO:teuthology.orchestra.run.smithi135.stdout:(139/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 2.9 MB/s | 221 kB 00:00 2024-05-08T23:05:47.738 INFO:teuthology.orchestra.run.smithi135.stdout:(140/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.3 MB/s | 237 kB 00:00 2024-05-08T23:05:47.763 INFO:teuthology.orchestra.run.smithi135.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.1 MB/s | 254 kB 00:00 2024-05-08T23:05:47.898 INFO:teuthology.orchestra.run.smithi135.stdout:(142/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.1 MB/s | 180 kB 00:00 2024-05-08T23:05:47.923 INFO:teuthology.orchestra.run.smithi135.stdout:(143/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 625 kB/s | 99 kB 00:00 2024-05-08T23:05:48.015 INFO:teuthology.orchestra.run.smithi135.stdout:(144/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 2.2 MB/s | 3.6 MB 00:01 2024-05-08T23:05:48.089 INFO:teuthology.orchestra.run.smithi135.stdout:(145/146): util-linux-2.32.1-44.el8_9.1.x86_64. 13 MB/s | 2.5 MB 00:00 2024-05-08T23:05:48.124 INFO:teuthology.orchestra.run.smithi135.stdout:(146/146): util-linux-user-2.32.1-44.el8_9.1.x8 513 kB/s | 103 kB 00:00 2024-05-08T23:05:48.127 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:05:48.130 INFO:teuthology.orchestra.run.smithi135.stdout:Total 10 MB/s | 215 MB 00:20 2024-05-08T23:05:48.326 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-05-08T23:05:48.720 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-05-08T23:05:48.720 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-05-08T23:05:49.188 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:05:49.582 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:05:49.582 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:05:49.925 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-05-08T23:05:49.936 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-05-08T23:05:50.784 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:05:50.795 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:05:51.986 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-05-08T23:05:52.122 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T23:05:52.402 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T23:05:52.615 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T23:05:52.803 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T23:05:53.015 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T23:05:53.076 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T23:05:53.257 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T23:05:53.330 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T23:05:53.561 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T23:05:53.772 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-05-08T23:05:53.957 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T23:05:54.078 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T23:05:54.265 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T23:05:54.671 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T23:05:54.874 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:05:55.268 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:05:55.432 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:05:55.555 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:05:55.788 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:05:55.868 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:05:56.176 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T23:05:56.251 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-05-08T23:05:56.385 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T23:05:56.447 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:05:56.456 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T23:05:56.542 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T23:05:56.582 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T23:05:56.665 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T23:05:56.796 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T23:05:56.867 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T23:05:56.882 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T23:05:57.072 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T23:05:57.078 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T23:05:57.088 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T23:05:57.253 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T23:05:57.293 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T23:05:57.305 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T23:05:57.394 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T23:05:57.424 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T23:05:57.482 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T23:05:57.596 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T23:05:57.662 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T23:05:57.674 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T23:05:57.674 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T23:05:57.727 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T23:05:57.927 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T23:05:57.938 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T23:05:57.943 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T23:05:58.073 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:05:58.108 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/162 2024-05-08T23:05:58.160 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:05:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/162 2024-05-08T23:05:58.186 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/162 2024-05-08T23:05:58.272 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/162 2024-05-08T23:05:58.352 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 7/162 2024-05-08T23:05:58.390 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T23:05:58.466 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T23:05:58.494 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 7/162 2024-05-08T23:05:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T23:05:58.635 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-05-08T23:05:58.712 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T23:05:58.926 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-05-08T23:05:58.945 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T23:05:59.111 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T23:05:59.141 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:05:59.170 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-05-08T23:05:59.348 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T23:05:59.371 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:05:59.531 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T23:05:59.532 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:05:59.689 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T23:05:59.699 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:05:59.743 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:05:59.826 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:05:59.962 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:06:00.010 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:06:00.098 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:06:00.122 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:06:00.311 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T23:06:00.355 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:06:00.422 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T23:06:00.450 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:06:00.464 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T23:06:00.640 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T23:06:00.721 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T23:06:00.824 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T23:06:00.929 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T23:06:01.060 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T23:06:01.129 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T23:06:01.208 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T23:06:01.223 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T23:06:01.227 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T23:06:01.402 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T23:06:01.443 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T23:06:01.756 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T23:06:01.769 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T23:06:01.903 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T23:06:01.940 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T23:06:02.011 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T23:06:02.182 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:06:02.212 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-05-08T23:06:02.273 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:06:02.292 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T23:06:02.405 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-05-08T23:06:02.415 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T23:06:02.478 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T23:06:02.557 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T23:06:02.640 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/162 2024-05-08T23:06:02.667 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T23:06:02.728 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:06:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/162 2024-05-08T23:06:02.858 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:06:02.870 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T23:06:02.915 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/162 2024-05-08T23:06:02.992 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T23:06:03.052 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T23:06:03.133 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T23:06:03.237 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T23:06:03.312 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/162 2024-05-08T23:06:03.433 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/162 2024-05-08T23:06:03.473 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T23:06:03.562 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/162 2024-05-08T23:06:03.628 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/162 2024-05-08T23:06:03.715 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-05-08T23:06:04.241 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/162 2024-05-08T23:06:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-05-08T23:06:04.445 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-05-08T23:06:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.15-6.el8.x86_64 24/162 2024-05-08T23:06:05.048 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-05-08T23:06:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 24/162 2024-05-08T23:06:05.236 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.15-6.el8.x86_64 24/162 2024-05-08T23:06:05.237 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T23:06:05.422 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/162 2024-05-08T23:06:05.562 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 26/162 2024-05-08T23:06:05.637 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-05-08T23:06:05.752 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/162 2024-05-08T23:06:05.949 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 24/162 2024-05-08T23:06:05.994 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/162 2024-05-08T23:06:06.259 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/162 2024-05-08T23:06:06.281 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/162 2024-05-08T23:06:06.392 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 26/162 2024-05-08T23:06:06.543 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T23:06:06.598 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/162 2024-05-08T23:06:06.630 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-05-08T23:06:06.696 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T23:06:06.826 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T23:06:06.863 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/162 2024-05-08T23:06:06.963 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-05-08T23:06:07.053 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T23:06:07.141 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/162 2024-05-08T23:06:07.239 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-05-08T23:06:07.433 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T23:06:07.467 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T23:06:07.651 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T23:06:07.708 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T23:06:07.788 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T23:06:07.902 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T23:06:07.987 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/162 2024-05-08T23:06:08.055 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T23:06:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T23:06:08.286 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/162 2024-05-08T23:06:08.313 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T23:06:08.391 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T23:06:08.601 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/162 2024-05-08T23:06:08.664 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T23:06:08.736 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T23:06:08.806 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-05-08T23:06:08.971 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T23:06:08.996 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/162 2024-05-08T23:06:09.158 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T23:06:09.358 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/162 2024-05-08T23:06:09.363 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T23:06:09.655 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/162 2024-05-08T23:06:09.810 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T23:06:09.925 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-05-08T23:06:10.139 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T23:06:10.166 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T23:06:10.405 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T23:06:10.492 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T23:06:10.558 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-05-08T23:06:10.752 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-05-08T23:06:10.884 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 38/162 2024-05-08T23:06:11.030 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-05-08T23:06:11.125 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T23:06:11.213 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T23:06:11.278 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T23:06:11.341 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T23:06:11.486 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-05-08T23:06:11.511 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T23:06:11.655 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T23:06:11.672 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-05-08T23:06:11.687 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-05-08T23:06:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T23:06:11.878 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T23:06:11.923 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-05-08T23:06:12.064 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 38/162 2024-05-08T23:06:12.102 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/162 2024-05-08T23:06:12.114 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T23:06:12.181 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T23:06:12.288 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/162 2024-05-08T23:06:12.322 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T23:06:12.403 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T23:06:12.494 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/162 2024-05-08T23:06:12.579 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T23:06:12.600 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T23:06:12.666 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/162 2024-05-08T23:06:12.807 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T23:06:12.822 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T23:06:12.842 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/162 2024-05-08T23:06:13.018 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T23:06:13.187 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/162 2024-05-08T23:06:13.210 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T23:06:13.261 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T23:06:13.294 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T23:06:13.471 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/162 2024-05-08T23:06:13.540 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T23:06:13.552 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T23:06:13.556 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T23:06:13.619 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T23:06:13.735 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/162 2024-05-08T23:06:13.751 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.7-17.el8.x86_64 49/162 2024-05-08T23:06:13.881 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T23:06:13.883 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/162 2024-05-08T23:06:13.951 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 50/162 2024-05-08T23:06:14.108 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/162 2024-05-08T23:06:14.134 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/162 2024-05-08T23:06:14.137 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T23:06:14.290 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/162 2024-05-08T23:06:14.338 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T23:06:14.458 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/162 2024-05-08T23:06:14.474 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/162 2024-05-08T23:06:14.743 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 54/162 2024-05-08T23:06:14.766 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 67/162 2024-05-08T23:06:14.797 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T23:06:14.983 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 55/162 2024-05-08T23:06:15.056 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/162 2024-05-08T23:06:15.144 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T23:06:15.161 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T23:06:15.185 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 56/162 2024-05-08T23:06:15.304 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 69/162 2024-05-08T23:06:15.343 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 57/162 2024-05-08T23:06:15.381 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.7-17.el8.x86_64 49/162 2024-05-08T23:06:15.515 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/162 2024-05-08T23:06:15.590 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 50/162 2024-05-08T23:06:15.608 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 58/162 2024-05-08T23:06:15.746 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 71/162 2024-05-08T23:06:15.807 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/162 2024-05-08T23:06:15.956 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 59/162 2024-05-08T23:06:16.027 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2024-05-08T23:06:16.038 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/162 2024-05-08T23:06:16.216 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 60/162 2024-05-08T23:06:16.247 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/162 2024-05-08T23:06:16.255 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2024-05-08T23:06:16.513 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 61/162 2024-05-08T23:06:16.515 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/162 2024-05-08T23:06:16.571 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 54/162 2024-05-08T23:06:16.704 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 62/162 2024-05-08T23:06:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/162 2024-05-08T23:06:16.865 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 55/162 2024-05-08T23:06:16.873 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/162 2024-05-08T23:06:17.041 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/162 2024-05-08T23:06:17.092 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 64/162 2024-05-08T23:06:17.131 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 56/162 2024-05-08T23:06:17.231 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-05-08T23:06:17.305 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 57/162 2024-05-08T23:06:17.396 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T23:06:17.547 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 58/162 2024-05-08T23:06:17.606 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T23:06:17.746 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 65/162 2024-05-08T23:06:17.912 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T23:06:17.924 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 59/162 2024-05-08T23:06:17.956 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 66/162 2024-05-08T23:06:18.124 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/162 2024-05-08T23:06:18.194 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T23:06:18.304 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 60/162 2024-05-08T23:06:18.322 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 68/162 2024-05-08T23:06:18.375 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T23:06:18.524 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T23:06:18.542 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 69/162 2024-05-08T23:06:18.650 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 61/162 2024-05-08T23:06:18.713 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-05-08T23:06:18.753 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T23:06:18.796 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-05-08T23:06:18.959 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 62/162 2024-05-08T23:06:18.968 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T23:06:19.046 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jq-1.6-7.el8.x86_64 71/162 2024-05-08T23:06:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/162 2024-05-08T23:06:19.268 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T23:06:19.272 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.1-8.el8.noarch 72/162 2024-05-08T23:06:19.398 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 64/162 2024-05-08T23:06:19.438 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-43.el8.x86_64 73/162 2024-05-08T23:06:19.465 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T23:06:19.497 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 73/162 2024-05-08T23:06:19.651 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T23:06:19.674 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 65/162 2024-05-08T23:06:19.677 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-05-08T23:06:19.862 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 75/162 2024-05-08T23:06:19.918 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T23:06:19.918 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 66/162 2024-05-08T23:06:20.074 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-05-08T23:06:20.141 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T23:06:20.153 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/162 2024-05-08T23:06:20.281 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-05-08T23:06:20.351 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T23:06:20.375 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 68/162 2024-05-08T23:06:20.438 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T23:06:20.613 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T23:06:20.617 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T23:06:20.654 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 69/162 2024-05-08T23:06:20.884 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-05-08T23:06:20.886 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T23:06:20.886 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T23:06:20.972 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-05-08T23:06:21.053 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T23:06:21.086 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T23:06:21.259 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T23:06:21.270 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T23:06:21.291 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : jq-1.6-7.el8.x86_64 71/162 2024-05-08T23:06:21.424 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T23:06:21.552 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : automake-1.16.1-8.el8.noarch 72/162 2024-05-08T23:06:21.616 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T23:06:21.784 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : uuid-1.6.2-43.el8.x86_64 73/162 2024-05-08T23:06:21.850 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T23:06:21.858 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 73/162 2024-05-08T23:06:22.066 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-05-08T23:06:22.074 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T23:06:22.249 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T23:06:22.258 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 75/162 2024-05-08T23:06:22.410 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T23:06:22.410 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T23:06:22.470 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-05-08T23:06:22.626 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T23:06:22.686 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-05-08T23:06:22.741 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T23:06:22.841 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T23:06:22.876 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T23:06:22.995 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T23:06:23.051 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T23:06:23.101 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T23:06:23.300 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T23:06:23.305 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T23:06:23.446 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T23:06:23.528 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T23:06:23.645 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T23:06:23.733 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T23:06:23.744 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T23:06:23.828 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T23:06:23.979 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T23:06:24.121 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T23:06:24.495 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T23:06:24.643 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T23:06:24.718 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T23:06:24.828 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T23:06:24.902 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T23:06:24.912 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T23:06:25.064 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T23:06:25.128 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T23:06:25.201 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T23:06:25.349 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T23:06:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T23:06:25.536 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T23:06:25.572 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T23:06:25.789 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T23:06:25.794 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T23:06:26.020 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T23:06:26.036 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T23:06:26.203 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T23:06:26.230 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T23:06:26.527 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T23:06:26.808 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T23:06:26.975 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T23:06:27.024 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T23:06:27.162 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T23:06:27.217 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T23:06:27.307 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T23:06:27.378 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T23:06:28.428 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T23:06:28.787 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T23:06:29.023 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T23:06:29.340 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T23:06:29.736 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:06:29.994 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:06:30.084 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T23:06:30.325 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T23:06:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:06:30.897 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T23:06:30.979 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T23:06:31.086 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:06:31.110 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T23:06:31.114 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T23:06:31.303 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:06:31.315 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T23:06:31.420 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T23:06:31.624 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T23:06:31.895 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:06:32.162 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T23:06:32.247 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T23:06:32.386 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T23:06:35.414 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:06:36.540 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:06:37.132 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:06:37.527 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T23:06:37.600 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T23:06:37.748 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T23:06:50.924 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T23:06:50.924 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /sys 2024-05-08T23:06:50.924 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /proc 2024-05-08T23:06:50.924 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /dev 2024-05-08T23:06:50.924 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /run 2024-05-08T23:06:50.925 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /mnt 2024-05-08T23:06:50.925 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /var/tmp 2024-05-08T23:06:50.925 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /home 2024-05-08T23:06:50.925 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /tmp 2024-05-08T23:06:50.925 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /dev 2024-05-08T23:06:50.925 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-05-08T23:06:51.275 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T23:06:52.147 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T23:06:52.147 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-05-08T23:06:52.147 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-05-08T23:06:52.147 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2024-05-08T23:06:52.147 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /run 2024-05-08T23:06:52.147 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-05-08T23:06:52.147 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-05-08T23:06:52.147 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-05-08T23:06:52.147 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-05-08T23:06:52.148 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2024-05-08T23:06:52.148 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:06:52.483 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T23:06:52.916 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T23:06:53.161 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T23:06:53.379 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T23:06:53.599 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T23:06:54.074 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T23:06:54.121 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T23:06:54.257 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T23:06:54.275 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T23:06:54.283 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T23:06:54.503 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T23:06:54.649 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T23:06:55.124 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T23:06:55.291 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T23:06:55.309 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T23:06:55.998 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T23:06:56.138 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T23:06:56.297 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T23:06:56.517 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T23:06:56.809 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T23:06:57.015 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T23:06:57.153 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T23:06:57.226 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T23:06:57.226 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2024-05-08T23:06:57.226 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2024-05-08T23:06:57.226 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /dev 2024-05-08T23:06:57.226 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /run 2024-05-08T23:06:57.226 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2024-05-08T23:06:57.226 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2024-05-08T23:06:57.226 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2024-05-08T23:06:57.226 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2024-05-08T23:06:57.227 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /dev 2024-05-08T23:06:57.227 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T23:06:57.289 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T23:06:57.483 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T23:06:57.595 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T23:06:57.687 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T23:06:57.841 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T23:06:58.101 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T23:06:58.727 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T23:06:58.957 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T23:06:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T23:06:59.233 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T23:06:59.248 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T23:06:59.343 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T23:06:59.415 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T23:06:59.632 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T23:06:59.723 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T23:06:59.820 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T23:06:59.918 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T23:06:59.921 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T23:06:59.957 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T23:07:00.073 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T23:07:00.167 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T23:07:00.265 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T23:07:00.277 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T23:07:00.293 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T23:07:00.495 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T23:07:00.512 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T23:07:00.528 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T23:07:00.691 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T23:07:00.729 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T23:07:00.915 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T23:07:00.926 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T23:07:01.532 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T23:07:01.768 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T23:07:01.802 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T23:07:02.006 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T23:07:02.049 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T23:07:02.188 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T23:07:02.248 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T23:07:02.374 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T23:07:02.409 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T23:07:02.558 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T23:07:02.595 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T23:07:02.631 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T23:07:02.675 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T23:07:02.733 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T23:07:02.806 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T23:07:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T23:07:02.851 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T23:07:03.053 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T23:07:03.187 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T23:07:03.356 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T23:07:03.386 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T23:07:04.406 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T23:07:04.755 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T23:07:05.717 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T23:07:05.935 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T23:07:06.028 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T23:07:06.409 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T23:07:06.630 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T23:07:06.669 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T23:07:06.860 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T23:07:06.872 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T23:07:07.269 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T23:07:07.820 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T23:07:08.108 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T23:07:08.289 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T23:07:08.313 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T23:07:08.323 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T23:07:08.348 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T23:07:08.602 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T23:07:08.616 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 127/162 2024-05-08T23:07:08.618 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-05-08T23:07:08.646 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T23:07:08.852 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T23:07:08.871 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-25.el8.x86_64 128/162 2024-05-08T23:07:08.897 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-05-08T23:07:09.198 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T23:07:09.296 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 129/162 2024-05-08T23:07:09.427 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T23:07:09.559 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 128/162 2024-05-08T23:07:09.599 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-05-08T23:07:09.864 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T23:07:09.876 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 129/162 2024-05-08T23:07:09.877 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T23:07:10.108 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T23:07:10.147 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 130/162 2024-05-08T23:07:10.335 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T23:07:10.353 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T23:07:10.539 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T23:07:10.541 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T23:07:10.734 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T23:07:10.923 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T23:07:12.831 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:07:13.147 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:07:13.186 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:07:13.201 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:07:13.539 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:07:13.579 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:07:13.663 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T23:07:13.867 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T23:07:13.985 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T23:07:14.011 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T23:07:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T23:07:14.350 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T23:07:14.353 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T23:07:14.462 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T23:07:14.558 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T23:07:14.687 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T23:07:14.703 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 127/162 2024-05-08T23:07:14.738 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T23:07:14.937 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T23:07:14.965 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T23:07:15.009 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libtool-2.4.6-25.el8.x86_64 128/162 2024-05-08T23:07:15.243 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T23:07:15.316 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T23:07:15.498 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T23:07:15.537 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T23:07:15.619 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T23:07:15.663 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-05-08T23:07:15.672 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-05-08T23:07:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 128/162 2024-05-08T23:07:15.837 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T23:07:15.851 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T23:07:15.875 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 144/162 2024-05-08T23:07:15.980 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 129/162 2024-05-08T23:07:16.012 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T23:07:16.022 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T23:07:16.104 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.1-9.el8.x86_64 145/162 2024-05-08T23:07:16.156 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-05-08T23:07:16.184 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 145/162 2024-05-08T23:07:16.250 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 130/162 2024-05-08T23:07:16.395 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T23:07:16.412 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.0.4-10.el8.x86_64 146/162 2024-05-08T23:07:16.426 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 146/162 2024-05-08T23:07:16.490 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T23:07:16.589 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T23:07:16.600 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T23:07:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T23:07:16.764 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T23:07:16.801 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T23:07:16.802 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T23:07:16.938 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T23:07:16.941 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T23:07:16.941 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T23:07:17.082 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T23:07:17.082 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T23:07:17.135 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T23:07:17.191 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T23:07:17.191 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T23:07:17.349 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T23:07:17.349 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T23:07:17.400 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T23:07:17.400 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T23:07:17.627 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T23:07:17.628 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T23:07:17.889 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T23:07:17.889 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T23:07:18.056 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T23:07:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T23:07:18.281 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T23:07:18.281 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:07:18.305 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T23:07:18.305 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:07:18.507 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:07:18.507 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T23:07:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:07:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T23:07:18.765 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T23:07:18.765 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:07:18.798 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T23:07:18.798 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:07:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:07:19.007 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T23:07:19.064 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:07:19.064 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T23:07:19.265 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T23:07:19.265 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:07:19.289 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T23:07:19.289 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:07:19.498 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:07:19.502 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:07:19.547 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:07:19.673 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T23:07:19.673 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T23:07:19.731 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T23:07:19.731 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T23:07:19.851 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:07:19.888 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:07:20.400 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T23:07:20.558 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T23:07:20.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T23:07:20.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T23:07:20.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T23:07:20.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T23:07:20.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T23:07:20.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T23:07:20.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T23:07:20.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T23:07:20.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:07:20.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:07:20.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:07:20.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T23:07:20.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T23:07:20.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T23:07:20.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T23:07:20.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T23:07:20.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T23:07:20.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T23:07:20.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:07:20.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T23:07:20.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T23:07:20.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T23:07:20.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T23:07:20.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T23:07:20.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T23:07:20.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T23:07:20.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T23:07:20.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T23:07:20.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T23:07:20.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T23:07:20.572 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T23:07:20.573 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T23:07:20.573 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T23:07:20.573 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T23:07:20.573 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T23:07:20.573 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T23:07:20.573 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T23:07:20.573 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T23:07:20.573 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T23:07:20.573 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T23:07:20.573 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T23:07:20.573 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T23:07:20.573 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T23:07:20.573 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T23:07:20.574 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T23:07:20.574 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T23:07:20.574 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T23:07:20.574 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T23:07:20.574 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T23:07:20.574 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T23:07:20.574 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T23:07:20.574 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T23:07:20.574 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T23:07:20.574 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T23:07:20.574 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T23:07:20.574 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T23:07:20.574 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T23:07:20.575 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T23:07:20.575 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T23:07:20.575 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T23:07:20.575 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T23:07:20.575 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T23:07:20.575 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T23:07:20.575 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T23:07:20.575 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T23:07:20.575 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T23:07:20.575 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T23:07:20.575 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T23:07:20.575 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T23:07:20.575 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T23:07:20.575 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T23:07:20.576 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-05-08T23:07:20.576 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 73/162 2024-05-08T23:07:20.576 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-05-08T23:07:20.576 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 75/162 2024-05-08T23:07:20.576 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-05-08T23:07:20.576 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 77/162 2024-05-08T23:07:20.576 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 78/162 2024-05-08T23:07:20.576 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.0.4-10.el8.x86_64 79/162 2024-05-08T23:07:20.576 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.1-9.el8.x86_64 80/162 2024-05-08T23:07:20.576 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 81/162 2024-05-08T23:07:20.576 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 82/162 2024-05-08T23:07:20.576 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 83/162 2024-05-08T23:07:20.576 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 84/162 2024-05-08T23:07:20.576 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 85/162 2024-05-08T23:07:20.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 86/162 2024-05-08T23:07:20.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 87/162 2024-05-08T23:07:20.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 88/162 2024-05-08T23:07:20.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 89/162 2024-05-08T23:07:20.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 90/162 2024-05-08T23:07:20.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 91/162 2024-05-08T23:07:20.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 92/162 2024-05-08T23:07:20.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 93/162 2024-05-08T23:07:20.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 94/162 2024-05-08T23:07:20.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.1-8.el8.noarch 95/162 2024-05-08T23:07:20.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpq-13.11-1.el8.x86_64 96/162 2024-05-08T23:07:20.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jq-1.6-7.el8.x86_64 97/162 2024-05-08T23:07:20.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 98/162 2024-05-08T23:07:20.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 99/162 2024-05-08T23:07:20.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 100/162 2024-05-08T23:07:20.578 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 101/162 2024-05-08T23:07:20.578 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 102/162 2024-05-08T23:07:20.578 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 103/162 2024-05-08T23:07:20.578 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 104/162 2024-05-08T23:07:20.578 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/162 2024-05-08T23:07:20.578 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 106/162 2024-05-08T23:07:20.578 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 107/162 2024-05-08T23:07:20.578 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 108/162 2024-05-08T23:07:20.578 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 109/162 2024-05-08T23:07:20.578 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 110/162 2024-05-08T23:07:20.578 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 111/162 2024-05-08T23:07:20.578 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 112/162 2024-05-08T23:07:20.578 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 113/162 2024-05-08T23:07:20.578 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 114/162 2024-05-08T23:07:20.579 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 115/162 2024-05-08T23:07:20.579 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 116/162 2024-05-08T23:07:20.579 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/162 2024-05-08T23:07:20.579 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/162 2024-05-08T23:07:20.579 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 119/162 2024-05-08T23:07:20.579 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 120/162 2024-05-08T23:07:20.579 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 121/162 2024-05-08T23:07:20.579 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 122/162 2024-05-08T23:07:20.579 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 123/162 2024-05-08T23:07:20.579 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 124/162 2024-05-08T23:07:20.579 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 125/162 2024-05-08T23:07:20.579 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 126/162 2024-05-08T23:07:20.579 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 127/162 2024-05-08T23:07:20.579 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 128/162 2024-05-08T23:07:20.580 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 129/162 2024-05-08T23:07:20.580 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 130/162 2024-05-08T23:07:20.580 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T23:07:20.580 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T23:07:20.580 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T23:07:20.580 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T23:07:20.580 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T23:07:20.580 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T23:07:20.580 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T23:07:20.580 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T23:07:20.580 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T23:07:20.580 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T23:07:20.580 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T23:07:20.580 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T23:07:20.581 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T23:07:20.581 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T23:07:20.581 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T23:07:20.581 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T23:07:20.581 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T23:07:20.581 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T23:07:20.581 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T23:07:20.581 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T23:07:20.581 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T23:07:20.581 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T23:07:20.581 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T23:07:20.581 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T23:07:20.581 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T23:07:20.581 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:07:20.582 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T23:07:20.582 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:07:20.582 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T23:07:20.582 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:07:20.582 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T23:07:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T23:07:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T23:07:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T23:07:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T23:07:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T23:07:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T23:07:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T23:07:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T23:07:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T23:07:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:07:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:07:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:07:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T23:07:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T23:07:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T23:07:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T23:07:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T23:07:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T23:07:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T23:07:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:07:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T23:07:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T23:07:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T23:07:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T23:07:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T23:07:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T23:07:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T23:07:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T23:07:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T23:07:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T23:07:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T23:07:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T23:07:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T23:07:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T23:07:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T23:07:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T23:07:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T23:07:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T23:07:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T23:07:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T23:07:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T23:07:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T23:07:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T23:07:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T23:07:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T23:07:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T23:07:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T23:07:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T23:07:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T23:07:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T23:07:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T23:07:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T23:07:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T23:07:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T23:07:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T23:07:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T23:07:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T23:07:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T23:07:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T23:07:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T23:07:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T23:07:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T23:07:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T23:07:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T23:07:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T23:07:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T23:07:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T23:07:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T23:07:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T23:07:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T23:07:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T23:07:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T23:07:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-05-08T23:07:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2024-05-08T23:07:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2024-05-08T23:07:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2024-05-08T23:07:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2024-05-08T23:07:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2024-05-08T23:07:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2024-05-08T23:07:20.675 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2024-05-08T23:07:20.675 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2024-05-08T23:07:20.675 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2024-05-08T23:07:20.675 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2024-05-08T23:07:20.675 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2024-05-08T23:07:20.675 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2024-05-08T23:07:20.675 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2024-05-08T23:07:20.675 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2024-05-08T23:07:20.675 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2024-05-08T23:07:20.675 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/162 2024-05-08T23:07:20.675 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/162 2024-05-08T23:07:20.675 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/162 2024-05-08T23:07:20.675 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/162 2024-05-08T23:07:20.675 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 92/162 2024-05-08T23:07:20.676 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 93/162 2024-05-08T23:07:20.676 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 94/162 2024-05-08T23:07:20.676 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 95/162 2024-05-08T23:07:20.676 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 96/162 2024-05-08T23:07:20.676 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 97/162 2024-05-08T23:07:20.676 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 98/162 2024-05-08T23:07:20.676 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 99/162 2024-05-08T23:07:20.676 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-05-08T23:07:20.676 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-05-08T23:07:20.676 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-05-08T23:07:20.676 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-05-08T23:07:20.676 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-05-08T23:07:20.676 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-05-08T23:07:20.676 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-05-08T23:07:20.677 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-05-08T23:07:20.677 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-05-08T23:07:20.677 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-05-08T23:07:20.677 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-05-08T23:07:20.677 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-05-08T23:07:20.677 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-05-08T23:07:20.677 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-05-08T23:07:20.677 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-05-08T23:07:20.677 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-05-08T23:07:20.677 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-05-08T23:07:20.677 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-05-08T23:07:20.677 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-05-08T23:07:20.677 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-05-08T23:07:20.677 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-05-08T23:07:20.677 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-05-08T23:07:20.678 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-05-08T23:07:20.678 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-05-08T23:07:20.678 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-05-08T23:07:20.678 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-05-08T23:07:20.678 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-05-08T23:07:20.678 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-05-08T23:07:20.678 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-05-08T23:07:20.678 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-05-08T23:07:20.678 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-05-08T23:07:20.678 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T23:07:20.678 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T23:07:20.678 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T23:07:20.678 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T23:07:20.679 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T23:07:20.679 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T23:07:20.679 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T23:07:20.679 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T23:07:20.679 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T23:07:20.679 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T23:07:20.679 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T23:07:20.679 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T23:07:20.679 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T23:07:20.679 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T23:07:20.679 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T23:07:20.679 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T23:07:20.679 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T23:07:20.679 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T23:07:20.679 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T23:07:20.680 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T23:07:20.680 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T23:07:20.680 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T23:07:20.680 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T23:07:20.680 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T23:07:20.680 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T23:07:20.680 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:07:20.680 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T23:07:20.680 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:07:20.680 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T23:07:20.680 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:07:20.680 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T23:07:20.824 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T23:07:21.079 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T23:07:21.275 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T23:07:21.483 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T23:07:21.803 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T23:07:22.160 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T23:07:22.391 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-05-08T23:07:22.402 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-05-08T23:07:22.655 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 144/162 2024-05-08T23:07:22.932 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flex-2.6.1-9.el8.x86_64 145/162 2024-05-08T23:07:23.013 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 145/162 2024-05-08T23:07:23.258 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : bison-3.0.4-10.el8.x86_64 146/162 2024-05-08T23:07:23.272 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 146/162 2024-05-08T23:07:23.482 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T23:07:23.710 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T23:07:23.920 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T23:07:23.920 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T23:07:24.252 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T23:07:24.253 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T23:07:24.520 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T23:07:24.520 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T23:07:24.805 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T23:07:25.059 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T23:07:25.276 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T23:07:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T23:07:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:07:25.827 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:07:25.827 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T23:07:26.152 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T23:07:26.152 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:07:26.410 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:07:26.410 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T23:07:26.676 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T23:07:26.676 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:07:27.168 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:07:27.368 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T23:07:27.368 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T23:07:28.319 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T23:07:28.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T23:07:28.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T23:07:28.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T23:07:28.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T23:07:28.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T23:07:28.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T23:07:28.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T23:07:28.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T23:07:28.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:07:28.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:07:28.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:07:28.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T23:07:28.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T23:07:28.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T23:07:28.321 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T23:07:28.321 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T23:07:28.321 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T23:07:28.321 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T23:07:28.321 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:07:28.321 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T23:07:28.321 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T23:07:28.321 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T23:07:28.321 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T23:07:28.321 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T23:07:28.321 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T23:07:28.321 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T23:07:28.321 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T23:07:28.334 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T23:07:28.334 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T23:07:28.334 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T23:07:28.334 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T23:07:28.334 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T23:07:28.334 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T23:07:28.334 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T23:07:28.334 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T23:07:28.335 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T23:07:28.335 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T23:07:28.335 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T23:07:28.335 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T23:07:28.335 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T23:07:28.335 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T23:07:28.335 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T23:07:28.335 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T23:07:28.335 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T23:07:28.335 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T23:07:28.335 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T23:07:28.335 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T23:07:28.335 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T23:07:28.335 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T23:07:28.336 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T23:07:28.336 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T23:07:28.336 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T23:07:28.336 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T23:07:28.336 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T23:07:28.336 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T23:07:28.336 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T23:07:28.336 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T23:07:28.336 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T23:07:28.337 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T23:07:28.337 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T23:07:28.337 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T23:07:28.337 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T23:07:28.337 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T23:07:28.337 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T23:07:28.337 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T23:07:28.337 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T23:07:28.337 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T23:07:28.337 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T23:07:28.337 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T23:07:28.337 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T23:07:28.337 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T23:07:28.337 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-05-08T23:07:28.337 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 73/162 2024-05-08T23:07:28.338 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-05-08T23:07:28.338 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 75/162 2024-05-08T23:07:28.338 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-05-08T23:07:28.338 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 77/162 2024-05-08T23:07:28.338 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 78/162 2024-05-08T23:07:28.338 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : bison-3.0.4-10.el8.x86_64 79/162 2024-05-08T23:07:28.338 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flex-2.6.1-9.el8.x86_64 80/162 2024-05-08T23:07:28.338 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 81/162 2024-05-08T23:07:28.338 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 82/162 2024-05-08T23:07:28.338 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 83/162 2024-05-08T23:07:28.338 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 84/162 2024-05-08T23:07:28.338 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 85/162 2024-05-08T23:07:28.338 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 86/162 2024-05-08T23:07:28.338 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 87/162 2024-05-08T23:07:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 88/162 2024-05-08T23:07:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 89/162 2024-05-08T23:07:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 90/162 2024-05-08T23:07:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 91/162 2024-05-08T23:07:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 92/162 2024-05-08T23:07:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 93/162 2024-05-08T23:07:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 94/162 2024-05-08T23:07:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : automake-1.16.1-8.el8.noarch 95/162 2024-05-08T23:07:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libpq-13.11-1.el8.x86_64 96/162 2024-05-08T23:07:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : jq-1.6-7.el8.x86_64 97/162 2024-05-08T23:07:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 98/162 2024-05-08T23:07:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 99/162 2024-05-08T23:07:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 100/162 2024-05-08T23:07:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 101/162 2024-05-08T23:07:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 102/162 2024-05-08T23:07:28.340 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 103/162 2024-05-08T23:07:28.340 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 104/162 2024-05-08T23:07:28.340 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/162 2024-05-08T23:07:28.340 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 106/162 2024-05-08T23:07:28.340 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 107/162 2024-05-08T23:07:28.340 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 108/162 2024-05-08T23:07:28.340 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 109/162 2024-05-08T23:07:28.340 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 110/162 2024-05-08T23:07:28.340 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 111/162 2024-05-08T23:07:28.340 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 112/162 2024-05-08T23:07:28.340 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 113/162 2024-05-08T23:07:28.340 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 114/162 2024-05-08T23:07:28.340 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 115/162 2024-05-08T23:07:28.340 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 116/162 2024-05-08T23:07:28.341 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/162 2024-05-08T23:07:28.341 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/162 2024-05-08T23:07:28.341 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 119/162 2024-05-08T23:07:28.341 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 120/162 2024-05-08T23:07:28.341 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 121/162 2024-05-08T23:07:28.341 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 122/162 2024-05-08T23:07:28.341 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 123/162 2024-05-08T23:07:28.341 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 124/162 2024-05-08T23:07:28.341 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 125/162 2024-05-08T23:07:28.341 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 126/162 2024-05-08T23:07:28.341 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 127/162 2024-05-08T23:07:28.341 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 128/162 2024-05-08T23:07:28.341 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 129/162 2024-05-08T23:07:28.341 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 130/162 2024-05-08T23:07:28.341 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T23:07:28.342 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T23:07:28.342 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T23:07:28.342 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T23:07:28.342 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T23:07:28.342 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T23:07:28.342 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T23:07:28.342 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T23:07:28.342 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T23:07:28.342 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T23:07:28.342 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T23:07:28.342 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T23:07:28.342 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T23:07:28.342 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T23:07:28.342 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T23:07:28.343 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T23:07:28.343 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T23:07:28.343 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T23:07:28.343 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T23:07:28.343 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T23:07:28.343 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T23:07:28.343 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T23:07:28.343 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T23:07:28.343 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T23:07:28.343 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T23:07:28.343 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:07:28.343 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T23:07:28.343 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:07:28.344 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T23:07:28.344 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:07:28.344 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T23:07:32.853 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T23:07:32.853 INFO:teuthology.orchestra.run.smithi179.stdout:Installed products updated. 2024-05-08T23:07:33.852 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-05-08T23:07:33.853 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2024-05-08T23:07:33.853 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T23:07:33.853 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T23:07:33.853 INFO:teuthology.orchestra.run.smithi179.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T23:07:33.853 INFO:teuthology.orchestra.run.smithi179.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:33.853 INFO:teuthology.orchestra.run.smithi179.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:33.853 INFO:teuthology.orchestra.run.smithi179.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:33.853 INFO:teuthology.orchestra.run.smithi179.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.853 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.853 INFO:teuthology.orchestra.run.smithi179.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:33.853 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:33.854 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:07:33.854 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:07:33.854 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:33.854 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:33.854 INFO:teuthology.orchestra.run.smithi179.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T23:07:33.854 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T23:07:33.854 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-05-08T23:07:33.854 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T23:07:33.854 INFO:teuthology.orchestra.run.smithi179.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T23:07:33.854 INFO:teuthology.orchestra.run.smithi179.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T23:07:33.854 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.854 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.854 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.855 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.855 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:33.855 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.855 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.855 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.855 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:33.855 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:33.855 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:33.855 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:33.855 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:33.855 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.855 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.855 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:33.855 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.856 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.856 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.856 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:33.856 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:33.856 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.856 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:33.856 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T23:07:33.856 INFO:teuthology.orchestra.run.smithi179.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T23:07:33.856 INFO:teuthology.orchestra.run.smithi179.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T23:07:33.856 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T23:07:33.856 INFO:teuthology.orchestra.run.smithi179.stdout: jq-1.6-7.el8.x86_64 2024-05-08T23:07:33.856 INFO:teuthology.orchestra.run.smithi179.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T23:07:33.856 INFO:teuthology.orchestra.run.smithi179.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T23:07:33.856 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T23:07:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T23:07:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T23:07:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T23:07:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T23:07:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T23:07:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T23:07:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T23:07:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T23:07:33.858 INFO:teuthology.orchestra.run.smithi179.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T23:07:33.858 INFO:teuthology.orchestra.run.smithi179.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T23:07:33.858 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T23:07:33.858 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:33.858 INFO:teuthology.orchestra.run.smithi179.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T23:07:33.858 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T23:07:33.858 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T23:07:33.858 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T23:07:33.858 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T23:07:33.858 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T23:07:33.858 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:07:33.858 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T23:07:33.858 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T23:07:33.859 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T23:07:33.859 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:07:33.859 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:07:33.859 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:07:33.859 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T23:07:33.859 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T23:07:33.859 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T23:07:33.859 INFO:teuthology.orchestra.run.smithi179.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T23:07:33.859 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T23:07:33.859 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.859 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.859 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.859 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T23:07:33.859 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T23:07:33.860 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T23:07:33.860 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T23:07:33.860 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T23:07:33.860 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T23:07:33.860 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T23:07:33.860 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T23:07:33.860 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T23:07:33.860 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T23:07:33.860 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T23:07:33.860 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T23:07:33.860 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T23:07:33.860 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T23:07:33.860 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T23:07:33.860 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T23:07:33.861 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T23:07:33.861 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T23:07:33.861 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T23:07:33.861 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T23:07:33.861 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T23:07:33.861 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T23:07:33.861 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T23:07:33.861 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T23:07:33.861 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T23:07:33.861 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T23:07:33.861 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T23:07:33.861 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T23:07:33.861 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T23:07:33.861 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T23:07:33.861 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.862 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.862 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T23:07:33.862 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T23:07:33.862 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.862 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T23:07:33.862 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T23:07:33.862 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T23:07:33.862 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T23:07:33.862 INFO:teuthology.orchestra.run.smithi179.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T23:07:33.862 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T23:07:33.862 INFO:teuthology.orchestra.run.smithi179.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T23:07:33.862 INFO:teuthology.orchestra.run.smithi179.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T23:07:33.862 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T23:07:33.863 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T23:07:33.863 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T23:07:33.863 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T23:07:33.863 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T23:07:33.863 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.863 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.863 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:33.863 INFO:teuthology.orchestra.run.smithi179.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T23:07:33.863 INFO:teuthology.orchestra.run.smithi179.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T23:07:33.863 INFO:teuthology.orchestra.run.smithi179.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T23:07:33.863 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T23:07:33.863 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T23:07:33.864 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T23:07:33.864 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-05-08T23:07:33.864 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-05-08T23:07:33.919 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T23:07:33.919 INFO:teuthology.orchestra.run.smithi135.stdout:Installed products updated. 2024-05-08T23:07:34.532 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:07:34.533 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-05-08T23:07:34.533 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T23:07:34.533 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T23:07:34.533 INFO:teuthology.orchestra.run.smithi135.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T23:07:34.533 INFO:teuthology.orchestra.run.smithi135.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:34.533 INFO:teuthology.orchestra.run.smithi135.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:34.533 INFO:teuthology.orchestra.run.smithi135.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:34.533 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.533 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.533 INFO:teuthology.orchestra.run.smithi135.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:34.533 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:34.533 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:07:34.533 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:07:34.533 INFO:teuthology.orchestra.run.smithi135.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:34.534 INFO:teuthology.orchestra.run.smithi135.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:34.534 INFO:teuthology.orchestra.run.smithi135.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T23:07:34.534 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T23:07:34.534 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:07:34.534 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T23:07:34.534 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T23:07:34.534 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T23:07:34.534 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.534 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.534 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.534 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.534 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:34.534 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.534 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.534 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.535 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:34.535 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:34.535 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:34.535 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:34.535 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:34.535 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.535 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.535 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:34.535 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.535 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.535 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.535 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:34.535 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:34.536 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.536 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:34.536 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T23:07:34.536 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T23:07:34.536 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T23:07:34.536 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T23:07:34.536 INFO:teuthology.orchestra.run.smithi135.stdout: jq-1.6-7.el8.x86_64 2024-05-08T23:07:34.536 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T23:07:34.536 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T23:07:34.536 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T23:07:34.536 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.536 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.536 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.536 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T23:07:34.536 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T23:07:34.537 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T23:07:34.537 INFO:teuthology.orchestra.run.smithi135.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T23:07:34.537 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T23:07:34.537 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T23:07:34.537 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.537 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.537 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T23:07:34.537 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.537 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T23:07:34.537 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T23:07:34.537 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T23:07:34.537 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T23:07:34.537 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:34.537 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T23:07:34.537 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T23:07:34.538 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T23:07:34.538 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T23:07:34.538 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T23:07:34.538 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T23:07:34.538 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:07:34.538 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T23:07:34.538 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T23:07:34.538 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T23:07:34.538 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:07:34.538 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:07:34.538 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:07:34.538 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T23:07:34.538 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T23:07:34.539 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T23:07:34.539 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T23:07:34.539 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T23:07:34.539 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.539 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.539 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.539 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T23:07:34.539 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T23:07:34.539 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T23:07:34.539 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T23:07:34.539 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T23:07:34.539 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T23:07:34.539 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T23:07:34.539 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T23:07:34.540 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T23:07:34.540 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T23:07:34.540 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T23:07:34.540 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T23:07:34.540 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T23:07:34.540 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T23:07:34.540 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T23:07:34.540 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T23:07:34.540 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T23:07:34.540 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T23:07:34.540 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T23:07:34.540 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T23:07:34.540 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T23:07:34.540 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T23:07:34.541 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T23:07:34.541 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T23:07:34.541 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T23:07:34.541 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T23:07:34.541 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T23:07:34.541 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T23:07:34.541 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T23:07:34.541 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T23:07:34.541 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.541 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.541 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T23:07:34.541 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T23:07:34.541 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.541 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T23:07:34.541 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T23:07:34.542 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T23:07:34.542 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T23:07:34.542 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T23:07:34.542 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T23:07:34.542 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T23:07:34.542 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T23:07:34.542 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T23:07:34.542 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T23:07:34.542 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T23:07:34.542 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T23:07:34.542 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T23:07:34.542 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.542 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.542 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:34.543 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T23:07:34.543 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T23:07:34.543 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T23:07:34.543 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T23:07:34.543 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T23:07:34.543 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T23:07:34.543 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:07:34.543 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:07:34.754 DEBUG:teuthology.parallel:result is None 2024-05-08T23:07:36.386 DEBUG:teuthology.parallel:result is None 2024-05-08T23:07:41.796 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T23:07:41.796 INFO:teuthology.orchestra.run.smithi195.stdout:Installed products updated. 2024-05-08T23:07:43.334 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T23:07:43.334 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2024-05-08T23:07:43.334 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T23:07:43.334 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T23:07:43.334 INFO:teuthology.orchestra.run.smithi195.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T23:07:43.334 INFO:teuthology.orchestra.run.smithi195.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:43.334 INFO:teuthology.orchestra.run.smithi195.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:43.335 INFO:teuthology.orchestra.run.smithi195.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:43.335 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.335 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.335 INFO:teuthology.orchestra.run.smithi195.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:43.335 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:43.335 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:07:43.335 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:07:43.335 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:43.335 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:43.335 INFO:teuthology.orchestra.run.smithi195.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T23:07:43.335 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T23:07:43.335 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-05-08T23:07:43.335 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T23:07:43.336 INFO:teuthology.orchestra.run.smithi195.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T23:07:43.336 INFO:teuthology.orchestra.run.smithi195.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T23:07:43.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:43.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:43.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:43.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:43.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:43.337 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:43.337 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.337 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.337 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:43.337 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.337 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.337 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.337 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:43.337 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:43.337 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.337 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:07:43.337 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T23:07:43.337 INFO:teuthology.orchestra.run.smithi195.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T23:07:43.337 INFO:teuthology.orchestra.run.smithi195.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T23:07:43.338 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T23:07:43.338 INFO:teuthology.orchestra.run.smithi195.stdout: jq-1.6-7.el8.x86_64 2024-05-08T23:07:43.338 INFO:teuthology.orchestra.run.smithi195.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T23:07:43.338 INFO:teuthology.orchestra.run.smithi195.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T23:07:43.338 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T23:07:43.338 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.338 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.338 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.338 INFO:teuthology.orchestra.run.smithi195.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T23:07:43.338 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T23:07:43.338 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T23:07:43.338 INFO:teuthology.orchestra.run.smithi195.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T23:07:43.338 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T23:07:43.339 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T23:07:43.339 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.339 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.339 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T23:07:43.339 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.339 INFO:teuthology.orchestra.run.smithi195.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T23:07:43.339 INFO:teuthology.orchestra.run.smithi195.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T23:07:43.339 INFO:teuthology.orchestra.run.smithi195.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T23:07:43.339 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T23:07:43.339 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:07:43.339 INFO:teuthology.orchestra.run.smithi195.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T23:07:43.339 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T23:07:43.339 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T23:07:43.339 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T23:07:43.340 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T23:07:43.340 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T23:07:43.340 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:07:43.340 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T23:07:43.340 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T23:07:43.340 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T23:07:43.340 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:07:43.340 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:07:43.340 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:07:43.340 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T23:07:43.340 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T23:07:43.340 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T23:07:43.340 INFO:teuthology.orchestra.run.smithi195.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T23:07:43.340 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T23:07:43.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T23:07:43.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T23:07:43.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T23:07:43.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T23:07:43.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T23:07:43.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T23:07:43.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T23:07:43.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T23:07:43.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T23:07:43.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T23:07:43.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T23:07:43.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T23:07:43.342 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T23:07:43.342 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T23:07:43.342 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T23:07:43.342 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T23:07:43.342 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T23:07:43.342 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T23:07:43.342 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T23:07:43.342 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T23:07:43.342 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T23:07:43.342 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T23:07:43.342 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T23:07:43.342 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T23:07:43.342 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T23:07:43.342 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T23:07:43.343 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T23:07:43.343 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T23:07:43.343 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T23:07:43.343 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T23:07:43.343 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.343 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.343 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T23:07:43.343 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T23:07:43.343 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.343 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T23:07:43.343 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T23:07:43.343 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T23:07:43.343 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T23:07:43.343 INFO:teuthology.orchestra.run.smithi195.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T23:07:43.343 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T23:07:43.344 INFO:teuthology.orchestra.run.smithi195.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T23:07:43.344 INFO:teuthology.orchestra.run.smithi195.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T23:07:43.344 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T23:07:43.344 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T23:07:43.344 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T23:07:43.344 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T23:07:43.344 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T23:07:43.344 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.344 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.344 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:07:43.344 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T23:07:43.344 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T23:07:43.344 INFO:teuthology.orchestra.run.smithi195.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T23:07:43.344 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T23:07:43.345 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T23:07:43.345 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T23:07:43.345 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T23:07:43.345 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-05-08T23:07:43.964 DEBUG:teuthology.parallel:result is None 2024-05-08T23:07:43.964 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:07:44.185 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T23:07:44.214 INFO:teuthology.orchestra.run.smithi135.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T23:07:44.215 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T23:07:44.215 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T23:07:44.217 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:07:44.442 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T23:07:44.470 INFO:teuthology.orchestra.run.smithi179.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T23:07:44.471 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T23:07:44.471 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T23:07:44.472 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:07:44.690 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T23:07:44.719 INFO:teuthology.orchestra.run.smithi195.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T23:07:44.719 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T23:07:44.719 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T23:07:44.721 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T23:07:44.721 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:07:44.721 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T23:07:44.772 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-05-08T23:07:44.772 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T23:07:44.823 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T23:07:44.823 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T23:07:44.871 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T23:07:44.872 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:07:44.872 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T23:07:44.904 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T23:07:44.977 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-05-08T23:07:44.977 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T23:07:45.010 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T23:07:45.079 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T23:07:45.079 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T23:07:45.112 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T23:07:45.182 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T23:07:45.183 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:07:45.183 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T23:07:45.214 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T23:07:45.288 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-05-08T23:07:45.288 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T23:07:45.318 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T23:07:45.388 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T23:07:45.388 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T23:07:45.420 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T23:07:45.491 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T23:07:45.491 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:07:45.491 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T23:07:45.523 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T23:07:45.593 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-05-08T23:07:45.593 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T23:07:45.623 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T23:07:45.693 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T23:07:45.693 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T23:07:45.726 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T23:07:45.795 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-08T23:07:45.900 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-05-08T23:07:45.900 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:07:45.900 INFO:tasks.cephadm:Cluster fsid is c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:07:45.900 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-08T23:07:45.901 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.135', 'mon.b': '172.21.15.179', 'mon.c': '172.21.15.195'} 2024-05-08T23:07:45.901 INFO:tasks.cephadm:First mon is mon.a on smithi135 2024-05-08T23:07:45.901 INFO:tasks.cephadm:First mgr is x 2024-05-08T23:07:45.901 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-08T23:07:45.901 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname $(hostname -s) 2024-05-08T23:07:45.934 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname $(hostname -s) 2024-05-08T23:07:45.966 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname $(hostname -s) 2024-05-08T23:07:45.998 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-08T23:07:45.999 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:07:46.219 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/79222/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.2-1322-gd21e4f96', 'node_name': '172.21.2.4+braggi04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.2-1322.gd21e4f96'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2024-05-08 19:11:17.581213', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240508.150423-reef', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/', 'archs': ['arm64', 'source', 'x86_64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/79220/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.2-1322-gd21e4f96', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.2-1322.gd21e4f96'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2024-05-08 18:26:58.979379', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240508.150423-reef', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-05-08T23:07:46.369 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-pdonnell-testing-20240508.150423-reef, sha1 d21e4f961318b56f0d915caa2490c3711bf13c34 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:07:46.370 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/x86_64/flavors/default/cephadm 2024-05-08T23:07:46.371 DEBUG:teuthology.orchestra.run.smithi135:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T23:07:46.872 INFO:teuthology.orchestra.run.smithi135.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 May 8 23:07 /home/ubuntu/cephtest/cephadm 2024-05-08T23:07:46.872 DEBUG:teuthology.orchestra.run.smithi179:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T23:07:47.376 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 May 8 23:07 /home/ubuntu/cephtest/cephadm 2024-05-08T23:07:47.376 DEBUG:teuthology.orchestra.run.smithi195:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T23:07:47.720 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 May 8 23:07 /home/ubuntu/cephtest/cephadm 2024-05-08T23:07:47.720 DEBUG:teuthology.orchestra.run.smithi135:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T23:07:47.742 DEBUG:teuthology.orchestra.run.smithi179:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T23:07:47.764 DEBUG:teuthology.orchestra.run.smithi195:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T23:07:47.802 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 on all hosts... 2024-05-08T23:07:47.802 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 pull 2024-05-08T23:07:47.805 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 pull 2024-05-08T23:07:47.807 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 pull 2024-05-08T23:07:48.730 INFO:teuthology.orchestra.run.smithi179.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34... 2024-05-08T23:07:48.798 INFO:teuthology.orchestra.run.smithi135.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34... 2024-05-08T23:07:49.686 INFO:teuthology.orchestra.run.smithi195.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34... 2024-05-08T23:08:17.724 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-05-08T23:08:17.725 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T23:08:17.725 INFO:teuthology.orchestra.run.smithi195.stdout: "image_id": "af23193ff691dd58bee78ea954b569105e41c41def20b81a25baa1d30500ad1c", 2024-05-08T23:08:17.725 INFO:teuthology.orchestra.run.smithi195.stdout: "repo_digests": [ 2024-05-08T23:08:17.725 INFO:teuthology.orchestra.run.smithi195.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985" 2024-05-08T23:08:17.725 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-05-08T23:08:17.725 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-05-08T23:08:21.766 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-05-08T23:08:21.876 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T23:08:21.876 INFO:teuthology.orchestra.run.smithi179.stdout: "image_id": "af23193ff691dd58bee78ea954b569105e41c41def20b81a25baa1d30500ad1c", 2024-05-08T23:08:21.876 INFO:teuthology.orchestra.run.smithi179.stdout: "repo_digests": [ 2024-05-08T23:08:21.877 INFO:teuthology.orchestra.run.smithi179.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985" 2024-05-08T23:08:21.877 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-05-08T23:08:21.877 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-05-08T23:08:24.274 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:08:24.274 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T23:08:24.275 INFO:teuthology.orchestra.run.smithi135.stdout: "image_id": "af23193ff691dd58bee78ea954b569105e41c41def20b81a25baa1d30500ad1c", 2024-05-08T23:08:24.275 INFO:teuthology.orchestra.run.smithi135.stdout: "repo_digests": [ 2024-05-08T23:08:24.275 INFO:teuthology.orchestra.run.smithi135.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985" 2024-05-08T23:08:24.275 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-08T23:08:24.275 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:08:24.293 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph 2024-05-08T23:08:24.325 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph 2024-05-08T23:08:24.362 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph 2024-05-08T23:08:24.400 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /etc/ceph 2024-05-08T23:08:24.427 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /etc/ceph 2024-05-08T23:08:24.458 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /etc/ceph 2024-05-08T23:08:24.488 INFO:tasks.cephadm:Writing seed config... 2024-05-08T23:08:24.490 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-08T23:08:24.490 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-08T23:08:24.490 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-08T23:08:24.490 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-08T23:08:24.490 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-08T23:08:24.490 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-05-08T23:08:24.490 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-08T23:08:24.490 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-08T23:08:24.490 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-08T23:08:24.490 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-08T23:08:24.490 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-08T23:08:24.490 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-08T23:08:24.491 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-08T23:08:24.491 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-08T23:08:24.491 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-08T23:08:24.491 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-08T23:08:24.491 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-08T23:08:24.491 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-05-08T23:08:24.491 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-05-08T23:08:24.491 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-08T23:08:24.491 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-08T23:08:24.492 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-08T23:08:24.492 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-08T23:08:24.492 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-08T23:08:24.492 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-08T23:08:24.492 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-08T23:08:24.493 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-08T23:08:24.493 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-08T23:08:24.493 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-08T23:08:24.493 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-08T23:08:24.493 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-05-08T23:08:24.493 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-08T23:08:24.493 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-05-08T23:08:24.493 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-05-08T23:08:24.493 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-08T23:08:24.493 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-08T23:08:24.493 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-05-08T23:08:24.493 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-08T23:08:24.493 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-08T23:08:24.493 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-08T23:08:24.493 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-08T23:08:24.494 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-08T23:08:24.494 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-08T23:08:24.494 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-08T23:08:24.494 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-05-08T23:08:24.495 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:08:24.495 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-08T23:08:24.511 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c804a50a-0d8f-11ef-bc97-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-08T23:08:24.511 DEBUG:teuthology.orchestra.run.smithi135:mon.a> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mon.a.service 2024-05-08T23:08:24.553 DEBUG:teuthology.orchestra.run.smithi135:mgr.x> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mgr.x.service 2024-05-08T23:08:24.579 INFO:journalctl@ceph.mon.a.smithi135.stdout:-- Logs begin at Wed 2024-05-08 22:52:39 UTC. -- 2024-05-08T23:08:24.580 INFO:tasks.cephadm:Bootstrapping... 2024-05-08T23:08:24.580 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 -v bootstrap --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.135 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-08T23:08:24.604 INFO:journalctl@ceph.mgr.x.smithi135.stdout:-- Logs begin at Wed 2024-05-08 22:52:39 UTC. -- 2024-05-08T23:08:24.738 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:08:24.738 INFO:teuthology.orchestra.run.smithi135.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34', '-v', 'bootstrap', '--fsid', 'c804a50a-0d8f-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.135', '--skip-admin-label'] 2024-05-08T23:08:24.767 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stdout 4.6.1 2024-05-08T23:08:24.767 INFO:teuthology.orchestra.run.smithi135.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-08T23:08:24.767 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying podman|docker is present... 2024-05-08T23:08:24.807 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stdout 4.6.1 2024-05-08T23:08:24.807 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying lvm2 is present... 2024-05-08T23:08:24.807 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying time synchronization is in place... 2024-05-08T23:08:24.814 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-08T23:08:24.814 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-08T23:08:24.820 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-08T23:08:24.820 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-05-08T23:08:24.826 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout enabled 2024-05-08T23:08:24.831 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout active 2024-05-08T23:08:24.832 INFO:teuthology.orchestra.run.smithi135.stdout:Unit chronyd.service is enabled and running 2024-05-08T23:08:24.832 INFO:teuthology.orchestra.run.smithi135.stdout:Repeating the final host check... 2024-05-08T23:08:24.859 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stdout 4.6.1 2024-05-08T23:08:24.859 INFO:teuthology.orchestra.run.smithi135.stdout:podman (/bin/podman) version 4.6.1 is present 2024-05-08T23:08:24.859 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl is present 2024-05-08T23:08:24.859 INFO:teuthology.orchestra.run.smithi135.stdout:lvcreate is present 2024-05-08T23:08:24.865 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-08T23:08:24.865 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-08T23:08:24.871 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-08T23:08:24.871 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-05-08T23:08:24.876 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout enabled 2024-05-08T23:08:24.882 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout active 2024-05-08T23:08:24.883 INFO:teuthology.orchestra.run.smithi135.stdout:Unit chronyd.service is enabled and running 2024-05-08T23:08:24.883 INFO:teuthology.orchestra.run.smithi135.stdout:Host looks OK 2024-05-08T23:08:24.883 INFO:teuthology.orchestra.run.smithi135.stdout:Cluster fsid: c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:08:24.883 INFO:teuthology.orchestra.run.smithi135.stdout:Acquiring lock 139898755025384 on /run/cephadm/c804a50a-0d8f-11ef-bc97-c7b262605968.lock 2024-05-08T23:08:24.883 INFO:teuthology.orchestra.run.smithi135.stdout:Lock 139898755025384 acquired on /run/cephadm/c804a50a-0d8f-11ef-bc97-c7b262605968.lock 2024-05-08T23:08:24.884 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying IP 172.21.15.135 port 3300 ... 2024-05-08T23:08:24.884 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying IP 172.21.15.135 port 6789 ... 2024-05-08T23:08:24.884 INFO:teuthology.orchestra.run.smithi135.stdout:Base mon IP(s) is [172.21.15.135:3300, 172.21.15.135:6789], mon addrv is [v2:172.21.15.135:3300,v1:172.21.15.135:6789] 2024-05-08T23:08:24.887 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2024-05-08T23:08:24.888 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.135 metric 100 2024-05-08T23:08:24.890 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-08T23:08:24.890 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-05-08T23:08:24.890 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-05-08T23:08:24.893 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-08T23:08:24.894 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-08T23:08:24.894 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-08T23:08:24.894 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-08T23:08:24.894 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout inet6 fe80::f5ee:27a9:fa5:c23b/64 scope link noprefixroute 2024-05-08T23:08:24.894 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-08T23:08:24.894 INFO:teuthology.orchestra.run.smithi135.stdout:Mon IP `172.21.15.135` is in CIDR network `172.21.0.0/20` 2024-05-08T23:08:24.894 INFO:teuthology.orchestra.run.smithi135.stdout:Mon IP `172.21.15.135` is in CIDR network `172.21.0.0/20` 2024-05-08T23:08:24.894 INFO:teuthology.orchestra.run.smithi135.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-08T23:08:24.895 INFO:teuthology.orchestra.run.smithi135.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-08T23:08:24.895 INFO:teuthology.orchestra.run.smithi135.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34... 2024-05-08T23:08:25.240 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stdout af23193ff691dd58bee78ea954b569105e41c41def20b81a25baa1d30500ad1c 2024-05-08T23:08:25.241 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34... 2024-05-08T23:08:25.241 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Getting image source signatures 2024-05-08T23:08:25.241 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Copying blob sha256:7850648fa4707607dddc5eec7674b8c9296086cf87f20a8b1acf1b014b952e9f 2024-05-08T23:08:25.241 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-08T23:08:25.241 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Copying config sha256:af23193ff691dd58bee78ea954b569105e41c41def20b81a25baa1d30500ad1c 2024-05-08T23:08:25.241 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-08T23:08:25.922 INFO:teuthology.orchestra.run.smithi135.stdout:ceph: stdout ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable) 2024-05-08T23:08:25.922 INFO:teuthology.orchestra.run.smithi135.stdout:Ceph version: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable) 2024-05-08T23:08:25.922 INFO:teuthology.orchestra.run.smithi135.stdout:Extracting ceph user uid/gid from container image... 2024-05-08T23:08:26.519 INFO:teuthology.orchestra.run.smithi135.stdout:stat: stdout 167 167 2024-05-08T23:08:26.520 INFO:teuthology.orchestra.run.smithi135.stdout:Creating initial keys... 2024-05-08T23:08:27.081 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph-authtool: stdout AQDqBTxmTtbILBAAVbfqEoixLpVD4EiTRhyYLg== 2024-05-08T23:08:27.657 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph-authtool: stdout AQDrBTxmHjXsEhAA3jDzuifl0RFTQ8euFX7ZwQ== 2024-05-08T23:08:28.721 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph-authtool: stdout AQDsBTxmCs1WChAASu3G/X554cVfSoovIZvAyA== 2024-05-08T23:08:28.721 INFO:teuthology.orchestra.run.smithi135.stdout:Creating initial monmap... 2024-05-08T23:08:29.350 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-08T23:08:29.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-05-08T23:08:29.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:08:29.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-08T23:08:29.351 INFO:teuthology.orchestra.run.smithi135.stdout:monmaptool for a [v2:172.21.15.135:3300,v1:172.21.15.135:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-08T23:08:29.351 INFO:teuthology.orchestra.run.smithi135.stdout:setting min_mon_release = pacific 2024-05-08T23:08:29.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: set fsid to c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:08:29.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-08T23:08:29.351 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:08:29.351 INFO:teuthology.orchestra.run.smithi135.stdout:Creating mon... 2024-05-08T23:08:29.925 INFO:teuthology.orchestra.run.smithi135.stdout:create mon.a on 2024-05-08T23:08:30.067 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-05-08T23:08:30.158 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-08T23:08:30.278 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c804a50a-0d8f-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-c804a50a-0d8f-11ef-bc97-c7b262605968.target. 2024-05-08T23:08:30.279 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c804a50a-0d8f-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-c804a50a-0d8f-11ef-bc97-c7b262605968.target. 2024-05-08T23:08:30.438 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mon.a 2024-05-08T23:08:30.439 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mon.a.service: Unit ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mon.a.service not loaded. 2024-05-08T23:08:30.526 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c804a50a-0d8f-11ef-bc97-c7b262605968.target.wants/ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mon.a.service → /etc/systemd/system/ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@.service. 2024-05-08T23:08:30.535 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:30 smithi135 systemd[1]: Starting Ceph mon.a for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:08:30.920 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T23:08:30.921 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout disabled 2024-05-08T23:08:30.928 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T23:08:30.929 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-05-08T23:08:30.929 INFO:teuthology.orchestra.run.smithi135.stdout:firewalld.service is not enabled 2024-05-08T23:08:30.929 INFO:teuthology.orchestra.run.smithi135.stdout:Not possible to enable service . firewalld.service is not available 2024-05-08T23:08:30.929 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mon to start... 2024-05-08T23:08:30.929 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mon... 2024-05-08T23:08:31.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:30 smithi135 bash[41922]: 8ff86eb11f3dba8da9fa35eb05b18d5544194df7a5ec2bace654fa4cddb3e804 2024-05-08T23:08:31.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:30 smithi135 systemd[1]: Started Ceph mon.a for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:08:31.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:30 smithi135 ceph-mon[41959]: mkfs c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:08:31.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:30 smithi135 ceph-mon[41959]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T23:08:31.747 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout cluster: 2024-05-08T23:08:31.748 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout id: c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:08:31.748 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-08T23:08:31.748 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-08T23:08:31.748 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout services: 2024-05-08T23:08:31.748 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.458043s) 2024-05-08T23:08:31.748 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-08T23:08:31.748 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-08T23:08:31.748 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-08T23:08:31.748 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout data: 2024-05-08T23:08:31.748 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-08T23:08:31.748 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-08T23:08:31.749 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-08T23:08:31.749 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout pgs: 2024-05-08T23:08:31.749 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-08T23:08:31.749 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.323+0000 7ff42a9fb700 1 Processor -- start 2024-05-08T23:08:31.749 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.323+0000 7ff42a9fb700 1 -- start start 2024-05-08T23:08:31.749 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.323+0000 7ff42a9fb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff424106720 0x7ff424106b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:31.749 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.323+0000 7ff42a9fb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff424107110 con 0x7ff424106720 2024-05-08T23:08:31.749 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.324+0000 7ff423fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff424106720 0x7ff424106b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:31.749 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.324+0000 7ff423fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff424106720 0x7ff424106b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35766/0 (socket says 172.21.15.135:35766) 2024-05-08T23:08:31.749 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.324+0000 7ff423fff700 1 -- 172.21.15.135:0/2614090570 learned_addr learned my addr 172.21.15.135:0/2614090570 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:31.750 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.324+0000 7ff423fff700 1 -- 172.21.15.135:0/2614090570 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff424107920 con 0x7ff424106720 2024-05-08T23:08:31.750 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.324+0000 7ff423fff700 1 --2- 172.21.15.135:0/2614090570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff424106720 0x7ff424106b40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff4140098a0 tx=0x7ff414009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1252573fee734cf2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:31.750 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.324+0000 7ff422ffd700 1 -- 172.21.15.135:0/2614090570 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff414004160 con 0x7ff424106720 2024-05-08T23:08:31.750 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.324+0000 7ff422ffd700 1 -- 172.21.15.135:0/2614090570 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4140042c0 con 0x7ff424106720 2024-05-08T23:08:31.750 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.324+0000 7ff422ffd700 1 -- 172.21.15.135:0/2614090570 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4140045a0 con 0x7ff424106720 2024-05-08T23:08:31.750 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.325+0000 7ff42a9fb700 1 -- 172.21.15.135:0/2614090570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff424106720 msgr2=0x7ff424106b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:31.750 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.325+0000 7ff42a9fb700 1 --2- 172.21.15.135:0/2614090570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff424106720 0x7ff424106b40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff4140098a0 tx=0x7ff414009bb0 comp rx=0 tx=0).stop 2024-05-08T23:08:31.750 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.325+0000 7ff42a9fb700 1 -- 172.21.15.135:0/2614090570 shutdown_connections 2024-05-08T23:08:31.750 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.325+0000 7ff42a9fb700 1 --2- 172.21.15.135:0/2614090570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff424106720 0x7ff424106b40 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:31.750 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.325+0000 7ff42a9fb700 1 -- 172.21.15.135:0/2614090570 >> 172.21.15.135:0/2614090570 conn(0x7ff424101ca0 msgr2=0x7ff424104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:31.751 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.325+0000 7ff42a9fb700 1 -- 172.21.15.135:0/2614090570 shutdown_connections 2024-05-08T23:08:31.751 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.325+0000 7ff42a9fb700 1 -- 172.21.15.135:0/2614090570 wait complete. 2024-05-08T23:08:31.751 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.325+0000 7ff42a9fb700 1 Processor -- start 2024-05-08T23:08:31.751 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.326+0000 7ff42a9fb700 1 -- start start 2024-05-08T23:08:31.751 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.326+0000 7ff42a9fb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff424106720 0x7ff42407bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:31.751 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.326+0000 7ff42a9fb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42407c080 con 0x7ff424106720 2024-05-08T23:08:31.751 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.326+0000 7ff423fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff424106720 0x7ff42407bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:31.751 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.326+0000 7ff423fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff424106720 0x7ff42407bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35782/0 (socket says 172.21.15.135:35782) 2024-05-08T23:08:31.751 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.326+0000 7ff423fff700 1 -- 172.21.15.135:0/268504378 learned_addr learned my addr 172.21.15.135:0/268504378 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:31.751 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.326+0000 7ff423fff700 1 -- 172.21.15.135:0/268504378 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff414009550 con 0x7ff424106720 2024-05-08T23:08:31.751 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.326+0000 7ff423fff700 1 --2- 172.21.15.135:0/268504378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff424106720 0x7ff42407bb40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff414004000 tx=0x7ff414004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:31.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.327+0000 7ff4217fa700 1 -- 172.21.15.135:0/268504378 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff414011630 con 0x7ff424106720 2024-05-08T23:08:31.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.327+0000 7ff4217fa700 1 -- 172.21.15.135:0/268504378 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff414011790 con 0x7ff424106720 2024-05-08T23:08:31.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.327+0000 7ff42a9fb700 1 -- 172.21.15.135:0/268504378 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42407a2c0 con 0x7ff424106720 2024-05-08T23:08:31.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.327+0000 7ff4217fa700 1 -- 172.21.15.135:0/268504378 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff414011a30 con 0x7ff424106720 2024-05-08T23:08:31.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.327+0000 7ff42a9fb700 1 -- 172.21.15.135:0/268504378 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42407a760 con 0x7ff424106720 2024-05-08T23:08:31.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.327+0000 7ff4217fa700 1 -- 172.21.15.135:0/268504378 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff414022070 con 0x7ff424106720 2024-05-08T23:08:31.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.327+0000 7ff4217fa700 1 -- 172.21.15.135:0/268504378 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff41401c450 con 0x7ff424106720 2024-05-08T23:08:31.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.327+0000 7ff42a9fb700 1 -- 172.21.15.135:0/268504378 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4240625d0 con 0x7ff424106720 2024-05-08T23:08:31.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.330+0000 7ff4217fa700 1 -- 172.21.15.135:0/268504378 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7ff41401b450 con 0x7ff424106720 2024-05-08T23:08:31.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.400+0000 7ff42a9fb700 1 -- 172.21.15.135:0/268504378 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7ff424107ea0 con 0x7ff424106720 2024-05-08T23:08:31.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.400+0000 7ff4217fa700 1 -- 172.21.15.135:0/268504378 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7ff41401b5f0 con 0x7ff424106720 2024-05-08T23:08:31.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.401+0000 7ff42a9fb700 1 -- 172.21.15.135:0/268504378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff424106720 msgr2=0x7ff42407bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:31.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.401+0000 7ff42a9fb700 1 --2- 172.21.15.135:0/268504378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff424106720 0x7ff42407bb40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff414004000 tx=0x7ff414004750 comp rx=0 tx=0).stop 2024-05-08T23:08:31.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.401+0000 7ff42a9fb700 1 -- 172.21.15.135:0/268504378 shutdown_connections 2024-05-08T23:08:31.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.401+0000 7ff42a9fb700 1 --2- 172.21.15.135:0/268504378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff424106720 0x7ff42407bb40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:31.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.401+0000 7ff42a9fb700 1 -- 172.21.15.135:0/268504378 >> 172.21.15.135:0/268504378 conn(0x7ff424101ca0 msgr2=0x7ff424190ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:31.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.401+0000 7ff42a9fb700 1 -- 172.21.15.135:0/268504378 shutdown_connections 2024-05-08T23:08:31.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:31.401+0000 7ff42a9fb700 1 -- 172.21.15.135:0/268504378 wait complete. 2024-05-08T23:08:31.753 INFO:teuthology.orchestra.run.smithi135.stdout:mon is available 2024-05-08T23:08:31.753 INFO:teuthology.orchestra.run.smithi135.stdout:Assimilating anything we can from ceph.conf... 2024-05-08T23:08:31.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:31 smithi135 ceph-mon[41959]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T23:08:31.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:31 smithi135 ceph-mon[41959]: monmap e1: 1 mons at {a=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:08:31.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:31 smithi135 ceph-mon[41959]: fsmap 2024-05-08T23:08:31.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:31 smithi135 ceph-mon[41959]: osdmap e1: 0 total, 0 up, 0 in 2024-05-08T23:08:31.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:31 smithi135 ceph-mon[41959]: mgrmap e1: no daemons active 2024-05-08T23:08:31.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:31 smithi135 ceph-mon[41959]: from='client.? 172.21.15.135:0/268504378' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-08T23:08:32.505 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-08T23:08:32.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [global] 2024-05-08T23:08:32.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout fsid = c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:08:32.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.135:3300,v1:172.21.15.135:6789] 2024-05-08T23:08:32.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-08T23:08:32.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-08T23:08:32.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-08T23:08:32.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-08T23:08:32.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-08T23:08:32.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-08T23:08:32.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-08T23:08:32.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-08T23:08:32.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [osd] 2024-05-08T23:08:32.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-08T23:08:32.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-08T23:08:32.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-08T23:08:32.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-08T23:08:32.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-08T23:08:32.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.081+0000 7fc144e60700 1 Processor -- start 2024-05-08T23:08:32.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.081+0000 7fc144e60700 1 -- start start 2024-05-08T23:08:32.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.081+0000 7fc144e60700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc140105010 0x7fc140105430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:32.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.081+0000 7fc144e60700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc140079e50 con 0x7fc140105010 2024-05-08T23:08:32.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.081+0000 7fc13e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc140105010 0x7fc140105430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:32.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.081+0000 7fc13e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc140105010 0x7fc140105430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35784/0 (socket says 172.21.15.135:35784) 2024-05-08T23:08:32.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.081+0000 7fc13e59c700 1 -- 172.21.15.135:0/746483288 learned_addr learned my addr 172.21.15.135:0/746483288 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:32.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.081+0000 7fc13e59c700 1 -- 172.21.15.135:0/746483288 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc140105970 con 0x7fc140105010 2024-05-08T23:08:32.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.082+0000 7fc13e59c700 1 --2- 172.21.15.135:0/746483288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc140105010 0x7fc140105430 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098a0 tx=0x7fc130009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b961080e3dcf55 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:32.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.082+0000 7fc13d59a700 1 -- 172.21.15.135:0/746483288 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc130004160 con 0x7fc140105010 2024-05-08T23:08:32.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.082+0000 7fc13d59a700 1 -- 172.21.15.135:0/746483288 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1300042c0 con 0x7fc140105010 2024-05-08T23:08:32.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.082+0000 7fc13d59a700 1 -- 172.21.15.135:0/746483288 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1300045a0 con 0x7fc140105010 2024-05-08T23:08:32.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.082+0000 7fc144e60700 1 -- 172.21.15.135:0/746483288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc140105010 msgr2=0x7fc140105430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:32.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.082+0000 7fc144e60700 1 --2- 172.21.15.135:0/746483288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc140105010 0x7fc140105430 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098a0 tx=0x7fc130009bb0 comp rx=0 tx=0).stop 2024-05-08T23:08:32.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.082+0000 7fc144e60700 1 -- 172.21.15.135:0/746483288 shutdown_connections 2024-05-08T23:08:32.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.082+0000 7fc144e60700 1 --2- 172.21.15.135:0/746483288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc140105010 0x7fc140105430 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:32.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.082+0000 7fc144e60700 1 -- 172.21.15.135:0/746483288 >> 172.21.15.135:0/746483288 conn(0x7fc140100bd0 msgr2=0x7fc140103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:32.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.082+0000 7fc144e60700 1 -- 172.21.15.135:0/746483288 shutdown_connections 2024-05-08T23:08:32.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.083+0000 7fc144e60700 1 -- 172.21.15.135:0/746483288 wait complete. 2024-05-08T23:08:32.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.083+0000 7fc144e60700 1 Processor -- start 2024-05-08T23:08:32.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.083+0000 7fc144e60700 1 -- start start 2024-05-08T23:08:32.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.084+0000 7fc144e60700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc140105010 0x7fc14019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:32.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.084+0000 7fc144e60700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14019c360 con 0x7fc140105010 2024-05-08T23:08:32.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.084+0000 7fc13e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc140105010 0x7fc14019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:32.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.084+0000 7fc13e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc140105010 0x7fc14019be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35792/0 (socket says 172.21.15.135:35792) 2024-05-08T23:08:32.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.084+0000 7fc13e59c700 1 -- 172.21.15.135:0/796901493 learned_addr learned my addr 172.21.15.135:0/796901493 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:32.509 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.084+0000 7fc13e59c700 1 -- 172.21.15.135:0/796901493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc130009550 con 0x7fc140105010 2024-05-08T23:08:32.509 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.084+0000 7fc13e59c700 1 --2- 172.21.15.135:0/796901493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc140105010 0x7fc14019be20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc140079290 tx=0x7fc130004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:32.509 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.084+0000 7fc12f7fe700 1 -- 172.21.15.135:0/796901493 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc130011630 con 0x7fc140105010 2024-05-08T23:08:32.509 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.084+0000 7fc12f7fe700 1 -- 172.21.15.135:0/796901493 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc130011790 con 0x7fc140105010 2024-05-08T23:08:32.509 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.084+0000 7fc144e60700 1 -- 172.21.15.135:0/796901493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14019c560 con 0x7fc140105010 2024-05-08T23:08:32.509 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.084+0000 7fc12f7fe700 1 -- 172.21.15.135:0/796901493 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc130011a30 con 0x7fc140105010 2024-05-08T23:08:32.509 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.084+0000 7fc144e60700 1 -- 172.21.15.135:0/796901493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14019ca00 con 0x7fc140105010 2024-05-08T23:08:32.509 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.085+0000 7fc12f7fe700 1 -- 172.21.15.135:0/796901493 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc130022070 con 0x7fc140105010 2024-05-08T23:08:32.509 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.085+0000 7fc12f7fe700 1 -- 172.21.15.135:0/796901493 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc13001c450 con 0x7fc140105010 2024-05-08T23:08:32.509 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.085+0000 7fc144e60700 1 -- 172.21.15.135:0/796901493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc140195aa0 con 0x7fc140105010 2024-05-08T23:08:32.509 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.088+0000 7fc12f7fe700 1 -- 172.21.15.135:0/796901493 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fc13001b450 con 0x7fc140105010 2024-05-08T23:08:32.509 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.155+0000 7fc144e60700 1 -- 172.21.15.135:0/796901493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fc140105ce0 con 0x7fc140105010 2024-05-08T23:08:32.509 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.159+0000 7fc12f7fe700 1 -- 172.21.15.135:0/796901493 <== mon.0 v2:172.21.15.135:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc13001b5f0 con 0x7fc140105010 2024-05-08T23:08:32.509 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.159+0000 7fc12f7fe700 1 -- 172.21.15.135:0/796901493 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7fc130036590 con 0x7fc140105010 2024-05-08T23:08:32.510 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.160+0000 7fc144e60700 1 -- 172.21.15.135:0/796901493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc140105010 msgr2=0x7fc14019be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:32.510 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.160+0000 7fc144e60700 1 --2- 172.21.15.135:0/796901493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc140105010 0x7fc14019be20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc140079290 tx=0x7fc130004750 comp rx=0 tx=0).stop 2024-05-08T23:08:32.510 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.160+0000 7fc144e60700 1 -- 172.21.15.135:0/796901493 shutdown_connections 2024-05-08T23:08:32.510 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.160+0000 7fc144e60700 1 --2- 172.21.15.135:0/796901493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc140105010 0x7fc14019be20 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:32.510 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.160+0000 7fc144e60700 1 -- 172.21.15.135:0/796901493 >> 172.21.15.135:0/796901493 conn(0x7fc140100bd0 msgr2=0x7fc140192be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:32.510 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.160+0000 7fc144e60700 1 -- 172.21.15.135:0/796901493 shutdown_connections 2024-05-08T23:08:32.510 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.160+0000 7fc144e60700 1 -- 172.21.15.135:0/796901493 wait complete. 2024-05-08T23:08:32.510 INFO:teuthology.orchestra.run.smithi135.stdout:Generating new minimal ceph.conf... 2024-05-08T23:08:33.201 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:32 smithi135 ceph-mon[41959]: from='client.? 172.21.15.135:0/796901493' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-08T23:08:33.201 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:32 smithi135 ceph-mon[41959]: from='client.? 172.21.15.135:0/796901493' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-08T23:08:33.201 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:32 smithi135 ceph-mon[41959]: from='client.? 172.21.15.135:0/3903155040' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:08:33.279 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.861+0000 7fa7567ac700 1 Processor -- start 2024-05-08T23:08:33.279 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.861+0000 7fa7567ac700 1 -- start start 2024-05-08T23:08:33.279 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.861+0000 7fa7567ac700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa750105630 0x7fa750105a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:33.279 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.862+0000 7fa7567ac700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa750106020 con 0x7fa750105630 2024-05-08T23:08:33.279 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.862+0000 7fa74ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa750105630 0x7fa750105a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:33.279 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.862+0000 7fa74ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa750105630 0x7fa750105a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35808/0 (socket says 172.21.15.135:35808) 2024-05-08T23:08:33.279 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.862+0000 7fa74ffff700 1 -- 172.21.15.135:0/3040277082 learned_addr learned my addr 172.21.15.135:0/3040277082 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:33.279 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.862+0000 7fa74ffff700 1 -- 172.21.15.135:0/3040277082 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa750106830 con 0x7fa750105630 2024-05-08T23:08:33.280 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.862+0000 7fa74ffff700 1 --2- 172.21.15.135:0/3040277082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa750105630 0x7fa750105a50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa7400098a0 tx=0x7fa740009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784526252683faf4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:33.280 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.862+0000 7fa74effd700 1 -- 172.21.15.135:0/3040277082 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa740004160 con 0x7fa750105630 2024-05-08T23:08:33.280 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.862+0000 7fa74effd700 1 -- 172.21.15.135:0/3040277082 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa7400042c0 con 0x7fa750105630 2024-05-08T23:08:33.280 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.862+0000 7fa74effd700 1 -- 172.21.15.135:0/3040277082 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa740011a00 con 0x7fa750105630 2024-05-08T23:08:33.280 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.863+0000 7fa7567ac700 1 -- 172.21.15.135:0/3040277082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa750105630 msgr2=0x7fa750105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:33.280 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.863+0000 7fa7567ac700 1 --2- 172.21.15.135:0/3040277082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa750105630 0x7fa750105a50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa7400098a0 tx=0x7fa740009bb0 comp rx=0 tx=0).stop 2024-05-08T23:08:33.280 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.863+0000 7fa7567ac700 1 -- 172.21.15.135:0/3040277082 shutdown_connections 2024-05-08T23:08:33.280 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.863+0000 7fa7567ac700 1 --2- 172.21.15.135:0/3040277082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa750105630 0x7fa750105a50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:33.280 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.863+0000 7fa7567ac700 1 -- 172.21.15.135:0/3040277082 >> 172.21.15.135:0/3040277082 conn(0x7fa750100bd0 msgr2=0x7fa750103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:33.280 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.863+0000 7fa7567ac700 1 -- 172.21.15.135:0/3040277082 shutdown_connections 2024-05-08T23:08:33.280 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.863+0000 7fa7567ac700 1 -- 172.21.15.135:0/3040277082 wait complete. 2024-05-08T23:08:33.280 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.863+0000 7fa7567ac700 1 Processor -- start 2024-05-08T23:08:33.280 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.864+0000 7fa7567ac700 1 -- start start 2024-05-08T23:08:33.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.864+0000 7fa7567ac700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa75019a770 0x7fa75019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:33.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.864+0000 7fa7567ac700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75019b0d0 con 0x7fa75019a770 2024-05-08T23:08:33.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.864+0000 7fa74ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa75019a770 0x7fa75019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:33.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.864+0000 7fa74ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa75019a770 0x7fa75019ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35824/0 (socket says 172.21.15.135:35824) 2024-05-08T23:08:33.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.864+0000 7fa74ffff700 1 -- 172.21.15.135:0/3903155040 learned_addr learned my addr 172.21.15.135:0/3903155040 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:33.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.864+0000 7fa74ffff700 1 -- 172.21.15.135:0/3903155040 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa740009550 con 0x7fa75019a770 2024-05-08T23:08:33.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.864+0000 7fa74ffff700 1 --2- 172.21.15.135:0/3903155040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa75019a770 0x7fa75019ab90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa740009fb0 tx=0x7fa740012fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:33.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.865+0000 7fa74d7fa700 1 -- 172.21.15.135:0/3903155040 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7400037d0 con 0x7fa75019a770 2024-05-08T23:08:33.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.865+0000 7fa74d7fa700 1 -- 172.21.15.135:0/3903155040 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa74001f070 con 0x7fa75019a770 2024-05-08T23:08:33.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.865+0000 7fa7567ac700 1 -- 172.21.15.135:0/3903155040 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75019b2d0 con 0x7fa75019a770 2024-05-08T23:08:33.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.865+0000 7fa74d7fa700 1 -- 172.21.15.135:0/3903155040 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa74001add0 con 0x7fa75019a770 2024-05-08T23:08:33.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.865+0000 7fa7567ac700 1 -- 172.21.15.135:0/3903155040 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75019ddf0 con 0x7fa75019a770 2024-05-08T23:08:33.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.865+0000 7fa74d7fa700 1 -- 172.21.15.135:0/3903155040 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa74001b440 con 0x7fa75019a770 2024-05-08T23:08:33.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.865+0000 7fa74d7fa700 1 -- 172.21.15.135:0/3903155040 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa740021070 con 0x7fa75019a770 2024-05-08T23:08:33.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.866+0000 7fa7567ac700 1 -- 172.21.15.135:0/3903155040 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa750194690 con 0x7fa75019a770 2024-05-08T23:08:33.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.868+0000 7fa74d7fa700 1 -- 172.21.15.135:0/3903155040 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fa74002a060 con 0x7fa75019a770 2024-05-08T23:08:33.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.936+0000 7fa7567ac700 1 -- 172.21.15.135:0/3903155040 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fa750109b50 con 0x7fa75019a770 2024-05-08T23:08:33.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.936+0000 7fa74d7fa700 1 -- 172.21.15.135:0/3903155040 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7fa74001a5d0 con 0x7fa75019a770 2024-05-08T23:08:33.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.937+0000 7fa7567ac700 1 -- 172.21.15.135:0/3903155040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa75019a770 msgr2=0x7fa75019ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:33.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.937+0000 7fa7567ac700 1 --2- 172.21.15.135:0/3903155040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa75019a770 0x7fa75019ab90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa740009fb0 tx=0x7fa740012fb0 comp rx=0 tx=0).stop 2024-05-08T23:08:33.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.937+0000 7fa7567ac700 1 -- 172.21.15.135:0/3903155040 shutdown_connections 2024-05-08T23:08:33.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.937+0000 7fa7567ac700 1 --2- 172.21.15.135:0/3903155040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa75019a770 0x7fa75019ab90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:33.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.937+0000 7fa7567ac700 1 -- 172.21.15.135:0/3903155040 >> 172.21.15.135:0/3903155040 conn(0x7fa750100bd0 msgr2=0x7fa750101c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:33.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.937+0000 7fa7567ac700 1 -- 172.21.15.135:0/3903155040 shutdown_connections 2024-05-08T23:08:33.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:32.937+0000 7fa7567ac700 1 -- 172.21.15.135:0/3903155040 wait complete. 2024-05-08T23:08:33.283 INFO:teuthology.orchestra.run.smithi135.stdout:Restarting the monitor... 2024-05-08T23:08:33.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:33 smithi135 systemd[1]: Stopping Ceph mon.a for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:08:33.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:33 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mon-a[41936]: 2024-05-08T23:08:33.665+0000 7fb17e19c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:08:33.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:33 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mon-a[41936]: 2024-05-08T23:08:33.665+0000 7fb17e19c700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-08T23:08:35.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:35 smithi135 bash[42283]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mon-a 2024-05-08T23:08:35.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:35 smithi135 systemd[1]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mon.a.service: Succeeded. 2024-05-08T23:08:35.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:35 smithi135 systemd[1]: Stopped Ceph mon.a for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:08:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:35 smithi135 systemd[1]: Starting Ceph mon.a for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:08:36.200 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: set uid:gid to 167:167 (ceph:ceph) 2024-05-08T23:08:36.209 INFO:teuthology.orchestra.run.smithi135.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-08T23:08:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable), process ceph-mon, pid 7 2024-05-08T23:08:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: pidfile_write: ignore empty --pid-file 2024-05-08T23:08:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: load: jerasure load: lrc 2024-05-08T23:08:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 bash[42402]: 28170a0ea9f3b1d510d626c28b26b684ad5abfcafee228ec572dfdbbc35f6307 2024-05-08T23:08:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: RocksDB version: 7.9.2 2024-05-08T23:08:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Git sha 0 2024-05-08T23:08:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Compile date 2024-05-08 17:55:50 2024-05-08T23:08:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: DB SUMMARY 2024-05-08T23:08:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: DB Session ID: GBB2EEOE09QTQTQ5SDLI 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: CURRENT file: CURRENT 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: IDENTITY file: IDENTITY 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99259 ; 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.error_if_exists: 0 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.create_if_missing: 0 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.paranoid_checks: 1 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.env: 0x564a1b793820 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.fs: PosixFileSystem 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.info_log: 0x564a1ce21520 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_file_opening_threads: 16 2024-05-08T23:08:36.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.statistics: (nil) 2024-05-08T23:08:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.use_fsync: 0 2024-05-08T23:08:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_log_file_size: 0 2024-05-08T23:08:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-08T23:08:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-08T23:08:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.keep_log_file_num: 1000 2024-05-08T23:08:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.recycle_log_file_num: 0 2024-05-08T23:08:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.allow_fallocate: 1 2024-05-08T23:08:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.allow_mmap_reads: 0 2024-05-08T23:08:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.allow_mmap_writes: 0 2024-05-08T23:08:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.use_direct_reads: 0 2024-05-08T23:08:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-08T23:08:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.create_missing_column_families: 0 2024-05-08T23:08:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.db_log_dir: 2024-05-08T23:08:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.wal_dir: 2024-05-08T23:08:36.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-08T23:08:36.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-08T23:08:36.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-08T23:08:36.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-08T23:08:36.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-08T23:08:36.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-08T23:08:36.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.advise_random_on_open: 1 2024-05-08T23:08:36.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.db_write_buffer_size: 0 2024-05-08T23:08:36.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.write_buffer_manager: 0x564a1c0b6320 2024-05-08T23:08:36.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-08T23:08:36.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-08T23:08:36.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-08T23:08:36.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.rate_limiter: (nil) 2024-05-08T23:08:36.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-08T23:08:36.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.wal_recovery_mode: 2 2024-05-08T23:08:36.457 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.enable_thread_tracking: 0 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.enable_pipelined_write: 0 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.unordered_write: 0 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.row_cache: None 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.wal_filter: None 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.allow_ingest_behind: 0 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.two_write_queues: 0 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.manual_wal_flush: 0 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.wal_compression: 0 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.atomic_flush: 0 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-08T23:08:36.458 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-08T23:08:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-08T23:08:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.log_readahead_size: 0 2024-05-08T23:08:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-08T23:08:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.best_efforts_recovery: 0 2024-05-08T23:08:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-08T23:08:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-08T23:08:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.allow_data_in_errors: 0 2024-05-08T23:08:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.db_host_id: __hostname__ 2024-05-08T23:08:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-08T23:08:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_background_jobs: 2 2024-05-08T23:08:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_background_compactions: -1 2024-05-08T23:08:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_subcompactions: 1 2024-05-08T23:08:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-08T23:08:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-08T23:08:36.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_total_wal_size: 0 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_open_files: -1 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.bytes_per_sync: 0 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compaction_readahead_size: 0 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_background_flushes: -1 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Compression algorithms supported: 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: kZSTD supported: 0 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: kXpressCompression supported: 0 2024-05-08T23:08:36.460 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: kLZ4HCCompression supported: 1 2024-05-08T23:08:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: kZlibCompression supported: 1 2024-05-08T23:08:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: kSnappyCompression supported: 1 2024-05-08T23:08:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: kLZ4Compression supported: 1 2024-05-08T23:08:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: kBZip2Compression supported: 0 2024-05-08T23:08:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-08T23:08:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-08T23:08:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-08T23:08:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-08T23:08:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-08T23:08:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.merge_operator: 2024-05-08T23:08:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compaction_filter: None 2024-05-08T23:08:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compaction_filter_factory: None 2024-05-08T23:08:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.sst_partitioner_factory: None 2024-05-08T23:08:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-08T23:08:36.461 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564a1ce21620) 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout: cache_index_and_filter_blocks: 1 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout: pin_top_level_index_and_filter: 1 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout: index_type: 0 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout: data_block_index_type: 0 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout: index_shortening: 1 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout: checksum: 4 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout: no_block_cache: 0 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_cache: 0x564a1c1391f0 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_cache_name: BinnedLRUCache 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_cache_options: 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout: capacity : 536870912 2024-05-08T23:08:36.462 INFO:journalctl@ceph.mon.a.smithi135.stdout: num_shard_bits : 4 2024-05-08T23:08:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout: strict_capacity_limit : 0 2024-05-08T23:08:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout: high_pri_pool_ratio: 0.000 2024-05-08T23:08:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_cache_compressed: (nil) 2024-05-08T23:08:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout: persistent_cache: (nil) 2024-05-08T23:08:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_size: 4096 2024-05-08T23:08:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_size_deviation: 10 2024-05-08T23:08:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_restart_interval: 16 2024-05-08T23:08:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout: index_block_restart_interval: 1 2024-05-08T23:08:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout: metadata_block_size: 4096 2024-05-08T23:08:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout: partition_filters: 0 2024-05-08T23:08:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout: use_delta_encoding: 1 2024-05-08T23:08:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout: filter_policy: bloomfilter 2024-05-08T23:08:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout: whole_key_filtering: 1 2024-05-08T23:08:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout: verify_compression: 0 2024-05-08T23:08:36.463 INFO:journalctl@ceph.mon.a.smithi135.stdout: read_amp_bytes_per_bit: 0 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout: format_version: 5 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout: enable_index_compression: 1 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_align: 0 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout: max_auto_readahead_size: 262144 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout: prepopulate_block_cache: 0 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout: initial_auto_readahead_size: 8192 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout: num_file_reads_for_auto_readahead: 2 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.write_buffer_size: 33554432 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_write_buffer_number: 2 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compression: NoCompression 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.bottommost_compression: Disabled 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.prefix_extractor: nullptr 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.num_levels: 7 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-08T23:08:36.464 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-08T23:08:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-08T23:08:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-08T23:08:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-08T23:08:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-08T23:08:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-08T23:08:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-08T23:08:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-08T23:08:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-08T23:08:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-08T23:08:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-08T23:08:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-08T23:08:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compression_opts.level: 32767 2024-05-08T23:08:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compression_opts.strategy: 0 2024-05-08T23:08:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-08T23:08:36.465 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-08T23:08:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-08T23:08:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-08T23:08:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compression_opts.enabled: false 2024-05-08T23:08:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-08T23:08:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-08T23:08:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-08T23:08:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-08T23:08:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.target_file_size_base: 67108864 2024-05-08T23:08:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-08T23:08:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-08T23:08:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-08T23:08:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-08T23:08:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-08T23:08:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-08T23:08:36.466 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-08T23:08:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-08T23:08:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-08T23:08:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-08T23:08:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-08T23:08:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-08T23:08:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-08T23:08:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-08T23:08:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.arena_block_size: 1048576 2024-05-08T23:08:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-08T23:08:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-08T23:08:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.disable_auto_compactions: 0 2024-05-08T23:08:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-08T23:08:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-08T23:08:36.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-08T23:08:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-08T23:08:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-08T23:08:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-08T23:08:36.468 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-08T23:08:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-08T23:08:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-08T23:08:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-08T23:08:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.table_properties_collectors: 2024-05-08T23:08:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.inplace_update_support: 0 2024-05-08T23:08:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-08T23:08:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-08T23:08:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-08T23:08:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-08T23:08:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.bloom_locality: 0 2024-05-08T23:08:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.max_successive_merges: 0 2024-05-08T23:08:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-08T23:08:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.paranoid_file_checks: 0 2024-05-08T23:08:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.force_consistency_checks: 1 2024-05-08T23:08:36.469 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.report_bg_io_stats: 0 2024-05-08T23:08:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.ttl: 2592000 2024-05-08T23:08:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-08T23:08:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-08T23:08:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-08T23:08:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.enable_blob_files: false 2024-05-08T23:08:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.min_blob_size: 0 2024-05-08T23:08:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.blob_file_size: 268435456 2024-05-08T23:08:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-08T23:08:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-08T23:08:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-08T23:08:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-08T23:08:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-08T23:08:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.blob_file_starting_level: 0 2024-05-08T23:08:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-08T23:08:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-08T23:08:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-08T23:08:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5dfbe011-d590-4611-8fc7-d209cb90e37b 2024-05-08T23:08:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715209716208098, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-08T23:08:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-08T23:08:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 systemd[1]: Started Ceph mon.a for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:08:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715209716209318, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94610, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 310, "table_properties": {"data_size": 92601, "index_size": 291, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13774, "raw_average_key_size": 50, "raw_value_size": 85090, "raw_average_value_size": 311, "num_data_blocks": 11, "num_entries": 273, "num_filter_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715209716, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5dfbe011-d590-4611-8fc7-d209cb90e37b", "db_session_id": "GBB2EEOE09QTQTQ5SDLI", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-08T23:08:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715209716209389, "job": 1, "event": "recovery_finished"} 2024-05-08T23:08:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-08T23:08:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-08T23:08:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564a1c1d6000 2024-05-08T23:08:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: DB pointer 0x564a1c1c4000 2024-05-08T23:08:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-08T23:08:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-08T23:08:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout: ** DB Stats ** 2024-05-08T23:08:36.471 INFO:journalctl@ceph.mon.a.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T23:08:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-08T23:08:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T23:08:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T23:08:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-08T23:08:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T23:08:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T23:08:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-05-08T23:08:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout: ** Compaction Stats [default] ** 2024-05-08T23:08:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T23:08:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-08T23:08:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout: L0 2/0 94.23 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T23:08:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout: Sum 2/0 94.23 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T23:08:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T23:08:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-05-08T23:08:36.472 INFO:journalctl@ceph.mon.a.smithi135.stdout: ** Compaction Stats [default] ** 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 126.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: Cumulative compaction: 0.00 GB write, 25.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: Interval compaction: 0.00 GB write, 25.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T23:08:36.473 INFO:journalctl@ceph.mon.a.smithi135.stdout: Block cache BinnedLRUCache@0x564a1c1391f0#7 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-05-08T23:08:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-08T23:08:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-05-08T23:08:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-08T23:08:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: starting mon.a rank 0 at public addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] at bind addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:08:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: mon.a@-1(???) e1 preinit fsid c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:08:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: mon.a@-1(???).mds e1 new map 2024-05-08T23:08:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: mon.a@-1(???).mds e1 print_map 2024-05-08T23:08:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout: e1 2024-05-08T23:08:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T23:08:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-08T23:08:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout: legacy client fscid: -1 2024-05-08T23:08:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-05-08T23:08:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout: No filesystems configured 2024-05-08T23:08:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-08T23:08:36.474 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:08:36.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:08:36.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:08:36.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-08T23:08:36.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T23:08:36.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: monmap e1: 1 mons at {a=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:08:36.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: fsmap 2024-05-08T23:08:36.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: osdmap e1: 0 total, 0 up, 0 in 2024-05-08T23:08:36.475 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:36 smithi135 ceph-mon[42440]: mgrmap e1: no daemons active 2024-05-08T23:08:37.103 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.616+0000 7fc5ca19f700 1 Processor -- start 2024-05-08T23:08:37.103 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.616+0000 7fc5ca19f700 1 -- start start 2024-05-08T23:08:37.103 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.616+0000 7fc5ca19f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5c41071d0 0x7fc5c41095c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:37.103 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.616+0000 7fc5ca19f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4079e90 con 0x7fc5c41071d0 2024-05-08T23:08:37.103 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.617+0000 7fc5c37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5c41071d0 0x7fc5c41095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:37.103 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.617+0000 7fc5c37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5c41071d0 0x7fc5c41095c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35830/0 (socket says 172.21.15.135:35830) 2024-05-08T23:08:37.103 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.617+0000 7fc5c37fe700 1 -- 172.21.15.135:0/4233248884 learned_addr learned my addr 172.21.15.135:0/4233248884 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:37.103 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.617+0000 7fc5c37fe700 1 -- 172.21.15.135:0/4233248884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c4109b00 con 0x7fc5c41071d0 2024-05-08T23:08:37.104 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.617+0000 7fc5c37fe700 1 --2- 172.21.15.135:0/4233248884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5c41071d0 0x7fc5c41095c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0098a0 tx=0x7fc5ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cf8401408b5f7b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:37.104 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.617+0000 7fc5c27fc700 1 -- 172.21.15.135:0/4233248884 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5ac004160 con 0x7fc5c41071d0 2024-05-08T23:08:37.104 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.617+0000 7fc5c27fc700 1 -- 172.21.15.135:0/4233248884 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc5ac0042c0 con 0x7fc5c41071d0 2024-05-08T23:08:37.104 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.617+0000 7fc5c27fc700 1 -- 172.21.15.135:0/4233248884 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5ac011a00 con 0x7fc5c41071d0 2024-05-08T23:08:37.104 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.618+0000 7fc5ca19f700 1 -- 172.21.15.135:0/4233248884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5c41071d0 msgr2=0x7fc5c41095c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:37.104 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.618+0000 7fc5ca19f700 1 --2- 172.21.15.135:0/4233248884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5c41071d0 0x7fc5c41095c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0098a0 tx=0x7fc5ac009bb0 comp rx=0 tx=0).stop 2024-05-08T23:08:37.104 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.618+0000 7fc5ca19f700 1 -- 172.21.15.135:0/4233248884 shutdown_connections 2024-05-08T23:08:37.104 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.618+0000 7fc5ca19f700 1 --2- 172.21.15.135:0/4233248884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5c41071d0 0x7fc5c41095c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:37.104 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.618+0000 7fc5ca19f700 1 -- 172.21.15.135:0/4233248884 >> 172.21.15.135:0/4233248884 conn(0x7fc5c4100bc0 msgr2=0x7fc5c4103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:37.104 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.618+0000 7fc5ca19f700 1 -- 172.21.15.135:0/4233248884 shutdown_connections 2024-05-08T23:08:37.104 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.618+0000 7fc5ca19f700 1 -- 172.21.15.135:0/4233248884 wait complete. 2024-05-08T23:08:37.104 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.618+0000 7fc5ca19f700 1 Processor -- start 2024-05-08T23:08:37.104 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.619+0000 7fc5ca19f700 1 -- start start 2024-05-08T23:08:37.104 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.619+0000 7fc5ca19f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5c41071d0 0x7fc5c419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:37.105 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.619+0000 7fc5ca19f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c419a9c0 con 0x7fc5c41071d0 2024-05-08T23:08:37.105 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.619+0000 7fc5c37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5c41071d0 0x7fc5c419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:37.105 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.619+0000 7fc5c37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5c41071d0 0x7fc5c419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35836/0 (socket says 172.21.15.135:35836) 2024-05-08T23:08:37.105 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.619+0000 7fc5c37fe700 1 -- 172.21.15.135:0/1797228400 learned_addr learned my addr 172.21.15.135:0/1797228400 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:37.105 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.619+0000 7fc5c37fe700 1 -- 172.21.15.135:0/1797228400 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac009550 con 0x7fc5c41071d0 2024-05-08T23:08:37.105 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.619+0000 7fc5c37fe700 1 --2- 172.21.15.135:0/1797228400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5c41071d0 0x7fc5c419a480 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009fb0 tx=0x7fc5ac011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:37.105 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.619+0000 7fc5c0ff9700 1 -- 172.21.15.135:0/1797228400 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5ac003a40 con 0x7fc5c41071d0 2024-05-08T23:08:37.105 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.619+0000 7fc5c0ff9700 1 -- 172.21.15.135:0/1797228400 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc5ac003ba0 con 0x7fc5c41071d0 2024-05-08T23:08:37.105 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.620+0000 7fc5ca19f700 1 -- 172.21.15.135:0/1797228400 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c419abc0 con 0x7fc5c41071d0 2024-05-08T23:08:37.105 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.620+0000 7fc5c0ff9700 1 -- 172.21.15.135:0/1797228400 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5ac01a750 con 0x7fc5c41071d0 2024-05-08T23:08:37.105 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.620+0000 7fc5ca19f700 1 -- 172.21.15.135:0/1797228400 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c419b060 con 0x7fc5c41071d0 2024-05-08T23:08:37.105 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.621+0000 7fc5c0ff9700 1 -- 172.21.15.135:0/1797228400 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc5ac01a980 con 0x7fc5c41071d0 2024-05-08T23:08:37.105 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.621+0000 7fc5ca19f700 1 -- 172.21.15.135:0/1797228400 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c410a8a0 con 0x7fc5c41071d0 2024-05-08T23:08:37.105 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.621+0000 7fc5c0ff9700 1 -- 172.21.15.135:0/1797228400 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc5ac01adc0 con 0x7fc5c41071d0 2024-05-08T23:08:37.106 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.623+0000 7fc5c0ff9700 1 -- 172.21.15.135:0/1797228400 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fc5ac02d3f0 con 0x7fc5c41071d0 2024-05-08T23:08:37.106 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.690+0000 7fc5ca19f700 1 -- 172.21.15.135:0/1797228400 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fc5c410aab0 con 0x7fc5c41071d0 2024-05-08T23:08:37.106 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.695+0000 7fc5c0ff9700 1 -- 172.21.15.135:0/1797228400 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc5ac024b60 con 0x7fc5c41071d0 2024-05-08T23:08:37.106 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.696+0000 7fc5ca19f700 1 -- 172.21.15.135:0/1797228400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5c41071d0 msgr2=0x7fc5c419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:37.106 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.696+0000 7fc5ca19f700 1 --2- 172.21.15.135:0/1797228400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5c41071d0 0x7fc5c419a480 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009fb0 tx=0x7fc5ac011ad0 comp rx=0 tx=0).stop 2024-05-08T23:08:37.106 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.696+0000 7fc5ca19f700 1 -- 172.21.15.135:0/1797228400 shutdown_connections 2024-05-08T23:08:37.106 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.696+0000 7fc5ca19f700 1 --2- 172.21.15.135:0/1797228400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5c41071d0 0x7fc5c419a480 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:37.106 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.696+0000 7fc5ca19f700 1 -- 172.21.15.135:0/1797228400 >> 172.21.15.135:0/1797228400 conn(0x7fc5c4100bc0 msgr2=0x7fc5c4101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:37.106 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.696+0000 7fc5ca19f700 1 -- 172.21.15.135:0/1797228400 shutdown_connections 2024-05-08T23:08:37.106 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:36.696+0000 7fc5ca19f700 1 -- 172.21.15.135:0/1797228400 wait complete. 2024-05-08T23:08:37.106 INFO:teuthology.orchestra.run.smithi135.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-08T23:08:37.127 INFO:teuthology.orchestra.run.smithi135.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-08T23:08:37.127 INFO:teuthology.orchestra.run.smithi135.stdout:Creating mgr... 2024-05-08T23:08:37.127 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-08T23:08:37.127 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-08T23:08:37.327 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mgr.x 2024-05-08T23:08:37.328 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mgr.x.service: Unit ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mgr.x.service not loaded. 2024-05-08T23:08:37.418 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c804a50a-0d8f-11ef-bc97-c7b262605968.target.wants/ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@.service. 2024-05-08T23:08:37.669 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:37 smithi135 systemd[1]: Starting Ceph mgr.x for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:08:37.835 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T23:08:37.835 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout disabled 2024-05-08T23:08:37.843 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T23:08:37.843 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-05-08T23:08:37.843 INFO:teuthology.orchestra.run.smithi135.stdout:firewalld.service is not enabled 2024-05-08T23:08:37.843 INFO:teuthology.orchestra.run.smithi135.stdout:Not possible to enable service . firewalld.service is not available 2024-05-08T23:08:37.852 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T23:08:37.852 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout disabled 2024-05-08T23:08:37.859 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T23:08:37.859 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-05-08T23:08:37.860 INFO:teuthology.orchestra.run.smithi135.stdout:firewalld.service is not enabled 2024-05-08T23:08:37.860 INFO:teuthology.orchestra.run.smithi135.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-08T23:08:37.860 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mgr to start... 2024-05-08T23:08:37.860 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mgr... 2024-05-08T23:08:37.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:37 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1797228400' entity='client.admin' 2024-05-08T23:08:37.953 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:37 smithi135 bash[42676]: bcb3ccb041d6659d5d4ab23ed5710805d0e8157c0446aa4de10957ce1c20780e 2024-05-08T23:08:37.953 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:37 smithi135 systemd[1]: Started Ceph mgr.x for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:08:38.325 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:38 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:38.227+0000 7f478880f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T23:08:38.659 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:38 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:38.324+0000 7f478880f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T23:08:38.659 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:38 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:38.415+0000 7f478880f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T23:08:38.659 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:38 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:38.504+0000 7f478880f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T23:08:38.726 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-08T23:08:38.726 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:08:38.726 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsid": "c804a50a-0d8f-11ef-bc97-c7b262605968", 2024-05-08T23:08:38.726 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T23:08:38.726 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T23:08:38.726 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T23:08:38.726 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T23:08:38.726 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:38.726 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T23:08:38.726 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T23:08:38.726 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 0 2024-05-08T23:08:38.727 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:08:38.727 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T23:08:38.727 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T23:08:38.727 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:08:38.727 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-05-08T23:08:38.727 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T23:08:38.727 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:38.727 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-08T23:08:38.727 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T23:08:38.727 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:38.727 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T23:08:38.727 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:38.727 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T23:08:38.727 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T23:08:38.727 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T23:08:38.735 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T23:08:38.735 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T23:08:38.735 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T23:08:38.735 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:38.736 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T23:08:38.736 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T23:08:38.736 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T23:08:38.736 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T23:08:38.736 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T23:08:38.736 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T23:08:38.736 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T23:08:38.736 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T23:08:38.736 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T23:08:38.736 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:38.736 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T23:08:38.736 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:38.736 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T23:08:38.736 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T23:08:38.736 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:38.737 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T23:08:38.737 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T23:08:38.737 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T23:08:38.737 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T23:08:38.737 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T23:08:38.737 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T23:08:38.737 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T23:08:38.737 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:08:38.737 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:08:38.737 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:38.737 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T23:08:38.737 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:38.737 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T23:08:30.945488+0000", 2024-05-08T23:08:38.737 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:08:38.737 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:38.738 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T23:08:38.738 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:08:38.738 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.301+0000 7f642b9da700 1 Processor -- start 2024-05-08T23:08:38.738 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.301+0000 7f642b9da700 1 -- start start 2024-05-08T23:08:38.738 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.301+0000 7f642b9da700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64241071e0 0x7f64241095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:38.738 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.301+0000 7f642b9da700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6424079e90 con 0x7f64241071e0 2024-05-08T23:08:38.738 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.301+0000 7f6429776700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64241071e0 0x7f64241095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:38.738 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.301+0000 7f6429776700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64241071e0 0x7f64241095d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57960/0 (socket says 172.21.15.135:57960) 2024-05-08T23:08:38.738 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.301+0000 7f6429776700 1 -- 172.21.15.135:0/1016018231 learned_addr learned my addr 172.21.15.135:0/1016018231 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:38.738 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.302+0000 7f6429776700 1 -- 172.21.15.135:0/1016018231 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6424109b10 con 0x7f64241071e0 2024-05-08T23:08:38.738 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.302+0000 7f6429776700 1 --2- 172.21.15.135:0/1016018231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64241071e0 0x7f64241095d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f64200098a0 tx=0x7f6420009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a552106c4822b9fc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:38.739 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.302+0000 7f641bfff700 1 -- 172.21.15.135:0/1016018231 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6420004160 con 0x7f64241071e0 2024-05-08T23:08:38.739 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.302+0000 7f641bfff700 1 -- 172.21.15.135:0/1016018231 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f64200042c0 con 0x7f64241071e0 2024-05-08T23:08:38.739 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.302+0000 7f641bfff700 1 -- 172.21.15.135:0/1016018231 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6420011a00 con 0x7f64241071e0 2024-05-08T23:08:38.739 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.303+0000 7f642b9da700 1 -- 172.21.15.135:0/1016018231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64241071e0 msgr2=0x7f64241095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:38.739 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.303+0000 7f642b9da700 1 --2- 172.21.15.135:0/1016018231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64241071e0 0x7f64241095d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f64200098a0 tx=0x7f6420009bb0 comp rx=0 tx=0).stop 2024-05-08T23:08:38.739 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.303+0000 7f642b9da700 1 -- 172.21.15.135:0/1016018231 shutdown_connections 2024-05-08T23:08:38.739 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.303+0000 7f642b9da700 1 --2- 172.21.15.135:0/1016018231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64241071e0 0x7f64241095d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:38.739 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.303+0000 7f642b9da700 1 -- 172.21.15.135:0/1016018231 >> 172.21.15.135:0/1016018231 conn(0x7f6424100bd0 msgr2=0x7f6424103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:38.739 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.303+0000 7f642b9da700 1 -- 172.21.15.135:0/1016018231 shutdown_connections 2024-05-08T23:08:38.739 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.303+0000 7f642b9da700 1 -- 172.21.15.135:0/1016018231 wait complete. 2024-05-08T23:08:38.739 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.303+0000 7f642b9da700 1 Processor -- start 2024-05-08T23:08:38.739 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.303+0000 7f642b9da700 1 -- start start 2024-05-08T23:08:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.304+0000 7f642b9da700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64241071e0 0x7f642419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.304+0000 7f642b9da700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642419a9f0 con 0x7f64241071e0 2024-05-08T23:08:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.304+0000 7f6429776700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64241071e0 0x7f642419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.304+0000 7f6429776700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64241071e0 0x7f642419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57964/0 (socket says 172.21.15.135:57964) 2024-05-08T23:08:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.304+0000 7f6429776700 1 -- 172.21.15.135:0/2922507347 learned_addr learned my addr 172.21.15.135:0/2922507347 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.304+0000 7f6429776700 1 -- 172.21.15.135:0/2922507347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6420009550 con 0x7f64241071e0 2024-05-08T23:08:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.304+0000 7f6429776700 1 --2- 172.21.15.135:0/2922507347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64241071e0 0x7f642419a4b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6420009130 tx=0x7f6420011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.304+0000 7f641a7fc700 1 -- 172.21.15.135:0/2922507347 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6420003b70 con 0x7f64241071e0 2024-05-08T23:08:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.304+0000 7f642b9da700 1 -- 172.21.15.135:0/2922507347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642419abf0 con 0x7f64241071e0 2024-05-08T23:08:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.304+0000 7f641a7fc700 1 -- 172.21.15.135:0/2922507347 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6420003cd0 con 0x7f64241071e0 2024-05-08T23:08:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.304+0000 7f641a7fc700 1 -- 172.21.15.135:0/2922507347 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64200197d0 con 0x7f64241071e0 2024-05-08T23:08:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.304+0000 7f642b9da700 1 -- 172.21.15.135:0/2922507347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642419b090 con 0x7f64241071e0 2024-05-08T23:08:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.305+0000 7f641a7fc700 1 -- 172.21.15.135:0/2922507347 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6420019a10 con 0x7f64241071e0 2024-05-08T23:08:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.305+0000 7f641a7fc700 1 -- 172.21.15.135:0/2922507347 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f642000b720 con 0x7f64241071e0 2024-05-08T23:08:38.741 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.305+0000 7f642b9da700 1 -- 172.21.15.135:0/2922507347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642410a8b0 con 0x7f64241071e0 2024-05-08T23:08:38.741 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.307+0000 7f641a7fc700 1 -- 172.21.15.135:0/2922507347 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f642002a060 con 0x7f64241071e0 2024-05-08T23:08:38.741 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.379+0000 7f642b9da700 1 -- 172.21.15.135:0/2922507347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6424104fd0 con 0x7f64241071e0 2024-05-08T23:08:38.741 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.380+0000 7f641a7fc700 1 -- 172.21.15.135:0/2922507347 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f6420019e50 con 0x7f64241071e0 2024-05-08T23:08:38.741 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.381+0000 7f642b9da700 1 -- 172.21.15.135:0/2922507347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64241071e0 msgr2=0x7f642419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:38.741 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.381+0000 7f642b9da700 1 --2- 172.21.15.135:0/2922507347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64241071e0 0x7f642419a4b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6420009130 tx=0x7f6420011ad0 comp rx=0 tx=0).stop 2024-05-08T23:08:38.741 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.381+0000 7f642b9da700 1 -- 172.21.15.135:0/2922507347 shutdown_connections 2024-05-08T23:08:38.741 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.381+0000 7f642b9da700 1 --2- 172.21.15.135:0/2922507347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64241071e0 0x7f642419a4b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:38.741 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.381+0000 7f642b9da700 1 -- 172.21.15.135:0/2922507347 >> 172.21.15.135:0/2922507347 conn(0x7f6424100bd0 msgr2=0x7f6424101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:38.741 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.381+0000 7f642b9da700 1 -- 172.21.15.135:0/2922507347 shutdown_connections 2024-05-08T23:08:38.741 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:38.381+0000 7f642b9da700 1 -- 172.21.15.135:0/2922507347 wait complete. 2024-05-08T23:08:38.741 INFO:teuthology.orchestra.run.smithi135.stdout:mgr not available, waiting (1/15)... 2024-05-08T23:08:38.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:38 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2922507347' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T23:08:39.453 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:39 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:39.148+0000 7f478880f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:08:39.453 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:39 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:39.396+0000 7f478880f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T23:08:39.747 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:39 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:39.481+0000 7f478880f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T23:08:39.747 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:39 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:39.590+0000 7f478880f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T23:08:39.748 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:39 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:39.747+0000 7f478880f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T23:08:40.203 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:39 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:39.872+0000 7f478880f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T23:08:40.203 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:39 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:39.957+0000 7f478880f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T23:08:40.703 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:40 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:40.325+0000 7f478880f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T23:08:41.019 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:40 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:40.710+0000 7f478880f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T23:08:41.020 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:40 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:40.921+0000 7f478880f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T23:08:41.020 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:41 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:41.019+0000 7f478880f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T23:08:41.321 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:41 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3852014640' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T23:08:41.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-08T23:08:41.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:08:41.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsid": "c804a50a-0d8f-11ef-bc97-c7b262605968", 2024-05-08T23:08:41.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T23:08:41.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T23:08:41.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T23:08:41.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T23:08:41.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:41.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T23:08:41.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T23:08:41.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 0 2024-05-08T23:08:41.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:08:41.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T23:08:41.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T23:08:41.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:08:41.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-05-08T23:08:41.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T23:08:41.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:41.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-08T23:08:41.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T23:08:41.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:41.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T23:08:41.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:41.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T23:08:41.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T23:08:41.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T23:08:41.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T23:08:41.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T23:08:41.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T23:08:41.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:41.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T23:08:41.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T23:08:41.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T23:08:41.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T23:08:41.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T23:08:41.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T23:08:41.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T23:08:41.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T23:08:41.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T23:08:41.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:41.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T23:08:41.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:41.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T23:08:41.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T23:08:41.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:41.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T23:08:41.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T23:08:41.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T23:08:41.484 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T23:08:41.484 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T23:08:41.484 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T23:08:41.484 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T23:08:41.484 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:08:41.484 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:08:41.484 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:41.484 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T23:08:41.484 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:41.484 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T23:08:30.945488+0000", 2024-05-08T23:08:41.484 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:08:41.484 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:41.484 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T23:08:41.484 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:08:41.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.074+0000 7f70cdb72700 1 Processor -- start 2024-05-08T23:08:41.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.074+0000 7f70cdb72700 1 -- start start 2024-05-08T23:08:41.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.074+0000 7f70cdb72700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c81071e0 0x7f70c81095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:41.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.074+0000 7f70cdb72700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c8079e90 con 0x7f70c81071e0 2024-05-08T23:08:41.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.074+0000 7f70c77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c81071e0 0x7f70c81095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:41.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.074+0000 7f70c77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c81071e0 0x7f70c81095d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57974/0 (socket says 172.21.15.135:57974) 2024-05-08T23:08:41.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.074+0000 7f70c77fe700 1 -- 172.21.15.135:0/2794881256 learned_addr learned my addr 172.21.15.135:0/2794881256 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:41.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.074+0000 7f70c77fe700 1 -- 172.21.15.135:0/2794881256 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8109b10 con 0x7f70c81071e0 2024-05-08T23:08:41.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.074+0000 7f70c77fe700 1 --2- 172.21.15.135:0/2794881256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c81071e0 0x7f70c81095d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f70b80098a0 tx=0x7f70b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551474318f6048ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:41.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.075+0000 7f70c67fc700 1 -- 172.21.15.135:0/2794881256 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70b8004160 con 0x7f70c81071e0 2024-05-08T23:08:41.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.075+0000 7f70c67fc700 1 -- 172.21.15.135:0/2794881256 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f70b80042c0 con 0x7f70c81071e0 2024-05-08T23:08:41.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.075+0000 7f70c67fc700 1 -- 172.21.15.135:0/2794881256 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70b8011a00 con 0x7f70c81071e0 2024-05-08T23:08:41.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.075+0000 7f70cdb72700 1 -- 172.21.15.135:0/2794881256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c81071e0 msgr2=0x7f70c81095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:41.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.075+0000 7f70cdb72700 1 --2- 172.21.15.135:0/2794881256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c81071e0 0x7f70c81095d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f70b80098a0 tx=0x7f70b8009bb0 comp rx=0 tx=0).stop 2024-05-08T23:08:41.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.075+0000 7f70cdb72700 1 -- 172.21.15.135:0/2794881256 shutdown_connections 2024-05-08T23:08:41.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.075+0000 7f70cdb72700 1 --2- 172.21.15.135:0/2794881256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c81071e0 0x7f70c81095d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:41.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.075+0000 7f70cdb72700 1 -- 172.21.15.135:0/2794881256 >> 172.21.15.135:0/2794881256 conn(0x7f70c8100bd0 msgr2=0x7f70c8103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:41.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.075+0000 7f70cdb72700 1 -- 172.21.15.135:0/2794881256 shutdown_connections 2024-05-08T23:08:41.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.075+0000 7f70cdb72700 1 -- 172.21.15.135:0/2794881256 wait complete. 2024-05-08T23:08:41.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.076+0000 7f70cdb72700 1 Processor -- start 2024-05-08T23:08:41.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.076+0000 7f70cdb72700 1 -- start start 2024-05-08T23:08:41.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.076+0000 7f70cdb72700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c81071e0 0x7f70c819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:41.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.076+0000 7f70cdb72700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c819a9f0 con 0x7f70c81071e0 2024-05-08T23:08:41.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.076+0000 7f70c77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c81071e0 0x7f70c819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:41.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.076+0000 7f70c77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c81071e0 0x7f70c819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57986/0 (socket says 172.21.15.135:57986) 2024-05-08T23:08:41.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.076+0000 7f70c77fe700 1 -- 172.21.15.135:0/3852014640 learned_addr learned my addr 172.21.15.135:0/3852014640 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:41.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.077+0000 7f70c77fe700 1 -- 172.21.15.135:0/3852014640 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b8009550 con 0x7f70c81071e0 2024-05-08T23:08:41.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.077+0000 7f70c77fe700 1 --2- 172.21.15.135:0/3852014640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c81071e0 0x7f70c819a4b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009130 tx=0x7f70b8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:41.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.077+0000 7f70c4ff9700 1 -- 172.21.15.135:0/3852014640 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70b8003b70 con 0x7f70c81071e0 2024-05-08T23:08:41.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.077+0000 7f70cdb72700 1 -- 172.21.15.135:0/3852014640 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c819abf0 con 0x7f70c81071e0 2024-05-08T23:08:41.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.077+0000 7f70c4ff9700 1 -- 172.21.15.135:0/3852014640 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f70b8003cd0 con 0x7f70c81071e0 2024-05-08T23:08:41.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.077+0000 7f70c4ff9700 1 -- 172.21.15.135:0/3852014640 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70b80197d0 con 0x7f70c81071e0 2024-05-08T23:08:41.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.077+0000 7f70cdb72700 1 -- 172.21.15.135:0/3852014640 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c819b090 con 0x7f70c81071e0 2024-05-08T23:08:41.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.078+0000 7f70c4ff9700 1 -- 172.21.15.135:0/3852014640 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f70b801a430 con 0x7f70c81071e0 2024-05-08T23:08:41.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.078+0000 7f70c4ff9700 1 -- 172.21.15.135:0/3852014640 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f70b8025c30 con 0x7f70c81071e0 2024-05-08T23:08:41.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.078+0000 7f70cdb72700 1 -- 172.21.15.135:0/3852014640 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c810a8b0 con 0x7f70c81071e0 2024-05-08T23:08:41.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.080+0000 7f70c4ff9700 1 -- 172.21.15.135:0/3852014640 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f70b802a060 con 0x7f70c81071e0 2024-05-08T23:08:41.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.163+0000 7f70cdb72700 1 -- 172.21.15.135:0/3852014640 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f70c810aaa0 con 0x7f70c81071e0 2024-05-08T23:08:41.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.163+0000 7f70c4ff9700 1 -- 172.21.15.135:0/3852014640 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f70b8033090 con 0x7f70c81071e0 2024-05-08T23:08:41.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.164+0000 7f70cdb72700 1 -- 172.21.15.135:0/3852014640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c81071e0 msgr2=0x7f70c819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:41.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.164+0000 7f70cdb72700 1 --2- 172.21.15.135:0/3852014640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c81071e0 0x7f70c819a4b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009130 tx=0x7f70b8011ad0 comp rx=0 tx=0).stop 2024-05-08T23:08:41.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.164+0000 7f70cdb72700 1 -- 172.21.15.135:0/3852014640 shutdown_connections 2024-05-08T23:08:41.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.164+0000 7f70cdb72700 1 --2- 172.21.15.135:0/3852014640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c81071e0 0x7f70c819a4b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:41.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.164+0000 7f70cdb72700 1 -- 172.21.15.135:0/3852014640 >> 172.21.15.135:0/3852014640 conn(0x7f70c8100bd0 msgr2=0x7f70c8101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:41.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.164+0000 7f70cdb72700 1 -- 172.21.15.135:0/3852014640 shutdown_connections 2024-05-08T23:08:41.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:41.164+0000 7f70cdb72700 1 -- 172.21.15.135:0/3852014640 wait complete. 2024-05-08T23:08:41.488 INFO:teuthology.orchestra.run.smithi135.stdout:mgr not available, waiting (2/15)... 2024-05-08T23:08:42.203 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:41 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:41.807+0000 7f478880f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T23:08:42.203 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:41 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:41.904+0000 7f478880f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T23:08:42.203 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:42 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:42.051+0000 7f478880f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T23:08:42.953 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:42 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:42.676+0000 7f478880f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T23:08:42.953 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:42 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:42.857+0000 7f478880f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T23:08:43.453 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:43 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:43.053+0000 7f478880f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T23:08:44.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:43 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2208018601' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T23:08:44.203 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:44 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:44.013+0000 7f478880f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T23:08:44.233 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-08T23:08:44.233 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:08:44.233 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsid": "c804a50a-0d8f-11ef-bc97-c7b262605968", 2024-05-08T23:08:44.233 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T23:08:44.233 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T23:08:44.233 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T23:08:44.233 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T23:08:44.233 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:44.233 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T23:08:44.233 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T23:08:44.233 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 0 2024-05-08T23:08:44.233 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:08:44.233 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T23:08:44.234 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T23:08:44.234 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:08:44.234 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-05-08T23:08:44.234 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T23:08:44.234 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:44.234 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-08T23:08:44.234 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T23:08:44.234 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:44.234 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T23:08:44.234 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:44.234 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T23:08:44.234 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T23:08:44.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T23:08:44.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T23:08:44.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T23:08:44.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T23:08:44.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:44.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T23:08:44.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T23:08:44.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T23:08:44.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T23:08:44.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T23:08:44.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T23:08:44.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T23:08:44.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T23:08:44.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T23:08:44.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:44.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T23:08:44.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:44.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T23:08:44.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T23:08:44.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:44.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T23:08:44.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T23:08:44.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T23:08:44.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T23:08:44.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T23:08:44.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T23:08:44.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T23:08:44.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:08:44.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:08:44.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:44.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T23:08:44.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:44.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T23:08:30.945488+0000", 2024-05-08T23:08:44.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:08:44.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:44.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T23:08:44.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:08:44.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.815+0000 7f83beee3700 1 Processor -- start 2024-05-08T23:08:44.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.815+0000 7f83beee3700 1 -- start start 2024-05-08T23:08:44.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.815+0000 7f83beee3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b81071e0 0x7f83b81095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:44.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.815+0000 7f83beee3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8079e90 con 0x7f83b81071e0 2024-05-08T23:08:44.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.816+0000 7f83bcc7f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b81071e0 0x7f83b81095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:44.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.816+0000 7f83bcc7f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b81071e0 0x7f83b81095d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57994/0 (socket says 172.21.15.135:57994) 2024-05-08T23:08:44.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.816+0000 7f83bcc7f700 1 -- 172.21.15.135:0/292628559 learned_addr learned my addr 172.21.15.135:0/292628559 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:44.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.816+0000 7f83bcc7f700 1 -- 172.21.15.135:0/292628559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b8109b10 con 0x7f83b81071e0 2024-05-08T23:08:44.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.816+0000 7f83bcc7f700 1 --2- 172.21.15.135:0/292628559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b81071e0 0x7f83b81095d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009e80 tx=0x7f83b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73f6032468f23ca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:44.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.816+0000 7f83b77fe700 1 -- 172.21.15.135:0/292628559 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83b000e070 con 0x7f83b81071e0 2024-05-08T23:08:44.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.816+0000 7f83b77fe700 1 -- 172.21.15.135:0/292628559 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f83b000b8c0 con 0x7f83b81071e0 2024-05-08T23:08:44.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.816+0000 7f83b77fe700 1 -- 172.21.15.135:0/292628559 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83b00044c0 con 0x7f83b81071e0 2024-05-08T23:08:44.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.817+0000 7f83beee3700 1 -- 172.21.15.135:0/292628559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b81071e0 msgr2=0x7f83b81095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:44.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.817+0000 7f83beee3700 1 --2- 172.21.15.135:0/292628559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b81071e0 0x7f83b81095d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009e80 tx=0x7f83b000b330 comp rx=0 tx=0).stop 2024-05-08T23:08:44.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.817+0000 7f83beee3700 1 -- 172.21.15.135:0/292628559 shutdown_connections 2024-05-08T23:08:44.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.817+0000 7f83beee3700 1 --2- 172.21.15.135:0/292628559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b81071e0 0x7f83b81095d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:44.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.817+0000 7f83beee3700 1 -- 172.21.15.135:0/292628559 >> 172.21.15.135:0/292628559 conn(0x7f83b8100bd0 msgr2=0x7f83b8103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:44.247 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.817+0000 7f83beee3700 1 -- 172.21.15.135:0/292628559 shutdown_connections 2024-05-08T23:08:44.247 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.817+0000 7f83beee3700 1 -- 172.21.15.135:0/292628559 wait complete. 2024-05-08T23:08:44.247 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.818+0000 7f83beee3700 1 Processor -- start 2024-05-08T23:08:44.247 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.818+0000 7f83beee3700 1 -- start start 2024-05-08T23:08:44.247 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.818+0000 7f83beee3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b81071e0 0x7f83b8106a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:44.247 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.818+0000 7f83beee3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8106f50 con 0x7f83b81071e0 2024-05-08T23:08:44.247 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.818+0000 7f83bcc7f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b81071e0 0x7f83b8106a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:44.247 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.818+0000 7f83bcc7f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b81071e0 0x7f83b8106a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58000/0 (socket says 172.21.15.135:58000) 2024-05-08T23:08:44.247 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.818+0000 7f83bcc7f700 1 -- 172.21.15.135:0/2208018601 learned_addr learned my addr 172.21.15.135:0/2208018601 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:44.247 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.818+0000 7f83bcc7f700 1 -- 172.21.15.135:0/2208018601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b0009b30 con 0x7f83b81071e0 2024-05-08T23:08:44.247 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.818+0000 7f83bcc7f700 1 --2- 172.21.15.135:0/2208018601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b81071e0 0x7f83b8106a10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009fd0 tx=0x7f83b00045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:44.247 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.818+0000 7f83b5ffb700 1 -- 172.21.15.135:0/2208018601 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83b000e040 con 0x7f83b81071e0 2024-05-08T23:08:44.247 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.819+0000 7f83b5ffb700 1 -- 172.21.15.135:0/2208018601 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f83b000bdf0 con 0x7f83b81071e0 2024-05-08T23:08:44.247 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.819+0000 7f83beee3700 1 -- 172.21.15.135:0/2208018601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b8105190 con 0x7f83b81071e0 2024-05-08T23:08:44.248 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.819+0000 7f83b5ffb700 1 -- 172.21.15.135:0/2208018601 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83b001c840 con 0x7f83b81071e0 2024-05-08T23:08:44.248 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.819+0000 7f83beee3700 1 -- 172.21.15.135:0/2208018601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b8105690 con 0x7f83b81071e0 2024-05-08T23:08:44.248 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.819+0000 7f83b5ffb700 1 -- 172.21.15.135:0/2208018601 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f83b0025450 con 0x7f83b81071e0 2024-05-08T23:08:44.248 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.819+0000 7f83b5ffb700 1 -- 172.21.15.135:0/2208018601 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f83b001b720 con 0x7f83b81071e0 2024-05-08T23:08:44.248 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.820+0000 7f83beee3700 1 -- 172.21.15.135:0/2208018601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b80625d0 con 0x7f83b81071e0 2024-05-08T23:08:44.248 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.822+0000 7f83b5ffb700 1 -- 172.21.15.135:0/2208018601 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f83b002a060 con 0x7f83b81071e0 2024-05-08T23:08:44.248 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.895+0000 7f83beee3700 1 -- 172.21.15.135:0/2208018601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f83b810a940 con 0x7f83b81071e0 2024-05-08T23:08:44.248 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.895+0000 7f83b5ffb700 1 -- 172.21.15.135:0/2208018601 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f83b0020070 con 0x7f83b81071e0 2024-05-08T23:08:44.248 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.896+0000 7f83beee3700 1 -- 172.21.15.135:0/2208018601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b81071e0 msgr2=0x7f83b8106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:44.248 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.896+0000 7f83beee3700 1 --2- 172.21.15.135:0/2208018601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b81071e0 0x7f83b8106a10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009fd0 tx=0x7f83b00045f0 comp rx=0 tx=0).stop 2024-05-08T23:08:44.248 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.896+0000 7f83beee3700 1 -- 172.21.15.135:0/2208018601 shutdown_connections 2024-05-08T23:08:44.248 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.896+0000 7f83beee3700 1 --2- 172.21.15.135:0/2208018601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83b81071e0 0x7f83b8106a10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:44.248 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.896+0000 7f83beee3700 1 -- 172.21.15.135:0/2208018601 >> 172.21.15.135:0/2208018601 conn(0x7f83b8100bd0 msgr2=0x7f83b81017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:44.248 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.896+0000 7f83beee3700 1 -- 172.21.15.135:0/2208018601 shutdown_connections 2024-05-08T23:08:44.248 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:43.896+0000 7f83beee3700 1 -- 172.21.15.135:0/2208018601 wait complete. 2024-05-08T23:08:44.249 INFO:teuthology.orchestra.run.smithi135.stdout:mgr not available, waiting (3/15)... 2024-05-08T23:08:44.580 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:44 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:44.305+0000 7f478880f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:08:44.580 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:44 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:44.392+0000 7f478880f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T23:08:44.948 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:44 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:44.580+0000 7f478880f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T23:08:45.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:44 smithi135 ceph-mon[42440]: Activating manager daemon x 2024-05-08T23:08:45.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:44 smithi135 ceph-mon[42440]: mgrmap e2: x(active, starting, since 0.00344043s) 2024-05-08T23:08:45.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:44 smithi135 ceph-mon[42440]: from='mgr.14100 172.21.15.135:0/1182740281' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T23:08:45.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:44 smithi135 ceph-mon[42440]: from='mgr.14100 172.21.15.135:0/1182740281' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T23:08:45.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:44 smithi135 ceph-mon[42440]: from='mgr.14100 172.21.15.135:0/1182740281' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T23:08:45.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:44 smithi135 ceph-mon[42440]: from='mgr.14100 172.21.15.135:0/1182740281' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:08:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:44 smithi135 ceph-mon[42440]: from='mgr.14100 172.21.15.135:0/1182740281' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T23:08:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:44 smithi135 ceph-mon[42440]: Manager daemon x is now available 2024-05-08T23:08:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:44 smithi135 ceph-mon[42440]: from='mgr.14100 172.21.15.135:0/1182740281' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T23:08:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:44 smithi135 ceph-mon[42440]: from='mgr.14100 172.21.15.135:0/1182740281' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T23:08:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:44 smithi135 ceph-mon[42440]: from='mgr.14100 172.21.15.135:0/1182740281' entity='mgr.x' 2024-05-08T23:08:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:44 smithi135 ceph-mon[42440]: from='mgr.14100 172.21.15.135:0/1182740281' entity='mgr.x' 2024-05-08T23:08:45.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:44 smithi135 ceph-mon[42440]: from='mgr.14100 172.21.15.135:0/1182740281' entity='mgr.x' 2024-05-08T23:08:46.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:46 smithi135 ceph-mon[42440]: mgrmap e3: x(active, since 1.00731s) 2024-05-08T23:08:48.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:48 smithi135 ceph-mon[42440]: mgrmap e4: x(active, since 3s) 2024-05-08T23:08:48.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:48 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2473421262' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T23:08:49.599 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-08T23:08:49.599 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:08:49.599 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsid": "c804a50a-0d8f-11ef-bc97-c7b262605968", 2024-05-08T23:08:49.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T23:08:49.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T23:08:49.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T23:08:49.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T23:08:49.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:49.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T23:08:49.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T23:08:49.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 0 2024-05-08T23:08:49.600 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:08:49.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T23:08:49.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T23:08:49.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:08:49.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-05-08T23:08:49.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T23:08:49.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:49.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-08T23:08:49.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T23:08:49.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:49.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T23:08:49.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:49.601 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T23:08:49.602 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T23:08:49.602 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T23:08:49.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T23:08:49.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T23:08:49.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T23:08:49.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:49.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T23:08:49.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T23:08:49.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T23:08:49.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T23:08:49.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T23:08:49.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T23:08:49.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T23:08:49.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T23:08:49.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T23:08:49.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:49.613 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T23:08:49.613 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:49.613 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T23:08:49.613 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T23:08:49.613 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:49.613 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T23:08:49.613 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T23:08:49.613 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T23:08:49.613 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T23:08:49.613 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T23:08:49.614 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T23:08:49.614 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T23:08:49.614 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:08:49.614 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:08:49.614 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:49.614 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T23:08:49.614 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:08:49.614 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T23:08:30.945488+0000", 2024-05-08T23:08:49.614 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:08:49.614 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:08:49.614 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T23:08:49.614 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:08:49.615 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.884+0000 7f5c79fb8700 1 Processor -- start 2024-05-08T23:08:49.615 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.884+0000 7f5c79fb8700 1 -- start start 2024-05-08T23:08:49.615 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.884+0000 7f5c79fb8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c74105670 0x7f5c74105a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:49.615 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.884+0000 7f5c79fb8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74106060 con 0x7f5c74105670 2024-05-08T23:08:49.615 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.884+0000 7f5c737fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c74105670 0x7f5c74105a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:49.615 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.884+0000 7f5c737fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c74105670 0x7f5c74105a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58064/0 (socket says 172.21.15.135:58064) 2024-05-08T23:08:49.615 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.884+0000 7f5c737fe700 1 -- 172.21.15.135:0/605159444 learned_addr learned my addr 172.21.15.135:0/605159444 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:49.616 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.885+0000 7f5c737fe700 1 -- 172.21.15.135:0/605159444 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c74106870 con 0x7f5c74105670 2024-05-08T23:08:49.616 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.885+0000 7f5c737fe700 1 --2- 172.21.15.135:0/605159444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c74105670 0x7f5c74105a90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0098a0 tx=0x7f5c5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec6e7458dd8c1fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:49.616 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.885+0000 7f5c727fc700 1 -- 172.21.15.135:0/605159444 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c5c004160 con 0x7f5c74105670 2024-05-08T23:08:49.616 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.885+0000 7f5c727fc700 1 -- 172.21.15.135:0/605159444 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5c5c0042c0 con 0x7f5c74105670 2024-05-08T23:08:49.616 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.885+0000 7f5c727fc700 1 -- 172.21.15.135:0/605159444 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c5c011a00 con 0x7f5c74105670 2024-05-08T23:08:49.616 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.885+0000 7f5c79fb8700 1 -- 172.21.15.135:0/605159444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c74105670 msgr2=0x7f5c74105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:49.616 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.885+0000 7f5c79fb8700 1 --2- 172.21.15.135:0/605159444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c74105670 0x7f5c74105a90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0098a0 tx=0x7f5c5c009bb0 comp rx=0 tx=0).stop 2024-05-08T23:08:49.616 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.886+0000 7f5c79fb8700 1 -- 172.21.15.135:0/605159444 shutdown_connections 2024-05-08T23:08:49.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.886+0000 7f5c79fb8700 1 --2- 172.21.15.135:0/605159444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c74105670 0x7f5c74105a90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:49.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.886+0000 7f5c79fb8700 1 -- 172.21.15.135:0/605159444 >> 172.21.15.135:0/605159444 conn(0x7f5c74100bf0 msgr2=0x7f5c74103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:49.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.886+0000 7f5c79fb8700 1 -- 172.21.15.135:0/605159444 shutdown_connections 2024-05-08T23:08:49.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.886+0000 7f5c79fb8700 1 -- 172.21.15.135:0/605159444 wait complete. 2024-05-08T23:08:49.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.886+0000 7f5c79fb8700 1 Processor -- start 2024-05-08T23:08:49.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.886+0000 7f5c79fb8700 1 -- start start 2024-05-08T23:08:49.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.886+0000 7f5c79fb8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c74105670 0x7f5c7419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:49.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.886+0000 7f5c79fb8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7419aa50 con 0x7f5c74105670 2024-05-08T23:08:49.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.887+0000 7f5c737fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c74105670 0x7f5c7419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:49.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.887+0000 7f5c737fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c74105670 0x7f5c7419a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58072/0 (socket says 172.21.15.135:58072) 2024-05-08T23:08:49.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.887+0000 7f5c737fe700 1 -- 172.21.15.135:0/2473421262 learned_addr learned my addr 172.21.15.135:0/2473421262 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:49.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.887+0000 7f5c737fe700 1 -- 172.21.15.135:0/2473421262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c009550 con 0x7f5c74105670 2024-05-08T23:08:49.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.887+0000 7f5c737fe700 1 --2- 172.21.15.135:0/2473421262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c74105670 0x7f5c7419a510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009fb0 tx=0x7f5c5c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:49.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.887+0000 7f5c70ff9700 1 -- 172.21.15.135:0/2473421262 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c5c003a40 con 0x7f5c74105670 2024-05-08T23:08:49.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.887+0000 7f5c79fb8700 1 -- 172.21.15.135:0/2473421262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7419ac50 con 0x7f5c74105670 2024-05-08T23:08:49.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.887+0000 7f5c70ff9700 1 -- 172.21.15.135:0/2473421262 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5c5c003ba0 con 0x7f5c74105670 2024-05-08T23:08:49.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.887+0000 7f5c70ff9700 1 -- 172.21.15.135:0/2473421262 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c5c01a750 con 0x7f5c74105670 2024-05-08T23:08:49.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.887+0000 7f5c79fb8700 1 -- 172.21.15.135:0/2473421262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7419b0f0 con 0x7f5c74105670 2024-05-08T23:08:49.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.888+0000 7f5c70ff9700 1 -- 172.21.15.135:0/2473421262 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f5c5c01a9d0 con 0x7f5c74105670 2024-05-08T23:08:49.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.888+0000 7f5c70ff9700 1 --2- 172.21.15.135:0/2473421262 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7f5c60038660 0x7f5c6003ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:49.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.888+0000 7f5c70ff9700 1 -- 172.21.15.135:0/2473421262 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5c5c04c320 con 0x7f5c74105670 2024-05-08T23:08:49.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.888+0000 7f5c79fb8700 1 -- 172.21.15.135:0/2473421262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c74194650 con 0x7f5c74105670 2024-05-08T23:08:49.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.888+0000 7f5c72ffd700 1 --2- 172.21.15.135:0/2473421262 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7f5c60038660 0x7f5c6003ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:49.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.889+0000 7f5c72ffd700 1 --2- 172.21.15.135:0/2473421262 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7f5c60038660 0x7f5c6003ab20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5c64006fd0 tx=0x7f5c64006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:49.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:47.893+0000 7f5c70ff9700 1 -- 172.21.15.135:0/2473421262 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5c5c018db0 con 0x7f5c74105670 2024-05-08T23:08:49.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:48.173+0000 7f5c79fb8700 1 -- 172.21.15.135:0/2473421262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5c74109aa0 con 0x7f5c74105670 2024-05-08T23:08:49.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:48.173+0000 7f5c70ff9700 1 -- 172.21.15.135:0/2473421262 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f5c5c018350 con 0x7f5c74105670 2024-05-08T23:08:49.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:48.175+0000 7f5c79fb8700 1 -- 172.21.15.135:0/2473421262 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7f5c60038660 msgr2=0x7f5c6003ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:49.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:48.175+0000 7f5c79fb8700 1 --2- 172.21.15.135:0/2473421262 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7f5c60038660 0x7f5c6003ab20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5c64006fd0 tx=0x7f5c64006e40 comp rx=0 tx=0).stop 2024-05-08T23:08:49.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:48.175+0000 7f5c79fb8700 1 -- 172.21.15.135:0/2473421262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c74105670 msgr2=0x7f5c7419a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:49.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:48.175+0000 7f5c79fb8700 1 --2- 172.21.15.135:0/2473421262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c74105670 0x7f5c7419a510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009fb0 tx=0x7f5c5c011ad0 comp rx=0 tx=0).stop 2024-05-08T23:08:49.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:48.176+0000 7f5c79fb8700 1 -- 172.21.15.135:0/2473421262 shutdown_connections 2024-05-08T23:08:49.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:48.176+0000 7f5c79fb8700 1 --2- 172.21.15.135:0/2473421262 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7f5c60038660 0x7f5c6003ab20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:49.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:48.176+0000 7f5c79fb8700 1 --2- 172.21.15.135:0/2473421262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c74105670 0x7f5c7419a510 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:49.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:48.176+0000 7f5c79fb8700 1 -- 172.21.15.135:0/2473421262 >> 172.21.15.135:0/2473421262 conn(0x7f5c74100bf0 msgr2=0x7f5c74101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:49.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:48.176+0000 7f5c79fb8700 1 -- 172.21.15.135:0/2473421262 shutdown_connections 2024-05-08T23:08:49.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:48.176+0000 7f5c79fb8700 1 -- 172.21.15.135:0/2473421262 wait complete. 2024-05-08T23:08:49.620 INFO:teuthology.orchestra.run.smithi135.stdout:mgr is available 2024-05-08T23:08:50.923 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:50 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1974016258' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-08T23:08:50.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-08T23:08:50.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [global] 2024-05-08T23:08:50.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout fsid = c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:08:50.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-08T23:08:50.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-08T23:08:50.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-08T23:08:50.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-08T23:08:50.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-08T23:08:50.988 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-08T23:08:50.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-08T23:08:50.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-05-08T23:08:50.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [osd] 2024-05-08T23:08:50.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-08T23:08:50.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-08T23:08:50.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-08T23:08:50.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-08T23:08:50.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-08T23:08:50.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.385+0000 7f3b7beb3700 1 Processor -- start 2024-05-08T23:08:50.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.385+0000 7f3b7beb3700 1 -- start start 2024-05-08T23:08:50.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.385+0000 7f3b7beb3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7407bee0 0x7f3b7407a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:50.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.385+0000 7f3b7beb3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7407a910 con 0x7f3b7407bee0 2024-05-08T23:08:50.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.386+0000 7f3b79c4f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7407bee0 0x7f3b7407a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:50.989 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.386+0000 7f3b79c4f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7407bee0 0x7f3b7407a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60148/0 (socket says 172.21.15.135:60148) 2024-05-08T23:08:50.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.386+0000 7f3b79c4f700 1 -- 172.21.15.135:0/3024447015 learned_addr learned my addr 172.21.15.135:0/3024447015 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:50.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.386+0000 7f3b79c4f700 1 -- 172.21.15.135:0/3024447015 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7407aa50 con 0x7f3b7407bee0 2024-05-08T23:08:50.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.386+0000 7f3b79c4f700 1 --2- 172.21.15.135:0/3024447015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7407bee0 0x7f3b7407a340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3b640098a0 tx=0x7f3b64009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9347fc2a6cdabb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:50.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.386+0000 7f3b78c4d700 1 -- 172.21.15.135:0/3024447015 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b64004160 con 0x7f3b7407bee0 2024-05-08T23:08:50.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.386+0000 7f3b78c4d700 1 -- 172.21.15.135:0/3024447015 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b640042c0 con 0x7f3b7407bee0 2024-05-08T23:08:50.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.386+0000 7f3b78c4d700 1 -- 172.21.15.135:0/3024447015 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b64011a00 con 0x7f3b7407bee0 2024-05-08T23:08:50.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.387+0000 7f3b7beb3700 1 -- 172.21.15.135:0/3024447015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7407bee0 msgr2=0x7f3b7407a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:50.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.387+0000 7f3b7beb3700 1 --2- 172.21.15.135:0/3024447015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7407bee0 0x7f3b7407a340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3b640098a0 tx=0x7f3b64009bb0 comp rx=0 tx=0).stop 2024-05-08T23:08:50.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.387+0000 7f3b7beb3700 1 -- 172.21.15.135:0/3024447015 shutdown_connections 2024-05-08T23:08:50.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.387+0000 7f3b7beb3700 1 --2- 172.21.15.135:0/3024447015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7407bee0 0x7f3b7407a340 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:50.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.387+0000 7f3b7beb3700 1 -- 172.21.15.135:0/3024447015 >> 172.21.15.135:0/3024447015 conn(0x7f3b74101d00 msgr2=0x7f3b74104160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:50.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.387+0000 7f3b7beb3700 1 -- 172.21.15.135:0/3024447015 shutdown_connections 2024-05-08T23:08:50.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.387+0000 7f3b7beb3700 1 -- 172.21.15.135:0/3024447015 wait complete. 2024-05-08T23:08:50.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.387+0000 7f3b7beb3700 1 Processor -- start 2024-05-08T23:08:50.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.388+0000 7f3b7beb3700 1 -- start start 2024-05-08T23:08:50.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.388+0000 7f3b7beb3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7407bee0 0x7f3b7419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:50.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.388+0000 7f3b7beb3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7419cbf0 con 0x7f3b7407bee0 2024-05-08T23:08:50.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.388+0000 7f3b79c4f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7407bee0 0x7f3b7419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:50.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.388+0000 7f3b79c4f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7407bee0 0x7f3b7419c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60158/0 (socket says 172.21.15.135:60158) 2024-05-08T23:08:50.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.388+0000 7f3b79c4f700 1 -- 172.21.15.135:0/1974016258 learned_addr learned my addr 172.21.15.135:0/1974016258 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:50.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.388+0000 7f3b79c4f700 1 -- 172.21.15.135:0/1974016258 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b64009550 con 0x7f3b7407bee0 2024-05-08T23:08:50.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.388+0000 7f3b79c4f700 1 --2- 172.21.15.135:0/1974016258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7407bee0 0x7f3b7419c6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009130 tx=0x7f3b64011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:50.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.388+0000 7f3b6affd700 1 -- 172.21.15.135:0/1974016258 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b64003ab0 con 0x7f3b7407bee0 2024-05-08T23:08:50.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.388+0000 7f3b6affd700 1 -- 172.21.15.135:0/1974016258 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b64003c10 con 0x7f3b7407bee0 2024-05-08T23:08:50.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.388+0000 7f3b7beb3700 1 -- 172.21.15.135:0/1974016258 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7419cdf0 con 0x7f3b7407bee0 2024-05-08T23:08:50.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.388+0000 7f3b6affd700 1 -- 172.21.15.135:0/1974016258 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b640247d0 con 0x7f3b7407bee0 2024-05-08T23:08:50.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.388+0000 7f3b7beb3700 1 -- 172.21.15.135:0/1974016258 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7419d290 con 0x7f3b7407bee0 2024-05-08T23:08:50.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.389+0000 7f3b7beb3700 1 -- 172.21.15.135:0/1974016258 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7410cad0 con 0x7f3b7407bee0 2024-05-08T23:08:50.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.390+0000 7f3b6affd700 1 -- 172.21.15.135:0/1974016258 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f3b6401abb0 con 0x7f3b7407bee0 2024-05-08T23:08:50.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.390+0000 7f3b6affd700 1 --2- 172.21.15.135:0/1974016258 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7f3b600386b0 0x7f3b6003ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:50.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.390+0000 7f3b6affd700 1 -- 172.21.15.135:0/1974016258 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3b6404c710 con 0x7f3b7407bee0 2024-05-08T23:08:50.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.390+0000 7f3b7944e700 1 --2- 172.21.15.135:0/1974016258 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7f3b600386b0 0x7f3b6003ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:50.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.390+0000 7f3b7944e700 1 --2- 172.21.15.135:0/1974016258 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7f3b600386b0 0x7f3b6003ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3b70006fd0 tx=0x7f3b70006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:50.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.394+0000 7f3b6affd700 1 -- 172.21.15.135:0/1974016258 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3b6402d3f0 con 0x7f3b7407bee0 2024-05-08T23:08:50.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.585+0000 7f3b7beb3700 1 -- 172.21.15.135:0/1974016258 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f3b7410cd40 con 0x7f3b7407bee0 2024-05-08T23:08:50.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.586+0000 7f3b6affd700 1 -- 172.21.15.135:0/1974016258 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f3b6402c3a0 con 0x7f3b7407bee0 2024-05-08T23:08:50.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.588+0000 7f3b7beb3700 1 -- 172.21.15.135:0/1974016258 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7f3b600386b0 msgr2=0x7f3b6003ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:50.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.588+0000 7f3b7beb3700 1 --2- 172.21.15.135:0/1974016258 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7f3b600386b0 0x7f3b6003ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3b70006fd0 tx=0x7f3b70006e40 comp rx=0 tx=0).stop 2024-05-08T23:08:50.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.588+0000 7f3b7beb3700 1 -- 172.21.15.135:0/1974016258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7407bee0 msgr2=0x7f3b7419c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:50.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.588+0000 7f3b7beb3700 1 --2- 172.21.15.135:0/1974016258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7407bee0 0x7f3b7419c6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009130 tx=0x7f3b64011ad0 comp rx=0 tx=0).stop 2024-05-08T23:08:50.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.588+0000 7f3b7beb3700 1 -- 172.21.15.135:0/1974016258 shutdown_connections 2024-05-08T23:08:50.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.588+0000 7f3b7beb3700 1 --2- 172.21.15.135:0/1974016258 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7f3b600386b0 0x7f3b6003ab70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:50.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.588+0000 7f3b7beb3700 1 --2- 172.21.15.135:0/1974016258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7407bee0 0x7f3b7419c6b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:50.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.588+0000 7f3b7beb3700 1 -- 172.21.15.135:0/1974016258 >> 172.21.15.135:0/1974016258 conn(0x7f3b74101d00 msgr2=0x7f3b74102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:50.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.588+0000 7f3b7beb3700 1 -- 172.21.15.135:0/1974016258 shutdown_connections 2024-05-08T23:08:50.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:50.588+0000 7f3b7beb3700 1 -- 172.21.15.135:0/1974016258 wait complete. 2024-05-08T23:08:50.993 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling cephadm module... 2024-05-08T23:08:51.932 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:51 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3335082426' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-08T23:08:51.932 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:51 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: ignoring --setuser ceph since I am not root 2024-05-08T23:08:51.932 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:51 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: ignoring --setgroup ceph since I am not root 2024-05-08T23:08:52.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.312+0000 7fc622d29700 1 Processor -- start 2024-05-08T23:08:52.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.312+0000 7fc622d29700 1 -- start start 2024-05-08T23:08:52.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.312+0000 7fc622d29700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c107210 0x7fc61c109600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:52.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.312+0000 7fc622d29700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c079e50 con 0x7fc61c107210 2024-05-08T23:08:52.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.313+0000 7fc620ac5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c107210 0x7fc61c109600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:52.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.313+0000 7fc620ac5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c107210 0x7fc61c109600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60164/0 (socket says 172.21.15.135:60164) 2024-05-08T23:08:52.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.313+0000 7fc620ac5700 1 -- 172.21.15.135:0/3657476844 learned_addr learned my addr 172.21.15.135:0/3657476844 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:52.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.313+0000 7fc620ac5700 1 -- 172.21.15.135:0/3657476844 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c109b40 con 0x7fc61c107210 2024-05-08T23:08:52.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.313+0000 7fc620ac5700 1 --2- 172.21.15.135:0/3657476844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c107210 0x7fc61c109600 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc6100098a0 tx=0x7fc610009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992f237166c5bbfb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:52.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.313+0000 7fc61b7fe700 1 -- 172.21.15.135:0/3657476844 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc610004160 con 0x7fc61c107210 2024-05-08T23:08:52.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.313+0000 7fc61b7fe700 1 -- 172.21.15.135:0/3657476844 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc6100042c0 con 0x7fc61c107210 2024-05-08T23:08:52.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.313+0000 7fc61b7fe700 1 -- 172.21.15.135:0/3657476844 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc610011a00 con 0x7fc61c107210 2024-05-08T23:08:52.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.314+0000 7fc622d29700 1 -- 172.21.15.135:0/3657476844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c107210 msgr2=0x7fc61c109600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:52.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.314+0000 7fc622d29700 1 --2- 172.21.15.135:0/3657476844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c107210 0x7fc61c109600 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc6100098a0 tx=0x7fc610009bb0 comp rx=0 tx=0).stop 2024-05-08T23:08:52.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.314+0000 7fc622d29700 1 -- 172.21.15.135:0/3657476844 shutdown_connections 2024-05-08T23:08:52.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.314+0000 7fc622d29700 1 --2- 172.21.15.135:0/3657476844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c107210 0x7fc61c109600 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:52.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.314+0000 7fc622d29700 1 -- 172.21.15.135:0/3657476844 >> 172.21.15.135:0/3657476844 conn(0x7fc61c100ba0 msgr2=0x7fc61c103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:52.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.314+0000 7fc622d29700 1 -- 172.21.15.135:0/3657476844 shutdown_connections 2024-05-08T23:08:52.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.314+0000 7fc622d29700 1 -- 172.21.15.135:0/3657476844 wait complete. 2024-05-08T23:08:52.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.314+0000 7fc622d29700 1 Processor -- start 2024-05-08T23:08:52.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.314+0000 7fc622d29700 1 -- start start 2024-05-08T23:08:52.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.315+0000 7fc622d29700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c107210 0x7fc61c19c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:52.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.315+0000 7fc622d29700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c19cc00 con 0x7fc61c107210 2024-05-08T23:08:52.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.315+0000 7fc620ac5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c107210 0x7fc61c19c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:52.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.315+0000 7fc620ac5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c107210 0x7fc61c19c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60176/0 (socket says 172.21.15.135:60176) 2024-05-08T23:08:52.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.315+0000 7fc620ac5700 1 -- 172.21.15.135:0/3335082426 learned_addr learned my addr 172.21.15.135:0/3335082426 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:52.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.315+0000 7fc620ac5700 1 -- 172.21.15.135:0/3335082426 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc610009550 con 0x7fc61c107210 2024-05-08T23:08:52.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.315+0000 7fc620ac5700 1 --2- 172.21.15.135:0/3335082426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c107210 0x7fc61c19c6c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc610009fb0 tx=0x7fc610011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:52.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.315+0000 7fc619ffb700 1 -- 172.21.15.135:0/3335082426 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc610003a40 con 0x7fc61c107210 2024-05-08T23:08:52.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.315+0000 7fc619ffb700 1 -- 172.21.15.135:0/3335082426 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc610003ba0 con 0x7fc61c107210 2024-05-08T23:08:52.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.315+0000 7fc622d29700 1 -- 172.21.15.135:0/3335082426 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c19ce00 con 0x7fc61c107210 2024-05-08T23:08:52.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.315+0000 7fc619ffb700 1 -- 172.21.15.135:0/3335082426 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc61001a750 con 0x7fc61c107210 2024-05-08T23:08:52.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.315+0000 7fc622d29700 1 -- 172.21.15.135:0/3335082426 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c19d2a0 con 0x7fc61c107210 2024-05-08T23:08:52.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.316+0000 7fc619ffb700 1 -- 172.21.15.135:0/3335082426 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7fc61001a9d0 con 0x7fc61c107210 2024-05-08T23:08:52.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.316+0000 7fc622d29700 1 -- 172.21.15.135:0/3335082426 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c10a890 con 0x7fc61c107210 2024-05-08T23:08:52.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.316+0000 7fc619ffb700 1 --2- 172.21.15.135:0/3335082426 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fc60c038660 0x7fc60c03ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:52.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.316+0000 7fc619ffb700 1 -- 172.21.15.135:0/3335082426 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc61004c350 con 0x7fc61c107210 2024-05-08T23:08:52.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.316+0000 7fc61bfff700 1 --2- 172.21.15.135:0/3335082426 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fc60c038660 0x7fc60c03ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:52.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.317+0000 7fc61bfff700 1 --2- 172.21.15.135:0/3335082426 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fc60c038660 0x7fc60c03ab20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc608006fd0 tx=0x7fc608006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:52.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.321+0000 7fc619ffb700 1 -- 172.21.15.135:0/3335082426 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc610018b80 con 0x7fc61c107210 2024-05-08T23:08:52.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.567+0000 7fc622d29700 1 -- 172.21.15.135:0/3335082426 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fc61c10aad0 con 0x7fc61c107210 2024-05-08T23:08:52.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.640+0000 7fc619ffb700 1 -- 172.21.15.135:0/3335082426 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fc61002d9e0 con 0x7fc61c107210 2024-05-08T23:08:52.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.642+0000 7fc619ffb700 1 -- 172.21.15.135:0/3335082426 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fc61004eba0 con 0x7fc61c107210 2024-05-08T23:08:52.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.644+0000 7fc622d29700 1 -- 172.21.15.135:0/3335082426 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fc60c038660 msgr2=0x7fc60c03ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:52.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.644+0000 7fc622d29700 1 --2- 172.21.15.135:0/3335082426 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fc60c038660 0x7fc60c03ab20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc608006fd0 tx=0x7fc608006e40 comp rx=0 tx=0).stop 2024-05-08T23:08:52.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.644+0000 7fc622d29700 1 -- 172.21.15.135:0/3335082426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c107210 msgr2=0x7fc61c19c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:52.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.644+0000 7fc622d29700 1 --2- 172.21.15.135:0/3335082426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c107210 0x7fc61c19c6c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc610009fb0 tx=0x7fc610011ad0 comp rx=0 tx=0).stop 2024-05-08T23:08:52.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.644+0000 7fc622d29700 1 -- 172.21.15.135:0/3335082426 shutdown_connections 2024-05-08T23:08:52.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.644+0000 7fc622d29700 1 --2- 172.21.15.135:0/3335082426 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fc60c038660 0x7fc60c03ab20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:52.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.644+0000 7fc622d29700 1 --2- 172.21.15.135:0/3335082426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c107210 0x7fc61c19c6c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:52.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.644+0000 7fc622d29700 1 -- 172.21.15.135:0/3335082426 >> 172.21.15.135:0/3335082426 conn(0x7fc61c100ba0 msgr2=0x7fc61c101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:52.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.644+0000 7fc622d29700 1 -- 172.21.15.135:0/3335082426 shutdown_connections 2024-05-08T23:08:52.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:51.645+0000 7fc622d29700 1 -- 172.21.15.135:0/3335082426 wait complete. 2024-05-08T23:08:52.203 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:52 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:52.080+0000 7fd1ed630200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T23:08:52.203 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:52 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:52.179+0000 7fd1ed630200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T23:08:52.624 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:52 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:52.270+0000 7fd1ed630200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T23:08:52.624 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:52 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:52.358+0000 7fd1ed630200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T23:08:52.882 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:52 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3335082426' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-08T23:08:52.882 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:52 smithi135 ceph-mon[42440]: mgrmap e5: x(active, since 7s) 2024-05-08T23:08:52.882 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:52 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3686459777' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-08T23:08:52.944 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:08:52.945 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-08T23:08:52.945 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T23:08:52.945 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-08T23:08:52.945 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-08T23:08:52.945 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:08:52.945 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.332+0000 7fa314880700 1 Processor -- start 2024-05-08T23:08:52.945 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.332+0000 7fa314880700 1 -- start start 2024-05-08T23:08:52.945 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.332+0000 7fa314880700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa310105060 0x7fa310105480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:52.945 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.332+0000 7fa314880700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310079e70 con 0x7fa310105060 2024-05-08T23:08:52.945 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.332+0000 7fa30e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa310105060 0x7fa310105480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:52.945 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.332+0000 7fa30e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa310105060 0x7fa310105480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60218/0 (socket says 172.21.15.135:60218) 2024-05-08T23:08:52.945 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.333+0000 7fa30e59c700 1 -- 172.21.15.135:0/3298115888 learned_addr learned my addr 172.21.15.135:0/3298115888 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:52.946 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.333+0000 7fa30e59c700 1 -- 172.21.15.135:0/3298115888 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3101059c0 con 0x7fa310105060 2024-05-08T23:08:52.946 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.333+0000 7fa30e59c700 1 --2- 172.21.15.135:0/3298115888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa310105060 0x7fa310105480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa3000098a0 tx=0x7fa300009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1127374409dcb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:52.946 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.333+0000 7fa30d59a700 1 -- 172.21.15.135:0/3298115888 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa300004160 con 0x7fa310105060 2024-05-08T23:08:52.946 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.333+0000 7fa30d59a700 1 -- 172.21.15.135:0/3298115888 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa3000042c0 con 0x7fa310105060 2024-05-08T23:08:52.946 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.333+0000 7fa30d59a700 1 -- 172.21.15.135:0/3298115888 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa300011a00 con 0x7fa310105060 2024-05-08T23:08:52.946 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.334+0000 7fa314880700 1 -- 172.21.15.135:0/3298115888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa310105060 msgr2=0x7fa310105480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:52.946 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.334+0000 7fa314880700 1 --2- 172.21.15.135:0/3298115888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa310105060 0x7fa310105480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa3000098a0 tx=0x7fa300009bb0 comp rx=0 tx=0).stop 2024-05-08T23:08:52.946 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.334+0000 7fa314880700 1 -- 172.21.15.135:0/3298115888 shutdown_connections 2024-05-08T23:08:52.947 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.334+0000 7fa314880700 1 --2- 172.21.15.135:0/3298115888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa310105060 0x7fa310105480 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:52.947 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.334+0000 7fa314880700 1 -- 172.21.15.135:0/3298115888 >> 172.21.15.135:0/3298115888 conn(0x7fa310100c80 msgr2=0x7fa3101030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:52.947 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.334+0000 7fa314880700 1 -- 172.21.15.135:0/3298115888 shutdown_connections 2024-05-08T23:08:52.947 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.334+0000 7fa314880700 1 -- 172.21.15.135:0/3298115888 wait complete. 2024-05-08T23:08:52.947 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.335+0000 7fa314880700 1 Processor -- start 2024-05-08T23:08:52.947 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.335+0000 7fa314880700 1 -- start start 2024-05-08T23:08:52.947 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.335+0000 7fa314880700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa310105060 0x7fa31019c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:52.947 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.335+0000 7fa314880700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31019cc40 con 0x7fa310105060 2024-05-08T23:08:52.947 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.335+0000 7fa30e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa310105060 0x7fa31019c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:08:52.947 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.335+0000 7fa30e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa310105060 0x7fa31019c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60222/0 (socket says 172.21.15.135:60222) 2024-05-08T23:08:52.947 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.335+0000 7fa30e59c700 1 -- 172.21.15.135:0/3686459777 learned_addr learned my addr 172.21.15.135:0/3686459777 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:08:52.947 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.335+0000 7fa30e59c700 1 -- 172.21.15.135:0/3686459777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa300009550 con 0x7fa310105060 2024-05-08T23:08:52.947 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.335+0000 7fa30e59c700 1 --2- 172.21.15.135:0/3686459777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa310105060 0x7fa31019c700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa300009130 tx=0x7fa300011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:08:52.947 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.335+0000 7fa2ff7fe700 1 -- 172.21.15.135:0/3686459777 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3000038b0 con 0x7fa310105060 2024-05-08T23:08:52.947 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.336+0000 7fa2ff7fe700 1 -- 172.21.15.135:0/3686459777 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa300003a10 con 0x7fa310105060 2024-05-08T23:08:52.948 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.336+0000 7fa314880700 1 -- 172.21.15.135:0/3686459777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31019ce40 con 0x7fa310105060 2024-05-08T23:08:52.948 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.336+0000 7fa2ff7fe700 1 -- 172.21.15.135:0/3686459777 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa300019550 con 0x7fa310105060 2024-05-08T23:08:52.948 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.336+0000 7fa314880700 1 -- 172.21.15.135:0/3686459777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31019d2e0 con 0x7fa310105060 2024-05-08T23:08:52.948 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.336+0000 7fa2ff7fe700 1 -- 172.21.15.135:0/3686459777 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fa300019810 con 0x7fa310105060 2024-05-08T23:08:52.948 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.336+0000 7fa314880700 1 -- 172.21.15.135:0/3686459777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa310196380 con 0x7fa310105060 2024-05-08T23:08:52.948 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.337+0000 7fa2ff7fe700 1 --2- 172.21.15.135:0/3686459777 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fa2f8038690 0x7fa2f803ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:08:52.948 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.337+0000 7fa2ff7fe700 1 -- 172.21.15.135:0/3686459777 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa30004c490 con 0x7fa310105060 2024-05-08T23:08:52.948 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.337+0000 7fa30dd9b700 1 -- 172.21.15.135:0/3686459777 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fa2f8038690 msgr2=0x7fa2f803ab50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/104127578 2024-05-08T23:08:52.948 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.337+0000 7fa30dd9b700 1 --2- 172.21.15.135:0/3686459777 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fa2f8038690 0x7fa2f803ab50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:08:52.948 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.342+0000 7fa2ff7fe700 1 -- 172.21.15.135:0/3686459777 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa30002d960 con 0x7fa310105060 2024-05-08T23:08:52.948 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.538+0000 7fa30dd9b700 1 -- 172.21.15.135:0/3686459777 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fa2f8038690 msgr2=0x7fa2f803ab50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/104127578 2024-05-08T23:08:52.948 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.538+0000 7fa30dd9b700 1 --2- 172.21.15.135:0/3686459777 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fa2f8038690 0x7fa2f803ab50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T23:08:52.948 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.598+0000 7fa314880700 1 -- 172.21.15.135:0/3686459777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fa310106830 con 0x7fa310105060 2024-05-08T23:08:52.948 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.598+0000 7fa2ff7fe700 1 -- 172.21.15.135:0/3686459777 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fa300018b40 con 0x7fa310105060 2024-05-08T23:08:52.949 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.600+0000 7fa314880700 1 -- 172.21.15.135:0/3686459777 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fa2f8038690 msgr2=0x7fa2f803ab50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:08:52.949 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.600+0000 7fa314880700 1 --2- 172.21.15.135:0/3686459777 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fa2f8038690 0x7fa2f803ab50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:52.949 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.600+0000 7fa314880700 1 -- 172.21.15.135:0/3686459777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa310105060 msgr2=0x7fa31019c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:08:52.949 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.600+0000 7fa314880700 1 --2- 172.21.15.135:0/3686459777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa310105060 0x7fa31019c700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa300009130 tx=0x7fa300011ad0 comp rx=0 tx=0).stop 2024-05-08T23:08:52.949 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.600+0000 7fa314880700 1 -- 172.21.15.135:0/3686459777 shutdown_connections 2024-05-08T23:08:52.949 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.600+0000 7fa314880700 1 --2- 172.21.15.135:0/3686459777 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fa2f8038690 0x7fa2f803ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:52.949 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.600+0000 7fa314880700 1 --2- 172.21.15.135:0/3686459777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa310105060 0x7fa31019c700 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:08:52.949 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.600+0000 7fa314880700 1 -- 172.21.15.135:0/3686459777 >> 172.21.15.135:0/3686459777 conn(0x7fa310100c80 msgr2=0x7fa3101934c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:08:52.949 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.600+0000 7fa314880700 1 -- 172.21.15.135:0/3686459777 shutdown_connections 2024-05-08T23:08:52.949 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:52.600+0000 7fa314880700 1 -- 172.21.15.135:0/3686459777 wait complete. 2024-05-08T23:08:52.949 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for the mgr to restart... 2024-05-08T23:08:52.949 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mgr epoch 5... 2024-05-08T23:08:53.203 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:53 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:53.012+0000 7fd1ed630200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:08:53.634 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:53 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:53.278+0000 7fd1ed630200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T23:08:53.634 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:53 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:53.368+0000 7fd1ed630200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T23:08:53.635 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:53 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:53.478+0000 7fd1ed630200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T23:08:53.635 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:53 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:53.635+0000 7fd1ed630200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T23:08:53.953 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:53 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:53.762+0000 7fd1ed630200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T23:08:53.953 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:53 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:53.846+0000 7fd1ed630200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T23:08:54.604 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:54 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:54.216+0000 7fd1ed630200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T23:08:54.889 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:54 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:54.604+0000 7fd1ed630200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T23:08:54.889 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:54 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:54.798+0000 7fd1ed630200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T23:08:54.889 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:54 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:54.890+0000 7fd1ed630200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T23:08:55.953 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:55 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:55.647+0000 7fd1ed630200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T23:08:55.953 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:55 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:55.744+0000 7fd1ed630200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T23:08:55.953 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:55 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:55.892+0000 7fd1ed630200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T23:08:56.896 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:56 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:56.519+0000 7fd1ed630200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T23:08:56.896 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:56 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:56.701+0000 7fd1ed630200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T23:08:57.203 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:56 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:56.897+0000 7fd1ed630200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T23:08:58.114 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:57 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:57.832+0000 7fd1ed630200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T23:08:58.393 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:58 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:58.115+0000 7fd1ed630200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:08:58.393 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:58 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:58.203+0000 7fd1ed630200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T23:08:58.703 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:08:58 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:08:58.393+0000 7fd1ed630200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T23:08:58.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:58 smithi135 ceph-mon[42440]: Active manager daemon x restarted 2024-05-08T23:08:58.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:58 smithi135 ceph-mon[42440]: Activating manager daemon x 2024-05-08T23:08:58.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:58 smithi135 ceph-mon[42440]: osdmap e2: 0 total, 0 up, 0 in 2024-05-08T23:08:58.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:58 smithi135 ceph-mon[42440]: mgrmap e6: x(active, starting, since 0.00557329s) 2024-05-08T23:08:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:58 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:08:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:58 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T23:08:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:58 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T23:08:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:58 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T23:08:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:58 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T23:08:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:58 smithi135 ceph-mon[42440]: Manager daemon x is now available 2024-05-08T23:08:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:58 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' 2024-05-08T23:08:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:58 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' 2024-05-08T23:08:58.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:58 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:08:59.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:59 smithi135 ceph-mon[42440]: Found migration_current of "None". Setting to last migration. 2024-05-08T23:08:59.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:59 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:08:59.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:59 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T23:08:59.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:59 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T23:08:59.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:59 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' 2024-05-08T23:08:59.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:59 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' 2024-05-08T23:08:59.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:59 smithi135 ceph-mon[42440]: mgrmap e7: x(active, since 1.00641s) 2024-05-08T23:08:59.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:08:59 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:09:00.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:00 smithi135 ceph-mon[42440]: [08/May/2024:23:08:59] ENGINE Bus STARTING 2024-05-08T23:09:00.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:00 smithi135 ceph-mon[42440]: [08/May/2024:23:08:59] ENGINE Serving on http://172.21.15.135:8765 2024-05-08T23:09:00.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:00 smithi135 ceph-mon[42440]: [08/May/2024:23:08:59] ENGINE Serving on https://172.21.15.135:7150 2024-05-08T23:09:00.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:00 smithi135 ceph-mon[42440]: [08/May/2024:23:08:59] ENGINE Bus STARTED 2024-05-08T23:09:00.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:00 smithi135 ceph-mon[42440]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-08T23:09:00.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:00 smithi135 ceph-mon[42440]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-08T23:09:01.520 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:09:01.521 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-08T23:09:01.521 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-08T23:09:01.521 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:09:01.521 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.322+0000 7fd227420700 1 Processor -- start 2024-05-08T23:09:01.521 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.322+0000 7fd227420700 1 -- start start 2024-05-08T23:09:01.521 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.322+0000 7fd227420700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2201071e0 0x7fd2201095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:01.521 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.322+0000 7fd227420700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd220079e90 con 0x7fd2201071e0 2024-05-08T23:09:01.521 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.322+0000 7fd2251bc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2201071e0 0x7fd2201095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:01.522 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.322+0000 7fd2251bc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2201071e0 0x7fd2201095d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60232/0 (socket says 172.21.15.135:60232) 2024-05-08T23:09:01.522 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.322+0000 7fd2251bc700 1 -- 172.21.15.135:0/3129284456 learned_addr learned my addr 172.21.15.135:0/3129284456 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:01.522 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.323+0000 7fd2251bc700 1 -- 172.21.15.135:0/3129284456 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd220109b10 con 0x7fd2201071e0 2024-05-08T23:09:01.522 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.323+0000 7fd2251bc700 1 --2- 172.21.15.135:0/3129284456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2201071e0 0x7fd2201095d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0098a0 tx=0x7fd21c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7a4f83c80f5c3f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:01.522 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.323+0000 7fd217fff700 1 -- 172.21.15.135:0/3129284456 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd21c004160 con 0x7fd2201071e0 2024-05-08T23:09:01.522 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.323+0000 7fd217fff700 1 -- 172.21.15.135:0/3129284456 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd21c0042c0 con 0x7fd2201071e0 2024-05-08T23:09:01.522 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.323+0000 7fd217fff700 1 -- 172.21.15.135:0/3129284456 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd21c011a00 con 0x7fd2201071e0 2024-05-08T23:09:01.522 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.324+0000 7fd227420700 1 -- 172.21.15.135:0/3129284456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2201071e0 msgr2=0x7fd2201095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:01.522 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.324+0000 7fd227420700 1 --2- 172.21.15.135:0/3129284456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2201071e0 0x7fd2201095d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0098a0 tx=0x7fd21c009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:01.522 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.324+0000 7fd227420700 1 -- 172.21.15.135:0/3129284456 shutdown_connections 2024-05-08T23:09:01.522 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.324+0000 7fd227420700 1 --2- 172.21.15.135:0/3129284456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2201071e0 0x7fd2201095d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:01.522 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.324+0000 7fd227420700 1 -- 172.21.15.135:0/3129284456 >> 172.21.15.135:0/3129284456 conn(0x7fd220100bd0 msgr2=0x7fd220103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:01.523 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.324+0000 7fd227420700 1 -- 172.21.15.135:0/3129284456 shutdown_connections 2024-05-08T23:09:01.523 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.324+0000 7fd227420700 1 -- 172.21.15.135:0/3129284456 wait complete. 2024-05-08T23:09:01.523 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.324+0000 7fd227420700 1 Processor -- start 2024-05-08T23:09:01.523 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.324+0000 7fd227420700 1 -- start start 2024-05-08T23:09:01.523 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.325+0000 7fd227420700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2201071e0 0x7fd22019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:01.523 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.325+0000 7fd227420700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22019a9f0 con 0x7fd2201071e0 2024-05-08T23:09:01.523 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.325+0000 7fd2251bc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2201071e0 0x7fd22019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:01.523 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.325+0000 7fd2251bc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2201071e0 0x7fd22019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60248/0 (socket says 172.21.15.135:60248) 2024-05-08T23:09:01.523 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.325+0000 7fd2251bc700 1 -- 172.21.15.135:0/653115788 learned_addr learned my addr 172.21.15.135:0/653115788 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:01.523 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.325+0000 7fd2251bc700 1 -- 172.21.15.135:0/653115788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c009550 con 0x7fd2201071e0 2024-05-08T23:09:01.523 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.325+0000 7fd2251bc700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2201071e0 0x7fd22019a4b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009130 tx=0x7fd21c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:01.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.325+0000 7fd2167fc700 1 -- 172.21.15.135:0/653115788 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd21c003b70 con 0x7fd2201071e0 2024-05-08T23:09:01.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.325+0000 7fd227420700 1 -- 172.21.15.135:0/653115788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22019abf0 con 0x7fd2201071e0 2024-05-08T23:09:01.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.325+0000 7fd2167fc700 1 -- 172.21.15.135:0/653115788 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd21c003cd0 con 0x7fd2201071e0 2024-05-08T23:09:01.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.325+0000 7fd2167fc700 1 -- 172.21.15.135:0/653115788 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd21c0197d0 con 0x7fd2201071e0 2024-05-08T23:09:01.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.325+0000 7fd227420700 1 -- 172.21.15.135:0/653115788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22019b090 con 0x7fd2201071e0 2024-05-08T23:09:01.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.327+0000 7fd2167fc700 1 -- 172.21.15.135:0/653115788 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fd21c01abb0 con 0x7fd2201071e0 2024-05-08T23:09:01.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.327+0000 7fd2167fc700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fd20c038750 0x7fd20c03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:01.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.327+0000 7fd2167fc700 1 -- 172.21.15.135:0/653115788 --> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd20c03b320 con 0x7fd20c038750 2024-05-08T23:09:01.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.327+0000 7fd2167fc700 1 -- 172.21.15.135:0/653115788 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd21c04c910 con 0x7fd2201071e0 2024-05-08T23:09:01.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.327+0000 7fd2249bb700 1 -- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fd20c038750 msgr2=0x7fd20c03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/104127578 2024-05-08T23:09:01.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.327+0000 7fd2249bb700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fd20c038750 0x7fd20c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:09:01.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.528+0000 7fd2249bb700 1 -- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fd20c038750 msgr2=0x7fd20c03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/104127578 2024-05-08T23:09:01.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.528+0000 7fd2249bb700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fd20c038750 0x7fd20c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T23:09:01.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.929+0000 7fd2249bb700 1 -- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fd20c038750 msgr2=0x7fd20c03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/104127578 2024-05-08T23:09:01.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:53.929+0000 7fd2249bb700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fd20c038750 0x7fd20c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T23:09:01.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:54.730+0000 7fd2249bb700 1 -- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fd20c038750 msgr2=0x7fd20c03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/104127578 2024-05-08T23:09:01.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:54.730+0000 7fd2249bb700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fd20c038750 0x7fd20c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T23:09:01.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:56.331+0000 7fd2249bb700 1 -- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fd20c038750 msgr2=0x7fd20c03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/104127578 2024-05-08T23:09:01.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:56.331+0000 7fd2249bb700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fd20c038750 0x7fd20c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-08T23:09:01.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:58.411+0000 7fd2167fc700 1 -- 172.21.15.135:0/653115788 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mgrmap(e 6) v1 ==== 45308+0+0 (secure 0 0 0) 0x7fd21c019a10 con 0x7fd2201071e0 2024-05-08T23:09:01.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:58.412+0000 7fd2167fc700 1 -- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fd20c038750 msgr2=0x7fd20c03ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:09:01.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:58.412+0000 7fd2167fc700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fd20c038750 0x7fd20c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:01.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.411+0000 7fd2167fc700 1 -- 172.21.15.135:0/653115788 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7fd21c019d90 con 0x7fd2201071e0 2024-05-08T23:09:01.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.411+0000 7fd2167fc700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fd20c03bfe0 0x7fd20c03e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:01.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.411+0000 7fd2167fc700 1 -- 172.21.15.135:0/653115788 --> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd20c03b320 con 0x7fd20c03bfe0 2024-05-08T23:09:01.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.411+0000 7fd2249bb700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fd20c03bfe0 0x7fd20c03e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:01.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.412+0000 7fd2249bb700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fd20c03bfe0 0x7fd20c03e3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd210003a10 tx=0x7fd2100092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:01.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.413+0000 7fd2167fc700 1 -- 172.21.15.135:0/653115788 <== mgr.14120 v2:172.21.15.135:6800/3165594440 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7fd20c03b320 con 0x7fd20c03bfe0 2024-05-08T23:09:01.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.419+0000 7fd227420700 1 -- 172.21.15.135:0/653115788 --> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fd22019b220 con 0x7fd20c03bfe0 2024-05-08T23:09:01.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.420+0000 7fd2167fc700 1 -- 172.21.15.135:0/653115788 <== mgr.14120 v2:172.21.15.135:6800/3165594440 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd21000a050 con 0x7fd20c03bfe0 2024-05-08T23:09:01.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.420+0000 7fd227420700 1 -- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fd20c03bfe0 msgr2=0x7fd20c03e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:01.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.420+0000 7fd227420700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fd20c03bfe0 0x7fd20c03e3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd210003a10 tx=0x7fd2100092b0 comp rx=0 tx=0).stop 2024-05-08T23:09:01.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.420+0000 7fd227420700 1 -- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2201071e0 msgr2=0x7fd22019a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:01.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.420+0000 7fd227420700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2201071e0 0x7fd22019a4b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009130 tx=0x7fd21c011ad0 comp rx=0 tx=0).stop 2024-05-08T23:09:01.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.420+0000 7fd227420700 1 -- 172.21.15.135:0/653115788 shutdown_connections 2024-05-08T23:09:01.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.420+0000 7fd227420700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fd20c03bfe0 0x7fd20c03e3d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:01.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.420+0000 7fd227420700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2201071e0 0x7fd22019a4b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:01.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.420+0000 7fd227420700 1 --2- 172.21.15.135:0/653115788 >> [v2:172.21.15.135:6800/104127578,v1:172.21.15.135:6801/104127578] conn(0x7fd20c038750 0x7fd20c03ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:01.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.420+0000 7fd227420700 1 -- 172.21.15.135:0/653115788 >> 172.21.15.135:0/653115788 conn(0x7fd220100bd0 msgr2=0x7fd220101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:01.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.420+0000 7fd227420700 1 -- 172.21.15.135:0/653115788 shutdown_connections 2024-05-08T23:09:01.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:08:59.420+0000 7fd227420700 1 -- 172.21.15.135:0/653115788 wait complete. 2024-05-08T23:09:01.527 INFO:teuthology.orchestra.run.smithi135.stdout:mgr epoch 5 is available 2024-05-08T23:09:01.528 INFO:teuthology.orchestra.run.smithi135.stdout:Setting orchestrator backend to cephadm... 2024-05-08T23:09:01.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:01 smithi135 ceph-mon[42440]: mgrmap e8: x(active, since 2s) 2024-05-08T23:09:02.426 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.837+0000 7fa343642700 1 Processor -- start 2024-05-08T23:09:02.426 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.838+0000 7fa343642700 1 -- start start 2024-05-08T23:09:02.426 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.838+0000 7fa343642700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa33c105620 0x7fa33c105a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:02.426 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.838+0000 7fa343642700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c106010 con 0x7fa33c105620 2024-05-08T23:09:02.426 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.838+0000 7fa3413de700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa33c105620 0x7fa33c105a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:02.426 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.838+0000 7fa3413de700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa33c105620 0x7fa33c105a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48686/0 (socket says 172.21.15.135:48686) 2024-05-08T23:09:02.426 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.838+0000 7fa3413de700 1 -- 172.21.15.135:0/3444636931 learned_addr learned my addr 172.21.15.135:0/3444636931 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:02.426 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.838+0000 7fa3413de700 1 -- 172.21.15.135:0/3444636931 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c106820 con 0x7fa33c105620 2024-05-08T23:09:02.426 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.838+0000 7fa3413de700 1 --2- 172.21.15.135:0/3444636931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa33c105620 0x7fa33c105a40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0098a0 tx=0x7fa32c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7edad5602673d9c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:02.427 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.838+0000 7fa333fff700 1 -- 172.21.15.135:0/3444636931 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa32c004160 con 0x7fa33c105620 2024-05-08T23:09:02.427 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.839+0000 7fa333fff700 1 -- 172.21.15.135:0/3444636931 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa32c0042c0 con 0x7fa33c105620 2024-05-08T23:09:02.427 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.839+0000 7fa333fff700 1 -- 172.21.15.135:0/3444636931 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa32c011a00 con 0x7fa33c105620 2024-05-08T23:09:02.427 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.839+0000 7fa343642700 1 -- 172.21.15.135:0/3444636931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa33c105620 msgr2=0x7fa33c105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:02.427 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.839+0000 7fa343642700 1 --2- 172.21.15.135:0/3444636931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa33c105620 0x7fa33c105a40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0098a0 tx=0x7fa32c009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:02.427 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.839+0000 7fa343642700 1 -- 172.21.15.135:0/3444636931 shutdown_connections 2024-05-08T23:09:02.427 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.839+0000 7fa343642700 1 --2- 172.21.15.135:0/3444636931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa33c105620 0x7fa33c105a40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:02.427 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.839+0000 7fa343642700 1 -- 172.21.15.135:0/3444636931 >> 172.21.15.135:0/3444636931 conn(0x7fa33c100bc0 msgr2=0x7fa33c103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:02.427 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.839+0000 7fa343642700 1 -- 172.21.15.135:0/3444636931 shutdown_connections 2024-05-08T23:09:02.427 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.839+0000 7fa343642700 1 -- 172.21.15.135:0/3444636931 wait complete. 2024-05-08T23:09:02.427 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.840+0000 7fa343642700 1 Processor -- start 2024-05-08T23:09:02.427 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.840+0000 7fa343642700 1 -- start start 2024-05-08T23:09:02.428 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.840+0000 7fa343642700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa33c105620 0x7fa33c1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:02.428 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.840+0000 7fa343642700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c1998f0 con 0x7fa33c105620 2024-05-08T23:09:02.428 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.840+0000 7fa3413de700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa33c105620 0x7fa33c1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:02.428 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.840+0000 7fa3413de700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa33c105620 0x7fa33c1993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48688/0 (socket says 172.21.15.135:48688) 2024-05-08T23:09:02.428 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.840+0000 7fa3413de700 1 -- 172.21.15.135:0/1249738418 learned_addr learned my addr 172.21.15.135:0/1249738418 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:02.428 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.840+0000 7fa3413de700 1 -- 172.21.15.135:0/1249738418 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c009550 con 0x7fa33c105620 2024-05-08T23:09:02.428 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.840+0000 7fa3413de700 1 --2- 172.21.15.135:0/1249738418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa33c105620 0x7fa33c1993b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009fb0 tx=0x7fa32c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:02.428 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.841+0000 7fa3327fc700 1 -- 172.21.15.135:0/1249738418 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa32c003a40 con 0x7fa33c105620 2024-05-08T23:09:02.428 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.841+0000 7fa3327fc700 1 -- 172.21.15.135:0/1249738418 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa32c003ba0 con 0x7fa33c105620 2024-05-08T23:09:02.428 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.841+0000 7fa343642700 1 -- 172.21.15.135:0/1249738418 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33c199af0 con 0x7fa33c105620 2024-05-08T23:09:02.428 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.841+0000 7fa3327fc700 1 -- 172.21.15.135:0/1249738418 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa32c01a750 con 0x7fa33c105620 2024-05-08T23:09:02.428 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.841+0000 7fa343642700 1 -- 172.21.15.135:0/1249738418 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33c199f90 con 0x7fa33c105620 2024-05-08T23:09:02.428 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.842+0000 7fa3327fc700 1 -- 172.21.15.135:0/1249738418 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fa32c01a980 con 0x7fa33c105620 2024-05-08T23:09:02.428 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.842+0000 7fa3327fc700 1 --2- 172.21.15.135:0/1249738418 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fa328038700 0x7fa32803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:02.429 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.842+0000 7fa343642700 1 -- 172.21.15.135:0/1249738418 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33c109a50 con 0x7fa33c105620 2024-05-08T23:09:02.429 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.842+0000 7fa3327fc700 1 -- 172.21.15.135:0/1249738418 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa32c04c870 con 0x7fa33c105620 2024-05-08T23:09:02.429 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.842+0000 7fa340bdd700 1 --2- 172.21.15.135:0/1249738418 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fa328038700 0x7fa32803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:02.429 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.842+0000 7fa340bdd700 1 --2- 172.21.15.135:0/1249738418 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fa328038700 0x7fa32803abc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa338006fd0 tx=0x7fa338006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:02.429 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:01.847+0000 7fa3327fc700 1 -- 172.21.15.135:0/1249738418 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa32c01ac30 con 0x7fa33c105620 2024-05-08T23:09:02.429 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.053+0000 7fa343642700 1 -- 172.21.15.135:0/1249738418 --> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fa33c101eb0 con 0x7fa328038700 2024-05-08T23:09:02.429 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.061+0000 7fa3327fc700 1 -- 172.21.15.135:0/1249738418 <== mgr.14120 v2:172.21.15.135:6800/3165594440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa33c101eb0 con 0x7fa328038700 2024-05-08T23:09:02.429 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.064+0000 7fa343642700 1 -- 172.21.15.135:0/1249738418 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fa328038700 msgr2=0x7fa32803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:02.429 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.064+0000 7fa343642700 1 --2- 172.21.15.135:0/1249738418 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fa328038700 0x7fa32803abc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa338006fd0 tx=0x7fa338006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:02.429 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.064+0000 7fa343642700 1 -- 172.21.15.135:0/1249738418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa33c105620 msgr2=0x7fa33c1993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:02.429 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.064+0000 7fa343642700 1 --2- 172.21.15.135:0/1249738418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa33c105620 0x7fa33c1993b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009fb0 tx=0x7fa32c011ad0 comp rx=0 tx=0).stop 2024-05-08T23:09:02.429 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.064+0000 7fa343642700 1 -- 172.21.15.135:0/1249738418 shutdown_connections 2024-05-08T23:09:02.429 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.065+0000 7fa343642700 1 --2- 172.21.15.135:0/1249738418 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fa328038700 0x7fa32803abc0 secure :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa338006fd0 tx=0x7fa338006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:02.429 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.065+0000 7fa343642700 1 --2- 172.21.15.135:0/1249738418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa33c105620 0x7fa33c1993b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:02.430 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.065+0000 7fa343642700 1 -- 172.21.15.135:0/1249738418 >> 172.21.15.135:0/1249738418 conn(0x7fa33c100bc0 msgr2=0x7fa33c1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:02.430 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.065+0000 7fa343642700 1 -- 172.21.15.135:0/1249738418 shutdown_connections 2024-05-08T23:09:02.430 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.065+0000 7fa343642700 1 -- 172.21.15.135:0/1249738418 wait complete. 2024-05-08T23:09:03.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-08T23:09:03.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.752+0000 7f9926530700 1 Processor -- start 2024-05-08T23:09:03.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.752+0000 7f9926530700 1 -- start start 2024-05-08T23:09:03.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.752+0000 7f9926530700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920106720 0x7f9920106b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:03.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.752+0000 7f9926530700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920107110 con 0x7f9920106720 2024-05-08T23:09:03.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.753+0000 7f991ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920106720 0x7f9920106b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:03.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.753+0000 7f991ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920106720 0x7f9920106b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48692/0 (socket says 172.21.15.135:48692) 2024-05-08T23:09:03.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.753+0000 7f991ffff700 1 -- 172.21.15.135:0/368808656 learned_addr learned my addr 172.21.15.135:0/368808656 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:03.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.753+0000 7f991ffff700 1 -- 172.21.15.135:0/368808656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920107920 con 0x7f9920106720 2024-05-08T23:09:03.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.753+0000 7f991ffff700 1 --2- 172.21.15.135:0/368808656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920106720 0x7f9920106b40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f99140098a0 tx=0x7f9914009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76786faedff8975a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:03.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.753+0000 7f991effd700 1 -- 172.21.15.135:0/368808656 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9914004160 con 0x7f9920106720 2024-05-08T23:09:03.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.753+0000 7f991effd700 1 -- 172.21.15.135:0/368808656 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f99140042c0 con 0x7f9920106720 2024-05-08T23:09:03.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.753+0000 7f991effd700 1 -- 172.21.15.135:0/368808656 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9914011a00 con 0x7f9920106720 2024-05-08T23:09:03.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.754+0000 7f9926530700 1 -- 172.21.15.135:0/368808656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920106720 msgr2=0x7f9920106b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:03.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.754+0000 7f9926530700 1 --2- 172.21.15.135:0/368808656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920106720 0x7f9920106b40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f99140098a0 tx=0x7f9914009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:03.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.754+0000 7f9926530700 1 -- 172.21.15.135:0/368808656 shutdown_connections 2024-05-08T23:09:03.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.754+0000 7f9926530700 1 --2- 172.21.15.135:0/368808656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920106720 0x7f9920106b40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:03.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.754+0000 7f9926530700 1 -- 172.21.15.135:0/368808656 >> 172.21.15.135:0/368808656 conn(0x7f9920101ca0 msgr2=0x7f9920104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:03.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.754+0000 7f9926530700 1 -- 172.21.15.135:0/368808656 shutdown_connections 2024-05-08T23:09:03.328 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.754+0000 7f9926530700 1 -- 172.21.15.135:0/368808656 wait complete. 2024-05-08T23:09:03.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.754+0000 7f9926530700 1 Processor -- start 2024-05-08T23:09:03.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.754+0000 7f9926530700 1 -- start start 2024-05-08T23:09:03.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.755+0000 7f9926530700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920106720 0x7f992007bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:03.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.755+0000 7f9926530700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992007c080 con 0x7f9920106720 2024-05-08T23:09:03.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.755+0000 7f991ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920106720 0x7f992007bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:03.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.755+0000 7f991ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920106720 0x7f992007bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48704/0 (socket says 172.21.15.135:48704) 2024-05-08T23:09:03.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.755+0000 7f991ffff700 1 -- 172.21.15.135:0/3794008036 learned_addr learned my addr 172.21.15.135:0/3794008036 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:03.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.755+0000 7f991ffff700 1 -- 172.21.15.135:0/3794008036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9914009550 con 0x7f9920106720 2024-05-08T23:09:03.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.755+0000 7f991ffff700 1 --2- 172.21.15.135:0/3794008036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920106720 0x7f992007bb40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9914009fb0 tx=0x7f9914011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:03.329 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.755+0000 7f991d7fa700 1 -- 172.21.15.135:0/3794008036 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9914003a40 con 0x7f9920106720 2024-05-08T23:09:03.330 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.755+0000 7f991d7fa700 1 -- 172.21.15.135:0/3794008036 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9914003ba0 con 0x7f9920106720 2024-05-08T23:09:03.330 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.755+0000 7f9926530700 1 -- 172.21.15.135:0/3794008036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992007a2c0 con 0x7f9920106720 2024-05-08T23:09:03.330 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.755+0000 7f991d7fa700 1 -- 172.21.15.135:0/3794008036 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f991401a750 con 0x7f9920106720 2024-05-08T23:09:03.330 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.755+0000 7f9926530700 1 -- 172.21.15.135:0/3794008036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992007a760 con 0x7f9920106720 2024-05-08T23:09:03.330 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.756+0000 7f991d7fa700 1 -- 172.21.15.135:0/3794008036 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f991401a980 con 0x7f9920106720 2024-05-08T23:09:03.330 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.756+0000 7f9926530700 1 -- 172.21.15.135:0/3794008036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99200625d0 con 0x7f9920106720 2024-05-08T23:09:03.330 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.756+0000 7f991d7fa700 1 --2- 172.21.15.135:0/3794008036 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9908038700 0x7f990803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:03.330 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.756+0000 7f991d7fa700 1 -- 172.21.15.135:0/3794008036 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f991404c700 con 0x7f9920106720 2024-05-08T23:09:03.330 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.756+0000 7f991f7fe700 1 --2- 172.21.15.135:0/3794008036 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9908038700 0x7f990803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:03.330 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.757+0000 7f991f7fe700 1 --2- 172.21.15.135:0/3794008036 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9908038700 0x7f990803abc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9910006fd0 tx=0x7f9910006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:03.331 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.761+0000 7f991d7fa700 1 -- 172.21.15.135:0/3794008036 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9914018db0 con 0x7f9920106720 2024-05-08T23:09:03.331 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.955+0000 7f9926530700 1 -- 172.21.15.135:0/3794008036 --> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f992007ada0 con 0x7f9908038700 2024-05-08T23:09:03.331 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.956+0000 7f991d7fa700 1 -- 172.21.15.135:0/3794008036 <== mgr.14120 v2:172.21.15.135:6800/3165594440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f992007ada0 con 0x7f9908038700 2024-05-08T23:09:03.331 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.958+0000 7f9926530700 1 -- 172.21.15.135:0/3794008036 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9908038700 msgr2=0x7f990803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:03.331 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.958+0000 7f9926530700 1 --2- 172.21.15.135:0/3794008036 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9908038700 0x7f990803abc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9910006fd0 tx=0x7f9910006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:03.331 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.958+0000 7f9926530700 1 -- 172.21.15.135:0/3794008036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920106720 msgr2=0x7f992007bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:03.331 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.958+0000 7f9926530700 1 --2- 172.21.15.135:0/3794008036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920106720 0x7f992007bb40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9914009fb0 tx=0x7f9914011ad0 comp rx=0 tx=0).stop 2024-05-08T23:09:03.331 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.958+0000 7f9926530700 1 -- 172.21.15.135:0/3794008036 shutdown_connections 2024-05-08T23:09:03.331 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.958+0000 7f9926530700 1 --2- 172.21.15.135:0/3794008036 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9908038700 0x7f990803abc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:03.331 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.958+0000 7f9926530700 1 --2- 172.21.15.135:0/3794008036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920106720 0x7f992007bb40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:03.331 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.958+0000 7f9926530700 1 -- 172.21.15.135:0/3794008036 >> 172.21.15.135:0/3794008036 conn(0x7f9920101ca0 msgr2=0x7f9920102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:03.331 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.958+0000 7f9926530700 1 -- 172.21.15.135:0/3794008036 shutdown_connections 2024-05-08T23:09:03.331 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:02.958+0000 7f9926530700 1 -- 172.21.15.135:0/3794008036 wait complete. 2024-05-08T23:09:03.331 INFO:teuthology.orchestra.run.smithi135.stdout:Generating ssh key... 2024-05-08T23:09:03.415 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:03 smithi135 ceph-mon[42440]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:09:03.415 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:03 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' 2024-05-08T23:09:03.416 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:03 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:09:04.288 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:04 smithi135 ceph-mon[42440]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:09:04.289 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:04 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' 2024-05-08T23:09:04.289 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:04 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' 2024-05-08T23:09:04.289 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: Generating public/private rsa key pair. 2024-05-08T23:09:04.289 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: Your identification has been saved in /tmp/tmpsrsxu_fa/key. 2024-05-08T23:09:04.289 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: Your public key has been saved in /tmp/tmpsrsxu_fa/key.pub. 2024-05-08T23:09:04.289 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: The key fingerprint is: 2024-05-08T23:09:04.289 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: SHA256:Drr88e8fDW6nFc/MkKRcJWmXQidgw0aduqXWaQzCsog ceph-c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:09:04.289 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: The key's randomart image is: 2024-05-08T23:09:04.289 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: +---[RSA 3072]----+ 2024-05-08T23:09:04.289 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: | o=+oooo| 2024-05-08T23:09:04.289 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: | .o.+=+.| 2024-05-08T23:09:04.290 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: | . . ..+. | 2024-05-08T23:09:04.290 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: | . o + = . | 2024-05-08T23:09:04.290 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: | . o S . @ = | 2024-05-08T23:09:04.290 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: | E o + = B B | 2024-05-08T23:09:04.290 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: | . . . . = + =| 2024-05-08T23:09:04.290 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: | . . o . = | 2024-05-08T23:09:04.290 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: | o.. .oo.o | 2024-05-08T23:09:04.290 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: +----[SHA256]-----+ 2024-05-08T23:09:04.349 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.659+0000 7f74e5e00700 1 Processor -- start 2024-05-08T23:09:04.350 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.659+0000 7f74e5e00700 1 -- start start 2024-05-08T23:09:04.350 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.659+0000 7f74e5e00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e0107200 0x7f74e01095f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:04.350 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.659+0000 7f74e5e00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e0079e70 con 0x7f74e0107200 2024-05-08T23:09:04.350 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.659+0000 7f74df7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e0107200 0x7f74e01095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:04.350 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.659+0000 7f74df7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e0107200 0x7f74e01095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48712/0 (socket says 172.21.15.135:48712) 2024-05-08T23:09:04.350 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.659+0000 7f74df7fe700 1 -- 172.21.15.135:0/1676064431 learned_addr learned my addr 172.21.15.135:0/1676064431 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:04.350 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.659+0000 7f74df7fe700 1 -- 172.21.15.135:0/1676064431 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e0109b30 con 0x7f74e0107200 2024-05-08T23:09:04.350 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.659+0000 7f74df7fe700 1 --2- 172.21.15.135:0/1676064431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e0107200 0x7f74e01095f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f74d00098a0 tx=0x7f74d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c831292b098716 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:04.350 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.660+0000 7f74deffd700 1 -- 172.21.15.135:0/1676064431 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74d0004160 con 0x7f74e0107200 2024-05-08T23:09:04.350 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.660+0000 7f74deffd700 1 -- 172.21.15.135:0/1676064431 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74d00042c0 con 0x7f74e0107200 2024-05-08T23:09:04.350 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.660+0000 7f74deffd700 1 -- 172.21.15.135:0/1676064431 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74d0011a00 con 0x7f74e0107200 2024-05-08T23:09:04.350 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.660+0000 7f74e5e00700 1 -- 172.21.15.135:0/1676064431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e0107200 msgr2=0x7f74e01095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:04.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.660+0000 7f74e5e00700 1 --2- 172.21.15.135:0/1676064431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e0107200 0x7f74e01095f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f74d00098a0 tx=0x7f74d0009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:04.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.660+0000 7f74e5e00700 1 -- 172.21.15.135:0/1676064431 shutdown_connections 2024-05-08T23:09:04.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.660+0000 7f74e5e00700 1 --2- 172.21.15.135:0/1676064431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e0107200 0x7f74e01095f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:04.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.660+0000 7f74e5e00700 1 -- 172.21.15.135:0/1676064431 >> 172.21.15.135:0/1676064431 conn(0x7f74e0100bd0 msgr2=0x7f74e0103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:04.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.660+0000 7f74e5e00700 1 -- 172.21.15.135:0/1676064431 shutdown_connections 2024-05-08T23:09:04.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.660+0000 7f74e5e00700 1 -- 172.21.15.135:0/1676064431 wait complete. 2024-05-08T23:09:04.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.661+0000 7f74e5e00700 1 Processor -- start 2024-05-08T23:09:04.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.661+0000 7f74e5e00700 1 -- start start 2024-05-08T23:09:04.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.661+0000 7f74e5e00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e0107200 0x7f74e019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:04.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.661+0000 7f74e5e00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e019a9e0 con 0x7f74e0107200 2024-05-08T23:09:04.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.661+0000 7f74df7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e0107200 0x7f74e019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:04.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.661+0000 7f74df7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e0107200 0x7f74e019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48722/0 (socket says 172.21.15.135:48722) 2024-05-08T23:09:04.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.661+0000 7f74df7fe700 1 -- 172.21.15.135:0/4019569930 learned_addr learned my addr 172.21.15.135:0/4019569930 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:04.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.662+0000 7f74df7fe700 1 -- 172.21.15.135:0/4019569930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d0009550 con 0x7f74e0107200 2024-05-08T23:09:04.351 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.662+0000 7f74df7fe700 1 --2- 172.21.15.135:0/4019569930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e0107200 0x7f74e019a4a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009fb0 tx=0x7f74d0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:04.352 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.662+0000 7f74dd7fa700 1 -- 172.21.15.135:0/4019569930 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74d0003a40 con 0x7f74e0107200 2024-05-08T23:09:04.352 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.662+0000 7f74dd7fa700 1 -- 172.21.15.135:0/4019569930 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74d0003ba0 con 0x7f74e0107200 2024-05-08T23:09:04.352 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.662+0000 7f74e5e00700 1 -- 172.21.15.135:0/4019569930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e019abe0 con 0x7f74e0107200 2024-05-08T23:09:04.352 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.662+0000 7f74dd7fa700 1 -- 172.21.15.135:0/4019569930 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74d001a750 con 0x7f74e0107200 2024-05-08T23:09:04.352 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.662+0000 7f74e5e00700 1 -- 172.21.15.135:0/4019569930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e019b080 con 0x7f74e0107200 2024-05-08T23:09:04.352 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.663+0000 7f74dd7fa700 1 -- 172.21.15.135:0/4019569930 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f74d001a980 con 0x7f74e0107200 2024-05-08T23:09:04.352 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.663+0000 7f74dd7fa700 1 --2- 172.21.15.135:0/4019569930 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f74cc038700 0x7f74cc03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:04.352 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.663+0000 7f74e5e00700 1 -- 172.21.15.135:0/4019569930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e010a8d0 con 0x7f74e0107200 2024-05-08T23:09:04.352 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.663+0000 7f74dd7fa700 1 -- 172.21.15.135:0/4019569930 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f74d004c7a0 con 0x7f74e0107200 2024-05-08T23:09:04.352 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.663+0000 7f74d7fff700 1 --2- 172.21.15.135:0/4019569930 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f74cc038700 0x7f74cc03abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:04.352 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.663+0000 7f74d7fff700 1 --2- 172.21.15.135:0/4019569930 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f74cc038700 0x7f74cc03abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f74c8006fd0 tx=0x7f74c8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:04.352 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.668+0000 7f74dd7fa700 1 -- 172.21.15.135:0/4019569930 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f74d001ac30 con 0x7f74e0107200 2024-05-08T23:09:04.352 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:03.861+0000 7f74e5e00700 1 -- 172.21.15.135:0/4019569930 --> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f74e0101ee0 con 0x7f74cc038700 2024-05-08T23:09:04.352 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.012+0000 7f74dd7fa700 1 -- 172.21.15.135:0/4019569930 <== mgr.14120 v2:172.21.15.135:6800/3165594440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f74e0101ee0 con 0x7f74cc038700 2024-05-08T23:09:04.353 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.014+0000 7f74e5e00700 1 -- 172.21.15.135:0/4019569930 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f74cc038700 msgr2=0x7f74cc03abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:04.353 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.014+0000 7f74e5e00700 1 --2- 172.21.15.135:0/4019569930 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f74cc038700 0x7f74cc03abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f74c8006fd0 tx=0x7f74c8006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:04.353 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.014+0000 7f74e5e00700 1 -- 172.21.15.135:0/4019569930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e0107200 msgr2=0x7f74e019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:04.353 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.014+0000 7f74e5e00700 1 --2- 172.21.15.135:0/4019569930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e0107200 0x7f74e019a4a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009fb0 tx=0x7f74d0011ad0 comp rx=0 tx=0).stop 2024-05-08T23:09:04.353 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.015+0000 7f74e5e00700 1 -- 172.21.15.135:0/4019569930 shutdown_connections 2024-05-08T23:09:04.353 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.015+0000 7f74e5e00700 1 --2- 172.21.15.135:0/4019569930 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f74cc038700 0x7f74cc03abc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:04.353 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.015+0000 7f74e5e00700 1 --2- 172.21.15.135:0/4019569930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74e0107200 0x7f74e019a4a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:04.353 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.015+0000 7f74e5e00700 1 -- 172.21.15.135:0/4019569930 >> 172.21.15.135:0/4019569930 conn(0x7f74e0100bd0 msgr2=0x7f74e01017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:04.353 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.015+0000 7f74e5e00700 1 -- 172.21.15.135:0/4019569930 shutdown_connections 2024-05-08T23:09:04.353 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.015+0000 7f74e5e00700 1 -- 172.21.15.135:0/4019569930 wait complete. 2024-05-08T23:09:05.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:05 smithi135 ceph-mon[42440]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:09:05.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:05 smithi135 ceph-mon[42440]: Generating ssh key... 2024-05-08T23:09:05.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCydpalXlFUuB6vA82Ka/jMqhZaubSMWynCNQpcaoxYA02/spU5PtzWY3ExzUghHXtljK0cKyjbNmtx2XNzvOe3O0j1l5NS6WWRhuJWUFLzvpu78vcgdo5dtVSkqpmXTPc3XLAl/VjbwqAIgXYbx/vzJF+PaAxPjauQf6VarVoRMRX1gwjZAhjCxESd5g8K0fsic8+VHbDtSqECOW99Giw5ZU1h89eKJpnqmTIVKZiZCS2p7vxx0k61HAED5kjP5OD23s0W+A92B1U4UYzlmdHZrmdzKVnko2Km+7Q7hXUp+q5b4A9ACbBg+OzzNu59MTephRWYNTjD3RZnSjrG8CeJ3zqgy3W3UAmO21IBcjlY/3BO1S0b/8DNlUgE68TRY0KAHU78u7EwTVB0glW70ahwZcqext6gveVOIgttWuhEDCxDJ+jWVA3X+CMgCClJvWnK6XGM1injruc3iz8NMGkWFTnBXv/JWORH8tlPZulDXMOs7PfgSgplBh1cTgh5xLk= ceph-c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:09:05.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.691+0000 7fe6e8428700 1 Processor -- start 2024-05-08T23:09:05.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.691+0000 7fe6e8428700 1 -- start start 2024-05-08T23:09:05.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.692+0000 7fe6e8428700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e0105650 0x7fe6e0105a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:05.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.692+0000 7fe6e8428700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e0106040 con 0x7fe6e0105650 2024-05-08T23:09:05.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.692+0000 7fe6e61c4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e0105650 0x7fe6e0105a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:05.242 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.692+0000 7fe6e61c4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e0105650 0x7fe6e0105a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48732/0 (socket says 172.21.15.135:48732) 2024-05-08T23:09:05.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.692+0000 7fe6e61c4700 1 -- 172.21.15.135:0/240959325 learned_addr learned my addr 172.21.15.135:0/240959325 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:05.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.692+0000 7fe6e61c4700 1 -- 172.21.15.135:0/240959325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e0106850 con 0x7fe6e0105650 2024-05-08T23:09:05.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.692+0000 7fe6e61c4700 1 --2- 172.21.15.135:0/240959325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e0105650 0x7fe6e0105a70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00098a0 tx=0x7fe6d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea071755471c71 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:05.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.693+0000 7fe6e51c2700 1 -- 172.21.15.135:0/240959325 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6d0004160 con 0x7fe6e0105650 2024-05-08T23:09:05.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.693+0000 7fe6e51c2700 1 -- 172.21.15.135:0/240959325 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe6d00042c0 con 0x7fe6e0105650 2024-05-08T23:09:05.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.693+0000 7fe6e51c2700 1 -- 172.21.15.135:0/240959325 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6d0011a00 con 0x7fe6e0105650 2024-05-08T23:09:05.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.693+0000 7fe6e8428700 1 -- 172.21.15.135:0/240959325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e0105650 msgr2=0x7fe6e0105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:05.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.693+0000 7fe6e8428700 1 --2- 172.21.15.135:0/240959325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e0105650 0x7fe6e0105a70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00098a0 tx=0x7fe6d0009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:05.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.693+0000 7fe6e8428700 1 -- 172.21.15.135:0/240959325 shutdown_connections 2024-05-08T23:09:05.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.693+0000 7fe6e8428700 1 --2- 172.21.15.135:0/240959325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e0105650 0x7fe6e0105a70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:05.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.693+0000 7fe6e8428700 1 -- 172.21.15.135:0/240959325 >> 172.21.15.135:0/240959325 conn(0x7fe6e0100bd0 msgr2=0x7fe6e0103030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:05.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.693+0000 7fe6e8428700 1 -- 172.21.15.135:0/240959325 shutdown_connections 2024-05-08T23:09:05.243 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.693+0000 7fe6e8428700 1 -- 172.21.15.135:0/240959325 wait complete. 2024-05-08T23:09:05.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.694+0000 7fe6e8428700 1 Processor -- start 2024-05-08T23:09:05.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.694+0000 7fe6e8428700 1 -- start start 2024-05-08T23:09:05.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.694+0000 7fe6e8428700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e0105650 0x7fe6e01906b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:05.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.694+0000 7fe6e8428700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e0190bf0 con 0x7fe6e0105650 2024-05-08T23:09:05.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.694+0000 7fe6e61c4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e0105650 0x7fe6e01906b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:05.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.694+0000 7fe6e61c4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e0105650 0x7fe6e01906b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48746/0 (socket says 172.21.15.135:48746) 2024-05-08T23:09:05.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.694+0000 7fe6e61c4700 1 -- 172.21.15.135:0/1817779430 learned_addr learned my addr 172.21.15.135:0/1817779430 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:05.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.694+0000 7fe6e61c4700 1 -- 172.21.15.135:0/1817779430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d0009550 con 0x7fe6e0105650 2024-05-08T23:09:05.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.695+0000 7fe6e61c4700 1 --2- 172.21.15.135:0/1817779430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e0105650 0x7fe6e01906b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0009fb0 tx=0x7fe6d0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:05.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.695+0000 7fe6d77fe700 1 -- 172.21.15.135:0/1817779430 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6d0003a40 con 0x7fe6e0105650 2024-05-08T23:09:05.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.695+0000 7fe6e8428700 1 -- 172.21.15.135:0/1817779430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e018ee30 con 0x7fe6e0105650 2024-05-08T23:09:05.244 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.695+0000 7fe6d77fe700 1 -- 172.21.15.135:0/1817779430 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe6d0003ba0 con 0x7fe6e0105650 2024-05-08T23:09:05.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.695+0000 7fe6d77fe700 1 -- 172.21.15.135:0/1817779430 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6d001a750 con 0x7fe6e0105650 2024-05-08T23:09:05.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.695+0000 7fe6e8428700 1 -- 172.21.15.135:0/1817779430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e018f2d0 con 0x7fe6e0105650 2024-05-08T23:09:05.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.696+0000 7fe6d77fe700 1 -- 172.21.15.135:0/1817779430 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fe6d001a9d0 con 0x7fe6e0105650 2024-05-08T23:09:05.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.696+0000 7fe6d57fa700 1 -- 172.21.15.135:0/1817779430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c80052f0 con 0x7fe6e0105650 2024-05-08T23:09:05.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.696+0000 7fe6d77fe700 1 --2- 172.21.15.135:0/1817779430 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fe6cc0386b0 0x7fe6cc03ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:05.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.696+0000 7fe6d77fe700 1 -- 172.21.15.135:0/1817779430 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe6d004c7e0 con 0x7fe6e0105650 2024-05-08T23:09:05.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.696+0000 7fe6e59c3700 1 --2- 172.21.15.135:0/1817779430 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fe6cc0386b0 0x7fe6cc03ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:05.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.696+0000 7fe6e59c3700 1 --2- 172.21.15.135:0/1817779430 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fe6cc0386b0 0x7fe6cc03ab70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc006fd0 tx=0x7fe6dc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:05.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.701+0000 7fe6d77fe700 1 -- 172.21.15.135:0/1817779430 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe6d0018d20 con 0x7fe6e0105650 2024-05-08T23:09:05.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.893+0000 7fe6d57fa700 1 -- 172.21.15.135:0/1817779430 --> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6c8000bc0 con 0x7fe6cc0386b0 2024-05-08T23:09:05.245 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.894+0000 7fe6d77fe700 1 -- 172.21.15.135:0/1817779430 <== mgr.14120 v2:172.21.15.135:6800/3165594440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fe6c8000bc0 con 0x7fe6cc0386b0 2024-05-08T23:09:05.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.896+0000 7fe6d57fa700 1 -- 172.21.15.135:0/1817779430 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fe6cc0386b0 msgr2=0x7fe6cc03ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:05.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.896+0000 7fe6d57fa700 1 --2- 172.21.15.135:0/1817779430 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fe6cc0386b0 0x7fe6cc03ab70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc006fd0 tx=0x7fe6dc006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:05.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.896+0000 7fe6d57fa700 1 -- 172.21.15.135:0/1817779430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e0105650 msgr2=0x7fe6e01906b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:05.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.896+0000 7fe6d57fa700 1 --2- 172.21.15.135:0/1817779430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e0105650 0x7fe6e01906b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0009fb0 tx=0x7fe6d0011ad0 comp rx=0 tx=0).stop 2024-05-08T23:09:05.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.896+0000 7fe6d57fa700 1 -- 172.21.15.135:0/1817779430 shutdown_connections 2024-05-08T23:09:05.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.896+0000 7fe6d57fa700 1 --2- 172.21.15.135:0/1817779430 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fe6cc0386b0 0x7fe6cc03ab70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:05.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.896+0000 7fe6d57fa700 1 --2- 172.21.15.135:0/1817779430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6e0105650 0x7fe6e01906b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:05.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.896+0000 7fe6d57fa700 1 -- 172.21.15.135:0/1817779430 >> 172.21.15.135:0/1817779430 conn(0x7fe6e0100bd0 msgr2=0x7fe6e0101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:05.246 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.896+0000 7fe6d57fa700 1 -- 172.21.15.135:0/1817779430 shutdown_connections 2024-05-08T23:09:05.247 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:04.896+0000 7fe6d57fa700 1 -- 172.21.15.135:0/1817779430 wait complete. 2024-05-08T23:09:05.247 INFO:teuthology.orchestra.run.smithi135.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-08T23:09:05.247 INFO:teuthology.orchestra.run.smithi135.stdout:Adding key to root@localhost authorized_keys... 2024-05-08T23:09:05.247 INFO:teuthology.orchestra.run.smithi135.stdout:Adding host smithi135... 2024-05-08T23:09:06.383 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:06 smithi135 ceph-mon[42440]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:09:07.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:07 smithi135 ceph-mon[42440]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "addr": "172.21.15.135", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:09:07.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:07 smithi135 ceph-mon[42440]: Deploying cephadm binary to smithi135 2024-05-08T23:09:08.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout Added host 'smithi135' with addr '172.21.15.135' 2024-05-08T23:09:08.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.561+0000 7f9baea7e700 1 Processor -- start 2024-05-08T23:09:08.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.561+0000 7f9baea7e700 1 -- start start 2024-05-08T23:09:08.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.561+0000 7f9baea7e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ba8104a80 0x7f9ba8104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:08.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.561+0000 7f9baea7e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba8105470 con 0x7f9ba8104a80 2024-05-08T23:09:08.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.562+0000 7f9bac81a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ba8104a80 0x7f9ba8104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:08.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.562+0000 7f9bac81a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ba8104a80 0x7f9ba8104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48758/0 (socket says 172.21.15.135:48758) 2024-05-08T23:09:08.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.562+0000 7f9bac81a700 1 -- 172.21.15.135:0/3526858579 learned_addr learned my addr 172.21.15.135:0/3526858579 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:08.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.562+0000 7f9bac81a700 1 -- 172.21.15.135:0/3526858579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba8107a10 con 0x7f9ba8104a80 2024-05-08T23:09:08.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.562+0000 7f9bac81a700 1 --2- 172.21.15.135:0/3526858579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ba8104a80 0x7f9ba8104ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0098a0 tx=0x7f9b9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e806c55a890cace server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:08.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.562+0000 7f9ba77fe700 1 -- 172.21.15.135:0/3526858579 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c004160 con 0x7f9ba8104a80 2024-05-08T23:09:08.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.562+0000 7f9ba77fe700 1 -- 172.21.15.135:0/3526858579 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9b9c0042c0 con 0x7f9ba8104a80 2024-05-08T23:09:08.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.562+0000 7f9ba77fe700 1 -- 172.21.15.135:0/3526858579 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c011a00 con 0x7f9ba8104a80 2024-05-08T23:09:08.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.563+0000 7f9baea7e700 1 -- 172.21.15.135:0/3526858579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ba8104a80 msgr2=0x7f9ba8104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:08.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.563+0000 7f9baea7e700 1 --2- 172.21.15.135:0/3526858579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ba8104a80 0x7f9ba8104ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0098a0 tx=0x7f9b9c009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:08.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.563+0000 7f9baea7e700 1 -- 172.21.15.135:0/3526858579 shutdown_connections 2024-05-08T23:09:08.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.563+0000 7f9baea7e700 1 --2- 172.21.15.135:0/3526858579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ba8104a80 0x7f9ba8104ea0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:08.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.563+0000 7f9baea7e700 1 -- 172.21.15.135:0/3526858579 >> 172.21.15.135:0/3526858579 conn(0x7f9ba81003d0 msgr2=0x7f9ba81027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:08.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.563+0000 7f9baea7e700 1 -- 172.21.15.135:0/3526858579 shutdown_connections 2024-05-08T23:09:08.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.563+0000 7f9baea7e700 1 -- 172.21.15.135:0/3526858579 wait complete. 2024-05-08T23:09:08.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.564+0000 7f9baea7e700 1 Processor -- start 2024-05-08T23:09:08.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.564+0000 7f9baea7e700 1 -- start start 2024-05-08T23:09:08.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.564+0000 7f9baea7e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ba8104a80 0x7f9ba819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:08.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.564+0000 7f9baea7e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba819aa30 con 0x7f9ba8104a80 2024-05-08T23:09:08.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.564+0000 7f9bac81a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ba8104a80 0x7f9ba819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:08.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.564+0000 7f9bac81a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ba8104a80 0x7f9ba819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48766/0 (socket says 172.21.15.135:48766) 2024-05-08T23:09:08.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.564+0000 7f9bac81a700 1 -- 172.21.15.135:0/3934033062 learned_addr learned my addr 172.21.15.135:0/3934033062 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:08.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.564+0000 7f9bac81a700 1 -- 172.21.15.135:0/3934033062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c009550 con 0x7f9ba8104a80 2024-05-08T23:09:08.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.564+0000 7f9bac81a700 1 --2- 172.21.15.135:0/3934033062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ba8104a80 0x7f9ba819a4f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009fb0 tx=0x7f9b9c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:08.207 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.564+0000 7f9ba5ffb700 1 -- 172.21.15.135:0/3934033062 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c003a40 con 0x7f9ba8104a80 2024-05-08T23:09:08.208 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.565+0000 7f9ba5ffb700 1 -- 172.21.15.135:0/3934033062 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9b9c003ba0 con 0x7f9ba8104a80 2024-05-08T23:09:08.208 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.565+0000 7f9baea7e700 1 -- 172.21.15.135:0/3934033062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba819ac30 con 0x7f9ba8104a80 2024-05-08T23:09:08.208 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.565+0000 7f9ba5ffb700 1 -- 172.21.15.135:0/3934033062 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c01a750 con 0x7f9ba8104a80 2024-05-08T23:09:08.208 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.565+0000 7f9baea7e700 1 -- 172.21.15.135:0/3934033062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba819b0d0 con 0x7f9ba8104a80 2024-05-08T23:09:08.208 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.565+0000 7f9ba5ffb700 1 -- 172.21.15.135:0/3934033062 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f9b9c01a980 con 0x7f9ba8104a80 2024-05-08T23:09:08.208 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.566+0000 7f9ba5ffb700 1 --2- 172.21.15.135:0/3934033062 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9b98038700 0x7f9b9803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:08.208 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.566+0000 7f9ba5ffb700 1 -- 172.21.15.135:0/3934033062 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9b9c04c6b0 con 0x7f9ba8104a80 2024-05-08T23:09:08.208 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.566+0000 7f9ba7fff700 1 --2- 172.21.15.135:0/3934033062 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9b98038700 0x7f9b9803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:08.208 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.566+0000 7f9baea7e700 1 -- 172.21.15.135:0/3934033062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba80625d0 con 0x7f9ba8104a80 2024-05-08T23:09:08.208 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.566+0000 7f9ba7fff700 1 --2- 172.21.15.135:0/3934033062 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9b98038700 0x7f9b9803abc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9b94006fd0 tx=0x7f9b94006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:08.208 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.571+0000 7f9ba5ffb700 1 -- 172.21.15.135:0/3934033062 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9b9c01ac30 con 0x7f9ba8104a80 2024-05-08T23:09:08.208 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:05.766+0000 7f9baea7e700 1 -- 172.21.15.135:0/3934033062 --> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi135", "addr": "172.21.15.135", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ba8101690 con 0x7f9b98038700 2024-05-08T23:09:08.208 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:07.891+0000 7f9ba5ffb700 1 -- 172.21.15.135:0/3934033062 <== mgr.14120 v2:172.21.15.135:6800/3165594440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f9ba8101690 con 0x7f9b98038700 2024-05-08T23:09:08.208 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:07.894+0000 7f9baea7e700 1 -- 172.21.15.135:0/3934033062 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9b98038700 msgr2=0x7f9b9803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:08.208 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:07.894+0000 7f9baea7e700 1 --2- 172.21.15.135:0/3934033062 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9b98038700 0x7f9b9803abc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9b94006fd0 tx=0x7f9b94006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:08.209 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:07.894+0000 7f9baea7e700 1 -- 172.21.15.135:0/3934033062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ba8104a80 msgr2=0x7f9ba819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:08.209 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:07.894+0000 7f9baea7e700 1 --2- 172.21.15.135:0/3934033062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ba8104a80 0x7f9ba819a4f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009fb0 tx=0x7f9b9c011ad0 comp rx=0 tx=0).stop 2024-05-08T23:09:08.209 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:07.894+0000 7f9baea7e700 1 -- 172.21.15.135:0/3934033062 shutdown_connections 2024-05-08T23:09:08.209 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:07.894+0000 7f9baea7e700 1 --2- 172.21.15.135:0/3934033062 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9b98038700 0x7f9b9803abc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:08.209 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:07.894+0000 7f9baea7e700 1 --2- 172.21.15.135:0/3934033062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ba8104a80 0x7f9ba819a4f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:08.209 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:07.894+0000 7f9baea7e700 1 -- 172.21.15.135:0/3934033062 >> 172.21.15.135:0/3934033062 conn(0x7f9ba81003d0 msgr2=0x7f9ba8100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:08.209 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:07.895+0000 7f9baea7e700 1 -- 172.21.15.135:0/3934033062 shutdown_connections 2024-05-08T23:09:08.209 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:07.895+0000 7f9baea7e700 1 -- 172.21.15.135:0/3934033062 wait complete. 2024-05-08T23:09:08.209 INFO:teuthology.orchestra.run.smithi135.stdout:Deploying unmanaged mon service... 2024-05-08T23:09:08.979 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:08 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' 2024-05-08T23:09:08.979 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:08 smithi135 ceph-mon[42440]: Added host smithi135 2024-05-08T23:09:08.979 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:08 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:09:08.979 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:08 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' 2024-05-08T23:09:09.299 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-08T23:09:09.299 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.599+0000 7f5f412dd700 1 Processor -- start 2024-05-08T23:09:09.299 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.600+0000 7f5f412dd700 1 -- start start 2024-05-08T23:09:09.300 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.600+0000 7f5f412dd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c106790 0x7f5f3c106bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:09.300 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.600+0000 7f5f412dd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c107180 con 0x7f5f3c106790 2024-05-08T23:09:09.300 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.600+0000 7f5f3affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c106790 0x7f5f3c106bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:09.300 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.600+0000 7f5f3affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c106790 0x7f5f3c106bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40602/0 (socket says 172.21.15.135:40602) 2024-05-08T23:09:09.300 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.600+0000 7f5f3affd700 1 -- 172.21.15.135:0/1076889713 learned_addr learned my addr 172.21.15.135:0/1076889713 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:09.300 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.600+0000 7f5f3affd700 1 -- 172.21.15.135:0/1076889713 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c107940 con 0x7f5f3c106790 2024-05-08T23:09:09.300 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.600+0000 7f5f3affd700 1 --2- 172.21.15.135:0/1076889713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c106790 0x7f5f3c106bb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0098a0 tx=0x7f5f2c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51bdb26db324f698 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:09.300 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.600+0000 7f5f39ffb700 1 -- 172.21.15.135:0/1076889713 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f2c004160 con 0x7f5f3c106790 2024-05-08T23:09:09.300 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.601+0000 7f5f39ffb700 1 -- 172.21.15.135:0/1076889713 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f2c0042c0 con 0x7f5f3c106790 2024-05-08T23:09:09.300 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.601+0000 7f5f39ffb700 1 -- 172.21.15.135:0/1076889713 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f2c011a00 con 0x7f5f3c106790 2024-05-08T23:09:09.300 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.601+0000 7f5f412dd700 1 -- 172.21.15.135:0/1076889713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c106790 msgr2=0x7f5f3c106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:09.300 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.601+0000 7f5f412dd700 1 --2- 172.21.15.135:0/1076889713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c106790 0x7f5f3c106bb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0098a0 tx=0x7f5f2c009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:09.300 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.601+0000 7f5f412dd700 1 -- 172.21.15.135:0/1076889713 shutdown_connections 2024-05-08T23:09:09.300 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.601+0000 7f5f412dd700 1 --2- 172.21.15.135:0/1076889713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c106790 0x7f5f3c106bb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:09.301 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.601+0000 7f5f412dd700 1 -- 172.21.15.135:0/1076889713 >> 172.21.15.135:0/1076889713 conn(0x7f5f3c101cf0 msgr2=0x7f5f3c104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:09.301 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.601+0000 7f5f412dd700 1 -- 172.21.15.135:0/1076889713 shutdown_connections 2024-05-08T23:09:09.301 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.601+0000 7f5f412dd700 1 -- 172.21.15.135:0/1076889713 wait complete. 2024-05-08T23:09:09.301 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.602+0000 7f5f412dd700 1 Processor -- start 2024-05-08T23:09:09.301 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.602+0000 7f5f412dd700 1 -- start start 2024-05-08T23:09:09.301 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.602+0000 7f5f412dd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c106790 0x7f5f3c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:09.301 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.602+0000 7f5f412dd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c19a9f0 con 0x7f5f3c106790 2024-05-08T23:09:09.301 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.602+0000 7f5f3affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c106790 0x7f5f3c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:09.301 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.602+0000 7f5f3affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c106790 0x7f5f3c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40618/0 (socket says 172.21.15.135:40618) 2024-05-08T23:09:09.301 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.602+0000 7f5f3affd700 1 -- 172.21.15.135:0/2252004297 learned_addr learned my addr 172.21.15.135:0/2252004297 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:09.301 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.603+0000 7f5f3affd700 1 -- 172.21.15.135:0/2252004297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c009550 con 0x7f5f3c106790 2024-05-08T23:09:09.301 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.603+0000 7f5f3affd700 1 --2- 172.21.15.135:0/2252004297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c106790 0x7f5f3c19a4b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009fb0 tx=0x7f5f2c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:09.301 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.603+0000 7f5f23fff700 1 -- 172.21.15.135:0/2252004297 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f2c003a40 con 0x7f5f3c106790 2024-05-08T23:09:09.301 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.603+0000 7f5f412dd700 1 -- 172.21.15.135:0/2252004297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c19abf0 con 0x7f5f3c106790 2024-05-08T23:09:09.302 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.603+0000 7f5f23fff700 1 -- 172.21.15.135:0/2252004297 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f2c003ba0 con 0x7f5f3c106790 2024-05-08T23:09:09.302 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.603+0000 7f5f23fff700 1 -- 172.21.15.135:0/2252004297 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f2c01a750 con 0x7f5f3c106790 2024-05-08T23:09:09.302 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.603+0000 7f5f412dd700 1 -- 172.21.15.135:0/2252004297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c19b090 con 0x7f5f3c106790 2024-05-08T23:09:09.302 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.604+0000 7f5f23fff700 1 -- 172.21.15.135:0/2252004297 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f5f2c01a9d0 con 0x7f5f3c106790 2024-05-08T23:09:09.302 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.604+0000 7f5f23fff700 1 --2- 172.21.15.135:0/2252004297 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f5f240386b0 0x7f5f2403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:09.302 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.604+0000 7f5f412dd700 1 -- 172.21.15.135:0/2252004297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c10ab70 con 0x7f5f3c106790 2024-05-08T23:09:09.302 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.604+0000 7f5f23fff700 1 -- 172.21.15.135:0/2252004297 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5f2c04d710 con 0x7f5f3c106790 2024-05-08T23:09:09.302 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.604+0000 7f5f3a7fc700 1 --2- 172.21.15.135:0/2252004297 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f5f240386b0 0x7f5f2403ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:09.302 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.605+0000 7f5f3a7fc700 1 --2- 172.21.15.135:0/2252004297 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f5f240386b0 0x7f5f2403ab70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5f30006fd0 tx=0x7f5f30006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:09.302 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.609+0000 7f5f23fff700 1 -- 172.21.15.135:0/2252004297 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5f2c01ae60 con 0x7f5f3c106790 2024-05-08T23:09:09.302 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.828+0000 7f5f412dd700 1 -- 172.21.15.135:0/2252004297 --> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f5f3c103040 con 0x7f5f240386b0 2024-05-08T23:09:09.302 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.833+0000 7f5f23fff700 1 -- 172.21.15.135:0/2252004297 <== mgr.14120 v2:172.21.15.135:6800/3165594440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f5f3c103040 con 0x7f5f240386b0 2024-05-08T23:09:09.302 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.835+0000 7f5f412dd700 1 -- 172.21.15.135:0/2252004297 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f5f240386b0 msgr2=0x7f5f2403ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:09.303 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.835+0000 7f5f412dd700 1 --2- 172.21.15.135:0/2252004297 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f5f240386b0 0x7f5f2403ab70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5f30006fd0 tx=0x7f5f30006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:09.303 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.835+0000 7f5f412dd700 1 -- 172.21.15.135:0/2252004297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c106790 msgr2=0x7f5f3c19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:09.303 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.835+0000 7f5f412dd700 1 --2- 172.21.15.135:0/2252004297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c106790 0x7f5f3c19a4b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009fb0 tx=0x7f5f2c011ad0 comp rx=0 tx=0).stop 2024-05-08T23:09:09.303 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.835+0000 7f5f412dd700 1 -- 172.21.15.135:0/2252004297 shutdown_connections 2024-05-08T23:09:09.303 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.835+0000 7f5f412dd700 1 --2- 172.21.15.135:0/2252004297 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f5f240386b0 0x7f5f2403ab70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:09.303 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.835+0000 7f5f412dd700 1 --2- 172.21.15.135:0/2252004297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c106790 0x7f5f3c19a4b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:09.303 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.835+0000 7f5f412dd700 1 -- 172.21.15.135:0/2252004297 >> 172.21.15.135:0/2252004297 conn(0x7f5f3c101cf0 msgr2=0x7f5f3c102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:09.303 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.835+0000 7f5f412dd700 1 -- 172.21.15.135:0/2252004297 shutdown_connections 2024-05-08T23:09:09.303 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:08.835+0000 7f5f412dd700 1 -- 172.21.15.135:0/2252004297 wait complete. 2024-05-08T23:09:09.303 INFO:teuthology.orchestra.run.smithi135.stdout:Deploying unmanaged mgr service... 2024-05-08T23:09:10.342 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:10 smithi135 ceph-mon[42440]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:09:10.342 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:10 smithi135 ceph-mon[42440]: Saving service mon spec with placement count:5 2024-05-08T23:09:10.342 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:10 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' 2024-05-08T23:09:10.342 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:10 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' 2024-05-08T23:09:10.342 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:10 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' 2024-05-08T23:09:10.566 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-08T23:09:10.566 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.657+0000 7fd264ba8700 1 Processor -- start 2024-05-08T23:09:10.567 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.657+0000 7fd264ba8700 1 -- start start 2024-05-08T23:09:10.567 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.657+0000 7fd264ba8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2601056b0 0x7fd260105ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:10.567 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.657+0000 7fd264ba8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2601060a0 con 0x7fd2601056b0 2024-05-08T23:09:10.567 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.657+0000 7fd25e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2601056b0 0x7fd260105ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:10.567 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.657+0000 7fd25e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2601056b0 0x7fd260105ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40634/0 (socket says 172.21.15.135:40634) 2024-05-08T23:09:10.567 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.657+0000 7fd25e59c700 1 -- 172.21.15.135:0/3678898499 learned_addr learned my addr 172.21.15.135:0/3678898499 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:10.567 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.658+0000 7fd25e59c700 1 -- 172.21.15.135:0/3678898499 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2601068b0 con 0x7fd2601056b0 2024-05-08T23:09:10.567 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.658+0000 7fd25e59c700 1 --2- 172.21.15.135:0/3678898499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2601056b0 0x7fd260105ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd25000bb40 tx=0x7fd25000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae85f4bcff2f16a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:10.567 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.658+0000 7fd25d59a700 1 -- 172.21.15.135:0/3678898499 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd25000dbe0 con 0x7fd2601056b0 2024-05-08T23:09:10.567 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.658+0000 7fd25d59a700 1 -- 172.21.15.135:0/3678898499 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2500044f0 con 0x7fd2601056b0 2024-05-08T23:09:10.567 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.658+0000 7fd25d59a700 1 -- 172.21.15.135:0/3678898499 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd250003e60 con 0x7fd2601056b0 2024-05-08T23:09:10.567 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.659+0000 7fd264ba8700 1 -- 172.21.15.135:0/3678898499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2601056b0 msgr2=0x7fd260105ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:10.567 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.659+0000 7fd264ba8700 1 --2- 172.21.15.135:0/3678898499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2601056b0 0x7fd260105ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd25000bb40 tx=0x7fd25000be50 comp rx=0 tx=0).stop 2024-05-08T23:09:10.567 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.659+0000 7fd264ba8700 1 -- 172.21.15.135:0/3678898499 shutdown_connections 2024-05-08T23:09:10.568 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.659+0000 7fd264ba8700 1 --2- 172.21.15.135:0/3678898499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2601056b0 0x7fd260105ad0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:10.568 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.659+0000 7fd264ba8700 1 -- 172.21.15.135:0/3678898499 >> 172.21.15.135:0/3678898499 conn(0x7fd260100c30 msgr2=0x7fd260103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:10.568 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.659+0000 7fd264ba8700 1 -- 172.21.15.135:0/3678898499 shutdown_connections 2024-05-08T23:09:10.568 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.659+0000 7fd264ba8700 1 -- 172.21.15.135:0/3678898499 wait complete. 2024-05-08T23:09:10.568 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.660+0000 7fd264ba8700 1 Processor -- start 2024-05-08T23:09:10.568 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.660+0000 7fd264ba8700 1 -- start start 2024-05-08T23:09:10.568 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.660+0000 7fd264ba8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2601056b0 0x7fd2601982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:10.568 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.660+0000 7fd264ba8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd260198800 con 0x7fd2601056b0 2024-05-08T23:09:10.568 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.660+0000 7fd25e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2601056b0 0x7fd2601982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:10.568 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.660+0000 7fd25e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2601056b0 0x7fd2601982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40642/0 (socket says 172.21.15.135:40642) 2024-05-08T23:09:10.568 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.660+0000 7fd25e59c700 1 -- 172.21.15.135:0/649904423 learned_addr learned my addr 172.21.15.135:0/649904423 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:10.568 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.661+0000 7fd25e59c700 1 -- 172.21.15.135:0/649904423 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25000b7f0 con 0x7fd2601056b0 2024-05-08T23:09:10.568 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.661+0000 7fd25e59c700 1 --2- 172.21.15.135:0/649904423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2601056b0 0x7fd2601982c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd250003bf0 tx=0x7fd250003fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:10.568 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.661+0000 7fd24f7fe700 1 -- 172.21.15.135:0/649904423 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd25001e070 con 0x7fd2601056b0 2024-05-08T23:09:10.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.661+0000 7fd24f7fe700 1 -- 172.21.15.135:0/649904423 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2500109c0 con 0x7fd2601056b0 2024-05-08T23:09:10.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.661+0000 7fd264ba8700 1 -- 172.21.15.135:0/649904423 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd260198a00 con 0x7fd2601056b0 2024-05-08T23:09:10.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.661+0000 7fd24f7fe700 1 -- 172.21.15.135:0/649904423 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2500229a0 con 0x7fd2601056b0 2024-05-08T23:09:10.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.661+0000 7fd264ba8700 1 -- 172.21.15.135:0/649904423 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd260198ea0 con 0x7fd2601056b0 2024-05-08T23:09:10.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.662+0000 7fd24f7fe700 1 -- 172.21.15.135:0/649904423 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fd25002c440 con 0x7fd2601056b0 2024-05-08T23:09:10.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.662+0000 7fd264ba8700 1 -- 172.21.15.135:0/649904423 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd260191f40 con 0x7fd2601056b0 2024-05-08T23:09:10.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.662+0000 7fd24f7fe700 1 --2- 172.21.15.135:0/649904423 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fd248038750 0x7fd24803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:10.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.662+0000 7fd24f7fe700 1 -- 172.21.15.135:0/649904423 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd25004e990 con 0x7fd2601056b0 2024-05-08T23:09:10.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.662+0000 7fd25dd9b700 1 --2- 172.21.15.135:0/649904423 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fd248038750 0x7fd24803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:10.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.663+0000 7fd25dd9b700 1 --2- 172.21.15.135:0/649904423 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fd248038750 0x7fd24803ac10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd254006fd0 tx=0x7fd254006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:10.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.671+0000 7fd24f7fe700 1 -- 172.21.15.135:0/649904423 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd25002a540 con 0x7fd2601056b0 2024-05-08T23:09:10.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.926+0000 7fd264ba8700 1 -- 172.21.15.135:0/649904423 --> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd2600613e0 con 0x7fd248038750 2024-05-08T23:09:10.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.931+0000 7fd24f7fe700 1 -- 172.21.15.135:0/649904423 <== mgr.14120 v2:172.21.15.135:6800/3165594440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd2600613e0 con 0x7fd248038750 2024-05-08T23:09:10.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.934+0000 7fd264ba8700 1 -- 172.21.15.135:0/649904423 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fd248038750 msgr2=0x7fd24803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:10.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.934+0000 7fd264ba8700 1 --2- 172.21.15.135:0/649904423 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fd248038750 0x7fd24803ac10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd254006fd0 tx=0x7fd254006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:10.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.934+0000 7fd264ba8700 1 -- 172.21.15.135:0/649904423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2601056b0 msgr2=0x7fd2601982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:10.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.934+0000 7fd264ba8700 1 --2- 172.21.15.135:0/649904423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2601056b0 0x7fd2601982c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd250003bf0 tx=0x7fd250003fb0 comp rx=0 tx=0).stop 2024-05-08T23:09:10.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.934+0000 7fd264ba8700 1 -- 172.21.15.135:0/649904423 shutdown_connections 2024-05-08T23:09:10.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.934+0000 7fd264ba8700 1 --2- 172.21.15.135:0/649904423 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fd248038750 0x7fd24803ac10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:10.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.934+0000 7fd264ba8700 1 --2- 172.21.15.135:0/649904423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2601056b0 0x7fd2601982c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:10.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.934+0000 7fd264ba8700 1 -- 172.21.15.135:0/649904423 >> 172.21.15.135:0/649904423 conn(0x7fd260100c30 msgr2=0x7fd26018f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:10.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.934+0000 7fd264ba8700 1 -- 172.21.15.135:0/649904423 shutdown_connections 2024-05-08T23:09:10.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:09.934+0000 7fd264ba8700 1 -- 172.21.15.135:0/649904423 wait complete. 2024-05-08T23:09:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:11 smithi135 ceph-mon[42440]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:09:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:11 smithi135 ceph-mon[42440]: Saving service mgr spec with placement count:2 2024-05-08T23:09:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:11 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' 2024-05-08T23:09:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:11 smithi135 ceph-mon[42440]: from='mgr.14120 172.21.15.135:0/2202727110' entity='mgr.x' 2024-05-08T23:09:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:11 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1983734582' entity='client.admin' 2024-05-08T23:09:11.544 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.932+0000 7f0986c94700 1 Processor -- start 2024-05-08T23:09:11.548 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.932+0000 7f0986c94700 1 -- start start 2024-05-08T23:09:11.548 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.932+0000 7f0986c94700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0980106c20 0x7f0980107040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:11.548 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.932+0000 7f0986c94700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0980107610 con 0x7f0980106c20 2024-05-08T23:09:11.548 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.932+0000 7f0984a30700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0980106c20 0x7f0980107040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:11.548 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.933+0000 7f0984a30700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0980106c20 0x7f0980107040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40654/0 (socket says 172.21.15.135:40654) 2024-05-08T23:09:11.548 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.933+0000 7f0984a30700 1 -- 172.21.15.135:0/1453518361 learned_addr learned my addr 172.21.15.135:0/1453518361 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:11.549 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.933+0000 7f0984a30700 1 -- 172.21.15.135:0/1453518361 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0980105830 con 0x7f0980106c20 2024-05-08T23:09:11.549 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.933+0000 7f0984a30700 1 --2- 172.21.15.135:0/1453518361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0980106c20 0x7f0980107040 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f09740098a0 tx=0x7f0974009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6486e5a2968237d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:11.549 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.933+0000 7f097f7fe700 1 -- 172.21.15.135:0/1453518361 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0974004160 con 0x7f0980106c20 2024-05-08T23:09:11.549 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.933+0000 7f097f7fe700 1 -- 172.21.15.135:0/1453518361 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09740042c0 con 0x7f0980106c20 2024-05-08T23:09:11.549 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.933+0000 7f097f7fe700 1 -- 172.21.15.135:0/1453518361 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09740119b0 con 0x7f0980106c20 2024-05-08T23:09:11.549 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.934+0000 7f0986c94700 1 -- 172.21.15.135:0/1453518361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0980106c20 msgr2=0x7f0980107040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:11.549 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.934+0000 7f0986c94700 1 --2- 172.21.15.135:0/1453518361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0980106c20 0x7f0980107040 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f09740098a0 tx=0x7f0974009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:11.549 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.934+0000 7f0986c94700 1 -- 172.21.15.135:0/1453518361 shutdown_connections 2024-05-08T23:09:11.549 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.934+0000 7f0986c94700 1 --2- 172.21.15.135:0/1453518361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0980106c20 0x7f0980107040 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:11.549 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.934+0000 7f0986c94700 1 -- 172.21.15.135:0/1453518361 >> 172.21.15.135:0/1453518361 conn(0x7f0980100340 msgr2=0x7f09801027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:11.549 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.934+0000 7f0986c94700 1 -- 172.21.15.135:0/1453518361 shutdown_connections 2024-05-08T23:09:11.549 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.934+0000 7f0986c94700 1 -- 172.21.15.135:0/1453518361 wait complete. 2024-05-08T23:09:11.550 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.935+0000 7f0986c94700 1 Processor -- start 2024-05-08T23:09:11.550 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.935+0000 7f0986c94700 1 -- start start 2024-05-08T23:09:11.550 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.935+0000 7f0986c94700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0980106c20 0x7f0980190760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:11.550 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.935+0000 7f0986c94700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0980190ca0 con 0x7f0980106c20 2024-05-08T23:09:11.550 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.935+0000 7f0984a30700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0980106c20 0x7f0980190760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:11.550 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.935+0000 7f0984a30700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0980106c20 0x7f0980190760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40670/0 (socket says 172.21.15.135:40670) 2024-05-08T23:09:11.550 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.935+0000 7f0984a30700 1 -- 172.21.15.135:0/1983734582 learned_addr learned my addr 172.21.15.135:0/1983734582 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:11.550 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.935+0000 7f0984a30700 1 -- 172.21.15.135:0/1983734582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0974009550 con 0x7f0980106c20 2024-05-08T23:09:11.550 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.935+0000 7f0984a30700 1 --2- 172.21.15.135:0/1983734582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0980106c20 0x7f0980190760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0974003e60 tx=0x7f0974011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:11.550 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.935+0000 7f097dffb700 1 -- 172.21.15.135:0/1983734582 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0974003a60 con 0x7f0980106c20 2024-05-08T23:09:11.550 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.935+0000 7f097dffb700 1 -- 172.21.15.135:0/1983734582 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0974003bc0 con 0x7f0980106c20 2024-05-08T23:09:11.551 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.935+0000 7f0986c94700 1 -- 172.21.15.135:0/1983734582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098018eee0 con 0x7f0980106c20 2024-05-08T23:09:11.551 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.935+0000 7f097dffb700 1 -- 172.21.15.135:0/1983734582 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09740196c0 con 0x7f0980106c20 2024-05-08T23:09:11.551 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.936+0000 7f0986c94700 1 -- 172.21.15.135:0/1983734582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098018f380 con 0x7f0980106c20 2024-05-08T23:09:11.551 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.936+0000 7f097dffb700 1 -- 172.21.15.135:0/1983734582 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f0974019980 con 0x7f0980106c20 2024-05-08T23:09:11.551 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.937+0000 7f097dffb700 1 --2- 172.21.15.135:0/1983734582 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f09700386e0 0x7f097003aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:11.553 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.937+0000 7f097dffb700 1 -- 172.21.15.135:0/1983734582 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f097404d970 con 0x7f0980106c20 2024-05-08T23:09:11.553 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.937+0000 7f0986c94700 1 -- 172.21.15.135:0/1983734582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098018fd90 con 0x7f0980106c20 2024-05-08T23:09:11.553 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.937+0000 7f097ffff700 1 --2- 172.21.15.135:0/1983734582 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f09700386e0 0x7f097003aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:11.553 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.937+0000 7f097ffff700 1 --2- 172.21.15.135:0/1983734582 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f09700386e0 0x7f097003aba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f096c006fd0 tx=0x7f096c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:11.553 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:10.942+0000 7f097dffb700 1 -- 172.21.15.135:0/1983734582 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0974019e60 con 0x7f0980106c20 2024-05-08T23:09:11.554 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.142+0000 7f0986c94700 1 -- 172.21.15.135:0/1983734582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f0980109d20 con 0x7f0980106c20 2024-05-08T23:09:11.554 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.146+0000 7f097dffb700 1 -- 172.21.15.135:0/1983734582 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f0974010b70 con 0x7f0980106c20 2024-05-08T23:09:11.554 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.149+0000 7f0986c94700 1 -- 172.21.15.135:0/1983734582 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f09700386e0 msgr2=0x7f097003aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:11.554 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.149+0000 7f0986c94700 1 --2- 172.21.15.135:0/1983734582 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f09700386e0 0x7f097003aba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f096c006fd0 tx=0x7f096c006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:11.554 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.149+0000 7f0986c94700 1 -- 172.21.15.135:0/1983734582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0980106c20 msgr2=0x7f0980190760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:11.554 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.149+0000 7f0986c94700 1 --2- 172.21.15.135:0/1983734582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0980106c20 0x7f0980190760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0974003e60 tx=0x7f0974011a30 comp rx=0 tx=0).stop 2024-05-08T23:09:11.554 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.149+0000 7f0986c94700 1 -- 172.21.15.135:0/1983734582 shutdown_connections 2024-05-08T23:09:11.554 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.149+0000 7f0986c94700 1 --2- 172.21.15.135:0/1983734582 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f09700386e0 0x7f097003aba0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:11.554 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.149+0000 7f0986c94700 1 --2- 172.21.15.135:0/1983734582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0980106c20 0x7f0980190760 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:11.554 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.149+0000 7f0986c94700 1 -- 172.21.15.135:0/1983734582 >> 172.21.15.135:0/1983734582 conn(0x7f0980100340 msgr2=0x7f0980101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:11.554 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.149+0000 7f0986c94700 1 -- 172.21.15.135:0/1983734582 shutdown_connections 2024-05-08T23:09:11.554 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.149+0000 7f0986c94700 1 -- 172.21.15.135:0/1983734582 wait complete. 2024-05-08T23:09:12.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.921+0000 7f5c13d19700 1 Processor -- start 2024-05-08T23:09:12.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.921+0000 7f5c13d19700 1 -- start start 2024-05-08T23:09:12.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.921+0000 7f5c13d19700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c0c107190 0x7f5c0c109580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:12.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.921+0000 7f5c13d19700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c079ed0 con 0x7f5c0c107190 2024-05-08T23:09:12.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.921+0000 7f5c11ab5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c0c107190 0x7f5c0c109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:12.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.921+0000 7f5c11ab5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c0c107190 0x7f5c0c109580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40682/0 (socket says 172.21.15.135:40682) 2024-05-08T23:09:12.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.921+0000 7f5c11ab5700 1 -- 172.21.15.135:0/2646132505 learned_addr learned my addr 172.21.15.135:0/2646132505 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:12.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.921+0000 7f5c11ab5700 1 -- 172.21.15.135:0/2646132505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c109ac0 con 0x7f5c0c107190 2024-05-08T23:09:12.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.922+0000 7f5c11ab5700 1 --2- 172.21.15.135:0/2646132505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c0c107190 0x7f5c0c109580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5c080098a0 tx=0x7f5c08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47549f2aec28622 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:12.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.922+0000 7f5c10ab3700 1 -- 172.21.15.135:0/2646132505 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c08004160 con 0x7f5c0c107190 2024-05-08T23:09:12.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.922+0000 7f5c10ab3700 1 -- 172.21.15.135:0/2646132505 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c080042c0 con 0x7f5c0c107190 2024-05-08T23:09:12.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.922+0000 7f5c10ab3700 1 -- 172.21.15.135:0/2646132505 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c080119b0 con 0x7f5c0c107190 2024-05-08T23:09:12.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.922+0000 7f5c13d19700 1 -- 172.21.15.135:0/2646132505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c0c107190 msgr2=0x7f5c0c109580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:12.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.922+0000 7f5c13d19700 1 --2- 172.21.15.135:0/2646132505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c0c107190 0x7f5c0c109580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5c080098a0 tx=0x7f5c08009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:12.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.922+0000 7f5c13d19700 1 -- 172.21.15.135:0/2646132505 shutdown_connections 2024-05-08T23:09:12.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.922+0000 7f5c13d19700 1 --2- 172.21.15.135:0/2646132505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c0c107190 0x7f5c0c109580 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:12.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.922+0000 7f5c13d19700 1 -- 172.21.15.135:0/2646132505 >> 172.21.15.135:0/2646132505 conn(0x7f5c0c100bc0 msgr2=0x7f5c0c103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:12.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.923+0000 7f5c13d19700 1 -- 172.21.15.135:0/2646132505 shutdown_connections 2024-05-08T23:09:12.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.923+0000 7f5c13d19700 1 -- 172.21.15.135:0/2646132505 wait complete. 2024-05-08T23:09:12.617 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.923+0000 7f5c13d19700 1 Processor -- start 2024-05-08T23:09:12.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.923+0000 7f5c13d19700 1 -- start start 2024-05-08T23:09:12.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.923+0000 7f5c13d19700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c0c107190 0x7f5c0c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:12.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.923+0000 7f5c13d19700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c19a9b0 con 0x7f5c0c107190 2024-05-08T23:09:12.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.923+0000 7f5c11ab5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c0c107190 0x7f5c0c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:12.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.923+0000 7f5c11ab5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c0c107190 0x7f5c0c19a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40694/0 (socket says 172.21.15.135:40694) 2024-05-08T23:09:12.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.923+0000 7f5c11ab5700 1 -- 172.21.15.135:0/1687970247 learned_addr learned my addr 172.21.15.135:0/1687970247 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:12.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.924+0000 7f5c11ab5700 1 -- 172.21.15.135:0/1687970247 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c08009550 con 0x7f5c0c107190 2024-05-08T23:09:12.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.924+0000 7f5c11ab5700 1 --2- 172.21.15.135:0/1687970247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c0c107190 0x7f5c0c19a470 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5c08006af0 tx=0x7f5c08011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:12.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.924+0000 7f5c02ffd700 1 -- 172.21.15.135:0/1687970247 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c08003a40 con 0x7f5c0c107190 2024-05-08T23:09:12.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.924+0000 7f5c02ffd700 1 -- 172.21.15.135:0/1687970247 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c08003ba0 con 0x7f5c0c107190 2024-05-08T23:09:12.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.924+0000 7f5c13d19700 1 -- 172.21.15.135:0/1687970247 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0c19abb0 con 0x7f5c0c107190 2024-05-08T23:09:12.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.924+0000 7f5c02ffd700 1 -- 172.21.15.135:0/1687970247 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c080196c0 con 0x7f5c0c107190 2024-05-08T23:09:12.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.924+0000 7f5c13d19700 1 -- 172.21.15.135:0/1687970247 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0c19b050 con 0x7f5c0c107190 2024-05-08T23:09:12.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.925+0000 7f5c13d19700 1 -- 172.21.15.135:0/1687970247 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0c10a900 con 0x7f5c0c107190 2024-05-08T23:09:12.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.925+0000 7f5c02ffd700 1 -- 172.21.15.135:0/1687970247 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f5c0801aa80 con 0x7f5c0c107190 2024-05-08T23:09:12.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.925+0000 7f5c02ffd700 1 --2- 172.21.15.135:0/1687970247 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f5bf8038700 0x7f5bf803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:12.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.925+0000 7f5c02ffd700 1 -- 172.21.15.135:0/1687970247 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5c0804c6b0 con 0x7f5c0c107190 2024-05-08T23:09:12.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.925+0000 7f5c112b4700 1 --2- 172.21.15.135:0/1687970247 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f5bf8038700 0x7f5bf803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:12.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.926+0000 7f5c112b4700 1 --2- 172.21.15.135:0/1687970247 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f5bf8038700 0x7f5bf803abc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc006fd0 tx=0x7f5bfc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:12.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:11.930+0000 7f5c02ffd700 1 -- 172.21.15.135:0/1687970247 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5c0801a430 con 0x7f5c0c107190 2024-05-08T23:09:12.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.136+0000 7f5c13d19700 1 -- 172.21.15.135:0/1687970247 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f5c0c10ab40 con 0x7f5c0c107190 2024-05-08T23:09:12.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.139+0000 7f5c02ffd700 1 -- 172.21.15.135:0/1687970247 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f5c0800b3e0 con 0x7f5c0c107190 2024-05-08T23:09:12.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.141+0000 7f5c13d19700 1 -- 172.21.15.135:0/1687970247 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f5bf8038700 msgr2=0x7f5bf803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:12.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.141+0000 7f5c13d19700 1 --2- 172.21.15.135:0/1687970247 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f5bf8038700 0x7f5bf803abc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc006fd0 tx=0x7f5bfc006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:12.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.141+0000 7f5c13d19700 1 -- 172.21.15.135:0/1687970247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c0c107190 msgr2=0x7f5c0c19a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:12.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.141+0000 7f5c13d19700 1 --2- 172.21.15.135:0/1687970247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c0c107190 0x7f5c0c19a470 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5c08006af0 tx=0x7f5c08011a10 comp rx=0 tx=0).stop 2024-05-08T23:09:12.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.141+0000 7f5c13d19700 1 -- 172.21.15.135:0/1687970247 shutdown_connections 2024-05-08T23:09:12.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.141+0000 7f5c13d19700 1 --2- 172.21.15.135:0/1687970247 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f5bf8038700 0x7f5bf803abc0 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc006fd0 tx=0x7f5bfc006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:12.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.141+0000 7f5c13d19700 1 --2- 172.21.15.135:0/1687970247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c0c107190 0x7f5c0c19a470 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:12.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.141+0000 7f5c13d19700 1 -- 172.21.15.135:0/1687970247 >> 172.21.15.135:0/1687970247 conn(0x7f5c0c100bc0 msgr2=0x7f5c0c101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:12.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.142+0000 7f5c13d19700 1 -- 172.21.15.135:0/1687970247 shutdown_connections 2024-05-08T23:09:12.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.142+0000 7f5c13d19700 1 -- 172.21.15.135:0/1687970247 wait complete. 2024-05-08T23:09:12.620 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling the dashboard module... 2024-05-08T23:09:13.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:13 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1687970247' entity='client.admin' 2024-05-08T23:09:14.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:14 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2997476700' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-08T23:09:14.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:14 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: ignoring --setuser ceph since I am not root 2024-05-08T23:09:14.454 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:14 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: ignoring --setgroup ceph since I am not root 2024-05-08T23:09:14.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.959+0000 7fa28ec9b700 1 Processor -- start 2024-05-08T23:09:14.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.959+0000 7fa28ec9b700 1 -- start start 2024-05-08T23:09:14.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.959+0000 7fa28ec9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa288104fe0 0x7fa288105400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:14.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.959+0000 7fa28ec9b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa288079e70 con 0x7fa288104fe0 2024-05-08T23:09:14.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.959+0000 7fa28ca37700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa288104fe0 0x7fa288105400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:14.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.959+0000 7fa28ca37700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa288104fe0 0x7fa288105400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40710/0 (socket says 172.21.15.135:40710) 2024-05-08T23:09:14.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.959+0000 7fa28ca37700 1 -- 172.21.15.135:0/875383303 learned_addr learned my addr 172.21.15.135:0/875383303 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:14.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.959+0000 7fa28ca37700 1 -- 172.21.15.135:0/875383303 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa288105940 con 0x7fa288104fe0 2024-05-08T23:09:14.524 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.960+0000 7fa28ca37700 1 --2- 172.21.15.135:0/875383303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa288104fe0 0x7fa288105400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0098a0 tx=0x7fa27c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a40db24c721719 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:14.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.960+0000 7fa2877fe700 1 -- 172.21.15.135:0/875383303 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa27c004160 con 0x7fa288104fe0 2024-05-08T23:09:14.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.960+0000 7fa2877fe700 1 -- 172.21.15.135:0/875383303 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa27c0042c0 con 0x7fa288104fe0 2024-05-08T23:09:14.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.960+0000 7fa2877fe700 1 -- 172.21.15.135:0/875383303 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa27c0119b0 con 0x7fa288104fe0 2024-05-08T23:09:14.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.960+0000 7fa28ec9b700 1 -- 172.21.15.135:0/875383303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa288104fe0 msgr2=0x7fa288105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:14.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.960+0000 7fa28ec9b700 1 --2- 172.21.15.135:0/875383303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa288104fe0 0x7fa288105400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0098a0 tx=0x7fa27c009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:14.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.960+0000 7fa28ec9b700 1 -- 172.21.15.135:0/875383303 shutdown_connections 2024-05-08T23:09:14.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.960+0000 7fa28ec9b700 1 --2- 172.21.15.135:0/875383303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa288104fe0 0x7fa288105400 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:14.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.960+0000 7fa28ec9b700 1 -- 172.21.15.135:0/875383303 >> 172.21.15.135:0/875383303 conn(0x7fa288100bc0 msgr2=0x7fa288103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:14.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.960+0000 7fa28ec9b700 1 -- 172.21.15.135:0/875383303 shutdown_connections 2024-05-08T23:09:14.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.960+0000 7fa28ec9b700 1 -- 172.21.15.135:0/875383303 wait complete. 2024-05-08T23:09:14.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.961+0000 7fa28ec9b700 1 Processor -- start 2024-05-08T23:09:14.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.961+0000 7fa28ec9b700 1 -- start start 2024-05-08T23:09:14.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.961+0000 7fa28ec9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa288104fe0 0x7fa28819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:14.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.961+0000 7fa28ec9b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28819cba0 con 0x7fa288104fe0 2024-05-08T23:09:14.525 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.961+0000 7fa28ca37700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa288104fe0 0x7fa28819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:14.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.961+0000 7fa28ca37700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa288104fe0 0x7fa28819c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40722/0 (socket says 172.21.15.135:40722) 2024-05-08T23:09:14.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.961+0000 7fa28ca37700 1 -- 172.21.15.135:0/2997476700 learned_addr learned my addr 172.21.15.135:0/2997476700 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:14.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.961+0000 7fa28ca37700 1 -- 172.21.15.135:0/2997476700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c009550 con 0x7fa288104fe0 2024-05-08T23:09:14.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.962+0000 7fa28ca37700 1 --2- 172.21.15.135:0/2997476700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa288104fe0 0x7fa28819c660 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa27c006af0 tx=0x7fa27c011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:14.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.962+0000 7fa285ffb700 1 -- 172.21.15.135:0/2997476700 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa27c003a40 con 0x7fa288104fe0 2024-05-08T23:09:14.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.962+0000 7fa28ec9b700 1 -- 172.21.15.135:0/2997476700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28819cda0 con 0x7fa288104fe0 2024-05-08T23:09:14.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.962+0000 7fa285ffb700 1 -- 172.21.15.135:0/2997476700 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa27c003ba0 con 0x7fa288104fe0 2024-05-08T23:09:14.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.962+0000 7fa285ffb700 1 -- 172.21.15.135:0/2997476700 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa27c0196c0 con 0x7fa288104fe0 2024-05-08T23:09:14.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.962+0000 7fa28ec9b700 1 -- 172.21.15.135:0/2997476700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28819d240 con 0x7fa288104fe0 2024-05-08T23:09:14.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.963+0000 7fa285ffb700 1 -- 172.21.15.135:0/2997476700 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fa27c019980 con 0x7fa288104fe0 2024-05-08T23:09:14.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.963+0000 7fa285ffb700 1 --2- 172.21.15.135:0/2997476700 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fa2780386b0 0x7fa27803ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:14.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.963+0000 7fa285ffb700 1 -- 172.21.15.135:0/2997476700 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa27c04c6d0 con 0x7fa288104fe0 2024-05-08T23:09:14.526 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.963+0000 7fa28ec9b700 1 -- 172.21.15.135:0/2997476700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2881963b0 con 0x7fa288104fe0 2024-05-08T23:09:14.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.963+0000 7fa287fff700 1 --2- 172.21.15.135:0/2997476700 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fa2780386b0 0x7fa27803ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:14.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.963+0000 7fa287fff700 1 --2- 172.21.15.135:0/2997476700 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fa2780386b0 0x7fa27803ab70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa274006fd0 tx=0x7fa274006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:14.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:12.968+0000 7fa285ffb700 1 -- 172.21.15.135:0/2997476700 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa27c0243f0 con 0x7fa288104fe0 2024-05-08T23:09:14.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:13.220+0000 7fa28ec9b700 1 -- 172.21.15.135:0/2997476700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fa2881067f0 con 0x7fa288104fe0 2024-05-08T23:09:14.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.147+0000 7fa285ffb700 1 -- 172.21.15.135:0/2997476700 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fa27c04b180 con 0x7fa288104fe0 2024-05-08T23:09:14.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.149+0000 7fa285ffb700 1 -- 172.21.15.135:0/2997476700 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fa27c0243f0 con 0x7fa288104fe0 2024-05-08T23:09:14.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.152+0000 7fa28ec9b700 1 -- 172.21.15.135:0/2997476700 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fa2780386b0 msgr2=0x7fa27803ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:14.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.152+0000 7fa28ec9b700 1 --2- 172.21.15.135:0/2997476700 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fa2780386b0 0x7fa27803ab70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa274006fd0 tx=0x7fa274006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:14.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.152+0000 7fa28ec9b700 1 -- 172.21.15.135:0/2997476700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa288104fe0 msgr2=0x7fa28819c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:14.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.152+0000 7fa28ec9b700 1 --2- 172.21.15.135:0/2997476700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa288104fe0 0x7fa28819c660 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa27c006af0 tx=0x7fa27c011a10 comp rx=0 tx=0).stop 2024-05-08T23:09:14.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.152+0000 7fa28ec9b700 1 -- 172.21.15.135:0/2997476700 shutdown_connections 2024-05-08T23:09:14.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.152+0000 7fa28ec9b700 1 --2- 172.21.15.135:0/2997476700 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7fa2780386b0 0x7fa27803ab70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:14.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.153+0000 7fa28ec9b700 1 --2- 172.21.15.135:0/2997476700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa288104fe0 0x7fa28819c660 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:14.527 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.153+0000 7fa28ec9b700 1 -- 172.21.15.135:0/2997476700 >> 172.21.15.135:0/2997476700 conn(0x7fa288100bc0 msgr2=0x7fa2881934f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:14.528 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.153+0000 7fa28ec9b700 1 -- 172.21.15.135:0/2997476700 shutdown_connections 2024-05-08T23:09:14.528 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.153+0000 7fa28ec9b700 1 -- 172.21.15.135:0/2997476700 wait complete. 2024-05-08T23:09:14.712 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:14 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:14.614+0000 7f6d3d12e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T23:09:15.147 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:14 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:14.712+0000 7f6d3d12e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T23:09:15.147 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:14 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:14.802+0000 7f6d3d12e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T23:09:15.147 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:14 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:14.892+0000 7f6d3d12e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T23:09:15.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:15 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2997476700' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-08T23:09:15.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:15 smithi135 ceph-mon[42440]: mgrmap e9: x(active, since 15s) 2024-05-08T23:09:15.557 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:09:15.557 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-08T23:09:15.557 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T23:09:15.557 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-08T23:09:15.557 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-08T23:09:15.557 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:09:15.557 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.920+0000 7efe3bdda700 1 Processor -- start 2024-05-08T23:09:15.557 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.921+0000 7efe3bdda700 1 -- start start 2024-05-08T23:09:15.558 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.921+0000 7efe3bdda700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe34107250 0x7efe34109640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:15.558 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.921+0000 7efe3bdda700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe34079e90 con 0x7efe34107250 2024-05-08T23:09:15.558 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.921+0000 7efe39b76700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe34107250 0x7efe34109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:15.558 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.921+0000 7efe39b76700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe34107250 0x7efe34109640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40734/0 (socket says 172.21.15.135:40734) 2024-05-08T23:09:15.558 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.921+0000 7efe39b76700 1 -- 172.21.15.135:0/2376114276 learned_addr learned my addr 172.21.15.135:0/2376114276 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:15.558 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.921+0000 7efe39b76700 1 -- 172.21.15.135:0/2376114276 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe34109b80 con 0x7efe34107250 2024-05-08T23:09:15.558 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.921+0000 7efe39b76700 1 --2- 172.21.15.135:0/2376114276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe34107250 0x7efe34109640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe300098a0 tx=0x7efe30009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37eadacad7d9dc56 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:15.558 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.922+0000 7efe38b74700 1 -- 172.21.15.135:0/2376114276 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe30004160 con 0x7efe34107250 2024-05-08T23:09:15.558 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.922+0000 7efe38b74700 1 -- 172.21.15.135:0/2376114276 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe300042c0 con 0x7efe34107250 2024-05-08T23:09:15.558 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.922+0000 7efe38b74700 1 -- 172.21.15.135:0/2376114276 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe300119b0 con 0x7efe34107250 2024-05-08T23:09:15.558 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.922+0000 7efe3bdda700 1 -- 172.21.15.135:0/2376114276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe34107250 msgr2=0x7efe34109640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:15.558 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.922+0000 7efe3bdda700 1 --2- 172.21.15.135:0/2376114276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe34107250 0x7efe34109640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe300098a0 tx=0x7efe30009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:15.559 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.922+0000 7efe3bdda700 1 -- 172.21.15.135:0/2376114276 shutdown_connections 2024-05-08T23:09:15.559 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.922+0000 7efe3bdda700 1 --2- 172.21.15.135:0/2376114276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe34107250 0x7efe34109640 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:15.559 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.922+0000 7efe3bdda700 1 -- 172.21.15.135:0/2376114276 >> 172.21.15.135:0/2376114276 conn(0x7efe34100c80 msgr2=0x7efe341030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:15.559 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.922+0000 7efe3bdda700 1 -- 172.21.15.135:0/2376114276 shutdown_connections 2024-05-08T23:09:15.559 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.922+0000 7efe3bdda700 1 -- 172.21.15.135:0/2376114276 wait complete. 2024-05-08T23:09:15.559 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.923+0000 7efe3bdda700 1 Processor -- start 2024-05-08T23:09:15.559 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.923+0000 7efe3bdda700 1 -- start start 2024-05-08T23:09:15.559 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.924+0000 7efe3bdda700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe34107250 0x7efe34106a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:15.559 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.924+0000 7efe3bdda700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe34106fc0 con 0x7efe34107250 2024-05-08T23:09:15.559 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.924+0000 7efe39b76700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe34107250 0x7efe34106a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:15.559 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.924+0000 7efe39b76700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe34107250 0x7efe34106a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40750/0 (socket says 172.21.15.135:40750) 2024-05-08T23:09:15.559 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.924+0000 7efe39b76700 1 -- 172.21.15.135:0/1144919937 learned_addr learned my addr 172.21.15.135:0/1144919937 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:15.559 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.924+0000 7efe39b76700 1 -- 172.21.15.135:0/1144919937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe30009550 con 0x7efe34107250 2024-05-08T23:09:15.560 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.924+0000 7efe39b76700 1 --2- 172.21.15.135:0/1144919937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe34107250 0x7efe34106a80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efe30011980 tx=0x7efe30011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:15.560 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.924+0000 7efe2affd700 1 -- 172.21.15.135:0/1144919937 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe30003af0 con 0x7efe34107250 2024-05-08T23:09:15.560 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.924+0000 7efe3bdda700 1 -- 172.21.15.135:0/1144919937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe34105200 con 0x7efe34107250 2024-05-08T23:09:15.560 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.924+0000 7efe2affd700 1 -- 172.21.15.135:0/1144919937 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe30003c50 con 0x7efe34107250 2024-05-08T23:09:15.560 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.924+0000 7efe2affd700 1 -- 172.21.15.135:0/1144919937 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe30019760 con 0x7efe34107250 2024-05-08T23:09:15.560 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.924+0000 7efe3bdda700 1 -- 172.21.15.135:0/1144919937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe341056a0 con 0x7efe34107250 2024-05-08T23:09:15.560 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.925+0000 7efe2affd700 1 -- 172.21.15.135:0/1144919937 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7efe300199a0 con 0x7efe34107250 2024-05-08T23:09:15.560 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.925+0000 7efe2affd700 1 --2- 172.21.15.135:0/1144919937 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7efe20038750 0x7efe2003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:15.560 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.925+0000 7efe2affd700 1 -- 172.21.15.135:0/1144919937 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7efe3004cac0 con 0x7efe34107250 2024-05-08T23:09:15.560 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.925+0000 7efe39375700 1 -- 172.21.15.135:0/1144919937 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7efe20038750 msgr2=0x7efe2003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3165594440 2024-05-08T23:09:15.561 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.925+0000 7efe39375700 1 --2- 172.21.15.135:0/1144919937 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7efe20038750 0x7efe2003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:09:15.561 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.926+0000 7efe3bdda700 1 -- 172.21.15.135:0/1144919937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe340625d0 con 0x7efe34107250 2024-05-08T23:09:15.561 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:14.931+0000 7efe2affd700 1 -- 172.21.15.135:0/1144919937 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efe30018db0 con 0x7efe34107250 2024-05-08T23:09:15.561 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.126+0000 7efe39375700 1 -- 172.21.15.135:0/1144919937 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7efe20038750 msgr2=0x7efe2003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3165594440 2024-05-08T23:09:15.561 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.126+0000 7efe39375700 1 --2- 172.21.15.135:0/1144919937 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7efe20038750 0x7efe2003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T23:09:15.561 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.202+0000 7efe3bdda700 1 -- 172.21.15.135:0/1144919937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7efe34105a60 con 0x7efe34107250 2024-05-08T23:09:15.561 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.202+0000 7efe2affd700 1 -- 172.21.15.135:0/1144919937 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7efe30018350 con 0x7efe34107250 2024-05-08T23:09:15.561 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.205+0000 7efe3bdda700 1 -- 172.21.15.135:0/1144919937 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7efe20038750 msgr2=0x7efe2003ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:09:15.561 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.205+0000 7efe3bdda700 1 --2- 172.21.15.135:0/1144919937 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7efe20038750 0x7efe2003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:15.561 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.205+0000 7efe3bdda700 1 -- 172.21.15.135:0/1144919937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe34107250 msgr2=0x7efe34106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:15.561 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.205+0000 7efe3bdda700 1 --2- 172.21.15.135:0/1144919937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe34107250 0x7efe34106a80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efe30011980 tx=0x7efe30011a60 comp rx=0 tx=0).stop 2024-05-08T23:09:15.561 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.205+0000 7efe3bdda700 1 -- 172.21.15.135:0/1144919937 shutdown_connections 2024-05-08T23:09:15.561 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.205+0000 7efe3bdda700 1 --2- 172.21.15.135:0/1144919937 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7efe20038750 0x7efe2003ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:15.561 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.205+0000 7efe3bdda700 1 --2- 172.21.15.135:0/1144919937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe34107250 0x7efe34106a80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:15.562 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.205+0000 7efe3bdda700 1 -- 172.21.15.135:0/1144919937 >> 172.21.15.135:0/1144919937 conn(0x7efe34100c80 msgr2=0x7efe341017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:15.562 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.205+0000 7efe3bdda700 1 -- 172.21.15.135:0/1144919937 shutdown_connections 2024-05-08T23:09:15.562 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.205+0000 7efe3bdda700 1 -- 172.21.15.135:0/1144919937 wait complete. 2024-05-08T23:09:15.562 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for the mgr to restart... 2024-05-08T23:09:15.562 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mgr epoch 9... 2024-05-08T23:09:15.823 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:15 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:15.555+0000 7f6d3d12e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:09:15.823 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:15 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:15.822+0000 7f6d3d12e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T23:09:16.147 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:15 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:15.914+0000 7f6d3d12e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T23:09:16.147 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:16 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:16.024+0000 7f6d3d12e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T23:09:16.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:16 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1144919937' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-08T23:09:16.453 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:16 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:16.182+0000 7f6d3d12e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T23:09:16.453 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:16 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:16.310+0000 7f6d3d12e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T23:09:16.453 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:16 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:16.396+0000 7f6d3d12e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T23:09:17.157 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:16 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:16.766+0000 7f6d3d12e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T23:09:17.446 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:17 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:17.156+0000 7f6d3d12e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T23:09:17.446 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:17 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:17.352+0000 7f6d3d12e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T23:09:17.446 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:17 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:17.445+0000 7f6d3d12e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T23:09:18.703 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:18 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:18.207+0000 7f6d3d12e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T23:09:18.703 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:18 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:18.304+0000 7f6d3d12e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T23:09:18.703 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:18 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:18.451+0000 7f6d3d12e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T23:09:19.453 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:19 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:19.078+0000 7f6d3d12e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T23:09:19.453 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:19 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:19.260+0000 7f6d3d12e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T23:09:19.953 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:19 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:19.456+0000 7f6d3d12e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T23:09:20.677 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:20 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:20.390+0000 7f6d3d12e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T23:09:20.953 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:20 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:20.677+0000 7f6d3d12e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:09:20.953 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:20 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:20.765+0000 7f6d3d12e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T23:09:21.453 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:09:20 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:09:20.956+0000 7f6d3d12e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T23:09:21.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:21 smithi135 ceph-mon[42440]: Active manager daemon x restarted 2024-05-08T23:09:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:21 smithi135 ceph-mon[42440]: Activating manager daemon x 2024-05-08T23:09:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:21 smithi135 ceph-mon[42440]: osdmap e3: 0 total, 0 up, 0 in 2024-05-08T23:09:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:21 smithi135 ceph-mon[42440]: mgrmap e10: x(active, starting, since 0.00315581s) 2024-05-08T23:09:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:09:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T23:09:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T23:09:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T23:09:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T23:09:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:21 smithi135 ceph-mon[42440]: Manager daemon x is now available 2024-05-08T23:09:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:09:22.449 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T23:09:22.449 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T23:09:22.449 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:22.449 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:22 smithi135 ceph-mon[42440]: mgrmap e11: x(active, since 1.00563s) 2024-05-08T23:09:22.817 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:09:22.817 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-08T23:09:22.817 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-08T23:09:22.818 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:09:22.818 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.910+0000 7f9795d8d700 1 Processor -- start 2024-05-08T23:09:22.818 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.910+0000 7f9795d8d700 1 -- start start 2024-05-08T23:09:22.818 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.910+0000 7f9795d8d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9790107260 0x7f9790109650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:22.818 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.910+0000 7f9795d8d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9790079e10 con 0x7f9790107260 2024-05-08T23:09:22.818 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.911+0000 7f978f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9790107260 0x7f9790109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:22.818 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.911+0000 7f978f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9790107260 0x7f9790109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40764/0 (socket says 172.21.15.135:40764) 2024-05-08T23:09:22.818 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.911+0000 7f978f7fe700 1 -- 172.21.15.135:0/968022428 learned_addr learned my addr 172.21.15.135:0/968022428 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:22.818 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.911+0000 7f978f7fe700 1 -- 172.21.15.135:0/968022428 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9790079f50 con 0x7f9790107260 2024-05-08T23:09:22.818 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.911+0000 7f978f7fe700 1 --2- 172.21.15.135:0/968022428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9790107260 0x7f9790109650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f97800098a0 tx=0x7f9780009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3daa4937f6e6686 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:22.818 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.911+0000 7f978e7fc700 1 -- 172.21.15.135:0/968022428 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9780004160 con 0x7f9790107260 2024-05-08T23:09:22.818 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.911+0000 7f978e7fc700 1 -- 172.21.15.135:0/968022428 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f97800042c0 con 0x7f9790107260 2024-05-08T23:09:22.818 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.911+0000 7f978e7fc700 1 -- 172.21.15.135:0/968022428 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97800119b0 con 0x7f9790107260 2024-05-08T23:09:22.818 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.912+0000 7f9795d8d700 1 -- 172.21.15.135:0/968022428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9790107260 msgr2=0x7f9790109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:22.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.912+0000 7f9795d8d700 1 --2- 172.21.15.135:0/968022428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9790107260 0x7f9790109650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f97800098a0 tx=0x7f9780009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:22.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.912+0000 7f9795d8d700 1 -- 172.21.15.135:0/968022428 shutdown_connections 2024-05-08T23:09:22.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.912+0000 7f9795d8d700 1 --2- 172.21.15.135:0/968022428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9790107260 0x7f9790109650 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:22.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.912+0000 7f9795d8d700 1 -- 172.21.15.135:0/968022428 >> 172.21.15.135:0/968022428 conn(0x7f9790100bd0 msgr2=0x7f9790103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:22.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.912+0000 7f9795d8d700 1 -- 172.21.15.135:0/968022428 shutdown_connections 2024-05-08T23:09:22.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.912+0000 7f9795d8d700 1 -- 172.21.15.135:0/968022428 wait complete. 2024-05-08T23:09:22.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.913+0000 7f9795d8d700 1 Processor -- start 2024-05-08T23:09:22.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.913+0000 7f9795d8d700 1 -- start start 2024-05-08T23:09:22.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.913+0000 7f9795d8d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9790107260 0x7f979019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:22.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.913+0000 7f9795d8d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979019aa00 con 0x7f9790107260 2024-05-08T23:09:22.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.914+0000 7f978f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9790107260 0x7f979019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:22.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.914+0000 7f978f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9790107260 0x7f979019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40780/0 (socket says 172.21.15.135:40780) 2024-05-08T23:09:22.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.914+0000 7f978f7fe700 1 -- 172.21.15.135:0/1719083121 learned_addr learned my addr 172.21.15.135:0/1719083121 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:22.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.914+0000 7f978f7fe700 1 -- 172.21.15.135:0/1719083121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9780009550 con 0x7f9790107260 2024-05-08T23:09:22.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.914+0000 7f978f7fe700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9790107260 0x7f979019a4c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9780006af0 tx=0x7f9780011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:22.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.914+0000 7f978cff9700 1 -- 172.21.15.135:0/1719083121 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9780003a40 con 0x7f9790107260 2024-05-08T23:09:22.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.914+0000 7f978cff9700 1 -- 172.21.15.135:0/1719083121 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9780003ba0 con 0x7f9790107260 2024-05-08T23:09:22.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.914+0000 7f9795d8d700 1 -- 172.21.15.135:0/1719083121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979019ac00 con 0x7f9790107260 2024-05-08T23:09:22.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.914+0000 7f978cff9700 1 -- 172.21.15.135:0/1719083121 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97800196c0 con 0x7f9790107260 2024-05-08T23:09:22.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.914+0000 7f9795d8d700 1 -- 172.21.15.135:0/1719083121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979019b0a0 con 0x7f9790107260 2024-05-08T23:09:22.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.915+0000 7f978cff9700 1 -- 172.21.15.135:0/1719083121 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f9780019980 con 0x7f9790107260 2024-05-08T23:09:22.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.915+0000 7f978cff9700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9778038700 0x7f977803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:22.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.916+0000 7f978cff9700 1 -- 172.21.15.135:0/1719083121 --> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f977803b2d0 con 0x7f9778038700 2024-05-08T23:09:22.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.916+0000 7f978cff9700 1 -- 172.21.15.135:0/1719083121 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f978004c6c0 con 0x7f9790107260 2024-05-08T23:09:22.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.916+0000 7f978effd700 1 -- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9778038700 msgr2=0x7f977803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3165594440 2024-05-08T23:09:22.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:15.916+0000 7f978effd700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9778038700 0x7f977803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:09:22.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:16.117+0000 7f978effd700 1 -- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9778038700 msgr2=0x7f977803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3165594440 2024-05-08T23:09:22.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:16.117+0000 7f978effd700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9778038700 0x7f977803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T23:09:22.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:16.518+0000 7f978effd700 1 -- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9778038700 msgr2=0x7f977803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3165594440 2024-05-08T23:09:22.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:16.518+0000 7f978effd700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9778038700 0x7f977803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T23:09:22.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:17.319+0000 7f978effd700 1 -- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9778038700 msgr2=0x7f977803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3165594440 2024-05-08T23:09:22.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:17.319+0000 7f978effd700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9778038700 0x7f977803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T23:09:22.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:18.920+0000 7f978effd700 1 -- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9778038700 msgr2=0x7f977803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3165594440 2024-05-08T23:09:22.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:18.920+0000 7f978effd700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9778038700 0x7f977803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-08T23:09:22.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:20.972+0000 7f978cff9700 1 -- 172.21.15.135:0/1719083121 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mgrmap(e 10) v1 ==== 45321+0+0 (secure 0 0 0) 0x7f9780019d20 con 0x7f9790107260 2024-05-08T23:09:22.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:20.972+0000 7f978cff9700 1 -- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9778038700 msgr2=0x7f977803abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:09:22.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:20.972+0000 7f978cff9700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9778038700 0x7f977803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:22.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.973+0000 7f978cff9700 1 -- 172.21.15.135:0/1719083121 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7f978004e590 con 0x7f9790107260 2024-05-08T23:09:22.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.973+0000 7f978cff9700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f977803bff0 0x7f977803e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:22.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.973+0000 7f978cff9700 1 -- 172.21.15.135:0/1719083121 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f977803b2d0 con 0x7f977803bff0 2024-05-08T23:09:22.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.974+0000 7f978effd700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f977803bff0 0x7f977803e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:22.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.975+0000 7f978effd700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f977803bff0 0x7f977803e3e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9784003a10 tx=0x7f97840092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:22.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.975+0000 7f978cff9700 1 -- 172.21.15.135:0/1719083121 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f977803b2d0 con 0x7f977803bff0 2024-05-08T23:09:22.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.981+0000 7f9795d8d700 1 -- 172.21.15.135:0/1719083121 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f979019b230 con 0x7f977803bff0 2024-05-08T23:09:22.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.982+0000 7f978cff9700 1 -- 172.21.15.135:0/1719083121 <== mgr.14152 v2:172.21.15.135:6800/1743116941 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f978400a050 con 0x7f977803bff0 2024-05-08T23:09:22.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.982+0000 7f9795d8d700 1 -- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f977803bff0 msgr2=0x7f977803e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:22.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.982+0000 7f9795d8d700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f977803bff0 0x7f977803e3e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9784003a10 tx=0x7f97840092b0 comp rx=0 tx=0).stop 2024-05-08T23:09:22.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.982+0000 7f9795d8d700 1 -- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9790107260 msgr2=0x7f979019a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:22.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.982+0000 7f9795d8d700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9790107260 0x7f979019a4c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9780006af0 tx=0x7f9780011a10 comp rx=0 tx=0).stop 2024-05-08T23:09:22.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.982+0000 7f9795d8d700 1 -- 172.21.15.135:0/1719083121 shutdown_connections 2024-05-08T23:09:22.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.982+0000 7f9795d8d700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f977803bff0 0x7f977803e3e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:22.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.982+0000 7f9795d8d700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9790107260 0x7f979019a4c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:22.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.982+0000 7f9795d8d700 1 --2- 172.21.15.135:0/1719083121 >> [v2:172.21.15.135:6800/3165594440,v1:172.21.15.135:6801/3165594440] conn(0x7f9778038700 0x7f977803abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:22.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.982+0000 7f9795d8d700 1 -- 172.21.15.135:0/1719083121 >> 172.21.15.135:0/1719083121 conn(0x7f9790100bd0 msgr2=0x7f9790101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:22.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.982+0000 7f9795d8d700 1 -- 172.21.15.135:0/1719083121 shutdown_connections 2024-05-08T23:09:22.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:21.982+0000 7f9795d8d700 1 -- 172.21.15.135:0/1719083121 wait complete. 2024-05-08T23:09:22.822 INFO:teuthology.orchestra.run.smithi135.stdout:mgr epoch 9 is available 2024-05-08T23:09:22.823 INFO:teuthology.orchestra.run.smithi135.stdout:Generating a dashboard self-signed certificate... 2024-05-08T23:09:23.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:23 smithi135 ceph-mon[42440]: [08/May/2024:23:09:21] ENGINE Bus STARTING 2024-05-08T23:09:23.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:23 smithi135 ceph-mon[42440]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-08T23:09:23.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:23 smithi135 ceph-mon[42440]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-08T23:09:23.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:23 smithi135 ceph-mon[42440]: [08/May/2024:23:09:22] ENGINE Serving on http://172.21.15.135:8765 2024-05-08T23:09:23.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:23 smithi135 ceph-mon[42440]: [08/May/2024:23:09:22] ENGINE Serving on https://172.21.15.135:7150 2024-05-08T23:09:23.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:23 smithi135 ceph-mon[42440]: [08/May/2024:23:09:22] ENGINE Bus STARTED 2024-05-08T23:09:24.097 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-08T23:09:24.097 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.177+0000 7f834ea5f700 1 Processor -- start 2024-05-08T23:09:24.097 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.177+0000 7f834ea5f700 1 -- start start 2024-05-08T23:09:24.097 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.177+0000 7f834ea5f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8348107260 0x7f8348109650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:24.097 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.177+0000 7f834ea5f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8348079e10 con 0x7f8348107260 2024-05-08T23:09:24.098 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.177+0000 7f8347fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8348107260 0x7f8348109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:24.098 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.177+0000 7f8347fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8348107260 0x7f8348109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48576/0 (socket says 172.21.15.135:48576) 2024-05-08T23:09:24.098 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.177+0000 7f8347fff700 1 -- 172.21.15.135:0/3845346749 learned_addr learned my addr 172.21.15.135:0/3845346749 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:24.098 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.177+0000 7f8347fff700 1 -- 172.21.15.135:0/3845346749 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8348079f50 con 0x7f8348107260 2024-05-08T23:09:24.098 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.178+0000 7f8347fff700 1 --2- 172.21.15.135:0/3845346749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8348107260 0x7f8348109650 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f83380098a0 tx=0x7f8338009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe0212727c5ecd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:24.098 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.178+0000 7f8346ffd700 1 -- 172.21.15.135:0/3845346749 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8338004160 con 0x7f8348107260 2024-05-08T23:09:24.098 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.178+0000 7f8346ffd700 1 -- 172.21.15.135:0/3845346749 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f83380042c0 con 0x7f8348107260 2024-05-08T23:09:24.098 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.178+0000 7f8346ffd700 1 -- 172.21.15.135:0/3845346749 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83380119b0 con 0x7f8348107260 2024-05-08T23:09:24.098 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.178+0000 7f834ea5f700 1 -- 172.21.15.135:0/3845346749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8348107260 msgr2=0x7f8348109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:24.098 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.178+0000 7f834ea5f700 1 --2- 172.21.15.135:0/3845346749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8348107260 0x7f8348109650 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f83380098a0 tx=0x7f8338009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:24.098 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.178+0000 7f834ea5f700 1 -- 172.21.15.135:0/3845346749 shutdown_connections 2024-05-08T23:09:24.098 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.179+0000 7f834ea5f700 1 --2- 172.21.15.135:0/3845346749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8348107260 0x7f8348109650 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:24.098 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.179+0000 7f834ea5f700 1 -- 172.21.15.135:0/3845346749 >> 172.21.15.135:0/3845346749 conn(0x7f8348100bd0 msgr2=0x7f8348103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:24.098 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.179+0000 7f834ea5f700 1 -- 172.21.15.135:0/3845346749 shutdown_connections 2024-05-08T23:09:24.099 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.179+0000 7f834ea5f700 1 -- 172.21.15.135:0/3845346749 wait complete. 2024-05-08T23:09:24.099 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.179+0000 7f834ea5f700 1 Processor -- start 2024-05-08T23:09:24.099 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.179+0000 7f834ea5f700 1 -- start start 2024-05-08T23:09:24.099 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.179+0000 7f834ea5f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8348107260 0x7f834819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:24.099 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.180+0000 7f834ea5f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834819aa00 con 0x7f8348107260 2024-05-08T23:09:24.099 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.180+0000 7f8347fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8348107260 0x7f834819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:24.099 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.180+0000 7f8347fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8348107260 0x7f834819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48586/0 (socket says 172.21.15.135:48586) 2024-05-08T23:09:24.099 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.180+0000 7f8347fff700 1 -- 172.21.15.135:0/1543091396 learned_addr learned my addr 172.21.15.135:0/1543091396 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:24.099 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.180+0000 7f8347fff700 1 -- 172.21.15.135:0/1543091396 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8338009550 con 0x7f8348107260 2024-05-08T23:09:24.099 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.180+0000 7f8347fff700 1 --2- 172.21.15.135:0/1543091396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8348107260 0x7f834819a4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8338011670 tx=0x7f8338011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:24.099 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.180+0000 7f83457fa700 1 -- 172.21.15.135:0/1543091396 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8338003b20 con 0x7f8348107260 2024-05-08T23:09:24.099 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.180+0000 7f83457fa700 1 -- 172.21.15.135:0/1543091396 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8338003c80 con 0x7f8348107260 2024-05-08T23:09:24.099 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.180+0000 7f834ea5f700 1 -- 172.21.15.135:0/1543091396 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834819ac00 con 0x7f8348107260 2024-05-08T23:09:24.099 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.180+0000 7f83457fa700 1 -- 172.21.15.135:0/1543091396 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8338019770 con 0x7f8348107260 2024-05-08T23:09:24.099 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.180+0000 7f834ea5f700 1 -- 172.21.15.135:0/1543091396 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834819b0a0 con 0x7f8348107260 2024-05-08T23:09:24.100 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.181+0000 7f834ea5f700 1 -- 172.21.15.135:0/1543091396 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834810aa50 con 0x7f8348107260 2024-05-08T23:09:24.100 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.181+0000 7f83457fa700 1 -- 172.21.15.135:0/1543091396 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f83380199e0 con 0x7f8348107260 2024-05-08T23:09:24.100 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.182+0000 7f83457fa700 1 --2- 172.21.15.135:0/1543091396 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f83300387a0 0x7f833003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:24.100 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.182+0000 7f83457fa700 1 -- 172.21.15.135:0/1543091396 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f833804ca80 con 0x7f8348107260 2024-05-08T23:09:24.100 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.182+0000 7f83477fe700 1 --2- 172.21.15.135:0/1543091396 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f83300387a0 0x7f833003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:24.100 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.182+0000 7f83477fe700 1 --2- 172.21.15.135:0/1543091396 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f83300387a0 0x7f833003ac60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f833c006fd0 tx=0x7f833c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:24.100 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.189+0000 7f83457fa700 1 -- 172.21.15.135:0/1543091396 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f833802d9a0 con 0x7f8348107260 2024-05-08T23:09:24.100 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.405+0000 7f834ea5f700 1 -- 172.21.15.135:0/1543091396 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f8348101f10 con 0x7f83300387a0 2024-05-08T23:09:24.100 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.554+0000 7f83457fa700 1 -- 172.21.15.135:0/1543091396 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f8348101f10 con 0x7f83300387a0 2024-05-08T23:09:24.100 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.556+0000 7f834ea5f700 1 -- 172.21.15.135:0/1543091396 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f83300387a0 msgr2=0x7f833003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:24.100 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.556+0000 7f834ea5f700 1 --2- 172.21.15.135:0/1543091396 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f83300387a0 0x7f833003ac60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f833c006fd0 tx=0x7f833c006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:24.100 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.556+0000 7f834ea5f700 1 -- 172.21.15.135:0/1543091396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8348107260 msgr2=0x7f834819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:24.100 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.556+0000 7f834ea5f700 1 --2- 172.21.15.135:0/1543091396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8348107260 0x7f834819a4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8338011670 tx=0x7f8338011a30 comp rx=0 tx=0).stop 2024-05-08T23:09:24.100 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.557+0000 7f834ea5f700 1 -- 172.21.15.135:0/1543091396 shutdown_connections 2024-05-08T23:09:24.101 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.557+0000 7f834ea5f700 1 --2- 172.21.15.135:0/1543091396 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f83300387a0 0x7f833003ac60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:24.101 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.557+0000 7f834ea5f700 1 --2- 172.21.15.135:0/1543091396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8348107260 0x7f834819a4c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:24.101 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.557+0000 7f834ea5f700 1 -- 172.21.15.135:0/1543091396 >> 172.21.15.135:0/1543091396 conn(0x7f8348100bd0 msgr2=0x7f8348101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:24.101 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.557+0000 7f834ea5f700 1 -- 172.21.15.135:0/1543091396 shutdown_connections 2024-05-08T23:09:24.101 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:23.557+0000 7f834ea5f700 1 -- 172.21.15.135:0/1543091396 wait complete. 2024-05-08T23:09:24.101 INFO:teuthology.orchestra.run.smithi135.stdout:Creating initial admin user... 2024-05-08T23:09:24.140 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:24 smithi135 ceph-mon[42440]: mgrmap e12: x(active, since 2s) 2024-05-08T23:09:24.140 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:24 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:24.140 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:24 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:24.140 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:24 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:25.318 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:25 smithi135 ceph-mon[42440]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:09:25.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$tKGVTXNdHrgGrk61kU.NKuISaJybKsfojrsSV5lgYGukqpPG0yM/G", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715209765, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-08T23:09:25.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.601+0000 7f56b3df6700 1 Processor -- start 2024-05-08T23:09:25.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.601+0000 7f56b3df6700 1 -- start start 2024-05-08T23:09:25.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.601+0000 7f56b3df6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56ac107220 0x7f56ac109610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:25.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.601+0000 7f56b3df6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac079e70 con 0x7f56ac107220 2024-05-08T23:09:25.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.602+0000 7f56b1b92700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56ac107220 0x7f56ac109610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:25.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.602+0000 7f56b1b92700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56ac107220 0x7f56ac109610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48600/0 (socket says 172.21.15.135:48600) 2024-05-08T23:09:25.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.602+0000 7f56b1b92700 1 -- 172.21.15.135:0/2852347600 learned_addr learned my addr 172.21.15.135:0/2852347600 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:25.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.602+0000 7f56b1b92700 1 -- 172.21.15.135:0/2852347600 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac109b50 con 0x7f56ac107220 2024-05-08T23:09:25.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.602+0000 7f56b1b92700 1 --2- 172.21.15.135:0/2852347600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56ac107220 0x7f56ac109610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f569c0098a0 tx=0x7f569c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa345f9b8012f13a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:25.397 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.602+0000 7f56b0b90700 1 -- 172.21.15.135:0/2852347600 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f569c004160 con 0x7f56ac107220 2024-05-08T23:09:25.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.602+0000 7f56b0b90700 1 -- 172.21.15.135:0/2852347600 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f569c0042c0 con 0x7f56ac107220 2024-05-08T23:09:25.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.602+0000 7f56b0b90700 1 -- 172.21.15.135:0/2852347600 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f569c0119b0 con 0x7f56ac107220 2024-05-08T23:09:25.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.603+0000 7f56b3df6700 1 -- 172.21.15.135:0/2852347600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56ac107220 msgr2=0x7f56ac109610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:25.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.603+0000 7f56b3df6700 1 --2- 172.21.15.135:0/2852347600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56ac107220 0x7f56ac109610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f569c0098a0 tx=0x7f569c009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:25.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.603+0000 7f56b3df6700 1 -- 172.21.15.135:0/2852347600 shutdown_connections 2024-05-08T23:09:25.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.603+0000 7f56b3df6700 1 --2- 172.21.15.135:0/2852347600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56ac107220 0x7f56ac109610 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:25.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.603+0000 7f56b3df6700 1 -- 172.21.15.135:0/2852347600 >> 172.21.15.135:0/2852347600 conn(0x7f56ac100bd0 msgr2=0x7f56ac103030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:25.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.603+0000 7f56b3df6700 1 -- 172.21.15.135:0/2852347600 shutdown_connections 2024-05-08T23:09:25.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.603+0000 7f56b3df6700 1 -- 172.21.15.135:0/2852347600 wait complete. 2024-05-08T23:09:25.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.604+0000 7f56b3df6700 1 Processor -- start 2024-05-08T23:09:25.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.604+0000 7f56b3df6700 1 -- start start 2024-05-08T23:09:25.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.604+0000 7f56b3df6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56ac107220 0x7f56ac106a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:25.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.604+0000 7f56b3df6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac106f90 con 0x7f56ac107220 2024-05-08T23:09:25.398 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.604+0000 7f56b1b92700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56ac107220 0x7f56ac106a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:25.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.604+0000 7f56b1b92700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56ac107220 0x7f56ac106a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48602/0 (socket says 172.21.15.135:48602) 2024-05-08T23:09:25.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.604+0000 7f56b1b92700 1 -- 172.21.15.135:0/3767065434 learned_addr learned my addr 172.21.15.135:0/3767065434 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:25.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.604+0000 7f56b1b92700 1 -- 172.21.15.135:0/3767065434 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c009550 con 0x7f56ac107220 2024-05-08T23:09:25.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.604+0000 7f56b1b92700 1 --2- 172.21.15.135:0/3767065434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56ac107220 0x7f56ac106a50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f569c006af0 tx=0x7f569c011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:25.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.604+0000 7f56a2ffd700 1 -- 172.21.15.135:0/3767065434 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f569c003a40 con 0x7f56ac107220 2024-05-08T23:09:25.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.605+0000 7f56a2ffd700 1 -- 172.21.15.135:0/3767065434 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f569c003ba0 con 0x7f56ac107220 2024-05-08T23:09:25.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.605+0000 7f56a2ffd700 1 -- 172.21.15.135:0/3767065434 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f569c0196c0 con 0x7f56ac107220 2024-05-08T23:09:25.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.605+0000 7f56b3df6700 1 -- 172.21.15.135:0/3767065434 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ac1051d0 con 0x7f56ac107220 2024-05-08T23:09:25.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.605+0000 7f56b3df6700 1 -- 172.21.15.135:0/3767065434 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ac105670 con 0x7f56ac107220 2024-05-08T23:09:25.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.605+0000 7f56a2ffd700 1 -- 172.21.15.135:0/3767065434 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f569c019930 con 0x7f56ac107220 2024-05-08T23:09:25.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.605+0000 7f56a2ffd700 1 --2- 172.21.15.135:0/3767065434 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5698038750 0x7f569803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:25.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.606+0000 7f56a2ffd700 1 -- 172.21.15.135:0/3767065434 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f569c04cb10 con 0x7f56ac107220 2024-05-08T23:09:25.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.606+0000 7f56b1391700 1 --2- 172.21.15.135:0/3767065434 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5698038750 0x7f569803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:25.399 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.606+0000 7f56b3df6700 1 -- 172.21.15.135:0/3767065434 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac10a930 con 0x7f56ac107220 2024-05-08T23:09:25.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.606+0000 7f56b1391700 1 --2- 172.21.15.135:0/3767065434 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5698038750 0x7f569803ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f56a8006fd0 tx=0x7f56a8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:25.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.611+0000 7f56a2ffd700 1 -- 172.21.15.135:0/3767065434 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f569c0243f0 con 0x7f56ac107220 2024-05-08T23:09:25.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:24.819+0000 7f56b3df6700 1 -- 172.21.15.135:0/3767065434 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f56ac0623f0 con 0x7f5698038750 2024-05-08T23:09:25.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.037+0000 7f56a2ffd700 1 -- 172.21.15.135:0/3767065434 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f56ac0623f0 con 0x7f5698038750 2024-05-08T23:09:25.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.039+0000 7f56b3df6700 1 -- 172.21.15.135:0/3767065434 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5698038750 msgr2=0x7f569803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:25.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.039+0000 7f56b3df6700 1 --2- 172.21.15.135:0/3767065434 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5698038750 0x7f569803ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f56a8006fd0 tx=0x7f56a8006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:25.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.039+0000 7f56b3df6700 1 -- 172.21.15.135:0/3767065434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56ac107220 msgr2=0x7f56ac106a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:25.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.039+0000 7f56b3df6700 1 --2- 172.21.15.135:0/3767065434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56ac107220 0x7f56ac106a50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f569c006af0 tx=0x7f569c011a10 comp rx=0 tx=0).stop 2024-05-08T23:09:25.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.039+0000 7f56b3df6700 1 -- 172.21.15.135:0/3767065434 shutdown_connections 2024-05-08T23:09:25.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.039+0000 7f56b3df6700 1 --2- 172.21.15.135:0/3767065434 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5698038750 0x7f569803ac10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:25.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.039+0000 7f56b3df6700 1 --2- 172.21.15.135:0/3767065434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56ac107220 0x7f56ac106a50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:25.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.039+0000 7f56b3df6700 1 -- 172.21.15.135:0/3767065434 >> 172.21.15.135:0/3767065434 conn(0x7f56ac100bd0 msgr2=0x7f56ac1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:25.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.039+0000 7f56b3df6700 1 -- 172.21.15.135:0/3767065434 shutdown_connections 2024-05-08T23:09:25.400 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.040+0000 7f56b3df6700 1 -- 172.21.15.135:0/3767065434 wait complete. 2024-05-08T23:09:25.400 INFO:teuthology.orchestra.run.smithi135.stdout:Fetching dashboard port number... 2024-05-08T23:09:26.304 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 8443 2024-05-08T23:09:26.304 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.734+0000 7f0ae5f11700 1 Processor -- start 2024-05-08T23:09:26.304 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.734+0000 7f0ae5f11700 1 -- start start 2024-05-08T23:09:26.304 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.734+0000 7f0ae5f11700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ae0107190 0x7f0ae0109580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:26.304 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.734+0000 7f0ae5f11700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae0079ed0 con 0x7f0ae0107190 2024-05-08T23:09:26.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.734+0000 7f0adf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ae0107190 0x7f0ae0109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:26.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.734+0000 7f0adf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ae0107190 0x7f0ae0109580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48604/0 (socket says 172.21.15.135:48604) 2024-05-08T23:09:26.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.734+0000 7f0adf7fe700 1 -- 172.21.15.135:0/1826814505 learned_addr learned my addr 172.21.15.135:0/1826814505 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:26.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.735+0000 7f0adf7fe700 1 -- 172.21.15.135:0/1826814505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae0109ac0 con 0x7f0ae0107190 2024-05-08T23:09:26.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.735+0000 7f0adf7fe700 1 --2- 172.21.15.135:0/1826814505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ae0107190 0x7f0ae0109580 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40098a0 tx=0x7f0ad4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db6347b338772dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:26.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.735+0000 7f0ade7fc700 1 -- 172.21.15.135:0/1826814505 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ad4004160 con 0x7f0ae0107190 2024-05-08T23:09:26.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.735+0000 7f0ade7fc700 1 -- 172.21.15.135:0/1826814505 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ad40042c0 con 0x7f0ae0107190 2024-05-08T23:09:26.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.735+0000 7f0ade7fc700 1 -- 172.21.15.135:0/1826814505 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ad40119b0 con 0x7f0ae0107190 2024-05-08T23:09:26.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.736+0000 7f0ae5f11700 1 -- 172.21.15.135:0/1826814505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ae0107190 msgr2=0x7f0ae0109580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:26.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.736+0000 7f0ae5f11700 1 --2- 172.21.15.135:0/1826814505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ae0107190 0x7f0ae0109580 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40098a0 tx=0x7f0ad4009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:26.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.736+0000 7f0ae5f11700 1 -- 172.21.15.135:0/1826814505 shutdown_connections 2024-05-08T23:09:26.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.736+0000 7f0ae5f11700 1 --2- 172.21.15.135:0/1826814505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ae0107190 0x7f0ae0109580 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:26.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.736+0000 7f0ae5f11700 1 -- 172.21.15.135:0/1826814505 >> 172.21.15.135:0/1826814505 conn(0x7f0ae0100bc0 msgr2=0x7f0ae0103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:26.305 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.736+0000 7f0ae5f11700 1 -- 172.21.15.135:0/1826814505 shutdown_connections 2024-05-08T23:09:26.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.736+0000 7f0ae5f11700 1 -- 172.21.15.135:0/1826814505 wait complete. 2024-05-08T23:09:26.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.736+0000 7f0ae5f11700 1 Processor -- start 2024-05-08T23:09:26.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.736+0000 7f0ae5f11700 1 -- start start 2024-05-08T23:09:26.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.737+0000 7f0ae5f11700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ae0107190 0x7f0ae019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:26.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.737+0000 7f0ae5f11700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae019a9b0 con 0x7f0ae0107190 2024-05-08T23:09:26.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.737+0000 7f0adf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ae0107190 0x7f0ae019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:26.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.737+0000 7f0adf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ae0107190 0x7f0ae019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48618/0 (socket says 172.21.15.135:48618) 2024-05-08T23:09:26.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.737+0000 7f0adf7fe700 1 -- 172.21.15.135:0/707438233 learned_addr learned my addr 172.21.15.135:0/707438233 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:26.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.737+0000 7f0adf7fe700 1 -- 172.21.15.135:0/707438233 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad4009550 con 0x7f0ae0107190 2024-05-08T23:09:26.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.737+0000 7f0adf7fe700 1 --2- 172.21.15.135:0/707438233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ae0107190 0x7f0ae019a470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4006af0 tx=0x7f0ad4011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:26.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.737+0000 7f0adcff9700 1 -- 172.21.15.135:0/707438233 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ad4003a40 con 0x7f0ae0107190 2024-05-08T23:09:26.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.737+0000 7f0ae5f11700 1 -- 172.21.15.135:0/707438233 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae019abb0 con 0x7f0ae0107190 2024-05-08T23:09:26.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.737+0000 7f0adcff9700 1 -- 172.21.15.135:0/707438233 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ad4003ba0 con 0x7f0ae0107190 2024-05-08T23:09:26.306 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.737+0000 7f0adcff9700 1 -- 172.21.15.135:0/707438233 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ad40196c0 con 0x7f0ae0107190 2024-05-08T23:09:26.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.737+0000 7f0ae5f11700 1 -- 172.21.15.135:0/707438233 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae019b050 con 0x7f0ae0107190 2024-05-08T23:09:26.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.738+0000 7f0adcff9700 1 -- 172.21.15.135:0/707438233 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f0ad4019980 con 0x7f0ae0107190 2024-05-08T23:09:26.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.738+0000 7f0ae5f11700 1 -- 172.21.15.135:0/707438233 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae010a900 con 0x7f0ae0107190 2024-05-08T23:09:26.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.738+0000 7f0adcff9700 1 --2- 172.21.15.135:0/707438233 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0ac8038700 0x7f0ac803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:26.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.739+0000 7f0adcff9700 1 -- 172.21.15.135:0/707438233 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0ad404cb90 con 0x7f0ae0107190 2024-05-08T23:09:26.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.739+0000 7f0adeffd700 1 --2- 172.21.15.135:0/707438233 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0ac8038700 0x7f0ac803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:26.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.739+0000 7f0adeffd700 1 --2- 172.21.15.135:0/707438233 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0ac8038700 0x7f0ac803abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0006fd0 tx=0x7f0ad0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:26.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.743+0000 7f0adcff9700 1 -- 172.21.15.135:0/707438233 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0ad402b750 con 0x7f0ae0107190 2024-05-08T23:09:26.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.935+0000 7f0ae5f11700 1 -- 172.21.15.135:0/707438233 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f0ae019d8e0 con 0x7f0ae0107190 2024-05-08T23:09:26.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.935+0000 7f0adcff9700 1 -- 172.21.15.135:0/707438233 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f0ad4018350 con 0x7f0ae0107190 2024-05-08T23:09:26.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.937+0000 7f0ae5f11700 1 -- 172.21.15.135:0/707438233 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0ac8038700 msgr2=0x7f0ac803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:26.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.937+0000 7f0ae5f11700 1 --2- 172.21.15.135:0/707438233 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0ac8038700 0x7f0ac803abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0006fd0 tx=0x7f0ad0006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:26.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.937+0000 7f0ae5f11700 1 -- 172.21.15.135:0/707438233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ae0107190 msgr2=0x7f0ae019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:26.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.937+0000 7f0ae5f11700 1 --2- 172.21.15.135:0/707438233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ae0107190 0x7f0ae019a470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4006af0 tx=0x7f0ad4011a10 comp rx=0 tx=0).stop 2024-05-08T23:09:26.307 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.937+0000 7f0ae5f11700 1 -- 172.21.15.135:0/707438233 shutdown_connections 2024-05-08T23:09:26.308 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.937+0000 7f0ae5f11700 1 --2- 172.21.15.135:0/707438233 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0ac8038700 0x7f0ac803abc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:26.308 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.937+0000 7f0ae5f11700 1 --2- 172.21.15.135:0/707438233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ae0107190 0x7f0ae019a470 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:26.308 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.937+0000 7f0ae5f11700 1 -- 172.21.15.135:0/707438233 >> 172.21.15.135:0/707438233 conn(0x7f0ae0100bc0 msgr2=0x7f0ae0101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:26.308 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.937+0000 7f0ae5f11700 1 -- 172.21.15.135:0/707438233 shutdown_connections 2024-05-08T23:09:26.308 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:25.937+0000 7f0ae5f11700 1 -- 172.21.15.135:0/707438233 wait complete. 2024-05-08T23:09:26.311 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T23:09:26.311 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout disabled 2024-05-08T23:09:26.318 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T23:09:26.318 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-05-08T23:09:26.318 INFO:teuthology.orchestra.run.smithi135.stdout:firewalld.service is not enabled 2024-05-08T23:09:26.318 INFO:teuthology.orchestra.run.smithi135.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-08T23:09:26.320 INFO:teuthology.orchestra.run.smithi135.stdout:Ceph Dashboard is now available at: 2024-05-08T23:09:26.320 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:09:26.320 INFO:teuthology.orchestra.run.smithi135.stdout: URL: https://smithi135:8443/ 2024-05-08T23:09:26.320 INFO:teuthology.orchestra.run.smithi135.stdout: User: admin 2024-05-08T23:09:26.320 INFO:teuthology.orchestra.run.smithi135.stdout: Password: 9ubhl4q7cf 2024-05-08T23:09:26.320 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:09:26.320 INFO:teuthology.orchestra.run.smithi135.stdout:Saving cluster configuration to /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config directory 2024-05-08T23:09:26.321 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling autotune for osd_memory_target 2024-05-08T23:09:26.421 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:26 smithi135 ceph-mon[42440]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:09:26.421 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:26 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:26.421 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:26 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/707438233' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-08T23:09:27.215 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.659+0000 7f99c201f700 1 Processor -- start 2024-05-08T23:09:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.659+0000 7f99c201f700 1 -- start start 2024-05-08T23:09:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.659+0000 7f99c201f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99bc106770 0x7f99bc106b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.659+0000 7f99c201f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc107160 con 0x7f99bc106770 2024-05-08T23:09:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.660+0000 7f99bb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99bc106770 0x7f99bc106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.660+0000 7f99bb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99bc106770 0x7f99bc106b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48624/0 (socket says 172.21.15.135:48624) 2024-05-08T23:09:27.216 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.660+0000 7f99bb7fe700 1 -- 172.21.15.135:0/493233645 learned_addr learned my addr 172.21.15.135:0/493233645 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.660+0000 7f99bb7fe700 1 -- 172.21.15.135:0/493233645 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc107920 con 0x7f99bc106770 2024-05-08T23:09:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.660+0000 7f99bb7fe700 1 --2- 172.21.15.135:0/493233645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99bc106770 0x7f99bc106b90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99b00098a0 tx=0x7f99b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd3e56be3a84d18 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.660+0000 7f99ba7fc700 1 -- 172.21.15.135:0/493233645 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99b0004160 con 0x7f99bc106770 2024-05-08T23:09:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.660+0000 7f99ba7fc700 1 -- 172.21.15.135:0/493233645 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99b00042c0 con 0x7f99bc106770 2024-05-08T23:09:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.660+0000 7f99ba7fc700 1 -- 172.21.15.135:0/493233645 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99b00119b0 con 0x7f99bc106770 2024-05-08T23:09:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.661+0000 7f99c201f700 1 -- 172.21.15.135:0/493233645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99bc106770 msgr2=0x7f99bc106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.661+0000 7f99c201f700 1 --2- 172.21.15.135:0/493233645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99bc106770 0x7f99bc106b90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99b00098a0 tx=0x7f99b0009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.661+0000 7f99c201f700 1 -- 172.21.15.135:0/493233645 shutdown_connections 2024-05-08T23:09:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.661+0000 7f99c201f700 1 --2- 172.21.15.135:0/493233645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99bc106770 0x7f99bc106b90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.661+0000 7f99c201f700 1 -- 172.21.15.135:0/493233645 >> 172.21.15.135:0/493233645 conn(0x7f99bc101d70 msgr2=0x7f99bc104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.661+0000 7f99c201f700 1 -- 172.21.15.135:0/493233645 shutdown_connections 2024-05-08T23:09:27.217 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.661+0000 7f99c201f700 1 -- 172.21.15.135:0/493233645 wait complete. 2024-05-08T23:09:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.662+0000 7f99c201f700 1 Processor -- start 2024-05-08T23:09:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.662+0000 7f99c201f700 1 -- start start 2024-05-08T23:09:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.662+0000 7f99c201f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99bc106770 0x7f99bc19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.662+0000 7f99c201f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc19a9f0 con 0x7f99bc106770 2024-05-08T23:09:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.662+0000 7f99bb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99bc106770 0x7f99bc19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.662+0000 7f99bb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99bc106770 0x7f99bc19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48630/0 (socket says 172.21.15.135:48630) 2024-05-08T23:09:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.662+0000 7f99bb7fe700 1 -- 172.21.15.135:0/1581503594 learned_addr learned my addr 172.21.15.135:0/1581503594 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.662+0000 7f99bb7fe700 1 -- 172.21.15.135:0/1581503594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b0009550 con 0x7f99bc106770 2024-05-08T23:09:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.662+0000 7f99bb7fe700 1 --2- 172.21.15.135:0/1581503594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99bc106770 0x7f99bc19a4b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f99b0003e60 tx=0x7f99b0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.663+0000 7f99b8ff9700 1 -- 172.21.15.135:0/1581503594 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99b0003a60 con 0x7f99bc106770 2024-05-08T23:09:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.663+0000 7f99c201f700 1 -- 172.21.15.135:0/1581503594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc19abf0 con 0x7f99bc106770 2024-05-08T23:09:27.218 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.663+0000 7f99b8ff9700 1 -- 172.21.15.135:0/1581503594 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99b0003bc0 con 0x7f99bc106770 2024-05-08T23:09:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.663+0000 7f99b8ff9700 1 -- 172.21.15.135:0/1581503594 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99b00196c0 con 0x7f99bc106770 2024-05-08T23:09:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.663+0000 7f99c201f700 1 -- 172.21.15.135:0/1581503594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc19b090 con 0x7f99bc106770 2024-05-08T23:09:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.664+0000 7f99c201f700 1 -- 172.21.15.135:0/1581503594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc10ab50 con 0x7f99bc106770 2024-05-08T23:09:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.664+0000 7f99b8ff9700 1 -- 172.21.15.135:0/1581503594 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f99b001ab60 con 0x7f99bc106770 2024-05-08T23:09:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.664+0000 7f99b8ff9700 1 --2- 172.21.15.135:0/1581503594 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f99a4038730 0x7f99a403abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.664+0000 7f99b8ff9700 1 -- 172.21.15.135:0/1581503594 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f99b004cc70 con 0x7f99bc106770 2024-05-08T23:09:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.664+0000 7f99baffd700 1 --2- 172.21.15.135:0/1581503594 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f99a4038730 0x7f99a403abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.665+0000 7f99baffd700 1 --2- 172.21.15.135:0/1581503594 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f99a4038730 0x7f99a403abf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f99ac006fd0 tx=0x7f99ac006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.669+0000 7f99b8ff9700 1 -- 172.21.15.135:0/1581503594 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f99b0019980 con 0x7f99bc106770 2024-05-08T23:09:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.860+0000 7f99c201f700 1 -- 172.21.15.135:0/1581503594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f99bc19d920 con 0x7f99bc106770 2024-05-08T23:09:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.861+0000 7f99b8ff9700 1 -- 172.21.15.135:0/1581503594 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f99b000b3e0 con 0x7f99bc106770 2024-05-08T23:09:27.219 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.863+0000 7f99c201f700 1 -- 172.21.15.135:0/1581503594 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f99a4038730 msgr2=0x7f99a403abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.863+0000 7f99c201f700 1 --2- 172.21.15.135:0/1581503594 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f99a4038730 0x7f99a403abf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f99ac006fd0 tx=0x7f99ac006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.863+0000 7f99c201f700 1 -- 172.21.15.135:0/1581503594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99bc106770 msgr2=0x7f99bc19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.863+0000 7f99c201f700 1 --2- 172.21.15.135:0/1581503594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99bc106770 0x7f99bc19a4b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f99b0003e60 tx=0x7f99b0011a30 comp rx=0 tx=0).stop 2024-05-08T23:09:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.863+0000 7f99c201f700 1 -- 172.21.15.135:0/1581503594 shutdown_connections 2024-05-08T23:09:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.863+0000 7f99c201f700 1 --2- 172.21.15.135:0/1581503594 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f99a4038730 0x7f99a403abf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.863+0000 7f99c201f700 1 --2- 172.21.15.135:0/1581503594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99bc106770 0x7f99bc19a4b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.863+0000 7f99c201f700 1 -- 172.21.15.135:0/1581503594 >> 172.21.15.135:0/1581503594 conn(0x7f99bc101d70 msgr2=0x7f99bc102990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.863+0000 7f99c201f700 1 -- 172.21.15.135:0/1581503594 shutdown_connections 2024-05-08T23:09:27.220 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:26.863+0000 7f99c201f700 1 -- 172.21.15.135:0/1581503594 wait complete. 2024-05-08T23:09:28.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:28 smithi135 ceph-mon[42440]: mgrmap e13: x(active, since 6s) 2024-05-08T23:09:28.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:28 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/4074224693' entity='client.admin' 2024-05-08T23:09:28.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.557+0000 7f332096f700 1 Processor -- start 2024-05-08T23:09:28.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.557+0000 7f332096f700 1 -- start start 2024-05-08T23:09:28.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.557+0000 7f332096f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f331c106bd0 0x7f331c106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:28.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.557+0000 7f332096f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c1075c0 con 0x7f331c106bd0 2024-05-08T23:09:28.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.557+0000 7f331a59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f331c106bd0 0x7f331c106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:28.221 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.558+0000 7f331a59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f331c106bd0 0x7f331c106ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48646/0 (socket says 172.21.15.135:48646) 2024-05-08T23:09:28.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.558+0000 7f331a59c700 1 -- 172.21.15.135:0/451762378 learned_addr learned my addr 172.21.15.135:0/451762378 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:28.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.558+0000 7f331a59c700 1 -- 172.21.15.135:0/451762378 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c105830 con 0x7f331c106bd0 2024-05-08T23:09:28.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.558+0000 7f331a59c700 1 --2- 172.21.15.135:0/451762378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f331c106bd0 0x7f331c106ff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f33100098a0 tx=0x7f3310009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb00ddfcc00621a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:28.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.558+0000 7f331959a700 1 -- 172.21.15.135:0/451762378 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3310004160 con 0x7f331c106bd0 2024-05-08T23:09:28.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.558+0000 7f331959a700 1 -- 172.21.15.135:0/451762378 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33100042c0 con 0x7f331c106bd0 2024-05-08T23:09:28.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.558+0000 7f331959a700 1 -- 172.21.15.135:0/451762378 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33100119b0 con 0x7f331c106bd0 2024-05-08T23:09:28.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.559+0000 7f332096f700 1 -- 172.21.15.135:0/451762378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f331c106bd0 msgr2=0x7f331c106ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:28.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.559+0000 7f332096f700 1 --2- 172.21.15.135:0/451762378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f331c106bd0 0x7f331c106ff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f33100098a0 tx=0x7f3310009bb0 comp rx=0 tx=0).stop 2024-05-08T23:09:28.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.559+0000 7f332096f700 1 -- 172.21.15.135:0/451762378 shutdown_connections 2024-05-08T23:09:28.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.559+0000 7f332096f700 1 --2- 172.21.15.135:0/451762378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f331c106bd0 0x7f331c106ff0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:28.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.559+0000 7f332096f700 1 -- 172.21.15.135:0/451762378 >> 172.21.15.135:0/451762378 conn(0x7f331c100360 msgr2=0x7f331c102780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:28.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.559+0000 7f332096f700 1 -- 172.21.15.135:0/451762378 shutdown_connections 2024-05-08T23:09:28.222 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.559+0000 7f332096f700 1 -- 172.21.15.135:0/451762378 wait complete. 2024-05-08T23:09:28.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.559+0000 7f332096f700 1 Processor -- start 2024-05-08T23:09:28.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.560+0000 7f332096f700 1 -- start start 2024-05-08T23:09:28.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.560+0000 7f332096f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f331c106bd0 0x7f331c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:28.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.560+0000 7f332096f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c19aa20 con 0x7f331c106bd0 2024-05-08T23:09:28.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.560+0000 7f331a59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f331c106bd0 0x7f331c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:28.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.560+0000 7f331a59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f331c106bd0 0x7f331c19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48664/0 (socket says 172.21.15.135:48664) 2024-05-08T23:09:28.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.560+0000 7f331a59c700 1 -- 172.21.15.135:0/4074224693 learned_addr learned my addr 172.21.15.135:0/4074224693 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:28.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.560+0000 7f331a59c700 1 -- 172.21.15.135:0/4074224693 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3310009550 con 0x7f331c106bd0 2024-05-08T23:09:28.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.560+0000 7f331a59c700 1 --2- 172.21.15.135:0/4074224693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f331c106bd0 0x7f331c19a4e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3310006af0 tx=0x7f3310011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:28.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.560+0000 7f330b7fe700 1 -- 172.21.15.135:0/4074224693 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3310003a40 con 0x7f331c106bd0 2024-05-08T23:09:28.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.560+0000 7f330b7fe700 1 -- 172.21.15.135:0/4074224693 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3310003ba0 con 0x7f331c106bd0 2024-05-08T23:09:28.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.560+0000 7f332096f700 1 -- 172.21.15.135:0/4074224693 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331c19ac20 con 0x7f331c106bd0 2024-05-08T23:09:28.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.560+0000 7f330b7fe700 1 -- 172.21.15.135:0/4074224693 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33100196c0 con 0x7f331c106bd0 2024-05-08T23:09:28.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.560+0000 7f332096f700 1 -- 172.21.15.135:0/4074224693 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331c19b0c0 con 0x7f331c106bd0 2024-05-08T23:09:28.223 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.561+0000 7f332096f700 1 -- 172.21.15.135:0/4074224693 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331c194650 con 0x7f331c106bd0 2024-05-08T23:09:28.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.562+0000 7f330b7fe700 1 -- 172.21.15.135:0/4074224693 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f331001aa80 con 0x7f331c106bd0 2024-05-08T23:09:28.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.562+0000 7f330b7fe700 1 --2- 172.21.15.135:0/4074224693 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f33040387a0 0x7f330403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:28.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.562+0000 7f330b7fe700 1 -- 172.21.15.135:0/4074224693 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f331004d1a0 con 0x7f331c106bd0 2024-05-08T23:09:28.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.562+0000 7f3319d9b700 1 --2- 172.21.15.135:0/4074224693 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f33040387a0 0x7f330403ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:28.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.562+0000 7f3319d9b700 1 --2- 172.21.15.135:0/4074224693 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f33040387a0 0x7f330403ac60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f330c006fd0 tx=0x7f330c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:28.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.567+0000 7f330b7fe700 1 -- 172.21.15.135:0/4074224693 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3310023750 con 0x7f331c106bd0 2024-05-08T23:09:28.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.866+0000 7f332096f700 1 -- 172.21.15.135:0/4074224693 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f331c109a70 con 0x7f331c106bd0 2024-05-08T23:09:28.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.868+0000 7f330b7fe700 1 -- 172.21.15.135:0/4074224693 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f331002c3e0 con 0x7f331c106bd0 2024-05-08T23:09:28.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.870+0000 7f332096f700 1 -- 172.21.15.135:0/4074224693 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f33040387a0 msgr2=0x7f330403ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:28.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.870+0000 7f332096f700 1 --2- 172.21.15.135:0/4074224693 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f33040387a0 0x7f330403ac60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f330c006fd0 tx=0x7f330c006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:28.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.870+0000 7f332096f700 1 -- 172.21.15.135:0/4074224693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f331c106bd0 msgr2=0x7f331c19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:28.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.870+0000 7f332096f700 1 --2- 172.21.15.135:0/4074224693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f331c106bd0 0x7f331c19a4e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3310006af0 tx=0x7f3310011a10 comp rx=0 tx=0).stop 2024-05-08T23:09:28.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.870+0000 7f332096f700 1 -- 172.21.15.135:0/4074224693 shutdown_connections 2024-05-08T23:09:28.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.870+0000 7f332096f700 1 --2- 172.21.15.135:0/4074224693 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f33040387a0 0x7f330403ac60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:28.224 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.870+0000 7f332096f700 1 --2- 172.21.15.135:0/4074224693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f331c106bd0 0x7f331c19a4e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:28.225 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.870+0000 7f332096f700 1 -- 172.21.15.135:0/4074224693 >> 172.21.15.135:0/4074224693 conn(0x7f331c100360 msgr2=0x7f331c101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:28.225 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.870+0000 7f332096f700 1 -- 172.21.15.135:0/4074224693 shutdown_connections 2024-05-08T23:09:28.225 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-05-08T23:09:27.871+0000 7f332096f700 1 -- 172.21.15.135:0/4074224693 wait complete. 2024-05-08T23:09:28.225 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-08T23:09:28.225 INFO:teuthology.orchestra.run.smithi135.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-08T23:09:28.225 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:09:28.225 INFO:teuthology.orchestra.run.smithi135.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-08T23:09:28.225 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:09:28.225 INFO:teuthology.orchestra.run.smithi135.stdout:Or, if you are only running a single cluster on this host: 2024-05-08T23:09:28.225 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:09:28.225 INFO:teuthology.orchestra.run.smithi135.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-08T23:09:28.225 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:09:28.225 INFO:teuthology.orchestra.run.smithi135.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-08T23:09:28.225 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:09:28.225 INFO:teuthology.orchestra.run.smithi135.stdout: ceph telemetry on 2024-05-08T23:09:28.226 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:09:28.226 INFO:teuthology.orchestra.run.smithi135.stdout:For more information see: 2024-05-08T23:09:28.226 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:09:28.226 INFO:teuthology.orchestra.run.smithi135.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-08T23:09:28.226 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:09:28.226 INFO:teuthology.orchestra.run.smithi135.stdout:Bootstrap complete. 2024-05-08T23:09:28.253 INFO:tasks.cephadm:Fetching config... 2024-05-08T23:09:28.254 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:09:28.254 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-08T23:09:28.273 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-08T23:09:28.273 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:09:28.273 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-08T23:09:28.328 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-08T23:09:28.328 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:09:28.329 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-08T23:09:28.400 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-08T23:09:28.400 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:09:28.401 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-08T23:09:28.461 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-08T23:09:28.461 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCydpalXlFUuB6vA82Ka/jMqhZaubSMWynCNQpcaoxYA02/spU5PtzWY3ExzUghHXtljK0cKyjbNmtx2XNzvOe3O0j1l5NS6WWRhuJWUFLzvpu78vcgdo5dtVSkqpmXTPc3XLAl/VjbwqAIgXYbx/vzJF+PaAxPjauQf6VarVoRMRX1gwjZAhjCxESd5g8K0fsic8+VHbDtSqECOW99Giw5ZU1h89eKJpnqmTIVKZiZCS2p7vxx0k61HAED5kjP5OD23s0W+A92B1U4UYzlmdHZrmdzKVnko2Km+7Q7hXUp+q5b4A9ACbBg+OzzNu59MTephRWYNTjD3RZnSjrG8CeJ3zqgy3W3UAmO21IBcjlY/3BO1S0b/8DNlUgE68TRY0KAHU78u7EwTVB0glW70ahwZcqext6gveVOIgttWuhEDCxDJ+jWVA3X+CMgCClJvWnK6XGM1injruc3iz8NMGkWFTnBXv/JWORH8tlPZulDXMOs7PfgSgplBh1cTgh5xLk= ceph-c804a50a-0d8f-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T23:09:28.539 INFO:teuthology.orchestra.run.smithi135.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCydpalXlFUuB6vA82Ka/jMqhZaubSMWynCNQpcaoxYA02/spU5PtzWY3ExzUghHXtljK0cKyjbNmtx2XNzvOe3O0j1l5NS6WWRhuJWUFLzvpu78vcgdo5dtVSkqpmXTPc3XLAl/VjbwqAIgXYbx/vzJF+PaAxPjauQf6VarVoRMRX1gwjZAhjCxESd5g8K0fsic8+VHbDtSqECOW99Giw5ZU1h89eKJpnqmTIVKZiZCS2p7vxx0k61HAED5kjP5OD23s0W+A92B1U4UYzlmdHZrmdzKVnko2Km+7Q7hXUp+q5b4A9ACbBg+OzzNu59MTephRWYNTjD3RZnSjrG8CeJ3zqgy3W3UAmO21IBcjlY/3BO1S0b/8DNlUgE68TRY0KAHU78u7EwTVB0glW70ahwZcqext6gveVOIgttWuhEDCxDJ+jWVA3X+CMgCClJvWnK6XGM1injruc3iz8NMGkWFTnBXv/JWORH8tlPZulDXMOs7PfgSgplBh1cTgh5xLk= ceph-c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:09:28.551 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCydpalXlFUuB6vA82Ka/jMqhZaubSMWynCNQpcaoxYA02/spU5PtzWY3ExzUghHXtljK0cKyjbNmtx2XNzvOe3O0j1l5NS6WWRhuJWUFLzvpu78vcgdo5dtVSkqpmXTPc3XLAl/VjbwqAIgXYbx/vzJF+PaAxPjauQf6VarVoRMRX1gwjZAhjCxESd5g8K0fsic8+VHbDtSqECOW99Giw5ZU1h89eKJpnqmTIVKZiZCS2p7vxx0k61HAED5kjP5OD23s0W+A92B1U4UYzlmdHZrmdzKVnko2Km+7Q7hXUp+q5b4A9ACbBg+OzzNu59MTephRWYNTjD3RZnSjrG8CeJ3zqgy3W3UAmO21IBcjlY/3BO1S0b/8DNlUgE68TRY0KAHU78u7EwTVB0glW70ahwZcqext6gveVOIgttWuhEDCxDJ+jWVA3X+CMgCClJvWnK6XGM1injruc3iz8NMGkWFTnBXv/JWORH8tlPZulDXMOs7PfgSgplBh1cTgh5xLk= ceph-c804a50a-0d8f-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T23:09:28.596 INFO:teuthology.orchestra.run.smithi179.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCydpalXlFUuB6vA82Ka/jMqhZaubSMWynCNQpcaoxYA02/spU5PtzWY3ExzUghHXtljK0cKyjbNmtx2XNzvOe3O0j1l5NS6WWRhuJWUFLzvpu78vcgdo5dtVSkqpmXTPc3XLAl/VjbwqAIgXYbx/vzJF+PaAxPjauQf6VarVoRMRX1gwjZAhjCxESd5g8K0fsic8+VHbDtSqECOW99Giw5ZU1h89eKJpnqmTIVKZiZCS2p7vxx0k61HAED5kjP5OD23s0W+A92B1U4UYzlmdHZrmdzKVnko2Km+7Q7hXUp+q5b4A9ACbBg+OzzNu59MTephRWYNTjD3RZnSjrG8CeJ3zqgy3W3UAmO21IBcjlY/3BO1S0b/8DNlUgE68TRY0KAHU78u7EwTVB0glW70ahwZcqext6gveVOIgttWuhEDCxDJ+jWVA3X+CMgCClJvWnK6XGM1injruc3iz8NMGkWFTnBXv/JWORH8tlPZulDXMOs7PfgSgplBh1cTgh5xLk= ceph-c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:09:28.609 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCydpalXlFUuB6vA82Ka/jMqhZaubSMWynCNQpcaoxYA02/spU5PtzWY3ExzUghHXtljK0cKyjbNmtx2XNzvOe3O0j1l5NS6WWRhuJWUFLzvpu78vcgdo5dtVSkqpmXTPc3XLAl/VjbwqAIgXYbx/vzJF+PaAxPjauQf6VarVoRMRX1gwjZAhjCxESd5g8K0fsic8+VHbDtSqECOW99Giw5ZU1h89eKJpnqmTIVKZiZCS2p7vxx0k61HAED5kjP5OD23s0W+A92B1U4UYzlmdHZrmdzKVnko2Km+7Q7hXUp+q5b4A9ACbBg+OzzNu59MTephRWYNTjD3RZnSjrG8CeJ3zqgy3W3UAmO21IBcjlY/3BO1S0b/8DNlUgE68TRY0KAHU78u7EwTVB0glW70ahwZcqext6gveVOIgttWuhEDCxDJ+jWVA3X+CMgCClJvWnK6XGM1injruc3iz8NMGkWFTnBXv/JWORH8tlPZulDXMOs7PfgSgplBh1cTgh5xLk= ceph-c804a50a-0d8f-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T23:09:28.654 INFO:teuthology.orchestra.run.smithi195.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCydpalXlFUuB6vA82Ka/jMqhZaubSMWynCNQpcaoxYA02/spU5PtzWY3ExzUghHXtljK0cKyjbNmtx2XNzvOe3O0j1l5NS6WWRhuJWUFLzvpu78vcgdo5dtVSkqpmXTPc3XLAl/VjbwqAIgXYbx/vzJF+PaAxPjauQf6VarVoRMRX1gwjZAhjCxESd5g8K0fsic8+VHbDtSqECOW99Giw5ZU1h89eKJpnqmTIVKZiZCS2p7vxx0k61HAED5kjP5OD23s0W+A92B1U4UYzlmdHZrmdzKVnko2Km+7Q7hXUp+q5b4A9ACbBg+OzzNu59MTephRWYNTjD3RZnSjrG8CeJ3zqgy3W3UAmO21IBcjlY/3BO1S0b/8DNlUgE68TRY0KAHU78u7EwTVB0glW70ahwZcqext6gveVOIgttWuhEDCxDJ+jWVA3X+CMgCClJvWnK6XGM1injruc3iz8NMGkWFTnBXv/JWORH8tlPZulDXMOs7PfgSgplBh1cTgh5xLk= ceph-c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:09:28.667 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-08T23:09:28.892 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:09:30.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.167+0000 7f44e2a0b700 1 -- 172.21.15.135:0/1973146035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44dc0ff820 msgr2=0x7f44dc0ffc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:30.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.167+0000 7f44e2a0b700 1 --2- 172.21.15.135:0/1973146035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44dc0ff820 0x7f44dc0ffc40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009910 tx=0x7f44cc009c20 comp rx=0 tx=0).stop 2024-05-08T23:09:30.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.167+0000 7f44e2a0b700 1 -- 172.21.15.135:0/1973146035 shutdown_connections 2024-05-08T23:09:30.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.167+0000 7f44e2a0b700 1 --2- 172.21.15.135:0/1973146035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44dc0ff820 0x7f44dc0ffc40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:30.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.167+0000 7f44e2a0b700 1 -- 172.21.15.135:0/1973146035 >> 172.21.15.135:0/1973146035 conn(0x7f44dc0fada0 msgr2=0x7f44dc0fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:30.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.167+0000 7f44e2a0b700 1 -- 172.21.15.135:0/1973146035 shutdown_connections 2024-05-08T23:09:30.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.167+0000 7f44e2a0b700 1 -- 172.21.15.135:0/1973146035 wait complete. 2024-05-08T23:09:30.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.167+0000 7f44e2a0b700 1 Processor -- start 2024-05-08T23:09:30.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.167+0000 7f44e2a0b700 1 -- start start 2024-05-08T23:09:30.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.168+0000 7f44e2a0b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44dc0ff820 0x7f44dc194c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:30.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.168+0000 7f44e2a0b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc1951b0 con 0x7f44dc0ff820 2024-05-08T23:09:30.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.168+0000 7f44dbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44dc0ff820 0x7f44dc194c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:30.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.168+0000 7f44dbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44dc0ff820 0x7f44dc194c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32892/0 (socket says 172.21.15.135:32892) 2024-05-08T23:09:30.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.168+0000 7f44dbfff700 1 -- 172.21.15.135:0/4204717337 learned_addr learned my addr 172.21.15.135:0/4204717337 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:30.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.168+0000 7f44dbfff700 1 -- 172.21.15.135:0/4204717337 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc0095f0 con 0x7f44dc0ff820 2024-05-08T23:09:30.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.169+0000 7f44dbfff700 1 --2- 172.21.15.135:0/4204717337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44dc0ff820 0x7f44dc194c70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f44cc004f70 tx=0x7f44cc004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:30.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.169+0000 7f44d97fa700 1 -- 172.21.15.135:0/4204717337 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44cc01f070 con 0x7f44dc0ff820 2024-05-08T23:09:30.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.169+0000 7f44d97fa700 1 -- 172.21.15.135:0/4204717337 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44cc00be20 con 0x7f44dc0ff820 2024-05-08T23:09:30.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.169+0000 7f44e2a0b700 1 -- 172.21.15.135:0/4204717337 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44dc1953b0 con 0x7f44dc0ff820 2024-05-08T23:09:30.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.169+0000 7f44d97fa700 1 -- 172.21.15.135:0/4204717337 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44cc024470 con 0x7f44dc0ff820 2024-05-08T23:09:30.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.169+0000 7f44e2a0b700 1 -- 172.21.15.135:0/4204717337 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44dc195850 con 0x7f44dc0ff820 2024-05-08T23:09:30.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.170+0000 7f44d97fa700 1 -- 172.21.15.135:0/4204717337 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f44cc00f460 con 0x7f44dc0ff820 2024-05-08T23:09:30.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.170+0000 7f44e2a0b700 1 -- 172.21.15.135:0/4204717337 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44dc0625d0 con 0x7f44dc0ff820 2024-05-08T23:09:30.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.170+0000 7f44d97fa700 1 --2- 172.21.15.135:0/4204717337 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f44c40387a0 0x7f44c403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:30.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.170+0000 7f44d97fa700 1 -- 172.21.15.135:0/4204717337 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f44cc04ea50 con 0x7f44dc0ff820 2024-05-08T23:09:30.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.170+0000 7f44db7fe700 1 --2- 172.21.15.135:0/4204717337 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f44c40387a0 0x7f44c403ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:30.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.171+0000 7f44db7fe700 1 --2- 172.21.15.135:0/4204717337 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f44c40387a0 0x7f44c403ac60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f44d0006fd0 tx=0x7f44d0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:30.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.175+0000 7f44d97fa700 1 -- 172.21.15.135:0/4204717337 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f44cc02e440 con 0x7f44dc0ff820 2024-05-08T23:09:30.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.399+0000 7f44e2a0b700 1 -- 172.21.15.135:0/4204717337 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f44dc105570 con 0x7f44dc0ff820 2024-05-08T23:09:30.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.403+0000 7f44d97fa700 1 -- 172.21.15.135:0/4204717337 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f44dc105570 con 0x7f44dc0ff820 2024-05-08T23:09:30.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.406+0000 7f44e2a0b700 1 -- 172.21.15.135:0/4204717337 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f44c40387a0 msgr2=0x7f44c403ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:30.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.406+0000 7f44e2a0b700 1 --2- 172.21.15.135:0/4204717337 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f44c40387a0 0x7f44c403ac60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f44d0006fd0 tx=0x7f44d0006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:30.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.406+0000 7f44e2a0b700 1 -- 172.21.15.135:0/4204717337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44dc0ff820 msgr2=0x7f44dc194c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:30.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.406+0000 7f44e2a0b700 1 --2- 172.21.15.135:0/4204717337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44dc0ff820 0x7f44dc194c70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f44cc004f70 tx=0x7f44cc004fa0 comp rx=0 tx=0).stop 2024-05-08T23:09:30.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.406+0000 7f44e2a0b700 1 -- 172.21.15.135:0/4204717337 shutdown_connections 2024-05-08T23:09:30.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.406+0000 7f44e2a0b700 1 --2- 172.21.15.135:0/4204717337 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f44c40387a0 0x7f44c403ac60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:30.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.406+0000 7f44e2a0b700 1 --2- 172.21.15.135:0/4204717337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44dc0ff820 0x7f44dc194c70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:30.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.406+0000 7f44e2a0b700 1 -- 172.21.15.135:0/4204717337 >> 172.21.15.135:0/4204717337 conn(0x7f44dc0fada0 msgr2=0x7f44dc0fb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:30.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.406+0000 7f44e2a0b700 1 -- 172.21.15.135:0/4204717337 shutdown_connections 2024-05-08T23:09:30.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:30.406+0000 7f44e2a0b700 1 -- 172.21.15.135:0/4204717337 wait complete. 2024-05-08T23:09:30.781 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-08T23:09:30.781 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-08T23:09:31.010 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:09:31.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:31.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:31.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:09:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:09:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:31 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/4204717337' entity='client.admin' 2024-05-08T23:09:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:09:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:32.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.086+0000 7f2c3dffa700 1 -- 172.21.15.135:0/4042629402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c380ff820 msgr2=0x7f2c380ffc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:32.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.086+0000 7f2c3dffa700 1 --2- 172.21.15.135:0/4042629402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c380ff820 0x7f2c380ffc40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009910 tx=0x7f2c2c009c20 comp rx=0 tx=0).stop 2024-05-08T23:09:32.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.087+0000 7f2c3dffa700 1 -- 172.21.15.135:0/4042629402 shutdown_connections 2024-05-08T23:09:32.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.087+0000 7f2c3dffa700 1 --2- 172.21.15.135:0/4042629402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c380ff820 0x7f2c380ffc40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:32.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.087+0000 7f2c3dffa700 1 -- 172.21.15.135:0/4042629402 >> 172.21.15.135:0/4042629402 conn(0x7f2c380fada0 msgr2=0x7f2c380fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:32.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.087+0000 7f2c3dffa700 1 -- 172.21.15.135:0/4042629402 shutdown_connections 2024-05-08T23:09:32.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.087+0000 7f2c3dffa700 1 -- 172.21.15.135:0/4042629402 wait complete. 2024-05-08T23:09:32.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.087+0000 7f2c3dffa700 1 Processor -- start 2024-05-08T23:09:32.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.087+0000 7f2c3dffa700 1 -- start start 2024-05-08T23:09:32.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.087+0000 7f2c3dffa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c380ff820 0x7f2c38197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:32.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.087+0000 7f2c3dffa700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c381984f0 con 0x7f2c380ff820 2024-05-08T23:09:32.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.088+0000 7f2c377fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c380ff820 0x7f2c38197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:32.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.088+0000 7f2c377fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c380ff820 0x7f2c38197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32912/0 (socket says 172.21.15.135:32912) 2024-05-08T23:09:32.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.088+0000 7f2c377fe700 1 -- 172.21.15.135:0/1650302368 learned_addr learned my addr 172.21.15.135:0/1650302368 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:32.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.088+0000 7f2c377fe700 1 -- 172.21.15.135:0/1650302368 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c0095f0 con 0x7f2c380ff820 2024-05-08T23:09:32.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.088+0000 7f2c377fe700 1 --2- 172.21.15.135:0/1650302368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c380ff820 0x7f2c38197fb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c004f70 tx=0x7f2c2c004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:32.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.088+0000 7f2c34ff9700 1 -- 172.21.15.135:0/1650302368 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c2c01d070 con 0x7f2c380ff820 2024-05-08T23:09:32.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.088+0000 7f2c34ff9700 1 -- 172.21.15.135:0/1650302368 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c2c00be20 con 0x7f2c380ff820 2024-05-08T23:09:32.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.088+0000 7f2c3dffa700 1 -- 172.21.15.135:0/1650302368 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c381986f0 con 0x7f2c380ff820 2024-05-08T23:09:32.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.088+0000 7f2c34ff9700 1 -- 172.21.15.135:0/1650302368 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c2c022df0 con 0x7f2c380ff820 2024-05-08T23:09:32.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.088+0000 7f2c3dffa700 1 -- 172.21.15.135:0/1650302368 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c38198b90 con 0x7f2c380ff820 2024-05-08T23:09:32.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.089+0000 7f2c34ff9700 1 -- 172.21.15.135:0/1650302368 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f2c2c00f460 con 0x7f2c380ff820 2024-05-08T23:09:32.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.089+0000 7f2c3dffa700 1 -- 172.21.15.135:0/1650302368 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c38192060 con 0x7f2c380ff820 2024-05-08T23:09:32.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.089+0000 7f2c34ff9700 1 --2- 172.21.15.135:0/1650302368 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c200387f0 0x7f2c2003acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:32.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.089+0000 7f2c34ff9700 1 -- 172.21.15.135:0/1650302368 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2c2c04c7e0 con 0x7f2c380ff820 2024-05-08T23:09:32.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.090+0000 7f2c36ffd700 1 --2- 172.21.15.135:0/1650302368 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c200387f0 0x7f2c2003acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:32.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.090+0000 7f2c36ffd700 1 --2- 172.21.15.135:0/1650302368 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c200387f0 0x7f2c2003acb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2c28006fd0 tx=0x7f2c28006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:32.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.094+0000 7f2c34ff9700 1 -- 172.21.15.135:0/1650302368 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2c2c020940 con 0x7f2c380ff820 2024-05-08T23:09:32.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.293+0000 7f2c3dffa700 1 -- 172.21.15.135:0/1650302368 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c380613e0 con 0x7f2c200387f0 2024-05-08T23:09:32.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.296+0000 7f2c34ff9700 1 -- 172.21.15.135:0/1650302368 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2c380613e0 con 0x7f2c200387f0 2024-05-08T23:09:32.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.298+0000 7f2c3dffa700 1 -- 172.21.15.135:0/1650302368 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c200387f0 msgr2=0x7f2c2003acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:32.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.298+0000 7f2c3dffa700 1 --2- 172.21.15.135:0/1650302368 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c200387f0 0x7f2c2003acb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2c28006fd0 tx=0x7f2c28006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:32.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.298+0000 7f2c3dffa700 1 -- 172.21.15.135:0/1650302368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c380ff820 msgr2=0x7f2c38197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:32.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.298+0000 7f2c3dffa700 1 --2- 172.21.15.135:0/1650302368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c380ff820 0x7f2c38197fb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c004f70 tx=0x7f2c2c004fa0 comp rx=0 tx=0).stop 2024-05-08T23:09:32.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.298+0000 7f2c3dffa700 1 -- 172.21.15.135:0/1650302368 shutdown_connections 2024-05-08T23:09:32.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.298+0000 7f2c3dffa700 1 --2- 172.21.15.135:0/1650302368 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c200387f0 0x7f2c2003acb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:32.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.298+0000 7f2c3dffa700 1 --2- 172.21.15.135:0/1650302368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c380ff820 0x7f2c38197fb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:32.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.298+0000 7f2c3dffa700 1 -- 172.21.15.135:0/1650302368 >> 172.21.15.135:0/1650302368 conn(0x7f2c380fada0 msgr2=0x7f2c3818f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:32.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.298+0000 7f2c3dffa700 1 -- 172.21.15.135:0/1650302368 shutdown_connections 2024-05-08T23:09:32.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:32.298+0000 7f2c3dffa700 1 -- 172.21.15.135:0/1650302368 wait complete. 2024-05-08T23:09:32.672 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi179 2024-05-08T23:09:32.672 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-05-08T23:09:32.672 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/etc/ceph/ceph.conf 2024-05-08T23:09:32.693 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-05-08T23:09:32.694 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:09:32.754 INFO:tasks.cephadm:Adding host smithi179 to orchestrator... 2024-05-08T23:09:32.754 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch host add smithi179 2024-05-08T23:09:33.001 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:09:33.588 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:33 smithi135 ceph-mon[42440]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:09:33.589 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:33.589 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:09:33.589 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:09:33.589 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:09:33.589 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:33 smithi135 ceph-mon[42440]: Updating smithi135:/etc/ceph/ceph.conf 2024-05-08T23:09:33.589 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:33 smithi135 ceph-mon[42440]: Updating smithi135:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:09:33.589 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:33 smithi135 ceph-mon[42440]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:09:33.589 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:33 smithi135 ceph-mon[42440]: Updating smithi135:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T23:09:33.589 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:33.589 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:33.589 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:34.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.150+0000 7f0dd6547700 1 -- 172.21.15.135:0/252029207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dd01057a0 msgr2=0x7f0dd0105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:34.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.150+0000 7f0dd6547700 1 --2- 172.21.15.135:0/252029207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dd01057a0 0x7f0dd0105b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009910 tx=0x7f0dc4009c20 comp rx=0 tx=0).stop 2024-05-08T23:09:34.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.150+0000 7f0dd6547700 1 -- 172.21.15.135:0/252029207 shutdown_connections 2024-05-08T23:09:34.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.150+0000 7f0dd6547700 1 --2- 172.21.15.135:0/252029207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dd01057a0 0x7f0dd0105b80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:34.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.150+0000 7f0dd6547700 1 -- 172.21.15.135:0/252029207 >> 172.21.15.135:0/252029207 conn(0x7f0dd00fb2f0 msgr2=0x7f0dd00fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:34.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.150+0000 7f0dd6547700 1 -- 172.21.15.135:0/252029207 shutdown_connections 2024-05-08T23:09:34.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.150+0000 7f0dd6547700 1 -- 172.21.15.135:0/252029207 wait complete. 2024-05-08T23:09:34.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.151+0000 7f0dd6547700 1 Processor -- start 2024-05-08T23:09:34.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.151+0000 7f0dd6547700 1 -- start start 2024-05-08T23:09:34.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.151+0000 7f0dd6547700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dd01057a0 0x7f0dd00fb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:34.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.151+0000 7f0dd6547700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00fd610 con 0x7f0dd01057a0 2024-05-08T23:09:34.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.151+0000 7f0dcffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dd01057a0 0x7f0dd00fb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:34.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.151+0000 7f0dcffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dd01057a0 0x7f0dd00fb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32932/0 (socket says 172.21.15.135:32932) 2024-05-08T23:09:34.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.151+0000 7f0dcffff700 1 -- 172.21.15.135:0/3011176673 learned_addr learned my addr 172.21.15.135:0/3011176673 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:34.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.151+0000 7f0dcffff700 1 -- 172.21.15.135:0/3011176673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc40095f0 con 0x7f0dd01057a0 2024-05-08T23:09:34.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.151+0000 7f0dcffff700 1 --2- 172.21.15.135:0/3011176673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dd01057a0 0x7f0dd00fb7a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4004f40 tx=0x7f0dc4005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:34.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.151+0000 7f0dcd7fa700 1 -- 172.21.15.135:0/3011176673 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0dc401d070 con 0x7f0dd01057a0 2024-05-08T23:09:34.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.152+0000 7f0dd6547700 1 -- 172.21.15.135:0/3011176673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd00fbce0 con 0x7f0dd01057a0 2024-05-08T23:09:34.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.152+0000 7f0dcd7fa700 1 -- 172.21.15.135:0/3011176673 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0dc400bbb0 con 0x7f0dd01057a0 2024-05-08T23:09:34.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.152+0000 7f0dd6547700 1 -- 172.21.15.135:0/3011176673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd00fc160 con 0x7f0dd01057a0 2024-05-08T23:09:34.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.152+0000 7f0dcd7fa700 1 -- 172.21.15.135:0/3011176673 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0dc4003810 con 0x7f0dd01057a0 2024-05-08T23:09:34.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.152+0000 7f0dcd7fa700 1 -- 172.21.15.135:0/3011176673 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f0dc4003ab0 con 0x7f0dd01057a0 2024-05-08T23:09:34.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.152+0000 7f0dd6547700 1 -- 172.21.15.135:0/3011176673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd00fd750 con 0x7f0dd01057a0 2024-05-08T23:09:34.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.153+0000 7f0dcd7fa700 1 --2- 172.21.15.135:0/3011176673 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0db80387a0 0x7f0db803ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:34.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.153+0000 7f0dcd7fa700 1 -- 172.21.15.135:0/3011176673 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0dc404c420 con 0x7f0dd01057a0 2024-05-08T23:09:34.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.153+0000 7f0dcf7fe700 1 --2- 172.21.15.135:0/3011176673 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0db80387a0 0x7f0db803ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:34.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.153+0000 7f0dcf7fe700 1 --2- 172.21.15.135:0/3011176673 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0db80387a0 0x7f0db803ac60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0006fd0 tx=0x7f0dc0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:34.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.157+0000 7f0dcd7fa700 1 -- 172.21.15.135:0/3011176673 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0dc402ad80 con 0x7f0dd01057a0 2024-05-08T23:09:34.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:34.352+0000 7f0dd6547700 1 -- 172.21.15.135:0/3011176673 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi179", "target": ["mon-mgr", ""]}) v1 -- 0x7f0dd00fcd40 con 0x7f0db80387a0 2024-05-08T23:09:35.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:35 smithi135 ceph-mon[42440]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi179", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:09:35.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:35 smithi135 ceph-mon[42440]: Deploying cephadm binary to smithi179 2024-05-08T23:09:36.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:36.582+0000 7f0dcd7fa700 1 -- 172.21.15.135:0/3011176673 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0dd00fcd40 con 0x7f0db80387a0 2024-05-08T23:09:36.582 INFO:teuthology.orchestra.run.smithi135.stdout:Added host 'smithi179' with addr '172.21.15.179' 2024-05-08T23:09:36.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:36.584+0000 7f0dd6547700 1 -- 172.21.15.135:0/3011176673 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0db80387a0 msgr2=0x7f0db803ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:36.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:36.584+0000 7f0dd6547700 1 --2- 172.21.15.135:0/3011176673 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0db80387a0 0x7f0db803ac60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0006fd0 tx=0x7f0dc0006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:36.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:36.584+0000 7f0dd6547700 1 -- 172.21.15.135:0/3011176673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dd01057a0 msgr2=0x7f0dd00fb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:36.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:36.584+0000 7f0dd6547700 1 --2- 172.21.15.135:0/3011176673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dd01057a0 0x7f0dd00fb7a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4004f40 tx=0x7f0dc4005020 comp rx=0 tx=0).stop 2024-05-08T23:09:36.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:36.584+0000 7f0dd6547700 1 -- 172.21.15.135:0/3011176673 shutdown_connections 2024-05-08T23:09:36.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:36.584+0000 7f0dd6547700 1 --2- 172.21.15.135:0/3011176673 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0db80387a0 0x7f0db803ac60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:36.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:36.584+0000 7f0dd6547700 1 --2- 172.21.15.135:0/3011176673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dd01057a0 0x7f0dd00fb7a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:36.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:36.584+0000 7f0dd6547700 1 -- 172.21.15.135:0/3011176673 >> 172.21.15.135:0/3011176673 conn(0x7f0dd00fb2f0 msgr2=0x7f0dd0068c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:36.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:36.584+0000 7f0dd6547700 1 -- 172.21.15.135:0/3011176673 shutdown_connections 2024-05-08T23:09:36.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:36.584+0000 7f0dd6547700 1 -- 172.21.15.135:0/3011176673 wait complete. 2024-05-08T23:09:36.952 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-08T23:09:37.171 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:09:37.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:37.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:37 smithi135 ceph-mon[42440]: Added host smithi179 2024-05-08T23:09:37.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:09:37.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:37.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:38.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.166+0000 7f4748a34700 1 -- 172.21.15.135:0/3319581205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47441057c0 msgr2=0x7f4744105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:38.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.166+0000 7f4748a34700 1 --2- 172.21.15.135:0/3319581205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47441057c0 0x7f4744105ba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4738009910 tx=0x7f4738009c20 comp rx=0 tx=0).stop 2024-05-08T23:09:38.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.166+0000 7f4748a34700 1 -- 172.21.15.135:0/3319581205 shutdown_connections 2024-05-08T23:09:38.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.166+0000 7f4748a34700 1 --2- 172.21.15.135:0/3319581205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47441057c0 0x7f4744105ba0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:38.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.166+0000 7f4748a34700 1 -- 172.21.15.135:0/3319581205 >> 172.21.15.135:0/3319581205 conn(0x7f47440fb2b0 msgr2=0x7f47440fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:38.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.166+0000 7f4748a34700 1 -- 172.21.15.135:0/3319581205 shutdown_connections 2024-05-08T23:09:38.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.166+0000 7f4748a34700 1 -- 172.21.15.135:0/3319581205 wait complete. 2024-05-08T23:09:38.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.167+0000 7f4748a34700 1 Processor -- start 2024-05-08T23:09:38.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.167+0000 7f4748a34700 1 -- start start 2024-05-08T23:09:38.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.167+0000 7f4748a34700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47441057c0 0x7f47441961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:38.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.167+0000 7f4748a34700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4744196730 con 0x7f47441057c0 2024-05-08T23:09:38.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.167+0000 7f474259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47441057c0 0x7f47441961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:38.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.167+0000 7f474259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47441057c0 0x7f47441961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32960/0 (socket says 172.21.15.135:32960) 2024-05-08T23:09:38.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.167+0000 7f474259c700 1 -- 172.21.15.135:0/3103953546 learned_addr learned my addr 172.21.15.135:0/3103953546 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:38.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.167+0000 7f474259c700 1 -- 172.21.15.135:0/3103953546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47380095f0 con 0x7f47441057c0 2024-05-08T23:09:38.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.167+0000 7f474259c700 1 --2- 172.21.15.135:0/3103953546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47441057c0 0x7f47441961f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4738006010 tx=0x7f4738004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:38.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.168+0000 7f47337fe700 1 -- 172.21.15.135:0/3103953546 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f473801d070 con 0x7f47441057c0 2024-05-08T23:09:38.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.168+0000 7f47337fe700 1 -- 172.21.15.135:0/3103953546 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f473800bbb0 con 0x7f47441057c0 2024-05-08T23:09:38.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.168+0000 7f4748a34700 1 -- 172.21.15.135:0/3103953546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4744196990 con 0x7f47441057c0 2024-05-08T23:09:38.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.168+0000 7f47337fe700 1 -- 172.21.15.135:0/3103953546 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4738003810 con 0x7f47441057c0 2024-05-08T23:09:38.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.168+0000 7f4748a34700 1 -- 172.21.15.135:0/3103953546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4744196e10 con 0x7f47441057c0 2024-05-08T23:09:38.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.168+0000 7f47337fe700 1 -- 172.21.15.135:0/3103953546 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f4738003a10 con 0x7f47441057c0 2024-05-08T23:09:38.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.169+0000 7f47337fe700 1 --2- 172.21.15.135:0/3103953546 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f472c0387a0 0x7f472c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:38.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.169+0000 7f47337fe700 1 -- 172.21.15.135:0/3103953546 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f473804c5d0 con 0x7f47441057c0 2024-05-08T23:09:38.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.169+0000 7f4741d9b700 1 --2- 172.21.15.135:0/3103953546 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f472c0387a0 0x7f472c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:38.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.169+0000 7f4748a34700 1 -- 172.21.15.135:0/3103953546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4744100f00 con 0x7f47441057c0 2024-05-08T23:09:38.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.169+0000 7f4741d9b700 1 --2- 172.21.15.135:0/3103953546 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f472c0387a0 0x7f472c03ac60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4734006fd0 tx=0x7f4734006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:38.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.174+0000 7f47337fe700 1 -- 172.21.15.135:0/3103953546 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4738026070 con 0x7f47441057c0 2024-05-08T23:09:38.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.370+0000 7f4748a34700 1 -- 172.21.15.135:0/3103953546 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4744197520 con 0x7f472c0387a0 2024-05-08T23:09:38.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.371+0000 7f47337fe700 1 -- 172.21.15.135:0/3103953546 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f4744197520 con 0x7f472c0387a0 2024-05-08T23:09:38.370 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:09:38.370 INFO:teuthology.orchestra.run.smithi135.stdout:[{"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}, {"addr": "172.21.15.179", "hostname": "smithi179", "labels": [], "status": ""}] 2024-05-08T23:09:38.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.373+0000 7f4748a34700 1 -- 172.21.15.135:0/3103953546 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f472c0387a0 msgr2=0x7f472c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:38.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.373+0000 7f4748a34700 1 --2- 172.21.15.135:0/3103953546 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f472c0387a0 0x7f472c03ac60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4734006fd0 tx=0x7f4734006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:38.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.373+0000 7f4748a34700 1 -- 172.21.15.135:0/3103953546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47441057c0 msgr2=0x7f47441961f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:38.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.373+0000 7f4748a34700 1 --2- 172.21.15.135:0/3103953546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47441057c0 0x7f47441961f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4738006010 tx=0x7f4738004ff0 comp rx=0 tx=0).stop 2024-05-08T23:09:38.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.373+0000 7f4748a34700 1 -- 172.21.15.135:0/3103953546 shutdown_connections 2024-05-08T23:09:38.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.373+0000 7f4748a34700 1 --2- 172.21.15.135:0/3103953546 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f472c0387a0 0x7f472c03ac60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:38.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.373+0000 7f4748a34700 1 --2- 172.21.15.135:0/3103953546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47441057c0 0x7f47441961f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:38.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.373+0000 7f4748a34700 1 -- 172.21.15.135:0/3103953546 >> 172.21.15.135:0/3103953546 conn(0x7f47440fb2b0 msgr2=0x7f4744068930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:38.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.373+0000 7f4748a34700 1 -- 172.21.15.135:0/3103953546 shutdown_connections 2024-05-08T23:09:38.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:38.373+0000 7f4748a34700 1 -- 172.21.15.135:0/3103953546 wait complete. 2024-05-08T23:09:38.793 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi195 2024-05-08T23:09:38.794 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T23:09:38.794 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.conf 2024-05-08T23:09:38.814 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T23:09:38.814 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:09:38.874 INFO:tasks.cephadm:Adding host smithi195 to orchestrator... 2024-05-08T23:09:38.875 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch host add smithi195 2024-05-08T23:09:38.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:38 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:39.094 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:09:40.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.007+0000 7f8c7384d700 1 -- 172.21.15.135:0/3098404000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c1068d0 msgr2=0x7f8c6c106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:40.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.007+0000 7f8c7384d700 1 --2- 172.21.15.135:0/3098404000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c1068d0 0x7f8c6c106cb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009910 tx=0x7f8c5c009c20 comp rx=0 tx=0).stop 2024-05-08T23:09:40.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.008+0000 7f8c7384d700 1 -- 172.21.15.135:0/3098404000 shutdown_connections 2024-05-08T23:09:40.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.008+0000 7f8c7384d700 1 --2- 172.21.15.135:0/3098404000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c1068d0 0x7f8c6c106cb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:40.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.008+0000 7f8c7384d700 1 -- 172.21.15.135:0/3098404000 >> 172.21.15.135:0/3098404000 conn(0x7f8c6c0fc3e0 msgr2=0x7f8c6c0fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.008+0000 7f8c7384d700 1 -- 172.21.15.135:0/3098404000 shutdown_connections 2024-05-08T23:09:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.008+0000 7f8c7384d700 1 -- 172.21.15.135:0/3098404000 wait complete. 2024-05-08T23:09:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.008+0000 7f8c7384d700 1 Processor -- start 2024-05-08T23:09:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.008+0000 7f8c7384d700 1 -- start start 2024-05-08T23:09:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.008+0000 7f8c7384d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c1068d0 0x7f8c6c196120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.008+0000 7f8c7384d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c196660 con 0x7f8c6c1068d0 2024-05-08T23:09:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.009+0000 7f8c715e9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c1068d0 0x7f8c6c196120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.009+0000 7f8c715e9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c1068d0 0x7f8c6c196120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38174/0 (socket says 172.21.15.135:38174) 2024-05-08T23:09:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.009+0000 7f8c715e9700 1 -- 172.21.15.135:0/3480415106 learned_addr learned my addr 172.21.15.135:0/3480415106 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.009+0000 7f8c715e9700 1 -- 172.21.15.135:0/3480415106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c0095f0 con 0x7f8c6c1068d0 2024-05-08T23:09:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.009+0000 7f8c715e9700 1 --2- 172.21.15.135:0/3480415106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c1068d0 0x7f8c6c196120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c006010 tx=0x7f8c5c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.009+0000 7f8c627fc700 1 -- 172.21.15.135:0/3480415106 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c5c01d070 con 0x7f8c6c1068d0 2024-05-08T23:09:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.009+0000 7f8c7384d700 1 -- 172.21.15.135:0/3480415106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6c1968c0 con 0x7f8c6c1068d0 2024-05-08T23:09:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.009+0000 7f8c627fc700 1 -- 172.21.15.135:0/3480415106 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c5c00bbb0 con 0x7f8c6c1068d0 2024-05-08T23:09:40.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.009+0000 7f8c627fc700 1 -- 172.21.15.135:0/3480415106 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c5c003810 con 0x7f8c6c1068d0 2024-05-08T23:09:40.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.009+0000 7f8c7384d700 1 -- 172.21.15.135:0/3480415106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6c196d40 con 0x7f8c6c1068d0 2024-05-08T23:09:40.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.010+0000 7f8c7384d700 1 -- 172.21.15.135:0/3480415106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6c102010 con 0x7f8c6c1068d0 2024-05-08T23:09:40.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.010+0000 7f8c627fc700 1 -- 172.21.15.135:0/3480415106 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f8c5c00bd20 con 0x7f8c6c1068d0 2024-05-08T23:09:40.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.010+0000 7f8c627fc700 1 --2- 172.21.15.135:0/3480415106 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8c580387a0 0x7f8c5803ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:40.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.010+0000 7f8c627fc700 1 -- 172.21.15.135:0/3480415106 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8c5c04c390 con 0x7f8c6c1068d0 2024-05-08T23:09:40.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.010+0000 7f8c70de8700 1 --2- 172.21.15.135:0/3480415106 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8c580387a0 0x7f8c5803ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:40.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.011+0000 7f8c70de8700 1 --2- 172.21.15.135:0/3480415106 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8c580387a0 0x7f8c5803ac60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8c68006fd0 tx=0x7f8c68006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:40.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.015+0000 7f8c627fc700 1 -- 172.21.15.135:0/3480415106 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8c5c02ab60 con 0x7f8c6c1068d0 2024-05-08T23:09:40.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:39 smithi135 ceph-mon[42440]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:09:40.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:40.210+0000 7f8c7384d700 1 -- 172.21.15.135:0/3480415106 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c6c10abd0 con 0x7f8c580387a0 2024-05-08T23:09:41.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:40 smithi135 ceph-mon[42440]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:09:41.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:40 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:41.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:40 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:41.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:40 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:41.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:40 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:41.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:40 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:09:41.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:40 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:09:41.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:40 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:09:42.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:42.375+0000 7f8c627fc700 1 -- 172.21.15.135:0/3480415106 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f8c6c10abd0 con 0x7f8c580387a0 2024-05-08T23:09:42.504 INFO:teuthology.orchestra.run.smithi135.stdout:Added host 'smithi195' with addr '172.21.15.195' 2024-05-08T23:09:42.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:42.377+0000 7f8c7384d700 1 -- 172.21.15.135:0/3480415106 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8c580387a0 msgr2=0x7f8c5803ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:42.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:42.377+0000 7f8c7384d700 1 --2- 172.21.15.135:0/3480415106 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8c580387a0 0x7f8c5803ac60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8c68006fd0 tx=0x7f8c68006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:42.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:42.377+0000 7f8c7384d700 1 -- 172.21.15.135:0/3480415106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c1068d0 msgr2=0x7f8c6c196120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:42.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:42.377+0000 7f8c7384d700 1 --2- 172.21.15.135:0/3480415106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c1068d0 0x7f8c6c196120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c006010 tx=0x7f8c5c004ff0 comp rx=0 tx=0).stop 2024-05-08T23:09:42.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:42.377+0000 7f8c7384d700 1 -- 172.21.15.135:0/3480415106 shutdown_connections 2024-05-08T23:09:42.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:42.377+0000 7f8c7384d700 1 --2- 172.21.15.135:0/3480415106 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8c580387a0 0x7f8c5803ac60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:42.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:42.377+0000 7f8c7384d700 1 --2- 172.21.15.135:0/3480415106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c1068d0 0x7f8c6c196120 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:42.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:42.377+0000 7f8c7384d700 1 -- 172.21.15.135:0/3480415106 >> 172.21.15.135:0/3480415106 conn(0x7f8c6c0fc3e0 msgr2=0x7f8c6c108480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:42.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:42.377+0000 7f8c7384d700 1 -- 172.21.15.135:0/3480415106 shutdown_connections 2024-05-08T23:09:42.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:42.377+0000 7f8c7384d700 1 -- 172.21.15.135:0/3480415106 wait complete. 2024-05-08T23:09:42.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:41 smithi135 ceph-mon[42440]: Updating smithi179:/etc/ceph/ceph.conf 2024-05-08T23:09:42.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:41 smithi135 ceph-mon[42440]: Updating smithi179:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:09:42.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:41 smithi135 ceph-mon[42440]: Deploying cephadm binary to smithi195 2024-05-08T23:09:42.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:41 smithi135 ceph-mon[42440]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:09:42.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:41 smithi135 ceph-mon[42440]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:09:42.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:41 smithi135 ceph-mon[42440]: Updating smithi179:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T23:09:42.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:41 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:42.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:41 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:42.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:41 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:42.742 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-08T23:09:42.960 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:09:43.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:43 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:43.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:43 smithi135 ceph-mon[42440]: Added host smithi195 2024-05-08T23:09:43.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:43 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:09:43.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:43 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:43.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:43 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:43 smithi135 ceph-mon[42440]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:09:43.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.955+0000 7f8add6fe700 1 -- 172.21.15.135:0/633161124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad81057c0 msgr2=0x7f8ad8105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:43.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.955+0000 7f8add6fe700 1 --2- 172.21.15.135:0/633161124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad81057c0 0x7f8ad8105ba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009910 tx=0x7f8ac8009c20 comp rx=0 tx=0).stop 2024-05-08T23:09:43.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.955+0000 7f8add6fe700 1 -- 172.21.15.135:0/633161124 shutdown_connections 2024-05-08T23:09:43.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.955+0000 7f8add6fe700 1 --2- 172.21.15.135:0/633161124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad81057c0 0x7f8ad8105ba0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:43.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.955+0000 7f8add6fe700 1 -- 172.21.15.135:0/633161124 >> 172.21.15.135:0/633161124 conn(0x7f8ad80fb2b0 msgr2=0x7f8ad80fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:43.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.956+0000 7f8add6fe700 1 -- 172.21.15.135:0/633161124 shutdown_connections 2024-05-08T23:09:43.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.956+0000 7f8add6fe700 1 -- 172.21.15.135:0/633161124 wait complete. 2024-05-08T23:09:43.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.956+0000 7f8add6fe700 1 Processor -- start 2024-05-08T23:09:43.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.957+0000 7f8add6fe700 1 -- start start 2024-05-08T23:09:43.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.957+0000 7f8add6fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad81057c0 0x7f8ad8195060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:43.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.957+0000 7f8add6fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad81955a0 con 0x7f8ad81057c0 2024-05-08T23:09:43.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.957+0000 7f8ad6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad81057c0 0x7f8ad8195060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:43.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.957+0000 7f8ad6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad81057c0 0x7f8ad8195060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38182/0 (socket says 172.21.15.135:38182) 2024-05-08T23:09:43.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.957+0000 7f8ad6ffd700 1 -- 172.21.15.135:0/2841899932 learned_addr learned my addr 172.21.15.135:0/2841899932 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:43.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.957+0000 7f8ad6ffd700 1 -- 172.21.15.135:0/2841899932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac80095f0 con 0x7f8ad81057c0 2024-05-08T23:09:43.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.957+0000 7f8ad6ffd700 1 --2- 172.21.15.135:0/2841899932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad81057c0 0x7f8ad8195060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8006010 tx=0x7f8ac8004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:43.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.957+0000 7f8abffff700 1 -- 172.21.15.135:0/2841899932 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ac801d070 con 0x7f8ad81057c0 2024-05-08T23:09:43.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.957+0000 7f8add6fe700 1 -- 172.21.15.135:0/2841899932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad8195800 con 0x7f8ad81057c0 2024-05-08T23:09:43.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.957+0000 7f8abffff700 1 -- 172.21.15.135:0/2841899932 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ac800bbb0 con 0x7f8ad81057c0 2024-05-08T23:09:43.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.957+0000 7f8abffff700 1 -- 172.21.15.135:0/2841899932 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ac8003810 con 0x7f8ad81057c0 2024-05-08T23:09:43.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.958+0000 7f8add6fe700 1 -- 172.21.15.135:0/2841899932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad8195c80 con 0x7f8ad81057c0 2024-05-08T23:09:43.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.958+0000 7f8abffff700 1 -- 172.21.15.135:0/2841899932 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f8ac8003a50 con 0x7f8ad81057c0 2024-05-08T23:09:43.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.958+0000 7f8abffff700 1 --2- 172.21.15.135:0/2841899932 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8ac00387a0 0x7f8ac003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:43.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.958+0000 7f8add6fe700 1 -- 172.21.15.135:0/2841899932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad8100f00 con 0x7f8ad81057c0 2024-05-08T23:09:43.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.959+0000 7f8abffff700 1 -- 172.21.15.135:0/2841899932 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8ac804c670 con 0x7f8ad81057c0 2024-05-08T23:09:43.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.959+0000 7f8ad67fc700 1 --2- 172.21.15.135:0/2841899932 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8ac00387a0 0x7f8ac003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:43.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.959+0000 7f8ad67fc700 1 --2- 172.21.15.135:0/2841899932 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8ac00387a0 0x7f8ac003ac60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8acc006fd0 tx=0x7f8acc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:43.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:43.964+0000 7f8abffff700 1 -- 172.21.15.135:0/2841899932 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8ac8029770 con 0x7f8ad81057c0 2024-05-08T23:09:44.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:44.161+0000 7f8add6fe700 1 -- 172.21.15.135:0/2841899932 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ad8109ac0 con 0x7f8ac00387a0 2024-05-08T23:09:44.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:44.162+0000 7f8abffff700 1 -- 172.21.15.135:0/2841899932 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+241 (secure 0 0 0) 0x7f8ad8109ac0 con 0x7f8ac00387a0 2024-05-08T23:09:44.162 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:09:44.162 INFO:teuthology.orchestra.run.smithi135.stdout:[{"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}, {"addr": "172.21.15.179", "hostname": "smithi179", "labels": [], "status": ""}, {"addr": "172.21.15.195", "hostname": "smithi195", "labels": [], "status": ""}] 2024-05-08T23:09:44.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:44.165+0000 7f8add6fe700 1 -- 172.21.15.135:0/2841899932 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8ac00387a0 msgr2=0x7f8ac003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:44.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:44.165+0000 7f8add6fe700 1 --2- 172.21.15.135:0/2841899932 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8ac00387a0 0x7f8ac003ac60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8acc006fd0 tx=0x7f8acc006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:44.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:44.165+0000 7f8add6fe700 1 -- 172.21.15.135:0/2841899932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad81057c0 msgr2=0x7f8ad8195060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:44.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:44.165+0000 7f8add6fe700 1 --2- 172.21.15.135:0/2841899932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad81057c0 0x7f8ad8195060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8006010 tx=0x7f8ac8004ff0 comp rx=0 tx=0).stop 2024-05-08T23:09:44.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:44.165+0000 7f8add6fe700 1 -- 172.21.15.135:0/2841899932 shutdown_connections 2024-05-08T23:09:44.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:44.165+0000 7f8add6fe700 1 --2- 172.21.15.135:0/2841899932 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8ac00387a0 0x7f8ac003ac60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:44.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:44.165+0000 7f8add6fe700 1 --2- 172.21.15.135:0/2841899932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad81057c0 0x7f8ad8195060 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:44.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:44.165+0000 7f8add6fe700 1 -- 172.21.15.135:0/2841899932 >> 172.21.15.135:0/2841899932 conn(0x7f8ad80fb2b0 msgr2=0x7f8ad8107470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:44.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:44.165+0000 7f8add6fe700 1 -- 172.21.15.135:0/2841899932 shutdown_connections 2024-05-08T23:09:44.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:44.165+0000 7f8add6fe700 1 -- 172.21.15.135:0/2841899932 wait complete. 2024-05-08T23:09:44.550 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-08T23:09:44.550 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-08T23:09:44.768 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:09:45.014 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:44 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:45.014 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:44 smithi135 ceph-mon[42440]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:09:45.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.716+0000 7f2def82a700 1 -- 172.21.15.135:0/1599849109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de81057c0 msgr2=0x7f2de8105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:45.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.716+0000 7f2def82a700 1 --2- 172.21.15.135:0/1599849109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de81057c0 0x7f2de8105ba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009910 tx=0x7f2dd8009c20 comp rx=0 tx=0).stop 2024-05-08T23:09:45.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.716+0000 7f2def82a700 1 -- 172.21.15.135:0/1599849109 shutdown_connections 2024-05-08T23:09:45.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.716+0000 7f2def82a700 1 --2- 172.21.15.135:0/1599849109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de81057c0 0x7f2de8105ba0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:45.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.716+0000 7f2def82a700 1 -- 172.21.15.135:0/1599849109 >> 172.21.15.135:0/1599849109 conn(0x7f2de8076450 msgr2=0x7f2de80fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:45.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.716+0000 7f2def82a700 1 -- 172.21.15.135:0/1599849109 shutdown_connections 2024-05-08T23:09:45.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.716+0000 7f2def82a700 1 -- 172.21.15.135:0/1599849109 wait complete. 2024-05-08T23:09:45.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.717+0000 7f2def82a700 1 Processor -- start 2024-05-08T23:09:45.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.717+0000 7f2def82a700 1 -- start start 2024-05-08T23:09:45.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.717+0000 7f2def82a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de81057c0 0x7f2de8196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:45.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.717+0000 7f2def82a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de8197470 con 0x7f2de81057c0 2024-05-08T23:09:45.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.717+0000 7f2ded5c6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de81057c0 0x7f2de8196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:45.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.717+0000 7f2ded5c6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de81057c0 0x7f2de8196f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38198/0 (socket says 172.21.15.135:38198) 2024-05-08T23:09:45.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.717+0000 7f2ded5c6700 1 -- 172.21.15.135:0/3318899819 learned_addr learned my addr 172.21.15.135:0/3318899819 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:09:45.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.717+0000 7f2ded5c6700 1 -- 172.21.15.135:0/3318899819 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd80095f0 con 0x7f2de81057c0 2024-05-08T23:09:45.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.717+0000 7f2ded5c6700 1 --2- 172.21.15.135:0/3318899819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de81057c0 0x7f2de8196f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8006010 tx=0x7f2dd8004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:45.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.718+0000 7f2dde7fc700 1 -- 172.21.15.135:0/3318899819 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dd801d070 con 0x7f2de81057c0 2024-05-08T23:09:45.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.718+0000 7f2dde7fc700 1 -- 172.21.15.135:0/3318899819 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2dd800bbb0 con 0x7f2de81057c0 2024-05-08T23:09:45.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.718+0000 7f2def82a700 1 -- 172.21.15.135:0/3318899819 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de81976d0 con 0x7f2de81057c0 2024-05-08T23:09:45.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.718+0000 7f2dde7fc700 1 -- 172.21.15.135:0/3318899819 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dd8003810 con 0x7f2de81057c0 2024-05-08T23:09:45.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.718+0000 7f2def82a700 1 -- 172.21.15.135:0/3318899819 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de8197b50 con 0x7f2de81057c0 2024-05-08T23:09:45.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.719+0000 7f2dde7fc700 1 -- 172.21.15.135:0/3318899819 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f2dd80039c0 con 0x7f2de81057c0 2024-05-08T23:09:45.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.719+0000 7f2dde7fc700 1 --2- 172.21.15.135:0/3318899819 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2dd40387f0 0x7f2dd403acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:45.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.719+0000 7f2dde7fc700 1 -- 172.21.15.135:0/3318899819 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2dd804c4c0 con 0x7f2de81057c0 2024-05-08T23:09:45.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.719+0000 7f2def82a700 1 -- 172.21.15.135:0/3318899819 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de80690d0 con 0x7f2de81057c0 2024-05-08T23:09:45.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.719+0000 7f2decdc5700 1 --2- 172.21.15.135:0/3318899819 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2dd40387f0 0x7f2dd403acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:45.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.719+0000 7f2decdc5700 1 --2- 172.21.15.135:0/3318899819 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2dd40387f0 0x7f2dd403acb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2de4006fd0 tx=0x7f2de4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:45.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.724+0000 7f2dde7fc700 1 -- 172.21.15.135:0/3318899819 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2dd8026020 con 0x7f2de81057c0 2024-05-08T23:09:45.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:45.922+0000 7f2def82a700 1 -- 172.21.15.135:0/3318899819 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2de80625d0 con 0x7f2de81057c0 2024-05-08T23:09:46.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:45 smithi135 ceph-mon[42440]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:09:46.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:46.762+0000 7f2dde7fc700 1 -- 172.21.15.135:0/3318899819 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2dd802aa00 con 0x7f2de81057c0 2024-05-08T23:09:46.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:46.765+0000 7f2def82a700 1 -- 172.21.15.135:0/3318899819 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2dd40387f0 msgr2=0x7f2dd403acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:46.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:46.765+0000 7f2def82a700 1 --2- 172.21.15.135:0/3318899819 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2dd40387f0 0x7f2dd403acb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2de4006fd0 tx=0x7f2de4006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:46.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:46.765+0000 7f2def82a700 1 -- 172.21.15.135:0/3318899819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de81057c0 msgr2=0x7f2de8196f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:46.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:46.765+0000 7f2def82a700 1 --2- 172.21.15.135:0/3318899819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de81057c0 0x7f2de8196f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8006010 tx=0x7f2dd8004ff0 comp rx=0 tx=0).stop 2024-05-08T23:09:46.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:46.765+0000 7f2def82a700 1 -- 172.21.15.135:0/3318899819 shutdown_connections 2024-05-08T23:09:46.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:46.765+0000 7f2def82a700 1 --2- 172.21.15.135:0/3318899819 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2dd40387f0 0x7f2dd403acb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:46.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:46.765+0000 7f2def82a700 1 --2- 172.21.15.135:0/3318899819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de81057c0 0x7f2de8196f30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:46.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:46.765+0000 7f2def82a700 1 -- 172.21.15.135:0/3318899819 >> 172.21.15.135:0/3318899819 conn(0x7f2de8076450 msgr2=0x7f2de8107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:46.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:46.765+0000 7f2def82a700 1 -- 172.21.15.135:0/3318899819 shutdown_connections 2024-05-08T23:09:46.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:09:46.765+0000 7f2def82a700 1 -- 172.21.15.135:0/3318899819 wait complete. 2024-05-08T23:09:46.765 INFO:teuthology.orchestra.run.smithi135.stderr:adjusted tunables profile to default 2024-05-08T23:09:47.082 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:46 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3318899819' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-08T23:09:47.082 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:46 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:47.082 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:46 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:47.082 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:46 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:47.083 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:46 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:47.083 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:46 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:09:47.083 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:46 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:09:47.083 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:46 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:09:47.083 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:46 smithi135 ceph-mon[42440]: Updating smithi195:/etc/ceph/ceph.conf 2024-05-08T23:09:47.174 INFO:tasks.cephadm:Adding mon.a on smithi135 2024-05-08T23:09:47.175 INFO:tasks.cephadm:Adding mon.b on smithi179 2024-05-08T23:09:47.175 INFO:tasks.cephadm:Adding mon.c on smithi195 2024-05-08T23:09:47.175 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch apply mon '3;smithi135:172.21.15.135=a;smithi179:172.21.15.179=b;smithi195:172.21.15.195=c' 2024-05-08T23:09:47.404 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:09:48.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:47 smithi135 ceph-mon[42440]: Updating smithi195:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:09:48.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:47 smithi135 ceph-mon[42440]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:09:48.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:47 smithi135 ceph-mon[42440]: Updating smithi195:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T23:09:48.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:47 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3318899819' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-08T23:09:48.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:47 smithi135 ceph-mon[42440]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:09:48.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:48.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:48.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:48.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:47 smithi135 ceph-mon[42440]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:09:48.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.468+0000 7f9e64a46700 1 -- 172.21.15.195:0/2920350534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e60101ae0 msgr2=0x7f9e60101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:48.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.468+0000 7f9e64a46700 1 --2- 172.21.15.195:0/2920350534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e60101ae0 0x7f9e60101ec0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009910 tx=0x7f9e54009c20 comp rx=0 tx=0).stop 2024-05-08T23:09:48.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.468+0000 7f9e64a46700 1 -- 172.21.15.195:0/2920350534 shutdown_connections 2024-05-08T23:09:48.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.468+0000 7f9e64a46700 1 --2- 172.21.15.195:0/2920350534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e60101ae0 0x7f9e60101ec0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:48.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.468+0000 7f9e64a46700 1 -- 172.21.15.195:0/2920350534 >> 172.21.15.195:0/2920350534 conn(0x7f9e600fb2b0 msgr2=0x7f9e600fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:48.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.468+0000 7f9e64a46700 1 -- 172.21.15.195:0/2920350534 shutdown_connections 2024-05-08T23:09:48.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.468+0000 7f9e64a46700 1 -- 172.21.15.195:0/2920350534 wait complete. 2024-05-08T23:09:48.470 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.468+0000 7f9e64a46700 1 Processor -- start 2024-05-08T23:09:48.470 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.469+0000 7f9e64a46700 1 -- start start 2024-05-08T23:09:48.470 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.469+0000 7f9e64a46700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e60101ae0 0x7f9e601961d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:48.470 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.469+0000 7f9e64a46700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e60196710 con 0x7f9e60101ae0 2024-05-08T23:09:48.470 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.469+0000 7f9e5e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e60101ae0 0x7f9e601961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:48.470 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.469+0000 7f9e5e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e60101ae0 0x7f9e601961d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.195:58948/0 (socket says 172.21.15.195:58948) 2024-05-08T23:09:48.470 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.469+0000 7f9e5e59c700 1 -- 172.21.15.195:0/2314406997 learned_addr learned my addr 172.21.15.195:0/2314406997 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T23:09:48.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.469+0000 7f9e5e59c700 1 -- 172.21.15.195:0/2314406997 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e540095f0 con 0x7f9e60101ae0 2024-05-08T23:09:48.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.469+0000 7f9e5e59c700 1 --2- 172.21.15.195:0/2314406997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e60101ae0 0x7f9e601961d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e54004f40 tx=0x7f9e54005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:48.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.470+0000 7f9e4f7fe700 1 -- 172.21.15.195:0/2314406997 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e5401d070 con 0x7f9e60101ae0 2024-05-08T23:09:48.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.470+0000 7f9e64a46700 1 -- 172.21.15.195:0/2314406997 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e60196910 con 0x7f9e60101ae0 2024-05-08T23:09:48.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.470+0000 7f9e4f7fe700 1 -- 172.21.15.195:0/2314406997 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e54004370 con 0x7f9e60101ae0 2024-05-08T23:09:48.471 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.470+0000 7f9e4f7fe700 1 -- 172.21.15.195:0/2314406997 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e54003970 con 0x7f9e60101ae0 2024-05-08T23:09:48.472 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.470+0000 7f9e64a46700 1 -- 172.21.15.195:0/2314406997 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e60196d30 con 0x7f9e60101ae0 2024-05-08T23:09:48.472 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.471+0000 7f9e4f7fe700 1 -- 172.21.15.195:0/2314406997 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f9e54003c30 con 0x7f9e60101ae0 2024-05-08T23:09:48.472 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.471+0000 7f9e4f7fe700 1 --2- 172.21.15.195:0/2314406997 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9e480387a0 0x7f9e4803ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:48.472 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.471+0000 7f9e4f7fe700 1 -- 172.21.15.195:0/2314406997 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9e5404c490 con 0x7f9e60101ae0 2024-05-08T23:09:48.472 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.471+0000 7f9e64a46700 1 -- 172.21.15.195:0/2314406997 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e600691b0 con 0x7f9e60101ae0 2024-05-08T23:09:48.472 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.471+0000 7f9e5dd9b700 1 --2- 172.21.15.195:0/2314406997 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9e480387a0 0x7f9e4803ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:48.472 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.472+0000 7f9e5dd9b700 1 --2- 172.21.15.195:0/2314406997 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9e480387a0 0x7f9e4803ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9e50006fd0 tx=0x7f9e50006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:48.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.477+0000 7f9e4f7fe700 1 -- 172.21.15.195:0/2314406997 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9e54026070 con 0x7f9e60101ae0 2024-05-08T23:09:48.677 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.677+0000 7f9e64a46700 1 -- 172.21.15.195:0/2314406997 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi135:172.21.15.135=a;smithi179:172.21.15.179=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e6010ac10 con 0x7f9e480387a0 2024-05-08T23:09:48.684 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.684+0000 7f9e4f7fe700 1 -- 172.21.15.195:0/2314406997 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9e6010ac10 con 0x7f9e480387a0 2024-05-08T23:09:48.684 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mon update... 2024-05-08T23:09:48.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.686+0000 7f9e64a46700 1 -- 172.21.15.195:0/2314406997 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9e480387a0 msgr2=0x7f9e4803ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:48.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.686+0000 7f9e64a46700 1 --2- 172.21.15.195:0/2314406997 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9e480387a0 0x7f9e4803ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9e50006fd0 tx=0x7f9e50006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:48.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.686+0000 7f9e64a46700 1 -- 172.21.15.195:0/2314406997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e60101ae0 msgr2=0x7f9e601961d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:48.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.686+0000 7f9e64a46700 1 --2- 172.21.15.195:0/2314406997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e60101ae0 0x7f9e601961d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e54004f40 tx=0x7f9e54005020 comp rx=0 tx=0).stop 2024-05-08T23:09:48.687 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.686+0000 7f9e64a46700 1 -- 172.21.15.195:0/2314406997 shutdown_connections 2024-05-08T23:09:48.687 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.686+0000 7f9e64a46700 1 --2- 172.21.15.195:0/2314406997 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9e480387a0 0x7f9e4803ac60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:48.687 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.686+0000 7f9e64a46700 1 --2- 172.21.15.195:0/2314406997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e60101ae0 0x7f9e601961d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:48.687 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.686+0000 7f9e64a46700 1 -- 172.21.15.195:0/2314406997 >> 172.21.15.195:0/2314406997 conn(0x7f9e600fb2b0 msgr2=0x7f9e601048a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:48.687 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.686+0000 7f9e64a46700 1 -- 172.21.15.195:0/2314406997 shutdown_connections 2024-05-08T23:09:48.687 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:48.686+0000 7f9e64a46700 1 -- 172.21.15.195:0/2314406997 wait complete. 2024-05-08T23:09:49.077 DEBUG:teuthology.orchestra.run.smithi179:mon.b> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mon.b.service 2024-05-08T23:09:49.080 DEBUG:teuthology.orchestra.run.smithi195:mon.c> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mon.c.service 2024-05-08T23:09:49.083 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T23:09:49.083 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T23:09:49.114 INFO:journalctl@ceph.mon.c.smithi195.stdout:-- Logs begin at Wed 2024-05-08 22:52:38 UTC. -- 2024-05-08T23:09:49.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:-- Logs begin at Wed 2024-05-08 22:52:32 UTC. -- 2024-05-08T23:09:49.481 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:09:49.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:49 smithi135 ceph-mon[42440]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi135:172.21.15.135=a;smithi179:172.21.15.179=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:09:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:49 smithi135 ceph-mon[42440]: Saving service mon spec with placement smithi135:172.21.15.135=a;smithi179:172.21.15.179=b;smithi195:172.21.15.195=c;count:3 2024-05-08T23:09:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:49 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:49 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:09:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:49 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:09:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:49 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:09:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:49 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:49 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:09:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:49 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:09:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:49 smithi135 ceph-mon[42440]: Deploying daemon mon.c on smithi195 2024-05-08T23:09:49.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:49 smithi135 ceph-mon[42440]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:09:51.586 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.582+0000 7f71e415b700 1 -- 172.21.15.195:0/3874885063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71dc0ff670 msgr2=0x7f71dc0ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:51.587 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.582+0000 7f71e415b700 1 --2- 172.21.15.195:0/3874885063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71dc0ff670 0x7f71dc0ffa50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71d8009910 tx=0x7f71d8009c20 comp rx=0 tx=0).stop 2024-05-08T23:09:51.587 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.582+0000 7f71e415b700 1 -- 172.21.15.195:0/3874885063 shutdown_connections 2024-05-08T23:09:51.587 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.582+0000 7f71e415b700 1 --2- 172.21.15.195:0/3874885063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71dc0ff670 0x7f71dc0ffa50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:51.587 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.582+0000 7f71e415b700 1 -- 172.21.15.195:0/3874885063 >> 172.21.15.195:0/3874885063 conn(0x7f71dc076450 msgr2=0x7f71dc0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:51.587 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.582+0000 7f71e415b700 1 -- 172.21.15.195:0/3874885063 shutdown_connections 2024-05-08T23:09:51.587 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.582+0000 7f71e415b700 1 -- 172.21.15.195:0/3874885063 wait complete. 2024-05-08T23:09:51.588 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.583+0000 7f71e415b700 1 Processor -- start 2024-05-08T23:09:51.588 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.583+0000 7f71e415b700 1 -- start start 2024-05-08T23:09:51.588 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.583+0000 7f71e415b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71dc0ff670 0x7f71dc1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:51.588 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.583+0000 7f71e415b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc198920 con 0x7f71dc0ff670 2024-05-08T23:09:51.588 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.584+0000 7f71e1ef7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71dc0ff670 0x7f71dc1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:51.588 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.584+0000 7f71e1ef7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71dc0ff670 0x7f71dc1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.195:58960/0 (socket says 172.21.15.195:58960) 2024-05-08T23:09:51.588 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.584+0000 7f71e1ef7700 1 -- 172.21.15.195:0/874351133 learned_addr learned my addr 172.21.15.195:0/874351133 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T23:09:51.588 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.584+0000 7f71e1ef7700 1 -- 172.21.15.195:0/874351133 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d80095f0 con 0x7f71dc0ff670 2024-05-08T23:09:51.588 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.584+0000 7f71e1ef7700 1 --2- 172.21.15.195:0/874351133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71dc0ff670 0x7f71dc1983e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f71d8004f40 tx=0x7f71d8005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:51.588 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.584+0000 7f71d2ffd700 1 -- 172.21.15.195:0/874351133 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71d801d070 con 0x7f71dc0ff670 2024-05-08T23:09:51.588 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.584+0000 7f71e415b700 1 -- 172.21.15.195:0/874351133 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc198b20 con 0x7f71dc0ff670 2024-05-08T23:09:51.588 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.584+0000 7f71d2ffd700 1 -- 172.21.15.195:0/874351133 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71d800bc10 con 0x7f71dc0ff670 2024-05-08T23:09:51.588 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.584+0000 7f71d2ffd700 1 -- 172.21.15.195:0/874351133 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71d80037d0 con 0x7f71dc0ff670 2024-05-08T23:09:51.588 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.584+0000 7f71e415b700 1 -- 172.21.15.195:0/874351133 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc198f40 con 0x7f71dc0ff670 2024-05-08T23:09:51.589 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.585+0000 7f71d2ffd700 1 -- 172.21.15.195:0/874351133 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f71d8003a90 con 0x7f71dc0ff670 2024-05-08T23:09:51.589 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.586+0000 7f71e415b700 1 -- 172.21.15.195:0/874351133 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc068920 con 0x7f71dc0ff670 2024-05-08T23:09:51.589 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.586+0000 7f71d2ffd700 1 --2- 172.21.15.195:0/874351133 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f71c80387a0 0x7f71c803ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:51.589 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.586+0000 7f71d2ffd700 1 -- 172.21.15.195:0/874351133 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f71d804c3f0 con 0x7f71dc0ff670 2024-05-08T23:09:51.589 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.586+0000 7f71e16f6700 1 --2- 172.21.15.195:0/874351133 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f71c80387a0 0x7f71c803ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:51.589 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.586+0000 7f71e16f6700 1 --2- 172.21.15.195:0/874351133 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f71c80387a0 0x7f71c803ac60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f71cc006fd0 tx=0x7f71cc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:51.591 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.591+0000 7f71d2ffd700 1 -- 172.21.15.195:0/874351133 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f71d8029360 con 0x7f71dc0ff670 2024-05-08T23:09:51.814 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 systemd[1]: Starting Ceph mon.c for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:09:51.902 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.901+0000 7f71e415b700 1 -- 172.21.15.195:0/874351133 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f71dc1997d0 con 0x7f71dc0ff670 2024-05-08T23:09:51.902 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.902+0000 7f71d2ffd700 1 -- 172.21.15.195:0/874351133 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7f71d8026030 con 0x7f71dc0ff670 2024-05-08T23:09:51.903 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T23:09:51.903 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","modified":"2024-05-08T23:08:28.973306Z","created":"2024-05-08T23:08:28.973306Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-08T23:09:51.904 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.904+0000 7f71d2ffd700 1 -- 172.21.15.195:0/874351133 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f71d8027ea0 con 0x7f71dc0ff670 2024-05-08T23:09:51.905 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.904+0000 7f71e415b700 1 -- 172.21.15.195:0/874351133 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f71c80387a0 msgr2=0x7f71c803ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:51.905 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.904+0000 7f71e415b700 1 --2- 172.21.15.195:0/874351133 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f71c80387a0 0x7f71c803ac60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f71cc006fd0 tx=0x7f71cc006e40 comp rx=0 tx=0).stop 2024-05-08T23:09:51.905 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.904+0000 7f71e415b700 1 -- 172.21.15.195:0/874351133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71dc0ff670 msgr2=0x7f71dc1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:51.905 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.904+0000 7f71e415b700 1 --2- 172.21.15.195:0/874351133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71dc0ff670 0x7f71dc1983e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f71d8004f40 tx=0x7f71d8005020 comp rx=0 tx=0).stop 2024-05-08T23:09:51.905 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.904+0000 7f71e415b700 1 -- 172.21.15.195:0/874351133 shutdown_connections 2024-05-08T23:09:51.905 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.904+0000 7f71e415b700 1 --2- 172.21.15.195:0/874351133 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f71c80387a0 0x7f71c803ac60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:51.905 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.904+0000 7f71e415b700 1 --2- 172.21.15.195:0/874351133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71dc0ff670 0x7f71dc1983e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:51.905 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.904+0000 7f71e415b700 1 -- 172.21.15.195:0/874351133 >> 172.21.15.195:0/874351133 conn(0x7f71dc076450 msgr2=0x7f71dc0fc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:51.905 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.904+0000 7f71e415b700 1 -- 172.21.15.195:0/874351133 shutdown_connections 2024-05-08T23:09:51.905 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:51.904+0000 7f71e415b700 1 -- 172.21.15.195:0/874351133 wait complete. 2024-05-08T23:09:51.906 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-05-08T23:09:52.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: set uid:gid to 167:167 (ceph:ceph) 2024-05-08T23:09:52.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable), process ceph-mon, pid 7 2024-05-08T23:09:52.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: pidfile_write: ignore empty --pid-file 2024-05-08T23:09:52.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: load: jerasure load: lrc 2024-05-08T23:09:52.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: RocksDB version: 7.9.2 2024-05-08T23:09:52.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Git sha 0 2024-05-08T23:09:52.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Compile date 2024-05-08 17:55:50 2024-05-08T23:09:52.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: DB SUMMARY 2024-05-08T23:09:52.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: DB Session ID: OVKP6UJUDF9GQ5CQA6VE 2024-05-08T23:09:52.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: CURRENT file: CURRENT 2024-05-08T23:09:52.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: IDENTITY file: IDENTITY 2024-05-08T23:09:52.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-08T23:09:52.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-05-08T23:09:52.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-05-08T23:09:52.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.error_if_exists: 0 2024-05-08T23:09:52.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.create_if_missing: 0 2024-05-08T23:09:52.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.paranoid_checks: 1 2024-05-08T23:09:52.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-08T23:09:52.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-08T23:09:52.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-08T23:09:52.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.env: 0x55a7b064c820 2024-05-08T23:09:52.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.fs: PosixFileSystem 2024-05-08T23:09:52.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.info_log: 0x55a7b223f520 2024-05-08T23:09:52.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_file_opening_threads: 16 2024-05-08T23:09:52.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.statistics: (nil) 2024-05-08T23:09:52.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.use_fsync: 0 2024-05-08T23:09:52.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_log_file_size: 0 2024-05-08T23:09:52.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-08T23:09:52.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-08T23:09:52.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.keep_log_file_num: 1000 2024-05-08T23:09:52.137 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.recycle_log_file_num: 0 2024-05-08T23:09:52.137 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.allow_fallocate: 1 2024-05-08T23:09:52.137 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.allow_mmap_reads: 0 2024-05-08T23:09:52.137 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.allow_mmap_writes: 0 2024-05-08T23:09:52.137 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.use_direct_reads: 0 2024-05-08T23:09:52.137 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-08T23:09:52.137 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.create_missing_column_families: 0 2024-05-08T23:09:52.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.db_log_dir: 2024-05-08T23:09:52.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.wal_dir: 2024-05-08T23:09:52.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-08T23:09:52.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-08T23:09:52.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-08T23:09:52.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-08T23:09:52.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-08T23:09:52.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-08T23:09:52.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.advise_random_on_open: 1 2024-05-08T23:09:52.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.db_write_buffer_size: 0 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.write_buffer_manager: 0x55a7b14d4320 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.rate_limiter: (nil) 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.wal_recovery_mode: 2 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.enable_thread_tracking: 0 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.enable_pipelined_write: 0 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.unordered_write: 0 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.row_cache: None 2024-05-08T23:09:52.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.wal_filter: None 2024-05-08T23:09:52.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-08T23:09:52.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.allow_ingest_behind: 0 2024-05-08T23:09:52.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.two_write_queues: 0 2024-05-08T23:09:52.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.manual_wal_flush: 0 2024-05-08T23:09:52.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.wal_compression: 0 2024-05-08T23:09:52.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.atomic_flush: 0 2024-05-08T23:09:52.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-08T23:09:52.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-08T23:09:52.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-08T23:09:52.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.log_readahead_size: 0 2024-05-08T23:09:52.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-08T23:09:52.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.best_efforts_recovery: 0 2024-05-08T23:09:52.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-08T23:09:52.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-08T23:09:52.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.allow_data_in_errors: 0 2024-05-08T23:09:52.141 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.db_host_id: __hostname__ 2024-05-08T23:09:52.141 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-08T23:09:52.141 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_background_jobs: 2 2024-05-08T23:09:52.141 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_background_compactions: -1 2024-05-08T23:09:52.141 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_subcompactions: 1 2024-05-08T23:09:52.141 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-08T23:09:52.141 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-08T23:09:52.141 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-08T23:09:52.141 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_total_wal_size: 0 2024-05-08T23:09:52.141 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-08T23:09:52.141 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-08T23:09:52.141 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-08T23:09:52.141 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-08T23:09:52.141 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_open_files: -1 2024-05-08T23:09:52.142 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.bytes_per_sync: 0 2024-05-08T23:09:52.142 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-08T23:09:52.142 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-08T23:09:52.142 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compaction_readahead_size: 0 2024-05-08T23:09:52.142 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_background_flushes: -1 2024-05-08T23:09:52.142 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Compression algorithms supported: 2024-05-08T23:09:52.142 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-08T23:09:52.142 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: kZSTD supported: 0 2024-05-08T23:09:52.142 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: kXpressCompression supported: 0 2024-05-08T23:09:52.142 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: kLZ4HCCompression supported: 1 2024-05-08T23:09:52.142 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: kZlibCompression supported: 1 2024-05-08T23:09:52.142 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: kSnappyCompression supported: 1 2024-05-08T23:09:52.142 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: kLZ4Compression supported: 1 2024-05-08T23:09:52.142 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: kBZip2Compression supported: 0 2024-05-08T23:09:52.142 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-08T23:09:52.143 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-08T23:09:52.143 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-05-08T23:09:52.143 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-08T23:09:52.143 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-08T23:09:52.143 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.merge_operator: 2024-05-08T23:09:52.143 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compaction_filter: None 2024-05-08T23:09:52.143 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compaction_filter_factory: None 2024-05-08T23:09:52.143 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.sst_partitioner_factory: None 2024-05-08T23:09:52.143 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-08T23:09:52.143 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-08T23:09:52.143 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a7b223f620) 2024-05-08T23:09:52.143 INFO:journalctl@ceph.mon.c.smithi195.stdout: cache_index_and_filter_blocks: 1 2024-05-08T23:09:52.143 INFO:journalctl@ceph.mon.c.smithi195.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-08T23:09:52.143 INFO:journalctl@ceph.mon.c.smithi195.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-08T23:09:52.143 INFO:journalctl@ceph.mon.c.smithi195.stdout: pin_top_level_index_and_filter: 1 2024-05-08T23:09:52.144 INFO:journalctl@ceph.mon.c.smithi195.stdout: index_type: 0 2024-05-08T23:09:52.144 INFO:journalctl@ceph.mon.c.smithi195.stdout: data_block_index_type: 0 2024-05-08T23:09:52.144 INFO:journalctl@ceph.mon.c.smithi195.stdout: index_shortening: 1 2024-05-08T23:09:52.144 INFO:journalctl@ceph.mon.c.smithi195.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-08T23:09:52.144 INFO:journalctl@ceph.mon.c.smithi195.stdout: checksum: 4 2024-05-08T23:09:52.144 INFO:journalctl@ceph.mon.c.smithi195.stdout: no_block_cache: 0 2024-05-08T23:09:52.144 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_cache: 0x55a7b15571f0 2024-05-08T23:09:52.144 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_cache_name: BinnedLRUCache 2024-05-08T23:09:52.144 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_cache_options: 2024-05-08T23:09:52.144 INFO:journalctl@ceph.mon.c.smithi195.stdout: capacity : 536870912 2024-05-08T23:09:52.144 INFO:journalctl@ceph.mon.c.smithi195.stdout: num_shard_bits : 4 2024-05-08T23:09:52.144 INFO:journalctl@ceph.mon.c.smithi195.stdout: strict_capacity_limit : 0 2024-05-08T23:09:52.144 INFO:journalctl@ceph.mon.c.smithi195.stdout: high_pri_pool_ratio: 0.000 2024-05-08T23:09:52.145 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_cache_compressed: (nil) 2024-05-08T23:09:52.145 INFO:journalctl@ceph.mon.c.smithi195.stdout: persistent_cache: (nil) 2024-05-08T23:09:52.145 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_size: 4096 2024-05-08T23:09:52.145 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_size_deviation: 10 2024-05-08T23:09:52.145 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_restart_interval: 16 2024-05-08T23:09:52.145 INFO:journalctl@ceph.mon.c.smithi195.stdout: index_block_restart_interval: 1 2024-05-08T23:09:52.145 INFO:journalctl@ceph.mon.c.smithi195.stdout: metadata_block_size: 4096 2024-05-08T23:09:52.145 INFO:journalctl@ceph.mon.c.smithi195.stdout: partition_filters: 0 2024-05-08T23:09:52.145 INFO:journalctl@ceph.mon.c.smithi195.stdout: use_delta_encoding: 1 2024-05-08T23:09:52.145 INFO:journalctl@ceph.mon.c.smithi195.stdout: filter_policy: bloomfilter 2024-05-08T23:09:52.145 INFO:journalctl@ceph.mon.c.smithi195.stdout: whole_key_filtering: 1 2024-05-08T23:09:52.145 INFO:journalctl@ceph.mon.c.smithi195.stdout: verify_compression: 0 2024-05-08T23:09:52.145 INFO:journalctl@ceph.mon.c.smithi195.stdout: read_amp_bytes_per_bit: 0 2024-05-08T23:09:52.145 INFO:journalctl@ceph.mon.c.smithi195.stdout: format_version: 5 2024-05-08T23:09:52.145 INFO:journalctl@ceph.mon.c.smithi195.stdout: enable_index_compression: 1 2024-05-08T23:09:52.146 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_align: 0 2024-05-08T23:09:52.146 INFO:journalctl@ceph.mon.c.smithi195.stdout: max_auto_readahead_size: 262144 2024-05-08T23:09:52.146 INFO:journalctl@ceph.mon.c.smithi195.stdout: prepopulate_block_cache: 0 2024-05-08T23:09:52.146 INFO:journalctl@ceph.mon.c.smithi195.stdout: initial_auto_readahead_size: 8192 2024-05-08T23:09:52.146 INFO:journalctl@ceph.mon.c.smithi195.stdout: num_file_reads_for_auto_readahead: 2 2024-05-08T23:09:52.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.write_buffer_size: 33554432 2024-05-08T23:09:52.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_write_buffer_number: 2 2024-05-08T23:09:52.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compression: NoCompression 2024-05-08T23:09:52.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.bottommost_compression: Disabled 2024-05-08T23:09:52.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.prefix_extractor: nullptr 2024-05-08T23:09:52.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-08T23:09:52.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.num_levels: 7 2024-05-08T23:09:52.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-08T23:09:52.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-08T23:09:52.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-08T23:09:52.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-08T23:09:52.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-08T23:09:52.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-08T23:09:52.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-08T23:09:52.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-08T23:09:52.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-08T23:09:52.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-08T23:09:52.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-08T23:09:52.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-08T23:09:52.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-08T23:09:52.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compression_opts.level: 32767 2024-05-08T23:09:52.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compression_opts.strategy: 0 2024-05-08T23:09:52.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-08T23:09:52.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-08T23:09:52.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-08T23:09:52.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-08T23:09:52.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compression_opts.enabled: false 2024-05-08T23:09:52.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-08T23:09:52.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-08T23:09:52.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-08T23:09:52.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-08T23:09:52.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.target_file_size_base: 67108864 2024-05-08T23:09:52.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-08T23:09:52.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-08T23:09:52.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-08T23:09:52.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-08T23:09:52.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-08T23:09:52.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-08T23:09:52.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-08T23:09:52.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-08T23:09:52.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-08T23:09:52.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-08T23:09:52.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-08T23:09:52.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-08T23:09:52.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-08T23:09:52.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-08T23:09:52.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.arena_block_size: 1048576 2024-05-08T23:09:52.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-08T23:09:52.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-08T23:09:52.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.disable_auto_compactions: 0 2024-05-08T23:09:52.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-08T23:09:52.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-08T23:09:52.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-08T23:09:52.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-08T23:09:52.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-08T23:09:52.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-08T23:09:52.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-08T23:09:52.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-08T23:09:52.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-08T23:09:52.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-08T23:09:52.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.table_properties_collectors: 2024-05-08T23:09:52.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.inplace_update_support: 0 2024-05-08T23:09:52.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-08T23:09:52.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-08T23:09:52.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-08T23:09:52.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-08T23:09:52.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.bloom_locality: 0 2024-05-08T23:09:52.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.max_successive_merges: 0 2024-05-08T23:09:52.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-08T23:09:52.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.paranoid_file_checks: 0 2024-05-08T23:09:52.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.force_consistency_checks: 1 2024-05-08T23:09:52.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.report_bg_io_stats: 0 2024-05-08T23:09:52.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.ttl: 2592000 2024-05-08T23:09:52.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-08T23:09:52.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-08T23:09:52.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-08T23:09:52.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.enable_blob_files: false 2024-05-08T23:09:52.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.min_blob_size: 0 2024-05-08T23:09:52.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.blob_file_size: 268435456 2024-05-08T23:09:52.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-08T23:09:52.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-08T23:09:52.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-08T23:09:52.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-08T23:09:52.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-08T23:09:52.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.blob_file_starting_level: 0 2024-05-08T23:09:52.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-08T23:09:52.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-08T23:09:52.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-08T23:09:52.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 89d92249-be70-48bf-9ad6-593ab25f6dc8 2024-05-08T23:09:52.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715209791882763, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-08T23:09:52.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-08T23:09:52.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715209791883173, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715209791, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "89d92249-be70-48bf-9ad6-593ab25f6dc8", "db_session_id": "OVKP6UJUDF9GQ5CQA6VE", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-08T23:09:52.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715209791883240, "job": 1, "event": "recovery_finished"} 2024-05-08T23:09:52.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-08T23:09:52.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-08T23:09:52.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a7b15f4000 2024-05-08T23:09:52.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: DB pointer 0x55a7b15e2000 2024-05-08T23:09:52.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-08T23:09:52.153 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-08T23:09:52.153 INFO:journalctl@ceph.mon.c.smithi195.stdout: ** DB Stats ** 2024-05-08T23:09:52.153 INFO:journalctl@ceph.mon.c.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T23:09:52.153 INFO:journalctl@ceph.mon.c.smithi195.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-08T23:09:52.153 INFO:journalctl@ceph.mon.c.smithi195.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T23:09:52.153 INFO:journalctl@ceph.mon.c.smithi195.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T23:09:52.153 INFO:journalctl@ceph.mon.c.smithi195.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-08T23:09:52.153 INFO:journalctl@ceph.mon.c.smithi195.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T23:09:52.153 INFO:journalctl@ceph.mon.c.smithi195.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T23:09:52.153 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2024-05-08T23:09:52.153 INFO:journalctl@ceph.mon.c.smithi195.stdout: ** Compaction Stats [default] ** 2024-05-08T23:09:52.153 INFO:journalctl@ceph.mon.c.smithi195.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T23:09:52.154 INFO:journalctl@ceph.mon.c.smithi195.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-08T23:09:52.154 INFO:journalctl@ceph.mon.c.smithi195.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T23:09:52.154 INFO:journalctl@ceph.mon.c.smithi195.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T23:09:52.155 INFO:journalctl@ceph.mon.c.smithi195.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T23:09:52.155 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2024-05-08T23:09:52.155 INFO:journalctl@ceph.mon.c.smithi195.stdout: ** Compaction Stats [default] ** 2024-05-08T23:09:52.155 INFO:journalctl@ceph.mon.c.smithi195.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T23:09:52.155 INFO:journalctl@ceph.mon.c.smithi195.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T23:09:52.155 INFO:journalctl@ceph.mon.c.smithi195.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T23:09:52.155 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2024-05-08T23:09:52.155 INFO:journalctl@ceph.mon.c.smithi195.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-08T23:09:52.156 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2024-05-08T23:09:52.156 INFO:journalctl@ceph.mon.c.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T23:09:52.156 INFO:journalctl@ceph.mon.c.smithi195.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T23:09:52.156 INFO:journalctl@ceph.mon.c.smithi195.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T23:09:52.156 INFO:journalctl@ceph.mon.c.smithi195.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T23:09:52.157 INFO:journalctl@ceph.mon.c.smithi195.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T23:09:52.157 INFO:journalctl@ceph.mon.c.smithi195.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-08T23:09:52.157 INFO:journalctl@ceph.mon.c.smithi195.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:09:52.157 INFO:journalctl@ceph.mon.c.smithi195.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:09:52.157 INFO:journalctl@ceph.mon.c.smithi195.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T23:09:52.158 INFO:journalctl@ceph.mon.c.smithi195.stdout: Block cache BinnedLRUCache@0x55a7b15571f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-05-08T23:09:52.158 INFO:journalctl@ceph.mon.c.smithi195.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-08T23:09:52.158 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2024-05-08T23:09:52.158 INFO:journalctl@ceph.mon.c.smithi195.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-08T23:09:52.158 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-05-08T23:09:52.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: using public_addr v2:172.21.15.195:0/0 -> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] 2024-05-08T23:09:52.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: starting mon.c rank -1 at public addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] at bind addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:09:52.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: mon.c@-1(???) e0 preinit fsid c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:09:52.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: mon.c@-1(synchronizing).mds e1 new map 2024-05-08T23:09:52.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: mon.c@-1(synchronizing).mds e1 print_map 2024-05-08T23:09:52.159 INFO:journalctl@ceph.mon.c.smithi195.stdout: e1 2024-05-08T23:09:52.160 INFO:journalctl@ceph.mon.c.smithi195.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T23:09:52.160 INFO:journalctl@ceph.mon.c.smithi195.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-08T23:09:52.160 INFO:journalctl@ceph.mon.c.smithi195.stdout: legacy client fscid: -1 2024-05-08T23:09:52.160 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2024-05-08T23:09:52.160 INFO:journalctl@ceph.mon.c.smithi195.stdout: No filesystems configured 2024-05-08T23:09:52.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-08T23:09:52.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-08T23:09:52.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-08T23:09:52.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-08T23:09:52.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-08T23:09:52.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-08T23:09:52.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-08T23:09:52.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:09:52.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:09:52.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:09:52.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi135:172.21.15.135=a;smithi179:172.21.15.179=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:09:52.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: Saving service mon spec with placement smithi135:172.21.15.135=a;smithi179:172.21.15.179=b;smithi195:172.21.15.195=c;count:3 2024-05-08T23:09:52.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:52.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:09:52.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:09:52.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:09:52.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:52.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:09:52.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:09:52.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: Deploying daemon mon.c on smithi195 2024-05-08T23:09:52.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:09:52.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 ceph-mon[46516]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-08T23:09:52.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 bash[46479]: 469fb922a144ae1773fa929787948deb92412f05b46d73a3169918fd6c8e06c1 2024-05-08T23:09:52.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:51 smithi195 systemd[1]: Started Ceph mon.c for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:09:53.294 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T23:09:53.294 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T23:09:53.524 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:09:57.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:09:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: mon.a calling monitor election 2024-05-08T23:09:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:09:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:09:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:09:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:09:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: mon.c calling monitor election 2024-05-08T23:09:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:09:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:09:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:09:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:09:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T23:09:57.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: monmap e2: 2 mons at {a=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:09:57.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: fsmap 2024-05-08T23:09:57.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:09:57.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: mgrmap e13: x(active, since 35s) 2024-05-08T23:09:57.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: overall HEALTH_OK 2024-05-08T23:09:57.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:57.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:57.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:57.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:09:57.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:09:57.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:09:57.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: mon.a calling monitor election 2024-05-08T23:09:57.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:09:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:09:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:09:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:09:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: mon.c calling monitor election 2024-05-08T23:09:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:09:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:09:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:09:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:09:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T23:09:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: monmap e2: 2 mons at {a=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:09:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: fsmap 2024-05-08T23:09:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:09:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: mgrmap e13: x(active, since 35s) 2024-05-08T23:09:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: overall HEALTH_OK 2024-05-08T23:09:57.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:57.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:57.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:09:57.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:09:57.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:09:57.532 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.531+0000 7f4f3d45e700 1 -- 172.21.15.195:0/3127133352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f200035c0 msgr2=0x7f4f20005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:57.532 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.531+0000 7f4f3d45e700 1 --2- 172.21.15.195:0/3127133352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f200035c0 0x7f4f20005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f38100910 tx=0x7f4f2c00feb0 comp rx=0 tx=0).stop 2024-05-08T23:09:57.532 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.532+0000 7f4f3d45e700 1 -- 172.21.15.195:0/3127133352 shutdown_connections 2024-05-08T23:09:57.532 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.532+0000 7f4f3d45e700 1 --2- 172.21.15.195:0/3127133352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f200035c0 0x7f4f20005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:57.532 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.532+0000 7f4f3d45e700 1 -- 172.21.15.195:0/3127133352 >> 172.21.15.195:0/3127133352 conn(0x7f4f380fc4d0 msgr2=0x7f4f380fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:57.532 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.532+0000 7f4f3d45e700 1 -- 172.21.15.195:0/3127133352 shutdown_connections 2024-05-08T23:09:57.532 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.532+0000 7f4f3d45e700 1 -- 172.21.15.195:0/3127133352 wait complete. 2024-05-08T23:09:57.532 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.533+0000 7f4f3d45e700 1 Processor -- start 2024-05-08T23:09:57.533 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.533+0000 7f4f3d45e700 1 -- start start 2024-05-08T23:09:57.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.533+0000 7f4f3d45e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f200035c0 0x7f4f380732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:57.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.533+0000 7f4f3d45e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f380737e0 0x7f4f38073c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:57.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.533+0000 7f4f3d45e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38075160 con 0x7f4f380737e0 2024-05-08T23:09:57.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.533+0000 7f4f3d45e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f381a2450 con 0x7f4f200035c0 2024-05-08T23:09:57.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.534+0000 7f4f36ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f200035c0 0x7f4f380732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:57.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.534+0000 7f4f36ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f200035c0 0x7f4f380732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:36488/0 (socket says 172.21.15.195:36488) 2024-05-08T23:09:57.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.534+0000 7f4f36ffd700 1 -- 172.21.15.195:0/3020048657 learned_addr learned my addr 172.21.15.195:0/3020048657 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T23:09:57.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.534+0000 7f4f36ffd700 1 -- 172.21.15.195:0/3020048657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f200035c0 msgr2=0x7f4f380732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-08T23:09:57.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.534+0000 7f4f36ffd700 1 -- 172.21.15.195:0/3020048657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f200035c0 msgr2=0x7f4f380732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T23:09:57.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.534+0000 7f4f36ffd700 1 --2- 172.21.15.195:0/3020048657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f200035c0 0x7f4f380732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T23:09:57.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.534+0000 7f4f367fc700 1 --2- 172.21.15.195:0/3020048657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f380737e0 0x7f4f38073c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:57.535 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.534+0000 7f4f36ffd700 1 --2- 172.21.15.195:0/3020048657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f200035c0 0x7f4f380732a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:09:57.536 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.534+0000 7f4f367fc700 1 -- 172.21.15.195:0/3020048657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f200035c0 msgr2=0x7f4f380732a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:09:57.536 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.534+0000 7f4f367fc700 1 --2- 172.21.15.195:0/3020048657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f200035c0 0x7f4f380732a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:57.536 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.534+0000 7f4f367fc700 1 -- 172.21.15.195:0/3020048657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c00f900 con 0x7f4f380737e0 2024-05-08T23:09:57.536 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.534+0000 7f4f367fc700 1 --2- 172.21.15.195:0/3020048657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f380737e0 0x7f4f38073c60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800b4d0 tx=0x7f4f2800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:57.536 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.535+0000 7f4f1ffff700 1 -- 172.21.15.195:0/3020048657 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f4f28011630 con 0x7f4f380737e0 2024-05-08T23:09:57.536 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.535+0000 7f4f1ffff700 1 -- 172.21.15.195:0/3020048657 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f28011c50 con 0x7f4f380737e0 2024-05-08T23:09:57.537 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.535+0000 7f4f1ffff700 1 -- 172.21.15.195:0/3020048657 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f4f28010d90 con 0x7f4f380737e0 2024-05-08T23:09:57.537 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.535+0000 7f4f3d45e700 1 -- 172.21.15.195:0/3020048657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f381a25f0 con 0x7f4f380737e0 2024-05-08T23:09:57.537 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.535+0000 7f4f3d45e700 1 -- 172.21.15.195:0/3020048657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f381a2ac0 con 0x7f4f380737e0 2024-05-08T23:09:57.537 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.536+0000 7f4f1ffff700 1 -- 172.21.15.195:0/3020048657 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f4f2801a400 con 0x7f4f380737e0 2024-05-08T23:09:57.537 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.536+0000 7f4f3d45e700 1 -- 172.21.15.195:0/3020048657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f381900d0 con 0x7f4f380737e0 2024-05-08T23:09:57.537 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.536+0000 7f4f1ffff700 1 --2- 172.21.15.195:0/3020048657 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4f240385e0 0x7f4f2403aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:09:57.537 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.536+0000 7f4f1ffff700 1 -- 172.21.15.195:0/3020048657 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4f2804add0 con 0x7f4f380737e0 2024-05-08T23:09:57.537 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.536+0000 7f4f36ffd700 1 --2- 172.21.15.195:0/3020048657 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4f240385e0 0x7f4f2403aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:09:57.537 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.537+0000 7f4f36ffd700 1 --2- 172.21.15.195:0/3020048657 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4f240385e0 0x7f4f2403aaa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00f800 tx=0x7f4f2c001e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:09:57.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.541+0000 7f4f1ffff700 1 -- 172.21.15.195:0/3020048657 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4f28017680 con 0x7f4f380737e0 2024-05-08T23:09:57.812 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.812+0000 7f4f3d45e700 1 -- 172.21.15.195:0/3020048657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4f38102120 con 0x7f4f380737e0 2024-05-08T23:09:57.813 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.813+0000 7f4f1ffff700 1 -- 172.21.15.195:0/3020048657 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1010 (secure 0 0 0) 0x7f4f280172c0 con 0x7f4f380737e0 2024-05-08T23:09:57.813 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T23:09:57.813 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":2,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","modified":"2024-05-08T23:09:51.905243Z","created":"2024-05-08T23:08:28.973306Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-08T23:09:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.815+0000 7f4f3d45e700 1 -- 172.21.15.195:0/3020048657 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4f240385e0 msgr2=0x7f4f2403aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.815+0000 7f4f3d45e700 1 --2- 172.21.15.195:0/3020048657 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4f240385e0 0x7f4f2403aaa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00f800 tx=0x7f4f2c001e50 comp rx=0 tx=0).stop 2024-05-08T23:09:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.815+0000 7f4f3d45e700 1 -- 172.21.15.195:0/3020048657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f380737e0 msgr2=0x7f4f38073c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:09:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.815+0000 7f4f3d45e700 1 --2- 172.21.15.195:0/3020048657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f380737e0 0x7f4f38073c60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800b4d0 tx=0x7f4f2800b890 comp rx=0 tx=0).stop 2024-05-08T23:09:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.815+0000 7f4f3d45e700 1 -- 172.21.15.195:0/3020048657 shutdown_connections 2024-05-08T23:09:57.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.815+0000 7f4f3d45e700 1 --2- 172.21.15.195:0/3020048657 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4f240385e0 0x7f4f2403aaa0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:57.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.815+0000 7f4f3d45e700 1 --2- 172.21.15.195:0/3020048657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f200035c0 0x7f4f380732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:57.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.815+0000 7f4f3d45e700 1 --2- 172.21.15.195:0/3020048657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f380737e0 0x7f4f38073c60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:09:57.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.815+0000 7f4f3d45e700 1 -- 172.21.15.195:0/3020048657 >> 172.21.15.195:0/3020048657 conn(0x7f4f380fc4d0 msgr2=0x7f4f380fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:09:57.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.815+0000 7f4f3d45e700 1 -- 172.21.15.195:0/3020048657 shutdown_connections 2024-05-08T23:09:57.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:09:57.815+0000 7f4f3d45e700 1 -- 172.21.15.195:0/3020048657 wait complete. 2024-05-08T23:09:57.816 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 2 2024-05-08T23:09:58.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:57 smithi195 ceph-mon[46516]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:09:58.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:57 smithi195 ceph-mon[46516]: Deploying daemon mon.b on smithi179 2024-05-08T23:09:58.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:57 smithi195 ceph-mon[46516]: from='client.? 172.21.15.195:0/3020048657' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:09:58.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:09:57 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:09:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:57 smithi135 ceph-mon[42440]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:09:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:57 smithi135 ceph-mon[42440]: Deploying daemon mon.b on smithi179 2024-05-08T23:09:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:57 smithi135 ceph-mon[42440]: from='client.? 172.21.15.195:0/3020048657' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:09:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:09:57 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:09:59.177 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T23:09:59.178 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T23:09:59.340 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 systemd[1]: Starting Ceph mon.b for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:09:59.396 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:10:00.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: set uid:gid to 167:167 (ceph:ceph) 2024-05-08T23:10:00.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable), process ceph-mon, pid 7 2024-05-08T23:10:00.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: pidfile_write: ignore empty --pid-file 2024-05-08T23:10:00.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: load: jerasure load: lrc 2024-05-08T23:10:00.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: RocksDB version: 7.9.2 2024-05-08T23:10:00.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Git sha 0 2024-05-08T23:10:00.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Compile date 2024-05-08 17:55:50 2024-05-08T23:10:00.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: DB SUMMARY 2024-05-08T23:10:00.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: DB Session ID: O6WEZJCPGI56LFPRW07P 2024-05-08T23:10:00.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: CURRENT file: CURRENT 2024-05-08T23:10:00.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: IDENTITY file: IDENTITY 2024-05-08T23:10:00.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-08T23:10:00.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-05-08T23:10:00.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-05-08T23:10:00.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.error_if_exists: 0 2024-05-08T23:10:00.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.create_if_missing: 0 2024-05-08T23:10:00.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.paranoid_checks: 1 2024-05-08T23:10:00.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-08T23:10:00.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-08T23:10:00.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-08T23:10:00.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.env: 0x55d3b9788820 2024-05-08T23:10:00.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.fs: PosixFileSystem 2024-05-08T23:10:00.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.info_log: 0x55d3bcbe9520 2024-05-08T23:10:00.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_file_opening_threads: 16 2024-05-08T23:10:00.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.statistics: (nil) 2024-05-08T23:10:00.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.use_fsync: 0 2024-05-08T23:10:00.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_log_file_size: 0 2024-05-08T23:10:00.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-08T23:10:00.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-08T23:10:00.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.keep_log_file_num: 1000 2024-05-08T23:10:00.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.recycle_log_file_num: 0 2024-05-08T23:10:00.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.allow_fallocate: 1 2024-05-08T23:10:00.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.allow_mmap_reads: 0 2024-05-08T23:10:00.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.allow_mmap_writes: 0 2024-05-08T23:10:00.103 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.use_direct_reads: 0 2024-05-08T23:10:00.103 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-08T23:10:00.103 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.create_missing_column_families: 0 2024-05-08T23:10:00.103 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.db_log_dir: 2024-05-08T23:10:00.103 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.wal_dir: 2024-05-08T23:10:00.103 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-08T23:10:00.103 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-08T23:10:00.103 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-08T23:10:00.103 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-08T23:10:00.103 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-08T23:10:00.103 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-08T23:10:00.103 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.advise_random_on_open: 1 2024-05-08T23:10:00.103 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.db_write_buffer_size: 0 2024-05-08T23:10:00.103 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.write_buffer_manager: 0x55d3bbe7e320 2024-05-08T23:10:00.104 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-08T23:10:00.104 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-08T23:10:00.104 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-08T23:10:00.104 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.rate_limiter: (nil) 2024-05-08T23:10:00.104 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-08T23:10:00.104 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.wal_recovery_mode: 2 2024-05-08T23:10:00.104 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.enable_thread_tracking: 0 2024-05-08T23:10:00.104 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.enable_pipelined_write: 0 2024-05-08T23:10:00.104 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.unordered_write: 0 2024-05-08T23:10:00.104 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-08T23:10:00.104 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-08T23:10:00.104 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-08T23:10:00.104 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-08T23:10:00.104 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.row_cache: None 2024-05-08T23:10:00.104 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.wal_filter: None 2024-05-08T23:10:00.105 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-08T23:10:00.105 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.allow_ingest_behind: 0 2024-05-08T23:10:00.105 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.two_write_queues: 0 2024-05-08T23:10:00.105 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.manual_wal_flush: 0 2024-05-08T23:10:00.105 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.wal_compression: 0 2024-05-08T23:10:00.105 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.atomic_flush: 0 2024-05-08T23:10:00.105 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-08T23:10:00.105 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-08T23:10:00.105 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-08T23:10:00.105 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.log_readahead_size: 0 2024-05-08T23:10:00.105 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-08T23:10:00.105 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.best_efforts_recovery: 0 2024-05-08T23:10:00.105 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-08T23:10:00.105 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-08T23:10:00.106 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.allow_data_in_errors: 0 2024-05-08T23:10:00.106 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.db_host_id: __hostname__ 2024-05-08T23:10:00.106 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-08T23:10:00.107 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_background_jobs: 2 2024-05-08T23:10:00.108 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_background_compactions: -1 2024-05-08T23:10:00.108 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_subcompactions: 1 2024-05-08T23:10:00.108 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-08T23:10:00.108 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-08T23:10:00.108 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-08T23:10:00.108 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_total_wal_size: 0 2024-05-08T23:10:00.108 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-08T23:10:00.108 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-08T23:10:00.108 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-08T23:10:00.108 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-08T23:10:00.108 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_open_files: -1 2024-05-08T23:10:00.108 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.bytes_per_sync: 0 2024-05-08T23:10:00.108 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-08T23:10:00.109 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-08T23:10:00.109 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compaction_readahead_size: 0 2024-05-08T23:10:00.109 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_background_flushes: -1 2024-05-08T23:10:00.109 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Compression algorithms supported: 2024-05-08T23:10:00.109 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-08T23:10:00.109 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: kZSTD supported: 0 2024-05-08T23:10:00.109 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: kXpressCompression supported: 0 2024-05-08T23:10:00.109 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: kLZ4HCCompression supported: 1 2024-05-08T23:10:00.109 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: kZlibCompression supported: 1 2024-05-08T23:10:00.109 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: kSnappyCompression supported: 1 2024-05-08T23:10:00.109 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: kLZ4Compression supported: 1 2024-05-08T23:10:00.109 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: kBZip2Compression supported: 0 2024-05-08T23:10:00.109 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-08T23:10:00.109 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-08T23:10:00.109 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-05-08T23:10:00.110 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-08T23:10:00.110 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-08T23:10:00.110 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.merge_operator: 2024-05-08T23:10:00.110 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compaction_filter: None 2024-05-08T23:10:00.110 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compaction_filter_factory: None 2024-05-08T23:10:00.110 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.sst_partitioner_factory: None 2024-05-08T23:10:00.110 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-08T23:10:00.110 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-08T23:10:00.110 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d3bcbe9620) 2024-05-08T23:10:00.110 INFO:journalctl@ceph.mon.b.smithi179.stdout: cache_index_and_filter_blocks: 1 2024-05-08T23:10:00.110 INFO:journalctl@ceph.mon.b.smithi179.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-08T23:10:00.110 INFO:journalctl@ceph.mon.b.smithi179.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-08T23:10:00.110 INFO:journalctl@ceph.mon.b.smithi179.stdout: pin_top_level_index_and_filter: 1 2024-05-08T23:10:00.110 INFO:journalctl@ceph.mon.b.smithi179.stdout: index_type: 0 2024-05-08T23:10:00.110 INFO:journalctl@ceph.mon.b.smithi179.stdout: data_block_index_type: 0 2024-05-08T23:10:00.111 INFO:journalctl@ceph.mon.b.smithi179.stdout: index_shortening: 1 2024-05-08T23:10:00.111 INFO:journalctl@ceph.mon.b.smithi179.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-08T23:10:00.111 INFO:journalctl@ceph.mon.b.smithi179.stdout: checksum: 4 2024-05-08T23:10:00.111 INFO:journalctl@ceph.mon.b.smithi179.stdout: no_block_cache: 0 2024-05-08T23:10:00.111 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_cache: 0x55d3bbf011f0 2024-05-08T23:10:00.111 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_cache_name: BinnedLRUCache 2024-05-08T23:10:00.111 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_cache_options: 2024-05-08T23:10:00.111 INFO:journalctl@ceph.mon.b.smithi179.stdout: capacity : 536870912 2024-05-08T23:10:00.111 INFO:journalctl@ceph.mon.b.smithi179.stdout: num_shard_bits : 4 2024-05-08T23:10:00.111 INFO:journalctl@ceph.mon.b.smithi179.stdout: strict_capacity_limit : 0 2024-05-08T23:10:00.111 INFO:journalctl@ceph.mon.b.smithi179.stdout: high_pri_pool_ratio: 0.000 2024-05-08T23:10:00.112 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_cache_compressed: (nil) 2024-05-08T23:10:00.112 INFO:journalctl@ceph.mon.b.smithi179.stdout: persistent_cache: (nil) 2024-05-08T23:10:00.112 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_size: 4096 2024-05-08T23:10:00.112 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_size_deviation: 10 2024-05-08T23:10:00.112 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_restart_interval: 16 2024-05-08T23:10:00.112 INFO:journalctl@ceph.mon.b.smithi179.stdout: index_block_restart_interval: 1 2024-05-08T23:10:00.112 INFO:journalctl@ceph.mon.b.smithi179.stdout: metadata_block_size: 4096 2024-05-08T23:10:00.112 INFO:journalctl@ceph.mon.b.smithi179.stdout: partition_filters: 0 2024-05-08T23:10:00.112 INFO:journalctl@ceph.mon.b.smithi179.stdout: use_delta_encoding: 1 2024-05-08T23:10:00.112 INFO:journalctl@ceph.mon.b.smithi179.stdout: filter_policy: bloomfilter 2024-05-08T23:10:00.112 INFO:journalctl@ceph.mon.b.smithi179.stdout: whole_key_filtering: 1 2024-05-08T23:10:00.112 INFO:journalctl@ceph.mon.b.smithi179.stdout: verify_compression: 0 2024-05-08T23:10:00.112 INFO:journalctl@ceph.mon.b.smithi179.stdout: read_amp_bytes_per_bit: 0 2024-05-08T23:10:00.112 INFO:journalctl@ceph.mon.b.smithi179.stdout: format_version: 5 2024-05-08T23:10:00.112 INFO:journalctl@ceph.mon.b.smithi179.stdout: enable_index_compression: 1 2024-05-08T23:10:00.113 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_align: 0 2024-05-08T23:10:00.113 INFO:journalctl@ceph.mon.b.smithi179.stdout: max_auto_readahead_size: 262144 2024-05-08T23:10:00.113 INFO:journalctl@ceph.mon.b.smithi179.stdout: prepopulate_block_cache: 0 2024-05-08T23:10:00.113 INFO:journalctl@ceph.mon.b.smithi179.stdout: initial_auto_readahead_size: 8192 2024-05-08T23:10:00.113 INFO:journalctl@ceph.mon.b.smithi179.stdout: num_file_reads_for_auto_readahead: 2 2024-05-08T23:10:00.113 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.write_buffer_size: 33554432 2024-05-08T23:10:00.113 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_write_buffer_number: 2 2024-05-08T23:10:00.113 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compression: NoCompression 2024-05-08T23:10:00.113 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.bottommost_compression: Disabled 2024-05-08T23:10:00.113 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.prefix_extractor: nullptr 2024-05-08T23:10:00.114 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-08T23:10:00.114 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.num_levels: 7 2024-05-08T23:10:00.114 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-08T23:10:00.114 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-08T23:10:00.114 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-08T23:10:00.114 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-08T23:10:00.114 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-08T23:10:00.114 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-08T23:10:00.114 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-08T23:10:00.114 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-08T23:10:00.114 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-08T23:10:00.114 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-08T23:10:00.114 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-08T23:10:00.114 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-08T23:10:00.115 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-08T23:10:00.115 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compression_opts.level: 32767 2024-05-08T23:10:00.115 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compression_opts.strategy: 0 2024-05-08T23:10:00.115 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-08T23:10:00.115 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-08T23:10:00.115 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-08T23:10:00.115 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-08T23:10:00.115 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compression_opts.enabled: false 2024-05-08T23:10:00.115 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-08T23:10:00.115 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-08T23:10:00.115 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-08T23:10:00.115 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-08T23:10:00.115 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.target_file_size_base: 67108864 2024-05-08T23:10:00.115 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-08T23:10:00.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-08T23:10:00.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-08T23:10:00.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-08T23:10:00.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-08T23:10:00.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-08T23:10:00.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-08T23:10:00.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-08T23:10:00.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-08T23:10:00.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-08T23:10:00.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-08T23:10:00.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-08T23:10:00.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-08T23:10:00.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-08T23:10:00.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.arena_block_size: 1048576 2024-05-08T23:10:00.116 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-08T23:10:00.117 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-08T23:10:00.117 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.disable_auto_compactions: 0 2024-05-08T23:10:00.117 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-08T23:10:00.117 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-08T23:10:00.117 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-08T23:10:00.117 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-08T23:10:00.117 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-08T23:10:00.117 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-08T23:10:00.117 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-08T23:10:00.117 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-08T23:10:00.117 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-08T23:10:00.117 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-08T23:10:00.117 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.table_properties_collectors: 2024-05-08T23:10:00.117 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.inplace_update_support: 0 2024-05-08T23:10:00.117 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-08T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-08T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-08T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-08T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.bloom_locality: 0 2024-05-08T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.max_successive_merges: 0 2024-05-08T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-08T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.paranoid_file_checks: 0 2024-05-08T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.force_consistency_checks: 1 2024-05-08T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.report_bg_io_stats: 0 2024-05-08T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.ttl: 2592000 2024-05-08T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-08T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-08T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-08T23:10:00.118 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.enable_blob_files: false 2024-05-08T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.min_blob_size: 0 2024-05-08T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.blob_file_size: 268435456 2024-05-08T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-08T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-08T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-08T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-08T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-08T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.blob_file_starting_level: 0 2024-05-08T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-08T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-08T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 bash[46276]: ef602f1c2127273312a0d2dac93fc1326f0430a34f90865f2a98d29dcd996494 2024-05-08T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-08T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0ef94bca-9fbc-4ee0-9fbc-ca2dde45271c 2024-05-08T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715209799667851, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-08T23:10:00.119 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-08T23:10:00.120 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715209799668297, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715209799, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0ef94bca-9fbc-4ee0-9fbc-ca2dde45271c", "db_session_id": "O6WEZJCPGI56LFPRW07P", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-08T23:10:00.120 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715209799668371, "job": 1, "event": "recovery_finished"} 2024-05-08T23:10:00.120 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-08T23:10:00.120 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-08T23:10:00.120 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d3bbf9e000 2024-05-08T23:10:00.120 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: DB pointer 0x55d3bbf8c000 2024-05-08T23:10:00.120 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-08T23:10:00.120 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-08T23:10:00.120 INFO:journalctl@ceph.mon.b.smithi179.stdout: ** DB Stats ** 2024-05-08T23:10:00.120 INFO:journalctl@ceph.mon.b.smithi179.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T23:10:00.120 INFO:journalctl@ceph.mon.b.smithi179.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-08T23:10:00.120 INFO:journalctl@ceph.mon.b.smithi179.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T23:10:00.120 INFO:journalctl@ceph.mon.b.smithi179.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T23:10:00.121 INFO:journalctl@ceph.mon.b.smithi179.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-08T23:10:00.121 INFO:journalctl@ceph.mon.b.smithi179.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T23:10:00.121 INFO:journalctl@ceph.mon.b.smithi179.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T23:10:00.121 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-05-08T23:10:00.121 INFO:journalctl@ceph.mon.b.smithi179.stdout: ** Compaction Stats [default] ** 2024-05-08T23:10:00.121 INFO:journalctl@ceph.mon.b.smithi179.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T23:10:00.121 INFO:journalctl@ceph.mon.b.smithi179.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-08T23:10:00.121 INFO:journalctl@ceph.mon.b.smithi179.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T23:10:00.121 INFO:journalctl@ceph.mon.b.smithi179.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T23:10:00.121 INFO:journalctl@ceph.mon.b.smithi179.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T23:10:00.121 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-05-08T23:10:00.121 INFO:journalctl@ceph.mon.b.smithi179.stdout: ** Compaction Stats [default] ** 2024-05-08T23:10:00.121 INFO:journalctl@ceph.mon.b.smithi179.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T23:10:00.122 INFO:journalctl@ceph.mon.b.smithi179.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T23:10:00.122 INFO:journalctl@ceph.mon.b.smithi179.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T23:10:00.122 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-05-08T23:10:00.122 INFO:journalctl@ceph.mon.b.smithi179.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-08T23:10:00.122 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-05-08T23:10:00.122 INFO:journalctl@ceph.mon.b.smithi179.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T23:10:00.122 INFO:journalctl@ceph.mon.b.smithi179.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T23:10:00.122 INFO:journalctl@ceph.mon.b.smithi179.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T23:10:00.122 INFO:journalctl@ceph.mon.b.smithi179.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T23:10:00.123 INFO:journalctl@ceph.mon.b.smithi179.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T23:10:00.123 INFO:journalctl@ceph.mon.b.smithi179.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-08T23:10:00.123 INFO:journalctl@ceph.mon.b.smithi179.stdout: Cumulative compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:10:00.123 INFO:journalctl@ceph.mon.b.smithi179.stdout: Interval compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:10:00.123 INFO:journalctl@ceph.mon.b.smithi179.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T23:10:00.123 INFO:journalctl@ceph.mon.b.smithi179.stdout: Block cache BinnedLRUCache@0x55d3bbf011f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-05-08T23:10:00.123 INFO:journalctl@ceph.mon.b.smithi179.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-08T23:10:00.123 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-05-08T23:10:00.123 INFO:journalctl@ceph.mon.b.smithi179.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-08T23:10:00.123 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-05-08T23:10:00.124 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: using public_addr v2:172.21.15.179:0/0 -> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-05-08T23:10:00.124 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: starting mon.b rank -1 at public addrs [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] at bind addrs [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:10:00.124 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.b@-1(???) e0 preinit fsid c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:10:00.124 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 systemd[1]: Started Ceph mon.b for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:10:00.124 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.b@-1(synchronizing).mds e1 new map 2024-05-08T23:10:00.124 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-08T23:10:00.124 INFO:journalctl@ceph.mon.b.smithi179.stdout: e1 2024-05-08T23:10:00.124 INFO:journalctl@ceph.mon.b.smithi179.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T23:10:00.124 INFO:journalctl@ceph.mon.b.smithi179.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-08T23:10:00.124 INFO:journalctl@ceph.mon.b.smithi179.stdout: legacy client fscid: -1 2024-05-08T23:10:00.124 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-05-08T23:10:00.124 INFO:journalctl@ceph.mon.b.smithi179.stdout: No filesystems configured 2024-05-08T23:10:00.124 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-08T23:10:00.124 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-08T23:10:00.125 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-08T23:10:00.125 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-08T23:10:00.125 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-08T23:10:00.125 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-08T23:10:00.125 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-08T23:10:00.125 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:10:00.125 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:10:00.125 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:10:00.125 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi135:172.21.15.135=a;smithi179:172.21.15.179=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:10:00.125 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: Saving service mon spec with placement smithi135:172.21.15.135=a;smithi179:172.21.15.179=b;smithi195:172.21.15.195=c;count:3 2024-05-08T23:10:00.125 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:00.125 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:00.125 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:00.125 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:00.125 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:00.126 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:10:00.126 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:00.126 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: Deploying daemon mon.c on smithi195 2024-05-08T23:10:00.126 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:00.126 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:10:00.126 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.a calling monitor election 2024-05-08T23:10:00.126 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:10:00.126 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:10:00.126 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:00.126 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:10:00.126 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.c calling monitor election 2024-05-08T23:10:00.126 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:10:00.126 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:00.126 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:10:00.126 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:10:00.127 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T23:10:00.127 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: monmap e2: 2 mons at {a=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:10:00.127 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: fsmap 2024-05-08T23:10:00.127 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:10:00.127 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mgrmap e13: x(active, since 35s) 2024-05-08T23:10:00.127 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: overall HEALTH_OK 2024-05-08T23:10:00.127 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:00.127 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:00.127 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:00.127 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:10:00.127 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:00.128 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:00.128 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: Deploying daemon mon.b on smithi179 2024-05-08T23:10:00.128 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='client.? 172.21.15.195:0/3020048657' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:10:00.128 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:10:00.128 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:09:59 smithi179 ceph-mon[46314]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-08T23:10:04.760 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.760+0000 7f9123e8c700 1 -- 172.21.15.195:0/488793739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f911c1058c0 msgr2=0x7f9108007820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:04.760 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.760+0000 7f9123e8c700 1 --2- 172.21.15.195:0/488793739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f911c1058c0 0x7f9108007820 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f910c005fa0 tx=0x7f910c00ff70 comp rx=0 tx=0).stop 2024-05-08T23:10:04.760 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.760+0000 7f9123e8c700 1 -- 172.21.15.195:0/488793739 shutdown_connections 2024-05-08T23:10:04.760 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.760+0000 7f9123e8c700 1 --2- 172.21.15.195:0/488793739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f911c1058c0 0x7f9108007820 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:04.761 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.760+0000 7f9123e8c700 1 -- 172.21.15.195:0/488793739 >> 172.21.15.195:0/488793739 conn(0x7f911c076570 msgr2=0x7f911c0fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:10:04.761 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.760+0000 7f9123e8c700 1 -- 172.21.15.195:0/488793739 shutdown_connections 2024-05-08T23:10:04.761 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.760+0000 7f9123e8c700 1 -- 172.21.15.195:0/488793739 wait complete. 2024-05-08T23:10:04.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.761+0000 7f9123e8c700 1 Processor -- start 2024-05-08T23:10:04.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.761+0000 7f9123e8c700 1 -- start start 2024-05-08T23:10:04.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.761+0000 7f9123e8c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f911c1058c0 0x7f911c194080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:04.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.761+0000 7f9123e8c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f911c1945c0 0x7f911c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:04.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.761+0000 7f9123e8c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c198eb0 0x7f911c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:04.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.761+0000 7f9123e8c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c194cb0 con 0x7f911c1058c0 2024-05-08T23:10:04.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.761+0000 7f9123e8c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c1a0c20 con 0x7f911c198eb0 2024-05-08T23:10:04.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.761+0000 7f9123e8c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c1a0d60 con 0x7f911c1945c0 2024-05-08T23:10:04.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.761+0000 7f9121427700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f911c1945c0 0x7f911c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:04.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.761+0000 7f9121427700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f911c1945c0 0x7f911c198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:36490/0 (socket says 172.21.15.195:36490) 2024-05-08T23:10:04.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.761+0000 7f9121427700 1 -- 172.21.15.195:0/1763386428 learned_addr learned my addr 172.21.15.195:0/1763386428 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T23:10:04.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.761+0000 7f9121c28700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f911c1058c0 0x7f911c194080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:04.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9121427700 1 -- 172.21.15.195:0/1763386428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f911c1945c0 msgr2=0x7f911c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-08T23:10:04.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9121427700 1 -- 172.21.15.195:0/1763386428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f911c1945c0 msgr2=0x7f911c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T23:10:04.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9121427700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f911c1945c0 0x7f911c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T23:10:04.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9122429700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c198eb0 0x7f911c199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:04.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9121427700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f911c1945c0 0x7f911c198970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:10:04.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9122429700 1 -- 172.21.15.195:0/1763386428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c198eb0 msgr2=0x7f911c199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-05-08T23:10:04.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9122429700 1 -- 172.21.15.195:0/1763386428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c198eb0 msgr2=0x7f911c199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T23:10:04.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9122429700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c198eb0 0x7f911c199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T23:10:04.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9121c28700 1 -- 172.21.15.195:0/1763386428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f911c1945c0 msgr2=0x7f911c198970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:10:04.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9121c28700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f911c1945c0 0x7f911c198970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:04.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9121c28700 1 -- 172.21.15.195:0/1763386428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c198eb0 msgr2=0x7f911c199360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:10:04.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9122429700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c198eb0 0x7f911c199360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:10:04.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9121c28700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c198eb0 0x7f911c199360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:04.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9121c28700 1 -- 172.21.15.195:0/1763386428 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c00f970 con 0x7f911c1058c0 2024-05-08T23:10:04.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9121c28700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f911c1058c0 0x7f911c194080 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f910c01f000 tx=0x7f910c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:10:04.765 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9112ffd700 1 -- 172.21.15.195:0/1763386428 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c012e40 con 0x7f911c1058c0 2024-05-08T23:10:04.765 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9112ffd700 1 -- 172.21.15.195:0/1763386428 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f910c004230 con 0x7f911c1058c0 2024-05-08T23:10:04.765 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9123e8c700 1 -- 172.21.15.195:0/1763386428 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911c1a0fe0 con 0x7f911c1058c0 2024-05-08T23:10:04.765 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9112ffd700 1 -- 172.21.15.195:0/1763386428 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c01d6a0 con 0x7f911c1058c0 2024-05-08T23:10:04.765 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.762+0000 7f9123e8c700 1 -- 172.21.15.195:0/1763386428 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911c1a13f0 con 0x7f911c1058c0 2024-05-08T23:10:04.766 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.763+0000 7f9112ffd700 1 -- 172.21.15.195:0/1763386428 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f910c024050 con 0x7f911c1058c0 2024-05-08T23:10:04.766 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.763+0000 7f9112ffd700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9100038c70 0x7f910003b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:04.766 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.764+0000 7f9112ffd700 1 -- 172.21.15.195:0/1763386428 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f910c04e090 con 0x7f911c1058c0 2024-05-08T23:10:04.766 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.764+0000 7f9123e8c700 1 -- 172.21.15.195:0/1763386428 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911c18ddc0 con 0x7f911c1058c0 2024-05-08T23:10:04.766 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.764+0000 7f9121427700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9100038c70 0x7f910003b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:04.766 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.764+0000 7f9121427700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9100038c70 0x7f910003b130 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9118009180 tx=0x7f9118008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:10:04.769 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:04.769+0000 7f9112ffd700 1 -- 172.21.15.195:0/1763386428 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f910c022080 con 0x7f911c1058c0 2024-05-08T23:10:05.062 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:05.062+0000 7f9123e8c700 1 -- 172.21.15.195:0/1763386428 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f911c0625d0 con 0x7f911c1058c0 2024-05-08T23:10:05.063 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:05.063+0000 7f9112ffd700 1 -- 172.21.15.195:0/1763386428 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1278 (secure 0 0 0) 0x7f910c02b020 con 0x7f911c1058c0 2024-05-08T23:10:05.063 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T23:10:05.063 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":3,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","modified":"2024-05-08T23:09:59.698685Z","created":"2024-05-08T23:08:28.973306Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:3300","nonce":0},{"type":"v1","addr":"172.21.15.179:6789","nonce":0}]},"addr":"172.21.15.179:6789/0","public_addr":"172.21.15.179:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-08T23:10:05.067 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:05.066+0000 7f9123e8c700 1 -- 172.21.15.195:0/1763386428 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9100038c70 msgr2=0x7f910003b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:05.067 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:05.066+0000 7f9123e8c700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9100038c70 0x7f910003b130 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9118009180 tx=0x7f9118008040 comp rx=0 tx=0).stop 2024-05-08T23:10:05.067 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:05.066+0000 7f9123e8c700 1 -- 172.21.15.195:0/1763386428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f911c1058c0 msgr2=0x7f911c194080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:05.067 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:05.066+0000 7f9123e8c700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f911c1058c0 0x7f911c194080 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f910c01f000 tx=0x7f910c015000 comp rx=0 tx=0).stop 2024-05-08T23:10:05.067 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:05.066+0000 7f9123e8c700 1 -- 172.21.15.195:0/1763386428 shutdown_connections 2024-05-08T23:10:05.067 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:05.066+0000 7f9123e8c700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9100038c70 0x7f910003b130 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:05.067 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:05.066+0000 7f9123e8c700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c198eb0 0x7f911c199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:05.067 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:05.066+0000 7f9123e8c700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f911c1058c0 0x7f911c194080 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:05.067 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:05.066+0000 7f9123e8c700 1 --2- 172.21.15.195:0/1763386428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f911c1945c0 0x7f911c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:05.067 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:05.066+0000 7f9123e8c700 1 -- 172.21.15.195:0/1763386428 >> 172.21.15.195:0/1763386428 conn(0x7f911c076570 msgr2=0x7f911c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:10:05.067 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:05.066+0000 7f9123e8c700 1 -- 172.21.15.195:0/1763386428 shutdown_connections 2024-05-08T23:10:05.067 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:05.066+0000 7f9123e8c700 1 -- 172.21.15.195:0/1763386428 wait complete. 2024-05-08T23:10:05.068 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 3 2024-05-08T23:10:05.090 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: mon.c calling monitor election 2024-05-08T23:10:05.090 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:10:05.090 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: mon.a calling monitor election 2024-05-08T23:10:05.090 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:10:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T23:10:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: monmap e3: 3 mons at {a=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],b=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:10:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: fsmap 2024-05-08T23:10:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:10:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: mgrmap e13: x(active, since 43s) 2024-05-08T23:10:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-05-08T23:10:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-05-08T23:10:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-05-08T23:10:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: mon.b (rank 2) addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] is down (out of quorum) 2024-05-08T23:10:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:05.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: mon.c calling monitor election 2024-05-08T23:10:05.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:10:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: mon.a calling monitor election 2024-05-08T23:10:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:10:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T23:10:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: monmap e3: 3 mons at {a=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],b=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:10:05.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: fsmap 2024-05-08T23:10:05.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:10:05.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: mgrmap e13: x(active, since 43s) 2024-05-08T23:10:05.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-05-08T23:10:05.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-05-08T23:10:05.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-05-08T23:10:05.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: mon.b (rank 2) addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] is down (out of quorum) 2024-05-08T23:10:05.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:05.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:05.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:05.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:05.506 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-08T23:10:05.506 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-08T23:10:05.742 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:10:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:05 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:05 smithi195 ceph-mon[46516]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:05 smithi195 ceph-mon[46516]: from='client.? 172.21.15.195:0/1763386428' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:10:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:05 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:05 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:05 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:06.150 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:05 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:06.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:05 smithi135 ceph-mon[42440]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:06.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:05 smithi135 ceph-mon[42440]: from='client.? 172.21.15.195:0/1763386428' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:10:06.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:05 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:06.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:05 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:06.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:05 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:06.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.926+0000 7fa830f63700 1 -- 172.21.15.135:0/2320066682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa82c101a80 msgr2=0x7fa82c101e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:06.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.926+0000 7fa830f63700 1 --2- 172.21.15.135:0/2320066682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa82c101a80 0x7fa82c101e60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00ba60 tx=0x7fa81c00bd70 comp rx=0 tx=0).stop 2024-05-08T23:10:06.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.926+0000 7fa830f63700 1 -- 172.21.15.135:0/2320066682 shutdown_connections 2024-05-08T23:10:06.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.926+0000 7fa830f63700 1 --2- 172.21.15.135:0/2320066682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa82c101a80 0x7fa82c101e60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:06.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.926+0000 7fa830f63700 1 -- 172.21.15.135:0/2320066682 >> 172.21.15.135:0/2320066682 conn(0x7fa82c076450 msgr2=0x7fa82c0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:10:06.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.926+0000 7fa830f63700 1 -- 172.21.15.135:0/2320066682 shutdown_connections 2024-05-08T23:10:06.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.926+0000 7fa830f63700 1 -- 172.21.15.135:0/2320066682 wait complete. 2024-05-08T23:10:06.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.927+0000 7fa830f63700 1 Processor -- start 2024-05-08T23:10:06.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.927+0000 7fa830f63700 1 -- start start 2024-05-08T23:10:06.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.927+0000 7fa830f63700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82c101a80 0x7fa82c1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:06.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.927+0000 7fa830f63700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa82c1968e0 0x7fa82c19ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:06.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.927+0000 7fa830f63700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa82c19b1d0 0x7fa82c19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:06.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.927+0000 7fa830f63700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c196fd0 con 0x7fa82c1968e0 2024-05-08T23:10:06.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.927+0000 7fa830f63700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c1a2f40 con 0x7fa82c101a80 2024-05-08T23:10:06.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.927+0000 7fa830f63700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c1a3080 con 0x7fa82c19b1d0 2024-05-08T23:10:06.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.927+0000 7fa829d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa82c1968e0 0x7fa82c19ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:06.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.928+0000 7fa829d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa82c1968e0 0x7fa82c19ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36586/0 (socket says 172.21.15.135:36586) 2024-05-08T23:10:06.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.928+0000 7fa829d9b700 1 -- 172.21.15.135:0/2540163927 learned_addr learned my addr 172.21.15.135:0/2540163927 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:10:06.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.928+0000 7fa82a59c700 1 --2- 172.21.15.135:0/2540163927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82c101a80 0x7fa82c1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:06.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.928+0000 7fa82ad9d700 1 --2- 172.21.15.135:0/2540163927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa82c19b1d0 0x7fa82c19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:06.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.928+0000 7fa829d9b700 1 -- 172.21.15.135:0/2540163927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa82c19b1d0 msgr2=0x7fa82c19b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:06.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.928+0000 7fa829d9b700 1 --2- 172.21.15.135:0/2540163927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa82c19b1d0 0x7fa82c19b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:06.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.928+0000 7fa829d9b700 1 -- 172.21.15.135:0/2540163927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82c101a80 msgr2=0x7fa82c1963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:06.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.928+0000 7fa829d9b700 1 --2- 172.21.15.135:0/2540163927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82c101a80 0x7fa82c1963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:06.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.928+0000 7fa829d9b700 1 -- 172.21.15.135:0/2540163927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c00b740 con 0x7fa82c1968e0 2024-05-08T23:10:06.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.928+0000 7fa829d9b700 1 --2- 172.21.15.135:0/2540163927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa82c1968e0 0x7fa82c19ac90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa82000b780 tx=0x7fa82000ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:10:06.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.928+0000 7fa81b7fe700 1 -- 172.21.15.135:0/2540163927 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa820004230 con 0x7fa82c1968e0 2024-05-08T23:10:06.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.928+0000 7fa81b7fe700 1 -- 172.21.15.135:0/2540163927 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa820004390 con 0x7fa82c1968e0 2024-05-08T23:10:06.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.928+0000 7fa830f63700 1 -- 172.21.15.135:0/2540163927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82c1a3360 con 0x7fa82c1968e0 2024-05-08T23:10:06.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.928+0000 7fa81b7fe700 1 -- 172.21.15.135:0/2540163927 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa820011ad0 con 0x7fa82c1968e0 2024-05-08T23:10:06.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.928+0000 7fa830f63700 1 -- 172.21.15.135:0/2540163927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c1a3860 con 0x7fa82c1968e0 2024-05-08T23:10:06.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.929+0000 7fa81b7fe700 1 -- 172.21.15.135:0/2540163927 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7fa820011c30 con 0x7fa82c1968e0 2024-05-08T23:10:06.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.929+0000 7fa81b7fe700 1 --2- 172.21.15.135:0/2540163927 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa814038c70 0x7fa81403b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:06.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.929+0000 7fa81b7fe700 1 -- 172.21.15.135:0/2540163927 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa820004500 con 0x7fa82c1968e0 2024-05-08T23:10:06.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.929+0000 7fa82a59c700 1 --2- 172.21.15.135:0/2540163927 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa814038c70 0x7fa81403b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:06.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.930+0000 7fa830f63700 1 -- 172.21.15.135:0/2540163927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82c068980 con 0x7fa82c1968e0 2024-05-08T23:10:06.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.930+0000 7fa82a59c700 1 --2- 172.21.15.135:0/2540163927 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa814038c70 0x7fa81403b130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa81c000c00 tx=0x7fa81c005c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:10:06.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:06.935+0000 7fa81b7fe700 1 -- 172.21.15.135:0/2540163927 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa82001a400 con 0x7fa82c1968e0 2024-05-08T23:10:07.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: mon.c calling monitor election 2024-05-08T23:10:07.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:10:07.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: mon.a calling monitor election 2024-05-08T23:10:07.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:07.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:10:07.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:07.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:07.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:07.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:07.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:07.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:07.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:07.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T23:10:07.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: monmap e3: 3 mons at {a=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],b=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:10:07.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: fsmap 2024-05-08T23:10:07.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:10:07.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: mgrmap e13: x(active, since 43s) 2024-05-08T23:10:07.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-05-08T23:10:07.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-05-08T23:10:07.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-05-08T23:10:07.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: mon.b (rank 2) addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] is down (out of quorum) 2024-05-08T23:10:07.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:07.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:07.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:07.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:07.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:07.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:07.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='client.? 172.21.15.195:0/1763386428' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:10:07.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:07.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:07.102 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:07.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:07.145+0000 7fa830f63700 1 -- 172.21.15.135:0/2540163927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fa82c10ac00 con 0x7fa82c1968e0 2024-05-08T23:10:07.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:07.145+0000 7fa81b7fe700 1 -- 172.21.15.135:0/2540163927 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+277 (secure 0 0 0) 0x7fa82003e030 con 0x7fa82c1968e0 2024-05-08T23:10:07.146 INFO:teuthology.orchestra.run.smithi135.stdout:# minimal ceph.conf for c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:10:07.146 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2024-05-08T23:10:07.146 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:10:07.146 INFO:teuthology.orchestra.run.smithi135.stdout: mon_host = [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] 2024-05-08T23:10:07.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:07.147+0000 7fa830f63700 1 -- 172.21.15.135:0/2540163927 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa814038c70 msgr2=0x7fa81403b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:07.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:07.147+0000 7fa830f63700 1 --2- 172.21.15.135:0/2540163927 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa814038c70 0x7fa81403b130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa81c000c00 tx=0x7fa81c005c60 comp rx=0 tx=0).stop 2024-05-08T23:10:07.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:07.147+0000 7fa830f63700 1 -- 172.21.15.135:0/2540163927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa82c1968e0 msgr2=0x7fa82c19ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:07.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:07.147+0000 7fa830f63700 1 --2- 172.21.15.135:0/2540163927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa82c1968e0 0x7fa82c19ac90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa82000b780 tx=0x7fa82000ba90 comp rx=0 tx=0).stop 2024-05-08T23:10:07.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:07.147+0000 7fa830f63700 1 -- 172.21.15.135:0/2540163927 shutdown_connections 2024-05-08T23:10:07.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:07.147+0000 7fa830f63700 1 --2- 172.21.15.135:0/2540163927 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa814038c70 0x7fa81403b130 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:07.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:07.147+0000 7fa830f63700 1 --2- 172.21.15.135:0/2540163927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa82c19b1d0 0x7fa82c19b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:07.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:07.147+0000 7fa830f63700 1 --2- 172.21.15.135:0/2540163927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa82c101a80 0x7fa82c1963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:07.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:07.147+0000 7fa830f63700 1 --2- 172.21.15.135:0/2540163927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa82c1968e0 0x7fa82c19ac90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:07.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:07.147+0000 7fa830f63700 1 -- 172.21.15.135:0/2540163927 >> 172.21.15.135:0/2540163927 conn(0x7fa82c076450 msgr2=0x7fa82c104840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:10:07.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:07.148+0000 7fa830f63700 1 -- 172.21.15.135:0/2540163927 shutdown_connections 2024-05-08T23:10:07.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:07.148+0000 7fa830f63700 1 -- 172.21.15.135:0/2540163927 wait complete. 2024-05-08T23:10:07.589 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-08T23:10:07.589 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:10:07.589 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T23:10:07.619 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:10:07.619 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:10:07.686 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-05-08T23:10:07.686 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T23:10:07.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: mon.b calling monitor election 2024-05-08T23:10:07.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: Updating smithi135:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:10:07.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: Updating smithi195:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:10:07.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: Updating smithi179:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:10:07.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: mon.b calling monitor election 2024-05-08T23:10:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: mon.c calling monitor election 2024-05-08T23:10:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: mon.a calling monitor election 2024-05-08T23:10:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T23:10:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: monmap e3: 3 mons at {a=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],b=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:10:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: fsmap 2024-05-08T23:10:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:10:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: mgrmap e13: x(active, since 45s) 2024-05-08T23:10:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-05-08T23:10:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: Cluster is now healthy 2024-05-08T23:10:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: overall HEALTH_OK 2024-05-08T23:10:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:07.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:07.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:07.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T23:10:07.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:10:07.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T23:10:07.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:07.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: Reconfiguring daemon mon.a on smithi135 2024-05-08T23:10:07.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:07.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:07 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2540163927' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:07.722 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-05-08T23:10:07.723 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:10:07.793 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T23:10:07.793 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T23:10:07.828 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T23:10:07.829 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:10:07.900 INFO:tasks.cephadm:Adding mgr.x on smithi135 2024-05-08T23:10:07.901 INFO:tasks.cephadm:Adding mgr.y on smithi179 2024-05-08T23:10:07.901 INFO:tasks.cephadm:Adding mgr.z on smithi195 2024-05-08T23:10:07.901 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch apply mgr '3;smithi135=x;smithi179=y;smithi195=z' 2024-05-08T23:10:07.966 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: mon.b calling monitor election 2024-05-08T23:10:07.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: Updating smithi135:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:10:07.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: Updating smithi195:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:10:07.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: Updating smithi179:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:10:07.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: mon.b calling monitor election 2024-05-08T23:10:07.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: mon.c calling monitor election 2024-05-08T23:10:07.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: mon.a calling monitor election 2024-05-08T23:10:07.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T23:10:07.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: monmap e3: 3 mons at {a=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],b=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:10:07.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: fsmap 2024-05-08T23:10:07.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:10:07.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: mgrmap e13: x(active, since 45s) 2024-05-08T23:10:07.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-05-08T23:10:07.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: Cluster is now healthy 2024-05-08T23:10:07.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: overall HEALTH_OK 2024-05-08T23:10:07.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:07.968 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:07.968 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:07.968 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:07.968 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T23:10:07.968 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:10:07.968 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T23:10:07.968 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:07.968 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: Reconfiguring daemon mon.a on smithi135 2024-05-08T23:10:07.968 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:07.968 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:07 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2540163927' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:08.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: mon.b calling monitor election 2024-05-08T23:10:08.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: Updating smithi135:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:10:08.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: Updating smithi195:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:10:08.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: Updating smithi179:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:10:08.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: mon.b calling monitor election 2024-05-08T23:10:08.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: mon.c calling monitor election 2024-05-08T23:10:08.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: mon.a calling monitor election 2024-05-08T23:10:08.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T23:10:08.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: monmap e3: 3 mons at {a=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],b=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:10:08.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: fsmap 2024-05-08T23:10:08.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:10:08.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: mgrmap e13: x(active, since 45s) 2024-05-08T23:10:08.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-05-08T23:10:08.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: Cluster is now healthy 2024-05-08T23:10:08.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: overall HEALTH_OK 2024-05-08T23:10:08.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:08.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:08.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:08.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:08.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T23:10:08.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:10:08.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T23:10:08.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:08.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: Reconfiguring daemon mon.a on smithi135 2024-05-08T23:10:08.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:08.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:07 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2540163927' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:08.155 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:10:08.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:08.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:08.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:08.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:08 smithi179 ceph-mon[46314]: Reconfiguring mon.b (monmap changed)... 2024-05-08T23:10:08.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:10:08.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T23:10:08.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:08.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:08 smithi179 ceph-mon[46314]: Reconfiguring daemon mon.b on smithi179 2024-05-08T23:10:08.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:08.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:08.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:08.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:08 smithi135 ceph-mon[42440]: Reconfiguring mon.b (monmap changed)... 2024-05-08T23:10:08.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:10:08.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T23:10:08.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:08.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:08 smithi135 ceph-mon[42440]: Reconfiguring daemon mon.b on smithi179 2024-05-08T23:10:09.021 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:10:09.021 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:09.021 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:09.021 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:08 smithi195 ceph-mon[46516]: Reconfiguring mon.b (monmap changed)... 2024-05-08T23:10:09.021 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:10:09.021 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T23:10:09.021 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:09.021 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:08 smithi195 ceph-mon[46516]: Reconfiguring daemon mon.b on smithi179 2024-05-08T23:10:09.240 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.240+0000 7f3be9216700 1 -- 172.21.15.195:0/991365982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3be40ff960 msgr2=0x7f3be40ffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:09.241 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.240+0000 7f3be9216700 1 --2- 172.21.15.195:0/991365982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3be40ff960 0x7f3be40ffd80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009910 tx=0x7f3bd4009c20 comp rx=0 tx=0).stop 2024-05-08T23:10:09.241 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.240+0000 7f3be9216700 1 -- 172.21.15.195:0/991365982 shutdown_connections 2024-05-08T23:10:09.241 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.240+0000 7f3be9216700 1 --2- 172.21.15.195:0/991365982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3be40ff960 0x7f3be40ffd80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:09.241 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.240+0000 7f3be9216700 1 -- 172.21.15.195:0/991365982 >> 172.21.15.195:0/991365982 conn(0x7f3be40faf00 msgr2=0x7f3be40fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:10:09.241 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.240+0000 7f3be9216700 1 -- 172.21.15.195:0/991365982 shutdown_connections 2024-05-08T23:10:09.241 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.240+0000 7f3be9216700 1 -- 172.21.15.195:0/991365982 wait complete. 2024-05-08T23:10:09.243 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.241+0000 7f3be9216700 1 Processor -- start 2024-05-08T23:10:09.243 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.241+0000 7f3be9216700 1 -- start start 2024-05-08T23:10:09.243 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.241+0000 7f3be9216700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3be40ff960 0x7f3be4194e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:09.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.241+0000 7f3be9216700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3be4195390 0x7f3be419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:09.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.241+0000 7f3be9216700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3be4195810 0x7f3be419c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:09.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.241+0000 7f3be9216700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be419d0e0 con 0x7f3be4195390 2024-05-08T23:10:09.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.241+0000 7f3be9216700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be419d250 con 0x7f3be40ff960 2024-05-08T23:10:09.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.241+0000 7f3be9216700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be419d410 con 0x7f3be4195810 2024-05-08T23:10:09.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3be359e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3be4195810 0x7f3be419c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:09.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3be359e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3be4195810 0x7f3be419c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:56044/0 (socket says 172.21.15.195:56044) 2024-05-08T23:10:09.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3be359e700 1 -- 172.21.15.195:0/4242331494 learned_addr learned my addr 172.21.15.195:0/4242331494 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T23:10:09.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3be259c700 1 --2- 172.21.15.195:0/4242331494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3be4195390 0x7f3be419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:09.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3be2d9d700 1 --2- 172.21.15.195:0/4242331494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3be40ff960 0x7f3be4194e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:09.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3be359e700 1 -- 172.21.15.195:0/4242331494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3be40ff960 msgr2=0x7f3be4194e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:09.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3be359e700 1 --2- 172.21.15.195:0/4242331494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3be40ff960 0x7f3be4194e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:09.244 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3be359e700 1 -- 172.21.15.195:0/4242331494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3be4195390 msgr2=0x7f3be419a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:09.245 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3be359e700 1 --2- 172.21.15.195:0/4242331494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3be4195390 0x7f3be419a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:09.245 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3be359e700 1 -- 172.21.15.195:0/4242331494 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd40095f0 con 0x7f3be4195810 2024-05-08T23:10:09.245 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3be359e700 1 --2- 172.21.15.195:0/4242331494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3be4195810 0x7f3be419c940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00df40 tx=0x7f3bdc00df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:10:09.245 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3bcbfff700 1 -- 172.21.15.195:0/4242331494 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc00e720 con 0x7f3be4195810 2024-05-08T23:10:09.245 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3bcbfff700 1 -- 172.21.15.195:0/4242331494 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bdc00bb40 con 0x7f3be4195810 2024-05-08T23:10:09.245 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3be9216700 1 -- 172.21.15.195:0/4242331494 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be4068e80 con 0x7f3be4195810 2024-05-08T23:10:09.245 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3bcbfff700 1 -- 172.21.15.195:0/4242331494 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0163f0 con 0x7f3be4195810 2024-05-08T23:10:09.245 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.242+0000 7f3be9216700 1 -- 172.21.15.195:0/4242331494 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be40693b0 con 0x7f3be4195810 2024-05-08T23:10:09.245 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.243+0000 7f3bcbfff700 1 -- 172.21.15.195:0/4242331494 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f3bdc016550 con 0x7f3be4195810 2024-05-08T23:10:09.245 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.243+0000 7f3be9216700 1 -- 172.21.15.195:0/4242331494 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be4105f60 con 0x7f3be4195810 2024-05-08T23:10:09.245 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.243+0000 7f3bcbfff700 1 --2- 172.21.15.195:0/4242331494 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3bcc038c20 0x7f3bcc03b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:09.246 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.243+0000 7f3bcbfff700 1 -- 172.21.15.195:0/4242331494 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3bdc04c7d0 con 0x7f3be4195810 2024-05-08T23:10:09.246 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.244+0000 7f3be2d9d700 1 --2- 172.21.15.195:0/4242331494 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3bcc038c20 0x7f3bcc03b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:09.246 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.244+0000 7f3be2d9d700 1 --2- 172.21.15.195:0/4242331494 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3bcc038c20 0x7f3bcc03b0e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400b5c0 tx=0x7f3bd4005200 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:10:09.250 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.248+0000 7f3bcbfff700 1 -- 172.21.15.195:0/4242331494 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3bdc0144e0 con 0x7f3be4195810 2024-05-08T23:10:09.486 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.486+0000 7f3be9216700 1 -- 172.21.15.195:0/4242331494 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi135=x;smithi179=y;smithi195=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f3be418e080 con 0x7f3bcc038c20 2024-05-08T23:10:09.493 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.493+0000 7f3bcbfff700 1 -- 172.21.15.195:0/4242331494 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3be418e080 con 0x7f3bcc038c20 2024-05-08T23:10:09.493 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mgr update... 2024-05-08T23:10:09.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.495+0000 7f3be9216700 1 -- 172.21.15.195:0/4242331494 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3bcc038c20 msgr2=0x7f3bcc03b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:09.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.495+0000 7f3be9216700 1 --2- 172.21.15.195:0/4242331494 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3bcc038c20 0x7f3bcc03b0e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400b5c0 tx=0x7f3bd4005200 comp rx=0 tx=0).stop 2024-05-08T23:10:09.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.495+0000 7f3be9216700 1 -- 172.21.15.195:0/4242331494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3be4195810 msgr2=0x7f3be419c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:09.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.495+0000 7f3be9216700 1 --2- 172.21.15.195:0/4242331494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3be4195810 0x7f3be419c940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00df40 tx=0x7f3bdc00df70 comp rx=0 tx=0).stop 2024-05-08T23:10:09.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.495+0000 7f3be9216700 1 -- 172.21.15.195:0/4242331494 shutdown_connections 2024-05-08T23:10:09.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.495+0000 7f3be9216700 1 --2- 172.21.15.195:0/4242331494 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3bcc038c20 0x7f3bcc03b0e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:09.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.495+0000 7f3be9216700 1 --2- 172.21.15.195:0/4242331494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3be4195810 0x7f3be419c940 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:09.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.495+0000 7f3be9216700 1 --2- 172.21.15.195:0/4242331494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3be40ff960 0x7f3be4194e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:09.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.495+0000 7f3be9216700 1 --2- 172.21.15.195:0/4242331494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3be4195390 0x7f3be419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:09.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.495+0000 7f3be9216700 1 -- 172.21.15.195:0/4242331494 >> 172.21.15.195:0/4242331494 conn(0x7f3be40faf00 msgr2=0x7f3be40fbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:10:09.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.496+0000 7f3be9216700 1 -- 172.21.15.195:0/4242331494 shutdown_connections 2024-05-08T23:10:09.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:09.496+0000 7f3be9216700 1 -- 172.21.15.195:0/4242331494 wait complete. 2024-05-08T23:10:10.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:10.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:10.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:09 smithi179 ceph-mon[46314]: Reconfiguring mon.c (monmap changed)... 2024-05-08T23:10:10.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:10:10.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T23:10:10.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:10.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:09 smithi179 ceph-mon[46314]: Reconfiguring daemon mon.c on smithi195 2024-05-08T23:10:10.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:09 smithi179 ceph-mon[46314]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:10.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:10.110 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:10.110 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:10.110 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:09 smithi195 ceph-mon[46516]: Reconfiguring mon.c (monmap changed)... 2024-05-08T23:10:10.110 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:10:10.110 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T23:10:10.110 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:10.110 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:09 smithi195 ceph-mon[46516]: Reconfiguring daemon mon.c on smithi195 2024-05-08T23:10:10.110 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:09 smithi195 ceph-mon[46516]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:10.110 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:10.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:10.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:10.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:09 smithi135 ceph-mon[42440]: Reconfiguring mon.c (monmap changed)... 2024-05-08T23:10:10.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:10:10.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T23:10:10.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:10.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:09 smithi135 ceph-mon[42440]: Reconfiguring daemon mon.c on smithi195 2024-05-08T23:10:10.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:09 smithi135 ceph-mon[42440]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:10.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:10.310 DEBUG:teuthology.orchestra.run.smithi179:mgr.y> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mgr.y.service 2024-05-08T23:10:10.313 DEBUG:teuthology.orchestra.run.smithi195:mgr.z> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mgr.z.service 2024-05-08T23:10:10.347 INFO:journalctl@ceph.mgr.y.smithi179.stdout:-- Logs begin at Wed 2024-05-08 22:52:32 UTC. -- 2024-05-08T23:10:10.352 INFO:tasks.cephadm:Deploying OSDs... 2024-05-08T23:10:10.353 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:10:10.353 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T23:10:10.374 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T23:10:10.374 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-05-08T23:10:10.382 INFO:journalctl@ceph.mgr.z.smithi195.stdout:-- Logs begin at Wed 2024-05-08 22:52:38 UTC. -- 2024-05-08T23:10:10.435 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T23:10:10.435 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:10:10.435 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 182666 Links: 1 2024-05-08T23:10:10.435 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:10:10.435 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:10:10.435 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-08 23:09:30.935461538 +0000 2024-05-08T23:10:10.435 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-08 23:03:05.727532938 +0000 2024-05-08T23:10:10.435 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-08 23:03:05.727532938 +0000 2024-05-08T23:10:10.435 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-05-08T23:10:10.436 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T23:10:10.507 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-08T23:10:10.507 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-08T23:10:10.507 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000237445 s, 2.2 MB/s 2024-05-08T23:10:10.508 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T23:10:10.567 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-05-08T23:10:10.626 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T23:10:10.626 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:10:10.626 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 184329 Links: 1 2024-05-08T23:10:10.626 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:10:10.626 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:10:10.626 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-08 23:09:30.981460567 +0000 2024-05-08T23:10:10.626 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-08 23:03:06.074525621 +0000 2024-05-08T23:10:10.626 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-08 23:03:06.074525621 +0000 2024-05-08T23:10:10.626 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-05-08T23:10:10.627 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T23:10:10.694 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-08T23:10:10.694 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-08T23:10:10.694 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000203275 s, 2.5 MB/s 2024-05-08T23:10:10.695 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T23:10:10.754 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-05-08T23:10:10.812 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T23:10:10.812 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:10:10.812 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 185353 Links: 1 2024-05-08T23:10:10.812 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:10:10.812 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:10:10.812 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-08 23:09:31.025459638 +0000 2024-05-08T23:10:10.813 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-08 23:03:06.414518451 +0000 2024-05-08T23:10:10.813 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-08 23:03:06.414518451 +0000 2024-05-08T23:10:10.813 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-05-08T23:10:10.813 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T23:10:10.878 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-08T23:10:10.879 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-08T23:10:10.879 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.00018581 s, 2.8 MB/s 2024-05-08T23:10:10.881 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T23:10:10.939 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-05-08T23:10:10.998 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T23:10:10.998 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:10:10.998 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 185417 Links: 1 2024-05-08T23:10:10.998 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:10:10.998 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:10:10.999 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-08 23:09:31.069458710 +0000 2024-05-08T23:10:10.999 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-08 23:03:06.753511303 +0000 2024-05-08T23:10:10.999 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-08 23:03:06.753511303 +0000 2024-05-08T23:10:10.999 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-05-08T23:10:10.999 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T23:10:11.064 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-08T23:10:11.064 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-08T23:10:11.064 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000231997 s, 2.2 MB/s 2024-05-08T23:10:11.065 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T23:10:11.123 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-05-08T23:10:11.123 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T23:10:11.145 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T23:10:11.146 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2024-05-08T23:10:11.207 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T23:10:11.208 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:10:11.208 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 6h/6d Inode: 180657 Links: 1 2024-05-08T23:10:11.208 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:10:11.208 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:10:11.208 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-05-08 23:09:59.257184291 +0000 2024-05-08T23:10:11.208 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-05-08 23:03:04.723180158 +0000 2024-05-08T23:10:11.208 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-05-08 23:03:04.723180158 +0000 2024-05-08T23:10:11.208 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-05-08T23:10:11.208 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T23:10:11.278 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-05-08T23:10:11.278 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-05-08T23:10:11.278 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000232491 s, 2.2 MB/s 2024-05-08T23:10:11.280 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T23:10:11.339 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2024-05-08T23:10:11.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:11 smithi195 ceph-mon[46516]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi135=x;smithi179=y;smithi195=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:10:11.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:11 smithi195 ceph-mon[46516]: Saving service mgr spec with placement smithi135=x;smithi179=y;smithi195=z;count:3 2024-05-08T23:10:11.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:11.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:11.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:11.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:11.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:11.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:11.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:10:11.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T23:10:11.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:10:11.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:11.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:11 smithi195 ceph-mon[46516]: Deploying daemon mgr.z on smithi195 2024-05-08T23:10:11.401 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T23:10:11.401 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:10:11.401 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 6h/6d Inode: 176858 Links: 1 2024-05-08T23:10:11.401 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:10:11.401 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:10:11.401 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-05-08 23:09:59.257184291 +0000 2024-05-08T23:10:11.401 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-05-08 23:03:05.057172825 +0000 2024-05-08T23:10:11.401 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-05-08 23:03:05.057172825 +0000 2024-05-08T23:10:11.401 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-05-08T23:10:11.402 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T23:10:11.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:11 smithi135 ceph-mon[42440]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi135=x;smithi179=y;smithi195=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:10:11.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:11 smithi135 ceph-mon[42440]: Saving service mgr spec with placement smithi135=x;smithi179=y;smithi195=z;count:3 2024-05-08T23:10:11.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:10:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T23:10:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:10:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:11.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:11 smithi135 ceph-mon[42440]: Deploying daemon mgr.z on smithi195 2024-05-08T23:10:11.466 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:11 smithi179 ceph-mon[46314]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi135=x;smithi179=y;smithi195=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:10:11.466 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:11 smithi179 ceph-mon[46314]: Saving service mgr spec with placement smithi135=x;smithi179=y;smithi195=z;count:3 2024-05-08T23:10:11.466 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:11.467 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:11.467 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:11.467 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:11.467 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:11.467 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:11.467 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:10:11.467 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T23:10:11.467 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:10:11.467 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:11.467 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:11 smithi179 ceph-mon[46314]: Deploying daemon mgr.z on smithi195 2024-05-08T23:10:11.469 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-05-08T23:10:11.469 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-05-08T23:10:11.469 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000259932 s, 2.0 MB/s 2024-05-08T23:10:11.470 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T23:10:11.529 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2024-05-08T23:10:11.591 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T23:10:11.592 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:10:11.592 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 6h/6d Inode: 182461 Links: 1 2024-05-08T23:10:11.592 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:10:11.592 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:10:11.592 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-05-08 23:09:59.257184291 +0000 2024-05-08T23:10:11.592 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-05-08 23:03:05.418164899 +0000 2024-05-08T23:10:11.592 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-05-08 23:03:05.418164899 +0000 2024-05-08T23:10:11.592 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-05-08T23:10:11.592 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T23:10:11.659 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-05-08T23:10:11.659 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-05-08T23:10:11.660 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000194149 s, 2.6 MB/s 2024-05-08T23:10:11.661 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T23:10:11.720 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2024-05-08T23:10:11.780 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T23:10:11.780 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:10:11.780 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 6h/6d Inode: 183402 Links: 1 2024-05-08T23:10:11.780 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:10:11.780 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:10:11.780 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-05-08 23:09:59.257184291 +0000 2024-05-08T23:10:11.781 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-05-08 23:03:05.761157368 +0000 2024-05-08T23:10:11.781 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-05-08 23:03:05.761157368 +0000 2024-05-08T23:10:11.781 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-05-08T23:10:11.781 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T23:10:11.847 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-05-08T23:10:11.847 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-05-08T23:10:11.847 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000231431 s, 2.2 MB/s 2024-05-08T23:10:11.848 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T23:10:11.908 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T23:10:11.908 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T23:10:11.926 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T23:10:11.926 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-05-08T23:10:11.983 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T23:10:11.984 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:10:11.984 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 183367 Links: 1 2024-05-08T23:10:11.984 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:10:11.984 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:10:11.984 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-05-08 23:10:11.395356680 +0000 2024-05-08T23:10:11.984 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-05-08 23:03:09.374218090 +0000 2024-05-08T23:10:11.984 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-05-08 23:03:09.374218090 +0000 2024-05-08T23:10:11.984 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-05-08T23:10:11.985 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T23:10:12.053 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-05-08T23:10:12.053 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-05-08T23:10:12.053 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000104684 s, 4.9 MB/s 2024-05-08T23:10:12.054 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T23:10:12.114 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-05-08T23:10:12.130 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:11 smithi195 bash[48355]: 5f066666071bb2c5031c86c72b912fa7d981fe07a3b665aa3eeb9888e82648a9 2024-05-08T23:10:12.130 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:11 smithi195 systemd[1]: Started Ceph mgr.z for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:10:12.147 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T23:10:12.147 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:10:12.147 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 179827 Links: 1 2024-05-08T23:10:12.147 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:10:12.147 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:10:12.147 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-05-08 23:10:11.395356680 +0000 2024-05-08T23:10:12.147 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-05-08 23:03:09.738211481 +0000 2024-05-08T23:10:12.147 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-05-08 23:03:09.738211481 +0000 2024-05-08T23:10:12.147 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-05-08T23:10:12.148 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T23:10:12.215 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-05-08T23:10:12.215 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-05-08T23:10:12.215 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 9.3161e-05 s, 5.5 MB/s 2024-05-08T23:10:12.216 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T23:10:12.276 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-05-08T23:10:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T23:10:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:10:12.337 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 179914 Links: 1 2024-05-08T23:10:12.337 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:10:12.337 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:10:12.337 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-05-08 23:10:11.395356680 +0000 2024-05-08T23:10:12.337 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-05-08 23:03:10.081205253 +0000 2024-05-08T23:10:12.337 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-05-08 23:03:10.081205253 +0000 2024-05-08T23:10:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-05-08T23:10:12.338 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T23:10:12.344 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:12 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:12.243+0000 7f62bfdbf200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T23:10:12.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:12 smithi195 ceph-mon[46516]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:12.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:12.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:12.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:12.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:10:12.346 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T23:10:12.346 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:10:12.346 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:12.371 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-05-08T23:10:12.371 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-05-08T23:10:12.371 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000100844 s, 5.1 MB/s 2024-05-08T23:10:12.372 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T23:10:12.431 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-05-08T23:10:12.439 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:12 smithi179 ceph-mon[46314]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:12.440 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:12.440 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:12.440 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:12.440 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:10:12.440 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T23:10:12.440 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:10:12.440 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:12.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:12 smithi135 ceph-mon[42440]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:12.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:12.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:12.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:12.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:10:12.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T23:10:12.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:10:12.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:12.489 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T23:10:12.489 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:10:12.489 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 184354 Links: 1 2024-05-08T23:10:12.489 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:10:12.489 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:10:12.489 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-05-08 23:10:11.395356680 +0000 2024-05-08T23:10:12.489 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-05-08 23:03:10.421199079 +0000 2024-05-08T23:10:12.490 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-05-08 23:03:10.421199079 +0000 2024-05-08T23:10:12.490 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-05-08T23:10:12.490 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T23:10:12.523 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:12 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:12.345+0000 7f62bfdbf200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T23:10:12.523 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:12 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:12.437+0000 7f62bfdbf200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T23:10:12.524 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:12 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:12.524+0000 7f62bfdbf200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T23:10:12.549 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-05-08T23:10:12.549 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-05-08T23:10:12.549 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000127517 s, 4.0 MB/s 2024-05-08T23:10:12.550 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T23:10:12.612 INFO:tasks.cephadm:Deploying osd.0 on smithi135 with /dev/vg_nvme/lv_4... 2024-05-08T23:10:12.612 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T23:10:12.838 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:10:13.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:13 smithi135 ceph-mon[42440]: Deploying daemon mgr.y on smithi179 2024-05-08T23:10:13.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:13 smithi195 ceph-mon[46516]: Deploying daemon mgr.y on smithi179 2024-05-08T23:10:13.413 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:13 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:13.163+0000 7f62bfdbf200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:10:13.542 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:13 smithi179 ceph-mon[46314]: Deploying daemon mgr.y on smithi179 2024-05-08T23:10:13.543 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:13 smithi179 systemd[1]: Starting Ceph mgr.y for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:10:13.763 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:13 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:13.414+0000 7f62bfdbf200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T23:10:13.764 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:13 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:13.498+0000 7f62bfdbf200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T23:10:13.764 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:13 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:13.607+0000 7f62bfdbf200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T23:10:13.764 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:13 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:13.764+0000 7f62bfdbf200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T23:10:14.099 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:13 smithi179 ceph-mgr[47786]: -- 172.21.15.179:0/3133453418 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e535fa81a0 con 0x55e535f7e800 2024-05-08T23:10:14.174 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:13 smithi179 bash[47749]: c966649f60bf540ebff04c2d304225327efad1a7fb9e9f6dfb9cf8580bdca637 2024-05-08T23:10:14.175 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:13 smithi179 systemd[1]: Started Ceph mgr.y for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:10:14.175 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T23:10:14.175 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T23:10:14.175 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-05-08T23:10:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-05-08T23:10:14.176 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0156536 s, 670 MB/s 2024-05-08T23:10:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-05-08T23:10:14.176 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:13 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:13.891+0000 7f62bfdbf200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T23:10:14.176 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:13 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:13.978+0000 7f62bfdbf200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T23:10:14.193 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:14 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:14.128+0000 7fed548e6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T23:10:14.430 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:14 smithi179 ceph-mon[46314]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:14.431 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:14 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:14.431 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:14 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:14.431 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:14 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:14.431 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:14 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:14.431 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:14 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:14.431 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:14 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:14.232+0000 7fed548e6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T23:10:14.431 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:14 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:14.334+0000 7fed548e6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T23:10:14.431 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:14 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:14.426+0000 7fed548e6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T23:10:14.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:14 smithi135 ceph-mon[42440]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:14.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:14 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:14.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:14 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:14.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:14 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:14.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:14 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:14.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:14 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:14.490 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_4 2024-05-08T23:10:14.630 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:14 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:14.396+0000 7f62bfdbf200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T23:10:14.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:14 smithi195 ceph-mon[46516]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:14.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:14 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:14.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:14 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:14.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:14 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:14.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:14 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:14.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:14 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:14.711 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:10:15.095 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:14 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:14.806+0000 7f62bfdbf200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T23:10:15.096 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:15 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:15.001+0000 7f62bfdbf200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T23:10:15.438 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:15 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:15.103+0000 7fed548e6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:10:15.438 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:15 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:15.352+0000 7fed548e6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T23:10:15.438 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:15 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:15.437+0000 7fed548e6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T23:10:15.704 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:15 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:15.546+0000 7fed548e6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T23:10:15.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.878+0000 7f6c7f78b700 1 -- 172.21.15.135:0/647406156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c780fff00 msgr2=0x7f6c78100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:15.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.878+0000 7f6c7f78b700 1 --2- 172.21.15.135:0/647406156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c780fff00 0x7f6c78100320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009990 tx=0x7f6c74009ca0 comp rx=0 tx=0).stop 2024-05-08T23:10:15.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.878+0000 7f6c7f78b700 1 -- 172.21.15.135:0/647406156 shutdown_connections 2024-05-08T23:10:15.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.878+0000 7f6c7f78b700 1 --2- 172.21.15.135:0/647406156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c78101a20 0x7f6c78108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:15.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.878+0000 7f6c7f78b700 1 --2- 172.21.15.135:0/647406156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c780fff00 0x7f6c78100320 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:15.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.878+0000 7f6c7f78b700 1 --2- 172.21.15.135:0/647406156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78101060 0x7f6c781014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:15.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.878+0000 7f6c7f78b700 1 -- 172.21.15.135:0/647406156 >> 172.21.15.135:0/647406156 conn(0x7f6c780fb4a0 msgr2=0x7f6c780fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:10:15.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.878+0000 7f6c7f78b700 1 -- 172.21.15.135:0/647406156 shutdown_connections 2024-05-08T23:10:15.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.878+0000 7f6c7f78b700 1 -- 172.21.15.135:0/647406156 wait complete. 2024-05-08T23:10:15.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.878+0000 7f6c7f78b700 1 Processor -- start 2024-05-08T23:10:15.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.878+0000 7f6c7f78b700 1 -- start start 2024-05-08T23:10:15.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7f78b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c780fff00 0x7f6c781991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:15.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7f78b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c78101060 0x7f6c78199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:15.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7f78b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78101a20 0x7f6c781a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:15.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7f78b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c781a0ce0 con 0x7f6c78101060 2024-05-08T23:10:15.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7f78b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c781a0e20 con 0x7f6c78101a20 2024-05-08T23:10:15.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7f78b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c781a0fb0 con 0x7f6c780fff00 2024-05-08T23:10:15.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7cd26700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c78101060 0x7f6c78199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:15.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7cd26700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c78101060 0x7f6c78199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49178/0 (socket says 172.21.15.135:49178) 2024-05-08T23:10:15.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7d527700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c780fff00 0x7f6c781991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:15.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7cd26700 1 -- 172.21.15.135:0/1683131976 learned_addr learned my addr 172.21.15.135:0/1683131976 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:10:15.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7dd28700 1 --2- 172.21.15.135:0/1683131976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78101a20 0x7f6c781a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:15.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7cd26700 1 -- 172.21.15.135:0/1683131976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c780fff00 msgr2=0x7f6c781991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:15.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7cd26700 1 --2- 172.21.15.135:0/1683131976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c780fff00 0x7f6c781991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:15.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7cd26700 1 -- 172.21.15.135:0/1683131976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78101a20 msgr2=0x7f6c781a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:15.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7cd26700 1 --2- 172.21.15.135:0/1683131976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78101a20 0x7f6c781a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:15.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7cd26700 1 -- 172.21.15.135:0/1683131976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c740095f0 con 0x7f6c78101060 2024-05-08T23:10:15.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7d527700 1 --2- 172.21.15.135:0/1683131976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c780fff00 0x7f6c781991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:10:15.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7cd26700 1 --2- 172.21.15.135:0/1683131976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c78101060 0x7f6c78199730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800d9b0 tx=0x7f6c6800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:10:15.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c6e7fc700 1 -- 172.21.15.135:0/1683131976 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68004220 con 0x7f6c78101060 2024-05-08T23:10:15.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c6e7fc700 1 -- 172.21.15.135:0/1683131976 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c68007640 con 0x7f6c78101060 2024-05-08T23:10:15.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7f78b700 1 -- 172.21.15.135:0/1683131976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c781a1290 con 0x7f6c78101060 2024-05-08T23:10:15.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c6e7fc700 1 -- 172.21.15.135:0/1683131976 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68005590 con 0x7f6c78101060 2024-05-08T23:10:15.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.879+0000 7f6c7f78b700 1 -- 172.21.15.135:0/1683131976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c781a17e0 con 0x7f6c78101060 2024-05-08T23:10:15.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.880+0000 7f6c6e7fc700 1 -- 172.21.15.135:0/1683131976 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f6c6800b750 con 0x7f6c78101060 2024-05-08T23:10:15.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.880+0000 7f6c7f78b700 1 -- 172.21.15.135:0/1683131976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7804ec60 con 0x7f6c78101060 2024-05-08T23:10:15.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.880+0000 7f6c6e7fc700 1 --2- 172.21.15.135:0/1683131976 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f6c640389d0 0x7f6c6403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:15.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.880+0000 7f6c6e7fc700 1 -- 172.21.15.135:0/1683131976 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6c6804b190 con 0x7f6c78101060 2024-05-08T23:10:15.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.881+0000 7f6c7d527700 1 --2- 172.21.15.135:0/1683131976 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f6c640389d0 0x7f6c6403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:15.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.881+0000 7f6c7d527700 1 --2- 172.21.15.135:0/1683131976 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f6c640389d0 0x7f6c6403ae90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400b2e0 tx=0x7f6c74005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:10:15.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:15.885+0000 7f6c6e7fc700 1 -- 172.21.15.135:0/1683131976 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6c68022350 con 0x7f6c78101060 2024-05-08T23:10:16.061 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:16.061 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:16.061 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:16.061 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:16.061 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:16.061 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:16.062 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:16.062 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:15 smithi135 ceph-mon[42440]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:16.062 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:15 smithi135 ceph-mon[42440]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T23:10:16.062 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:10:16.062 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:10:16.062 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:16.062 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:15 smithi135 ceph-mon[42440]: Reconfiguring daemon mgr.x on smithi135 2024-05-08T23:10:16.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:16.095+0000 7f6c7f78b700 1 -- 172.21.15.135:0/1683131976 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c780fd6f0 con 0x7f6c640389d0 2024-05-08T23:10:16.099 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:15 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:15.704+0000 7fed548e6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T23:10:16.099 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:15 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:15.830+0000 7fed548e6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T23:10:16.099 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:15 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:15.915+0000 7fed548e6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T23:10:16.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:16.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:16.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:16.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:16.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:16.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:16.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:16.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:15 smithi179 ceph-mon[46314]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:16.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:15 smithi179 ceph-mon[46314]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T23:10:16.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:10:16.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:10:16.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:16.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:15 smithi179 ceph-mon[46314]: Reconfiguring daemon mgr.x on smithi135 2024-05-08T23:10:16.105 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:15 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:15.096+0000 7f62bfdbf200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T23:10:16.105 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:15 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:15.861+0000 7f62bfdbf200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T23:10:16.105 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:15 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:15.959+0000 7f62bfdbf200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T23:10:16.105 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:16 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:16.106+0000 7f62bfdbf200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T23:10:16.105 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:16.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:16.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:16.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:16.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:16.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:16.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:16.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:15 smithi195 ceph-mon[46516]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:16.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:15 smithi195 ceph-mon[46516]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T23:10:16.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:10:16.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:10:16.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:16.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:15 smithi195 ceph-mon[46516]: Reconfiguring daemon mgr.x on smithi135 2024-05-08T23:10:16.599 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:16 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:16.287+0000 7fed548e6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T23:10:16.965 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:16 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:16.680+0000 7fed548e6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T23:10:16.965 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:16 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:16.872+0000 7fed548e6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T23:10:17.039 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:16 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:16.738+0000 7f62bfdbf200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T23:10:17.039 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:16 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:16.919+0000 7f62bfdbf200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T23:10:17.150 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:17.150 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:17 smithi135 ceph-mon[42440]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:10:17.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:10:17.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:10:17.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:17.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:17.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:17.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:17.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:17.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:17.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:17.349 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:16 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:16.964+0000 7fed548e6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T23:10:17.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:17.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:17 smithi179 ceph-mon[46314]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:10:17.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:10:17.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:10:17.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:17.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:17.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:17.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:17.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:17.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:17.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:17.380 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:17 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:17.115+0000 7f62bfdbf200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T23:10:17.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:17.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:17 smithi195 ceph-mon[46516]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:10:17.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:10:17.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:10:17.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:17.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:17.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:17.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:17.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:17.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:17.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:18.040 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:17 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:17.726+0000 7fed548e6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T23:10:18.040 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:17 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:17.822+0000 7fed548e6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T23:10:18.040 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:17 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:17.970+0000 7fed548e6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T23:10:18.330 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:18 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:18.046+0000 7f62bfdbf200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T23:10:18.330 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:18 smithi195 ceph-mon[46516]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:18.330 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:18 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/429012184' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2aafc0bf-d99a-4981-b7c4-a0e26072aab4"}]: dispatch 2024-05-08T23:10:18.330 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:18 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/429012184' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2aafc0bf-d99a-4981-b7c4-a0e26072aab4"}]': finished 2024-05-08T23:10:18.330 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:18 smithi195 ceph-mon[46516]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T23:10:18.330 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:10:18.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:18 smithi179 ceph-mon[46314]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:18.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:18 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/429012184' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2aafc0bf-d99a-4981-b7c4-a0e26072aab4"}]: dispatch 2024-05-08T23:10:18.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:18 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/429012184' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2aafc0bf-d99a-4981-b7c4-a0e26072aab4"}]': finished 2024-05-08T23:10:18.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:18 smithi179 ceph-mon[46314]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T23:10:18.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:10:18.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:18 smithi135 ceph-mon[42440]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:18.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:18 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/429012184' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2aafc0bf-d99a-4981-b7c4-a0e26072aab4"}]: dispatch 2024-05-08T23:10:18.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:18 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/429012184' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2aafc0bf-d99a-4981-b7c4-a0e26072aab4"}]': finished 2024-05-08T23:10:18.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:18 smithi135 ceph-mon[42440]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T23:10:18.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:10:18.607 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:18 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:18.330+0000 7f62bfdbf200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:10:18.607 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:18 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:18.419+0000 7f62bfdbf200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T23:10:18.849 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:18 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:18.597+0000 7fed548e6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T23:10:18.849 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:18 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:18.778+0000 7fed548e6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T23:10:18.880 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:10:18 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z[48370]: 2024-05-08T23:10:18.608+0000 7f62bfdbf200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T23:10:19.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:19.048+0000 7f6c6e7fc700 1 -- 172.21.15.135:0/1683131976 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 14) v1 ==== 90708+0+0 (secure 0 0 0) 0x7f6c68010ce0 con 0x7f6c78101060 2024-05-08T23:10:19.349 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:18 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:18.970+0000 7fed548e6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T23:10:19.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:19 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3174382690' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:10:19.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:19 smithi179 ceph-mon[46314]: Standby manager daemon z started 2024-05-08T23:10:19.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:19 smithi179 ceph-mon[46314]: from='mgr.? 172.21.15.195:0/1553992541' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T23:10:19.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:19 smithi179 ceph-mon[46314]: from='mgr.? 172.21.15.195:0/1553992541' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T23:10:19.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:19 smithi179 ceph-mon[46314]: from='mgr.? 172.21.15.195:0/1553992541' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T23:10:19.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:19 smithi179 ceph-mon[46314]: from='mgr.? 172.21.15.195:0/1553992541' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T23:10:19.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:19 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3174382690' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:10:19.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:19 smithi195 ceph-mon[46516]: Standby manager daemon z started 2024-05-08T23:10:19.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:19 smithi195 ceph-mon[46516]: from='mgr.? 172.21.15.195:0/1553992541' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T23:10:19.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:19 smithi195 ceph-mon[46516]: from='mgr.? 172.21.15.195:0/1553992541' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T23:10:19.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:19 smithi195 ceph-mon[46516]: from='mgr.? 172.21.15.195:0/1553992541' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T23:10:19.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:19 smithi195 ceph-mon[46516]: from='mgr.? 172.21.15.195:0/1553992541' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T23:10:19.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:19 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3174382690' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:10:19.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:19 smithi135 ceph-mon[42440]: Standby manager daemon z started 2024-05-08T23:10:19.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:19 smithi135 ceph-mon[42440]: from='mgr.? 172.21.15.195:0/1553992541' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T23:10:19.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:19 smithi135 ceph-mon[42440]: from='mgr.? 172.21.15.195:0/1553992541' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T23:10:19.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:19 smithi135 ceph-mon[42440]: from='mgr.? 172.21.15.195:0/1553992541' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T23:10:19.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:19 smithi135 ceph-mon[42440]: from='mgr.? 172.21.15.195:0/1553992541' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T23:10:20.184 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:19 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:19.900+0000 7fed548e6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T23:10:20.184 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:20 smithi179 ceph-mon[46314]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:20.184 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:20 smithi179 ceph-mon[46314]: mgrmap e14: x(active, since 58s), standbys: z 2024-05-08T23:10:20.184 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:20 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T23:10:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:20 smithi195 ceph-mon[46516]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:20 smithi195 ceph-mon[46516]: mgrmap e14: x(active, since 58s), standbys: z 2024-05-08T23:10:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:20 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T23:10:20.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:20 smithi135 ceph-mon[42440]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:20.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:20 smithi135 ceph-mon[42440]: mgrmap e14: x(active, since 58s), standbys: z 2024-05-08T23:10:20.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:20 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T23:10:20.463 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:20 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:20.183+0000 7fed548e6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:10:20.463 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:20 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:20.272+0000 7fed548e6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T23:10:20.849 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:10:20 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y[47763]: 2024-05-08T23:10:20.462+0000 7fed548e6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T23:10:21.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:21.058+0000 7f6c6e7fc700 1 -- 172.21.15.135:0/1683131976 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mgrmap(e 15) v1 ==== 135818+0+0 (secure 0 0 0) 0x7f6c680193b0 con 0x7f6c78101060 2024-05-08T23:10:21.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:21 smithi179 ceph-mon[46314]: Standby manager daemon y started 2024-05-08T23:10:21.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:21 smithi179 ceph-mon[46314]: from='mgr.? 172.21.15.179:0/4017889715' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T23:10:21.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:21 smithi179 ceph-mon[46314]: from='mgr.? 172.21.15.179:0/4017889715' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T23:10:21.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:21 smithi179 ceph-mon[46314]: from='mgr.? 172.21.15.179:0/4017889715' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T23:10:21.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:21 smithi179 ceph-mon[46314]: from='mgr.? 172.21.15.179:0/4017889715' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T23:10:21.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:21 smithi195 ceph-mon[46516]: Standby manager daemon y started 2024-05-08T23:10:21.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:21 smithi195 ceph-mon[46516]: from='mgr.? 172.21.15.179:0/4017889715' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T23:10:21.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:21 smithi195 ceph-mon[46516]: from='mgr.? 172.21.15.179:0/4017889715' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T23:10:21.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:21 smithi195 ceph-mon[46516]: from='mgr.? 172.21.15.179:0/4017889715' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T23:10:21.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:21 smithi195 ceph-mon[46516]: from='mgr.? 172.21.15.179:0/4017889715' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T23:10:21.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:21 smithi135 ceph-mon[42440]: Standby manager daemon y started 2024-05-08T23:10:21.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:21 smithi135 ceph-mon[42440]: from='mgr.? 172.21.15.179:0/4017889715' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T23:10:21.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:21 smithi135 ceph-mon[42440]: from='mgr.? 172.21.15.179:0/4017889715' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T23:10:21.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:21 smithi135 ceph-mon[42440]: from='mgr.? 172.21.15.179:0/4017889715' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T23:10:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:21 smithi135 ceph-mon[42440]: from='mgr.? 172.21.15.179:0/4017889715' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T23:10:22.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:22 smithi135 ceph-mon[42440]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:22.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:22 smithi135 ceph-mon[42440]: mgrmap e15: x(active, since 60s), standbys: z, y 2024-05-08T23:10:22.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T23:10:22.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:22 smithi179 ceph-mon[46314]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:22.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:22 smithi179 ceph-mon[46314]: mgrmap e15: x(active, since 60s), standbys: z, y 2024-05-08T23:10:22.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T23:10:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:22 smithi195 ceph-mon[46516]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:22 smithi195 ceph-mon[46516]: mgrmap e15: x(active, since 60s), standbys: z, y 2024-05-08T23:10:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T23:10:24.340 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:24 smithi135 ceph-mon[42440]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:24.340 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:24 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T23:10:24.340 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:24 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:24.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:24 smithi179 ceph-mon[46314]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:24.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:24 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T23:10:24.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:24 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:24.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:24 smithi195 ceph-mon[46516]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:24.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:24 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T23:10:24.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:24 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:25.326 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:25 smithi135 ceph-mon[42440]: Deploying daemon osd.0 on smithi135 2024-05-08T23:10:25.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:25 smithi179 ceph-mon[46314]: Deploying daemon osd.0 on smithi135 2024-05-08T23:10:25.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:25 smithi195 ceph-mon[46516]: Deploying daemon osd.0 on smithi135 2024-05-08T23:10:26.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:26 smithi179 ceph-mon[46314]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:26 smithi195 ceph-mon[46516]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:26.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:26 smithi135 ceph-mon[42440]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:28.326 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:28 smithi135 ceph-mon[42440]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:28.326 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:28 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:28.326 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:28 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:28.326 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:28 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:28.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:28 smithi179 ceph-mon[46314]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:28.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:28 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:28.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:28 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:28.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:28 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:28.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:28 smithi195 ceph-mon[46516]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:28.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:28 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:28.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:28 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:28.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:28 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:29.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:29.395+0000 7f6c6e7fc700 1 -- 172.21.15.135:0/1683131976 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6c780fd6f0 con 0x7f6c640389d0 2024-05-08T23:10:29.398 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 0 on host 'smithi135' 2024-05-08T23:10:29.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:29.397+0000 7f6c7f78b700 1 -- 172.21.15.135:0/1683131976 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f6c640389d0 msgr2=0x7f6c6403ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:29.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:29.397+0000 7f6c7f78b700 1 --2- 172.21.15.135:0/1683131976 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f6c640389d0 0x7f6c6403ae90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400b2e0 tx=0x7f6c74005fb0 comp rx=0 tx=0).stop 2024-05-08T23:10:29.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:29.397+0000 7f6c7f78b700 1 -- 172.21.15.135:0/1683131976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c78101060 msgr2=0x7f6c78199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:29.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:29.397+0000 7f6c7f78b700 1 --2- 172.21.15.135:0/1683131976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c78101060 0x7f6c78199730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800d9b0 tx=0x7f6c6800dcc0 comp rx=0 tx=0).stop 2024-05-08T23:10:29.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:29.397+0000 7f6c7f78b700 1 -- 172.21.15.135:0/1683131976 shutdown_connections 2024-05-08T23:10:29.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:29.397+0000 7f6c7f78b700 1 --2- 172.21.15.135:0/1683131976 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f6c640389d0 0x7f6c6403ae90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:29.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:29.397+0000 7f6c7f78b700 1 --2- 172.21.15.135:0/1683131976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c780fff00 0x7f6c781991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:29.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:29.397+0000 7f6c7f78b700 1 --2- 172.21.15.135:0/1683131976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78101a20 0x7f6c781a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:29.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:29.397+0000 7f6c7f78b700 1 --2- 172.21.15.135:0/1683131976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c78101060 0x7f6c78199730 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:29.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:29.397+0000 7f6c7f78b700 1 -- 172.21.15.135:0/1683131976 >> 172.21.15.135:0/1683131976 conn(0x7f6c780fb4a0 msgr2=0x7f6c780fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:10:29.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:29.397+0000 7f6c7f78b700 1 -- 172.21.15.135:0/1683131976 shutdown_connections 2024-05-08T23:10:29.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:10:29.397+0000 7f6c7f78b700 1 -- 172.21.15.135:0/1683131976 wait complete. 2024-05-08T23:10:29.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:29 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:29.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:29 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:29.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:29 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:29.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:29 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:29 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:29 smithi135 ceph-mon[42440]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:29 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:29 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:29 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:29.775 DEBUG:teuthology.orchestra.run.smithi135:osd.0> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.0.service 2024-05-08T23:10:29.778 INFO:tasks.cephadm:Deploying osd.1 on smithi179 with /dev/vg_nvme/lv_4... 2024-05-08T23:10:29.778 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T23:10:29.807 INFO:journalctl@ceph.osd.0.smithi135.stdout:-- Logs begin at Wed 2024-05-08 22:52:39 UTC. -- 2024-05-08T23:10:29.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:29 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:29.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:29 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:29.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:29 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:29.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:29 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:29.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:29 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:29.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:29 smithi179 ceph-mon[46314]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:29.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:29 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:29.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:29 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:29.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:29 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:29.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:29 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:29.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:29 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:29.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:29 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:29.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:29 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:29.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:29 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:29.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:29 smithi195 ceph-mon[46516]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:29.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:29 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:29.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:29 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:29.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:29 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:30.009 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:10:31.454 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:10:31 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-0[60145]: 2024-05-08T23:10:31.191+0000 7fd52078a7c0 -1 osd.0 0 log_to_monitors true 2024-05-08T23:10:31.501 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T23:10:31.501 INFO:teuthology.orchestra.run.smithi179.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T23:10:31.501 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10+0 records in 2024-05-08T23:10:31.501 INFO:teuthology.orchestra.run.smithi179.stderr:10+0 records out 2024-05-08T23:10:31.501 INFO:teuthology.orchestra.run.smithi179.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0154221 s, 680 MB/s 2024-05-08T23:10:31.501 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping successful for: 2024-05-08T23:10:31.891 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi179:vg_nvme/lv_4 2024-05-08T23:10:32.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:32 smithi179 ceph-mon[46314]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:32.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:32 smithi179 ceph-mon[46314]: from='osd.0 [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T23:10:32.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:32 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:32.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:32 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:32.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:32 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:10:32.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:32 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:32.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:32 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:32.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:32 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:32.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:32 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:32.148 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:10:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:32 smithi195 ceph-mon[46516]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:32 smithi195 ceph-mon[46516]: from='osd.0 [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T23:10:32.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:32 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:32.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:32 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:32.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:32 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:10:32.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:32 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:32.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:32 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:32.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:32 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:32.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:32 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:32.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:32 smithi135 ceph-mon[42440]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:32.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:32 smithi135 ceph-mon[42440]: from='osd.0 [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T23:10:32.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:32 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:32.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:32 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:32.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:32 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:10:32.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:32 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:32.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:32 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:32.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:32 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:32.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:32 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:33.171 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.171+0000 7f61613d6700 1 -- 172.21.15.179:0/3991543159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f615c1021e0 msgr2=0x7f615c102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:33.172 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.171+0000 7f61613d6700 1 --2- 172.21.15.179:0/3991543159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f615c1021e0 0x7f615c102640 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f614c0099c0 tx=0x7f614c009cd0 comp rx=0 tx=0).stop 2024-05-08T23:10:33.172 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.171+0000 7f61613d6700 1 -- 172.21.15.179:0/3991543159 shutdown_connections 2024-05-08T23:10:33.172 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.171+0000 7f61613d6700 1 --2- 172.21.15.179:0/3991543159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f615c102b80 0x7f615c109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:33.172 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.171+0000 7f61613d6700 1 --2- 172.21.15.179:0/3991543159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f615c100fe0 0x7f615c101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:33.172 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.171+0000 7f61613d6700 1 --2- 172.21.15.179:0/3991543159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f615c1021e0 0x7f615c102640 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:33.172 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.171+0000 7f61613d6700 1 -- 172.21.15.179:0/3991543159 >> 172.21.15.179:0/3991543159 conn(0x7f615c0fc5a0 msgr2=0x7f615c0fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:10:33.172 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.171+0000 7f61613d6700 1 -- 172.21.15.179:0/3991543159 shutdown_connections 2024-05-08T23:10:33.172 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.171+0000 7f61613d6700 1 -- 172.21.15.179:0/3991543159 wait complete. 2024-05-08T23:10:33.175 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.172+0000 7f61613d6700 1 Processor -- start 2024-05-08T23:10:33.175 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.172+0000 7f61613d6700 1 -- start start 2024-05-08T23:10:33.175 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.172+0000 7f61613d6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f615c100fe0 0x7f615c196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:33.175 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.172+0000 7f61613d6700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f615c1021e0 0x7f615c197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:33.175 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.172+0000 7f61613d6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f615c102b80 0x7f615c19e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:33.175 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.172+0000 7f61613d6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c19e980 con 0x7f615c102b80 2024-05-08T23:10:33.175 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.172+0000 7f61613d6700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c19eac0 con 0x7f615c1021e0 2024-05-08T23:10:33.175 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.172+0000 7f61613d6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c19ec50 con 0x7f615c100fe0 2024-05-08T23:10:33.175 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.172+0000 7f615a7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f615c1021e0 0x7f615c197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:33.175 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.172+0000 7f615a7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f615c1021e0 0x7f615c197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:34538/0 (socket says 172.21.15.179:34538) 2024-05-08T23:10:33.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.172+0000 7f615a7fc700 1 -- 172.21.15.179:0/245683439 learned_addr learned my addr 172.21.15.179:0/245683439 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-05-08T23:10:33.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.172+0000 7f615affd700 1 --2- 172.21.15.179:0/245683439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f615c100fe0 0x7f615c196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:33.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.173+0000 7f615b7fe700 1 --2- 172.21.15.179:0/245683439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f615c102b80 0x7f615c19e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:33.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.173+0000 7f615a7fc700 1 -- 172.21.15.179:0/245683439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f615c100fe0 msgr2=0x7f615c196e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:33.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.173+0000 7f615a7fc700 1 --2- 172.21.15.179:0/245683439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f615c100fe0 0x7f615c196e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:33.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.173+0000 7f615a7fc700 1 -- 172.21.15.179:0/245683439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f615c102b80 msgr2=0x7f615c19e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:33.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.173+0000 7f615a7fc700 1 --2- 172.21.15.179:0/245683439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f615c102b80 0x7f615c19e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:33.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.173+0000 7f615a7fc700 1 -- 172.21.15.179:0/245683439 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c0095f0 con 0x7f615c1021e0 2024-05-08T23:10:33.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.173+0000 7f615a7fc700 1 --2- 172.21.15.179:0/245683439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f615c1021e0 0x7f615c197380 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f614c0036f0 tx=0x7f614c0047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:10:33.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.173+0000 7f6143fff700 1 -- 172.21.15.179:0/245683439 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c01d070 con 0x7f615c1021e0 2024-05-08T23:10:33.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.173+0000 7f6143fff700 1 -- 172.21.15.179:0/245683439 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f614c004090 con 0x7f615c1021e0 2024-05-08T23:10:33.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.173+0000 7f61613d6700 1 -- 172.21.15.179:0/245683439 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c19eed0 con 0x7f615c1021e0 2024-05-08T23:10:33.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.173+0000 7f6143fff700 1 -- 172.21.15.179:0/245683439 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c022d70 con 0x7f615c1021e0 2024-05-08T23:10:33.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.173+0000 7f61613d6700 1 -- 172.21.15.179:0/245683439 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c19f2e0 con 0x7f615c1021e0 2024-05-08T23:10:33.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.174+0000 7f61613d6700 1 -- 172.21.15.179:0/245683439 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c108420 con 0x7f615c1021e0 2024-05-08T23:10:33.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.175+0000 7f6143fff700 1 -- 172.21.15.179:0/245683439 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 15) v1 ==== 135818+0+0 (secure 0 0 0) 0x7f614c022470 con 0x7f615c1021e0 2024-05-08T23:10:33.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.176+0000 7f6143fff700 1 --2- 172.21.15.179:0/245683439 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f61440a1090 0x7f61440a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:33.178 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.176+0000 7f6143fff700 1 -- 172.21.15.179:0/245683439 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1487+0+0 (secure 0 0 0) 0x7f614c0cc100 con 0x7f615c1021e0 2024-05-08T23:10:33.178 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.176+0000 7f615affd700 1 --2- 172.21.15.179:0/245683439 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f61440a1090 0x7f61440a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:33.178 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.176+0000 7f615affd700 1 --2- 172.21.15.179:0/245683439 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f61440a1090 0x7f61440a3550 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f615c102040 tx=0x7f615000a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:10:33.179 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.179+0000 7f6143fff700 1 -- 172.21.15.179:0/245683439 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f614c0974b0 con 0x7f615c1021e0 2024-05-08T23:10:33.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:33 smithi179 ceph-mon[46314]: Detected new or changed devices on smithi135 2024-05-08T23:10:33.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:33 smithi179 ceph-mon[46314]: Adjusting osd_memory_target on smithi135 to 17113M 2024-05-08T23:10:33.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:33 smithi179 ceph-mon[46314]: from='osd.0 [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T23:10:33.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:33 smithi179 ceph-mon[46314]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T23:10:33.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:33 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:10:33.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:33 smithi179 ceph-mon[46314]: from='osd.0 [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-08T23:10:33.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:33.380+0000 7f61613d6700 1 -- 172.21.15.179:0/245683439 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f615c02ceb0 con 0x7f61440a1090 2024-05-08T23:10:33.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:33 smithi195 ceph-mon[46516]: Detected new or changed devices on smithi135 2024-05-08T23:10:33.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:33 smithi195 ceph-mon[46516]: Adjusting osd_memory_target on smithi135 to 17113M 2024-05-08T23:10:33.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:33 smithi195 ceph-mon[46516]: from='osd.0 [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T23:10:33.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:33 smithi195 ceph-mon[46516]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T23:10:33.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:33 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:10:33.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:33 smithi195 ceph-mon[46516]: from='osd.0 [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-08T23:10:33.453 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:10:33 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-0[60145]: 2024-05-08T23:10:33.052+0000 7fd515dee700 -1 osd.0 0 waiting for initial osdmap 2024-05-08T23:10:33.453 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:10:33 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-0[60145]: 2024-05-08T23:10:33.055+0000 7fd511be3700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:10:33.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:33 smithi135 ceph-mon[42440]: Detected new or changed devices on smithi135 2024-05-08T23:10:33.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:33 smithi135 ceph-mon[42440]: Adjusting osd_memory_target on smithi135 to 17113M 2024-05-08T23:10:33.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:33 smithi135 ceph-mon[42440]: from='osd.0 [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T23:10:33.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:33 smithi135 ceph-mon[42440]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T23:10:33.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:10:33.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:33 smithi135 ceph-mon[42440]: from='osd.0 [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-08T23:10:34.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:34 smithi179 ceph-mon[46314]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:34.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:34 smithi179 ceph-mon[46314]: from='osd.0 [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-08T23:10:34.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:34 smithi179 ceph-mon[46314]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T23:10:34.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:34 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:10:34.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:34 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:10:34.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:34 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:10:34.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:34 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:10:34.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:34 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:34.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:34 smithi195 ceph-mon[46516]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:34.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:34 smithi195 ceph-mon[46516]: from='osd.0 [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-08T23:10:34.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:34 smithi195 ceph-mon[46516]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T23:10:34.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:34 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:10:34.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:34 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:10:34.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:34 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:10:34.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:34 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:10:34.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:34 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:34.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:34 smithi135 ceph-mon[42440]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:34.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:34 smithi135 ceph-mon[42440]: from='osd.0 [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-08T23:10:34.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:34 smithi135 ceph-mon[42440]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T23:10:34.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:34 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:10:34.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:34 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:10:34.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:34 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:10:34.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:34 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:10:34.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:34 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:35.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:35 smithi179 ceph-mon[46314]: purged_snaps scrub starts 2024-05-08T23:10:35.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:35 smithi179 ceph-mon[46314]: purged_snaps scrub ok 2024-05-08T23:10:35.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:35 smithi179 ceph-mon[46314]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:10:35.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:35 smithi179 ceph-mon[46314]: osd.0 [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982] boot 2024-05-08T23:10:35.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:35 smithi179 ceph-mon[46314]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T23:10:35.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:35 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:10:35.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:35 smithi195 ceph-mon[46516]: purged_snaps scrub starts 2024-05-08T23:10:35.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:35 smithi195 ceph-mon[46516]: purged_snaps scrub ok 2024-05-08T23:10:35.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:35 smithi195 ceph-mon[46516]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:10:35.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:35 smithi195 ceph-mon[46516]: osd.0 [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982] boot 2024-05-08T23:10:35.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:35 smithi195 ceph-mon[46516]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T23:10:35.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:35 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:10:35.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:35 smithi135 ceph-mon[42440]: purged_snaps scrub starts 2024-05-08T23:10:35.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:35 smithi135 ceph-mon[42440]: purged_snaps scrub ok 2024-05-08T23:10:35.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:35 smithi135 ceph-mon[42440]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:10:35.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:35 smithi135 ceph-mon[42440]: osd.0 [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982] boot 2024-05-08T23:10:35.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:35 smithi135 ceph-mon[42440]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T23:10:35.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:35 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:10:36.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:36 smithi179 ceph-mon[46314]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:36.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:36 smithi179 ceph-mon[46314]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T23:10:36.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:36 smithi179 ceph-mon[46314]: from='client.? 172.21.15.179:0/1068058790' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23d196fd-2c00-40a3-84d4-fa1acbf73426"}]: dispatch 2024-05-08T23:10:36.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:36 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23d196fd-2c00-40a3-84d4-fa1acbf73426"}]: dispatch 2024-05-08T23:10:36.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:36 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23d196fd-2c00-40a3-84d4-fa1acbf73426"}]': finished 2024-05-08T23:10:36.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:36 smithi179 ceph-mon[46314]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T23:10:36.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:36 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:36.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:36 smithi179 ceph-mon[46314]: from='client.? 172.21.15.179:0/1334351437' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:10:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:36 smithi195 ceph-mon[46516]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:36 smithi195 ceph-mon[46516]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T23:10:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:36 smithi195 ceph-mon[46516]: from='client.? 172.21.15.179:0/1068058790' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23d196fd-2c00-40a3-84d4-fa1acbf73426"}]: dispatch 2024-05-08T23:10:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:36 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23d196fd-2c00-40a3-84d4-fa1acbf73426"}]: dispatch 2024-05-08T23:10:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:36 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23d196fd-2c00-40a3-84d4-fa1acbf73426"}]': finished 2024-05-08T23:10:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:36 smithi195 ceph-mon[46516]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T23:10:36.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:36 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:36.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:36 smithi195 ceph-mon[46516]: from='client.? 172.21.15.179:0/1334351437' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:10:36.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:36 smithi135 ceph-mon[42440]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:10:36.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:36 smithi135 ceph-mon[42440]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T23:10:36.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:36 smithi135 ceph-mon[42440]: from='client.? 172.21.15.179:0/1068058790' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23d196fd-2c00-40a3-84d4-fa1acbf73426"}]: dispatch 2024-05-08T23:10:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:36 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23d196fd-2c00-40a3-84d4-fa1acbf73426"}]: dispatch 2024-05-08T23:10:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:36 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23d196fd-2c00-40a3-84d4-fa1acbf73426"}]': finished 2024-05-08T23:10:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:36 smithi135 ceph-mon[42440]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T23:10:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:36 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:36 smithi135 ceph-mon[42440]: from='client.? 172.21.15.179:0/1334351437' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:10:38.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:38 smithi179 ceph-mon[46314]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:38.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:38 smithi195 ceph-mon[46516]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:38.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:38 smithi135 ceph-mon[42440]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:40.330 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:40 smithi179 ceph-mon[46314]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:40.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:40 smithi195 ceph-mon[46516]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:40.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:40 smithi135 ceph-mon[42440]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:42.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:42 smithi179 ceph-mon[46314]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:42.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:42 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T23:10:42.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:42 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:42.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:42 smithi195 ceph-mon[46516]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:42.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:42 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T23:10:42.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:42 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:42.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:42 smithi135 ceph-mon[42440]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:42.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:42 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T23:10:42.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:42 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:43.328 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:43 smithi179 ceph-mon[46314]: Deploying daemon osd.1 on smithi179 2024-05-08T23:10:43.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:43 smithi195 ceph-mon[46516]: Deploying daemon osd.1 on smithi179 2024-05-08T23:10:43.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:43 smithi135 ceph-mon[42440]: Deploying daemon osd.1 on smithi179 2024-05-08T23:10:44.340 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:44 smithi179 ceph-mon[46314]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:44.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:44 smithi195 ceph-mon[46516]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:44.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:44 smithi135 ceph-mon[42440]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:46.313 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:46 smithi179 ceph-mon[46314]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:46.313 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:46 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:46.313 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:46 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:46.313 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:46 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:46.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:46 smithi195 ceph-mon[46516]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:46.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:46 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:46.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:46 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:46.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:46 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:46.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:46 smithi135 ceph-mon[42440]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:46.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:46 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:46.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:46 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:46.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:46 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:47.484 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:47.484+0000 7f6143fff700 1 -- 172.21.15.179:0/245683439 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f615c02ceb0 con 0x7f61440a1090 2024-05-08T23:10:47.484 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 1 on host 'smithi179' 2024-05-08T23:10:47.485 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:47.486+0000 7f61613d6700 1 -- 172.21.15.179:0/245683439 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f61440a1090 msgr2=0x7f61440a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:47.486 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:47.486+0000 7f61613d6700 1 --2- 172.21.15.179:0/245683439 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f61440a1090 0x7f61440a3550 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f615c102040 tx=0x7f615000a3b0 comp rx=0 tx=0).stop 2024-05-08T23:10:47.486 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:47.486+0000 7f61613d6700 1 -- 172.21.15.179:0/245683439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f615c1021e0 msgr2=0x7f615c197380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:47.486 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:47.486+0000 7f61613d6700 1 --2- 172.21.15.179:0/245683439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f615c1021e0 0x7f615c197380 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f614c0036f0 tx=0x7f614c0047b0 comp rx=0 tx=0).stop 2024-05-08T23:10:47.486 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:47.486+0000 7f61613d6700 1 -- 172.21.15.179:0/245683439 shutdown_connections 2024-05-08T23:10:47.486 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:47.486+0000 7f61613d6700 1 --2- 172.21.15.179:0/245683439 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f61440a1090 0x7f61440a3550 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:47.486 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:47.486+0000 7f61613d6700 1 --2- 172.21.15.179:0/245683439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f615c100fe0 0x7f615c196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:47.486 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:47.486+0000 7f61613d6700 1 --2- 172.21.15.179:0/245683439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f615c102b80 0x7f615c19e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:47.486 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:47.486+0000 7f61613d6700 1 --2- 172.21.15.179:0/245683439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f615c1021e0 0x7f615c197380 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:47.486 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:47.486+0000 7f61613d6700 1 -- 172.21.15.179:0/245683439 >> 172.21.15.179:0/245683439 conn(0x7f615c0fc5a0 msgr2=0x7f615c105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:10:47.486 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:47.486+0000 7f61613d6700 1 -- 172.21.15.179:0/245683439 shutdown_connections 2024-05-08T23:10:47.486 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:10:47.486+0000 7f61613d6700 1 -- 172.21.15.179:0/245683439 wait complete. 2024-05-08T23:10:47.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:47.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:47.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:47.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:47.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:47 smithi135 ceph-mon[42440]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:47.784 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:47.785 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:47.785 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:47.785 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:47.785 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:47.785 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:47 smithi179 ceph-mon[46314]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:47.878 DEBUG:teuthology.orchestra.run.smithi179:osd.1> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.1.service 2024-05-08T23:10:47.880 INFO:tasks.cephadm:Deploying osd.2 on smithi195 with /dev/vg_nvme/lv_4... 2024-05-08T23:10:47.880 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T23:10:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:47 smithi195 ceph-mon[46516]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:47.909 INFO:journalctl@ceph.osd.1.smithi179.stdout:-- Logs begin at Wed 2024-05-08 22:52:32 UTC. -- 2024-05-08T23:10:48.108 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:10:48.597 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:48 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:48.597 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:48 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:48.597 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:48 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:48.688 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:48 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:48.688 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:48 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:48.688 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:48 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:48.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:48 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:48.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:48 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:48.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:48 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:10:49.350 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:10:49 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-1[51237]: 2024-05-08T23:10:49.038+0000 7eff4c7567c0 -1 osd.1 0 log_to_monitors true 2024-05-08T23:10:49.474 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T23:10:49.474 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T23:10:49.474 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-05-08T23:10:49.474 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-05-08T23:10:49.475 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0082943 s, 1.3 GB/s 2024-05-08T23:10:49.475 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-05-08T23:10:49.697 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:49 smithi195 ceph-mon[46516]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:49.697 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:49 smithi195 ceph-mon[46516]: from='osd.1 [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T23:10:49.697 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:49 smithi195 ceph-mon[46516]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T23:10:49.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:49 smithi135 ceph-mon[42440]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:49.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:49 smithi135 ceph-mon[42440]: from='osd.1 [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T23:10:49.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:49 smithi135 ceph-mon[42440]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T23:10:49.750 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:49 smithi179 ceph-mon[46314]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:49.750 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:49 smithi179 ceph-mon[46314]: from='osd.1 [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T23:10:49.750 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:49 smithi179 ceph-mon[46314]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T23:10:49.892 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi195:vg_nvme/lv_4 2024-05-08T23:10:50.109 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:10:50.605 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:50 smithi195 ceph-mon[46516]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T23:10:50.605 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:50 smithi195 ceph-mon[46516]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T23:10:50.605 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:50 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:50.605 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:50 smithi195 ceph-mon[46516]: from='osd.1 [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:10:50.605 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:50 smithi195 ceph-mon[46516]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:10:50.605 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:50 smithi195 ceph-mon[46516]: Detected new or changed devices on smithi179 2024-05-08T23:10:50.605 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:50 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:50.605 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:50 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:50.605 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:50 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:10:50.605 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:50 smithi195 ceph-mon[46516]: Adjusting osd_memory_target on smithi179 to 17113M 2024-05-08T23:10:50.606 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:50 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:50.606 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:50 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:50.606 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:50 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:50.606 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:50 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:50.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:50 smithi135 ceph-mon[42440]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T23:10:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:50 smithi135 ceph-mon[42440]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T23:10:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:50 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:50 smithi135 ceph-mon[42440]: from='osd.1 [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:10:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:50 smithi135 ceph-mon[42440]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:10:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:50 smithi135 ceph-mon[42440]: Detected new or changed devices on smithi179 2024-05-08T23:10:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:50 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:50 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:50 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:10:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:50 smithi135 ceph-mon[42440]: Adjusting osd_memory_target on smithi179 to 17113M 2024-05-08T23:10:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:50 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:50 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:50 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:50.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:50 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:50.849 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:10:50 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-1[51237]: 2024-05-08T23:10:50.451+0000 7eff41dba700 -1 osd.1 0 waiting for initial osdmap 2024-05-08T23:10:50.849 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:10:50 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-1[51237]: 2024-05-08T23:10:50.454+0000 7eff3dbaf700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:10:50.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:50 smithi179 ceph-mon[46314]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T23:10:50.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:50 smithi179 ceph-mon[46314]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T23:10:50.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:50 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:50.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:50 smithi179 ceph-mon[46314]: from='osd.1 [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:10:50.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:50 smithi179 ceph-mon[46314]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:10:50.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:50 smithi179 ceph-mon[46314]: Detected new or changed devices on smithi179 2024-05-08T23:10:50.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:50 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:50.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:50 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:50.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:50 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:10:50.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:50 smithi179 ceph-mon[46314]: Adjusting osd_memory_target on smithi179 to 17113M 2024-05-08T23:10:50.851 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:50 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:50.851 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:50 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:50.851 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:50 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:10:50.851 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:50 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:10:51.150 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.148+0000 7fc844c36700 1 -- 172.21.15.195:0/3530410535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc840102200 msgr2=0x7fc840102660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:51.151 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.148+0000 7fc844c36700 1 --2- 172.21.15.195:0/3530410535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc840102200 0x7fc840102660 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc828009990 tx=0x7fc828009ca0 comp rx=0 tx=0).stop 2024-05-08T23:10:51.151 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.148+0000 7fc844c36700 1 -- 172.21.15.195:0/3530410535 shutdown_connections 2024-05-08T23:10:51.151 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.148+0000 7fc844c36700 1 --2- 172.21.15.195:0/3530410535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc840102ba0 0x7fc840109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:51.151 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.148+0000 7fc844c36700 1 --2- 172.21.15.195:0/3530410535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc840101000 0x7fc840101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:51.151 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.148+0000 7fc844c36700 1 --2- 172.21.15.195:0/3530410535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc840102200 0x7fc840102660 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:51.151 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.148+0000 7fc844c36700 1 -- 172.21.15.195:0/3530410535 >> 172.21.15.195:0/3530410535 conn(0x7fc8400fc5c0 msgr2=0x7fc8400fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:10:51.151 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.148+0000 7fc844c36700 1 -- 172.21.15.195:0/3530410535 shutdown_connections 2024-05-08T23:10:51.151 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.148+0000 7fc844c36700 1 -- 172.21.15.195:0/3530410535 wait complete. 2024-05-08T23:10:51.151 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.149+0000 7fc844c36700 1 Processor -- start 2024-05-08T23:10:51.151 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.149+0000 7fc844c36700 1 -- start start 2024-05-08T23:10:51.151 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.149+0000 7fc844c36700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc840101000 0x7fc840196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:51.152 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.149+0000 7fc844c36700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc840102200 0x7fc840197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:51.152 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.149+0000 7fc844c36700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc840102ba0 0x7fc84019e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:51.152 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.149+0000 7fc844c36700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84019ea70 con 0x7fc840102ba0 2024-05-08T23:10:51.152 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.149+0000 7fc844c36700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84019ebb0 con 0x7fc840102200 2024-05-08T23:10:51.152 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.149+0000 7fc844c36700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84019ed40 con 0x7fc840101000 2024-05-08T23:10:51.152 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.149+0000 7fc83e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc840101000 0x7fc840196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:51.152 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.149+0000 7fc83e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc840101000 0x7fc840196f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:47988/0 (socket says 172.21.15.195:47988) 2024-05-08T23:10:51.152 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.149+0000 7fc83e59c700 1 -- 172.21.15.195:0/3248280905 learned_addr learned my addr 172.21.15.195:0/3248280905 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T23:10:51.152 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.150+0000 7fc83dd9b700 1 --2- 172.21.15.195:0/3248280905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc840102200 0x7fc840197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:51.152 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.150+0000 7fc83ed9d700 1 --2- 172.21.15.195:0/3248280905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc840102ba0 0x7fc84019e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:51.152 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.150+0000 7fc83e59c700 1 -- 172.21.15.195:0/3248280905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc840102200 msgr2=0x7fc840197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:51.152 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.150+0000 7fc83e59c700 1 --2- 172.21.15.195:0/3248280905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc840102200 0x7fc840197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:51.152 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.150+0000 7fc83e59c700 1 -- 172.21.15.195:0/3248280905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc840102ba0 msgr2=0x7fc84019e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:10:51.152 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.150+0000 7fc83e59c700 1 --2- 172.21.15.195:0/3248280905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc840102ba0 0x7fc84019e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:10:51.153 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.150+0000 7fc83e59c700 1 -- 172.21.15.195:0/3248280905 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8280095f0 con 0x7fc840101000 2024-05-08T23:10:51.153 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.150+0000 7fc83ed9d700 1 --2- 172.21.15.195:0/3248280905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc840102ba0 0x7fc84019e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:10:51.153 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.150+0000 7fc83e59c700 1 --2- 172.21.15.195:0/3248280905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc840101000 0x7fc840196f30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc83000b530 tx=0x7fc83000b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:10:51.153 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.150+0000 7fc8377fe700 1 -- 172.21.15.195:0/3248280905 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830011830 con 0x7fc840101000 2024-05-08T23:10:51.153 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.150+0000 7fc8377fe700 1 -- 172.21.15.195:0/3248280905 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc830011e50 con 0x7fc840101000 2024-05-08T23:10:51.153 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.150+0000 7fc844c36700 1 -- 172.21.15.195:0/3248280905 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84019efc0 con 0x7fc840101000 2024-05-08T23:10:51.153 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.150+0000 7fc8377fe700 1 -- 172.21.15.195:0/3248280905 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000f2e0 con 0x7fc840101000 2024-05-08T23:10:51.153 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.150+0000 7fc844c36700 1 -- 172.21.15.195:0/3248280905 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84019f480 con 0x7fc840101000 2024-05-08T23:10:51.154 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.151+0000 7fc844c36700 1 -- 172.21.15.195:0/3248280905 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc840108410 con 0x7fc840101000 2024-05-08T23:10:51.154 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.152+0000 7fc8377fe700 1 -- 172.21.15.195:0/3248280905 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 15) v1 ==== 135818+0+0 (secure 0 0 0) 0x7fc830010580 con 0x7fc840101000 2024-05-08T23:10:51.154 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.152+0000 7fc8377fe700 1 --2- 172.21.15.195:0/3248280905 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc82c0a1110 0x7fc82c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:10:51.154 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.153+0000 7fc8377fe700 1 -- 172.21.15.195:0/3248280905 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2029+0+0 (secure 0 0 0) 0x7fc8300caf00 con 0x7fc840101000 2024-05-08T23:10:51.154 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.153+0000 7fc83dd9b700 1 --2- 172.21.15.195:0/3248280905 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc82c0a1110 0x7fc82c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:10:51.155 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.153+0000 7fc83dd9b700 1 --2- 172.21.15.195:0/3248280905 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc82c0a1110 0x7fc82c0a35d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc82800b5c0 tx=0x7fc828005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:10:51.156 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.156+0000 7fc8377fe700 1 -- 172.21.15.195:0/3248280905 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc830096000 con 0x7fc840101000 2024-05-08T23:10:51.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:10:51.357+0000 7fc844c36700 1 -- 172.21.15.195:0/3248280905 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc84002cee0 con 0x7fc82c0a1110 2024-05-08T23:10:51.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:51 smithi135 ceph-mon[42440]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-05-08T23:10:51.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:51 smithi135 ceph-mon[42440]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T23:10:51.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:51 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:51.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:51 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:51.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:51 smithi135 ceph-mon[42440]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:51.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:51 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:10:51.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:51 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:10:51.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:51 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:51.718 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:51 smithi195 ceph-mon[46516]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-05-08T23:10:51.718 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:51 smithi195 ceph-mon[46516]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T23:10:51.718 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:51.718 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:51.718 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:51 smithi195 ceph-mon[46516]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:51.718 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:10:51.718 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:10:51.718 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:51.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:51 smithi179 ceph-mon[46314]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-05-08T23:10:51.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:51 smithi179 ceph-mon[46314]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T23:10:51.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:51 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:51.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:51 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:51.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:51 smithi179 ceph-mon[46314]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:10:51.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:51 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:10:51.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:51 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:10:51.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:51 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:10:52.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:52 smithi135 ceph-mon[42440]: purged_snaps scrub starts 2024-05-08T23:10:52.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:52 smithi135 ceph-mon[42440]: purged_snaps scrub ok 2024-05-08T23:10:52.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:52 smithi135 ceph-mon[42440]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:10:52.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:52 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:52.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:52 smithi135 ceph-mon[42440]: osd.1 [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152] boot 2024-05-08T23:10:52.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:52 smithi135 ceph-mon[42440]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T23:10:52.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:52 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:52.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:52 smithi179 ceph-mon[46314]: purged_snaps scrub starts 2024-05-08T23:10:52.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:52 smithi179 ceph-mon[46314]: purged_snaps scrub ok 2024-05-08T23:10:52.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:52 smithi179 ceph-mon[46314]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:10:52.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:52 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:52.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:52 smithi179 ceph-mon[46314]: osd.1 [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152] boot 2024-05-08T23:10:52.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:52 smithi179 ceph-mon[46314]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T23:10:52.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:52 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:52.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:52 smithi195 ceph-mon[46516]: purged_snaps scrub starts 2024-05-08T23:10:52.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:52 smithi195 ceph-mon[46516]: purged_snaps scrub ok 2024-05-08T23:10:52.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:52 smithi195 ceph-mon[46516]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:10:52.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:52 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:52.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:52 smithi195 ceph-mon[46516]: osd.1 [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152] boot 2024-05-08T23:10:52.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:52 smithi195 ceph-mon[46516]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T23:10:52.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:52 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:10:53.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:53 smithi179 ceph-mon[46314]: osdmap e14: 2 total, 2 up, 2 in 2024-05-08T23:10:53.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:53 smithi179 ceph-mon[46314]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:10:53.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:53 smithi179 ceph-mon[46314]: from='client.? 172.21.15.195:0/3127326440' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb61be11-dbcf-45c7-b436-a00694480bbf"}]: dispatch 2024-05-08T23:10:53.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:53 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb61be11-dbcf-45c7-b436-a00694480bbf"}]: dispatch 2024-05-08T23:10:53.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:53 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb61be11-dbcf-45c7-b436-a00694480bbf"}]': finished 2024-05-08T23:10:53.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:53 smithi179 ceph-mon[46314]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T23:10:53.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:53 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:10:53.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:53 smithi195 ceph-mon[46516]: osdmap e14: 2 total, 2 up, 2 in 2024-05-08T23:10:53.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:53 smithi195 ceph-mon[46516]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:10:53.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:53 smithi195 ceph-mon[46516]: from='client.? 172.21.15.195:0/3127326440' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb61be11-dbcf-45c7-b436-a00694480bbf"}]: dispatch 2024-05-08T23:10:53.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:53 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb61be11-dbcf-45c7-b436-a00694480bbf"}]: dispatch 2024-05-08T23:10:53.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:53 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb61be11-dbcf-45c7-b436-a00694480bbf"}]': finished 2024-05-08T23:10:53.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:53 smithi195 ceph-mon[46516]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T23:10:53.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:53 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:10:53.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:53 smithi135 ceph-mon[42440]: osdmap e14: 2 total, 2 up, 2 in 2024-05-08T23:10:53.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:53 smithi135 ceph-mon[42440]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:10:53.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:53 smithi135 ceph-mon[42440]: from='client.? 172.21.15.195:0/3127326440' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb61be11-dbcf-45c7-b436-a00694480bbf"}]: dispatch 2024-05-08T23:10:53.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:53 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb61be11-dbcf-45c7-b436-a00694480bbf"}]: dispatch 2024-05-08T23:10:53.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:53 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb61be11-dbcf-45c7-b436-a00694480bbf"}]': finished 2024-05-08T23:10:53.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:53 smithi135 ceph-mon[42440]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T23:10:53.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:53 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:10:54.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:54 smithi179 ceph-mon[46314]: from='client.? 172.21.15.195:0/1746941172' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:10:54.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:54 smithi195 ceph-mon[46516]: from='client.? 172.21.15.195:0/1746941172' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:10:54.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:54 smithi135 ceph-mon[42440]: from='client.? 172.21.15.195:0/1746941172' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:10:55.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:55 smithi179 ceph-mon[46314]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:10:55.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:55 smithi195 ceph-mon[46516]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:10:55.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:55 smithi135 ceph-mon[42440]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:10:58.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:10:58 smithi179 ceph-mon[46314]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:10:58.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:10:58 smithi195 ceph-mon[46516]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:10:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:10:58 smithi135 ceph-mon[42440]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:00.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:00 smithi179 ceph-mon[46314]: pgmap v54: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:00.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:00 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T23:11:00.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:00 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:00.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:00 smithi195 ceph-mon[46516]: pgmap v54: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:00.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:00 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T23:11:00.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:00 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:00.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:00 smithi135 ceph-mon[42440]: pgmap v54: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:00.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:00 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T23:11:00.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:00 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:01.311 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:01 smithi195 ceph-mon[46516]: Deploying daemon osd.2 on smithi195 2024-05-08T23:11:01.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:01 smithi179 ceph-mon[46314]: Deploying daemon osd.2 on smithi195 2024-05-08T23:11:01.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:01 smithi135 ceph-mon[42440]: Deploying daemon osd.2 on smithi195 2024-05-08T23:11:02.331 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:02 smithi195 ceph-mon[46516]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:02.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:02 smithi179 ceph-mon[46314]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:02.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:02 smithi135 ceph-mon[42440]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:04.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:04 smithi179 ceph-mon[46314]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:04.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:04 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:04.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:04 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:04.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:04 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:04.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:04 smithi195 ceph-mon[46516]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:04.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:04.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:04.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:04.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:04 smithi135 ceph-mon[42440]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:04.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:04.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:04.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:05.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:05.361+0000 7fc8377fe700 1 -- 172.21.15.195:0/3248280905 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc84002cee0 con 0x7fc82c0a1110 2024-05-08T23:11:05.361 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 2 on host 'smithi195' 2024-05-08T23:11:05.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:05.363+0000 7fc844c36700 1 -- 172.21.15.195:0/3248280905 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc82c0a1110 msgr2=0x7fc82c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:05.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:05.363+0000 7fc844c36700 1 --2- 172.21.15.195:0/3248280905 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc82c0a1110 0x7fc82c0a35d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc82800b5c0 tx=0x7fc828005fb0 comp rx=0 tx=0).stop 2024-05-08T23:11:05.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:05.363+0000 7fc844c36700 1 -- 172.21.15.195:0/3248280905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc840101000 msgr2=0x7fc840196f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:05.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:05.363+0000 7fc844c36700 1 --2- 172.21.15.195:0/3248280905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc840101000 0x7fc840196f30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc83000b530 tx=0x7fc83000b8f0 comp rx=0 tx=0).stop 2024-05-08T23:11:05.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:05.363+0000 7fc844c36700 1 -- 172.21.15.195:0/3248280905 shutdown_connections 2024-05-08T23:11:05.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:05.363+0000 7fc844c36700 1 --2- 172.21.15.195:0/3248280905 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc82c0a1110 0x7fc82c0a35d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:05.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:05.363+0000 7fc844c36700 1 --2- 172.21.15.195:0/3248280905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc840101000 0x7fc840196f30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:05.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:05.363+0000 7fc844c36700 1 --2- 172.21.15.195:0/3248280905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc840102ba0 0x7fc84019e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:05.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:05.363+0000 7fc844c36700 1 --2- 172.21.15.195:0/3248280905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc840102200 0x7fc840197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:05.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:05.363+0000 7fc844c36700 1 -- 172.21.15.195:0/3248280905 >> 172.21.15.195:0/3248280905 conn(0x7fc8400fc5c0 msgr2=0x7fc840105550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:11:05.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:05.363+0000 7fc844c36700 1 -- 172.21.15.195:0/3248280905 shutdown_connections 2024-05-08T23:11:05.364 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:05.363+0000 7fc844c36700 1 -- 172.21.15.195:0/3248280905 wait complete. 2024-05-08T23:11:05.797 DEBUG:teuthology.orchestra.run.smithi195:osd.2> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.2.service 2024-05-08T23:11:05.799 INFO:tasks.cephadm:Deploying osd.3 on smithi135 with /dev/vg_nvme/lv_3... 2024-05-08T23:11:05.799 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T23:11:05.831 INFO:journalctl@ceph.osd.2.smithi195.stdout:-- Logs begin at Wed 2024-05-08 22:52:38 UTC. -- 2024-05-08T23:11:05.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:05 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:05.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:05 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:05.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:05 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:05.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:05 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:05.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:05 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:05.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:05 smithi195 ceph-mon[46516]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:05.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:05 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:05.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:05 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:05.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:05 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:05.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:05 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:05.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:05 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:05.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:05 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:05.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:05 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:05.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:05 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:05.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:05 smithi135 ceph-mon[42440]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:05.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:05 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:05.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:05 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:05.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:05 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:06.034 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:11:06.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:05 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:06.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:05 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:06.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:05 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:06.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:05 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:06.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:05 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:06.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:05 smithi179 ceph-mon[46314]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:06.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:05 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:06.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:05 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:06.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:05 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:07.359 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T23:11:07.359 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T23:11:07.360 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-05-08T23:11:07.360 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-05-08T23:11:07.360 INFO:teuthology.orchestra.run.smithi135.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112015 s, 936 MB/s 2024-05-08T23:11:07.360 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-05-08T23:11:07.380 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:11:07 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-2[52283]: 2024-05-08T23:11:07.056+0000 7f47a1ea87c0 -1 osd.2 0 log_to_monitors true 2024-05-08T23:11:07.747 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_3 2024-05-08T23:11:07.971 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:11:08.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:08 smithi179 ceph-mon[46314]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:08.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:08 smithi179 ceph-mon[46314]: from='osd.2 [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T23:11:08.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:08.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:08.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:11:08.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:08.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:08.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:08.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:08.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:08 smithi135 ceph-mon[42440]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:08.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:08 smithi135 ceph-mon[42440]: from='osd.2 [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T23:11:08.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:08.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:08.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:11:08.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:08.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:08.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:08.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:08.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:08 smithi195 ceph-mon[46516]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:08.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:08 smithi195 ceph-mon[46516]: from='osd.2 [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T23:11:08.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:08.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:08.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:11:08.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:08.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:08.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:08.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:08.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.904+0000 7efdadb2c700 1 -- 172.21.15.135:0/2400052182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda8102200 msgr2=0x7efda8102660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:08.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.904+0000 7efdadb2c700 1 --2- 172.21.15.135:0/2400052182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda8102200 0x7efda8102660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efd900099c0 tx=0x7efd90009cd0 comp rx=0 tx=0).stop 2024-05-08T23:11:08.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.904+0000 7efdadb2c700 1 -- 172.21.15.135:0/2400052182 shutdown_connections 2024-05-08T23:11:08.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.904+0000 7efdadb2c700 1 --2- 172.21.15.135:0/2400052182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efda8101000 0x7efda8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:08.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.904+0000 7efdadb2c700 1 --2- 172.21.15.135:0/2400052182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efda8102ba0 0x7efda8109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:08.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.904+0000 7efdadb2c700 1 --2- 172.21.15.135:0/2400052182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda8102200 0x7efda8102660 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:08.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.904+0000 7efdadb2c700 1 -- 172.21.15.135:0/2400052182 >> 172.21.15.135:0/2400052182 conn(0x7efda80fc5c0 msgr2=0x7efda80fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:11:08.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.904+0000 7efdadb2c700 1 -- 172.21.15.135:0/2400052182 shutdown_connections 2024-05-08T23:11:08.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.904+0000 7efdadb2c700 1 -- 172.21.15.135:0/2400052182 wait complete. 2024-05-08T23:11:08.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.905+0000 7efdadb2c700 1 Processor -- start 2024-05-08T23:11:08.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.905+0000 7efdadb2c700 1 -- start start 2024-05-08T23:11:08.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.905+0000 7efdadb2c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda8101000 0x7efda8074cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:11:08.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.905+0000 7efdadb2c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efda8102200 0x7efda8073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:11:08.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.905+0000 7efdadb2c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efda8102ba0 0x7efda80738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:11:08.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.905+0000 7efdadb2c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda8074070 con 0x7efda8101000 2024-05-08T23:11:08.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.905+0000 7efdadb2c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda80741e0 con 0x7efda8102ba0 2024-05-08T23:11:08.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.905+0000 7efdadb2c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda81a1020 con 0x7efda8102200 2024-05-08T23:11:08.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.905+0000 7efda77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda8101000 0x7efda8074cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:11:08.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.905+0000 7efda77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda8101000 0x7efda8074cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35924/0 (socket says 172.21.15.135:35924) 2024-05-08T23:11:08.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.905+0000 7efda77fe700 1 -- 172.21.15.135:0/4291072976 learned_addr learned my addr 172.21.15.135:0/4291072976 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:11:08.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.906+0000 7efda7fff700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efda8102ba0 0x7efda80738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:11:08.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.906+0000 7efda6ffd700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efda8102200 0x7efda8073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:11:08.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.906+0000 7efda77fe700 1 -- 172.21.15.135:0/4291072976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efda8102200 msgr2=0x7efda8073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:08.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.906+0000 7efda77fe700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efda8102200 0x7efda8073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:08.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.906+0000 7efda77fe700 1 -- 172.21.15.135:0/4291072976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efda8102ba0 msgr2=0x7efda80738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:08.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.906+0000 7efda77fe700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efda8102ba0 0x7efda80738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:08.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.906+0000 7efda77fe700 1 -- 172.21.15.135:0/4291072976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd900095f0 con 0x7efda8101000 2024-05-08T23:11:08.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.906+0000 7efda7fff700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efda8102ba0 0x7efda80738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:11:08.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.906+0000 7efda6ffd700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efda8102200 0x7efda8073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:11:08.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.906+0000 7efda77fe700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda8101000 0x7efda8074cf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efd9800c970 tx=0x7efd9800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:11:08.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.906+0000 7efda4ff9700 1 -- 172.21.15.135:0/4291072976 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98004220 con 0x7efda8101000 2024-05-08T23:11:08.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.906+0000 7efdadb2c700 1 -- 172.21.15.135:0/4291072976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda81a12b0 con 0x7efda8101000 2024-05-08T23:11:08.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.906+0000 7efda4ff9700 1 -- 172.21.15.135:0/4291072976 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd98007d60 con 0x7efda8101000 2024-05-08T23:11:08.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.906+0000 7efda4ff9700 1 -- 172.21.15.135:0/4291072976 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98003d00 con 0x7efda8101000 2024-05-08T23:11:08.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.906+0000 7efdadb2c700 1 -- 172.21.15.135:0/4291072976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda81a1800 con 0x7efda8101000 2024-05-08T23:11:08.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.907+0000 7efdadb2c700 1 -- 172.21.15.135:0/4291072976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda81084e0 con 0x7efda8101000 2024-05-08T23:11:08.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.908+0000 7efda4ff9700 1 -- 172.21.15.135:0/4291072976 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 15) v1 ==== 135818+0+0 (secure 0 0 0) 0x7efd98004380 con 0x7efda8101000 2024-05-08T23:11:08.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.909+0000 7efda4ff9700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7efd940a1090 0x7efd940a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:11:08.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.909+0000 7efda6ffd700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7efd940a1090 0x7efd940a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:11:08.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.909+0000 7efda4ff9700 1 -- 172.21.15.135:0/4291072976 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2445+0+0 (secure 0 0 0) 0x7efd980cb100 con 0x7efda8101000 2024-05-08T23:11:08.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.909+0000 7efda6ffd700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7efd940a1090 0x7efd940a3550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efd90003820 tx=0x7efd90000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:11:08.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:08.913+0000 7efda4ff9700 1 -- 172.21.15.135:0/4291072976 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efd98095fc0 con 0x7efda8101000 2024-05-08T23:11:09.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:09.118+0000 7efdadb2c700 1 -- 172.21.15.135:0/4291072976 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7efda802cdf0 con 0x7efd940a1090 2024-05-08T23:11:09.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:09 smithi179 ceph-mon[46314]: Detected new or changed devices on smithi195 2024-05-08T23:11:09.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:09 smithi179 ceph-mon[46314]: Adjusting osd_memory_target on smithi195 to 17113M 2024-05-08T23:11:09.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:09 smithi179 ceph-mon[46314]: from='osd.2 [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T23:11:09.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:09 smithi179 ceph-mon[46314]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T23:11:09.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:11:09.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:09 smithi179 ceph-mon[46314]: from='osd.2 [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:11:09.380 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:11:09 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-2[52283]: 2024-05-08T23:11:09.057+0000 7f479750c700 -1 osd.2 0 waiting for initial osdmap 2024-05-08T23:11:09.381 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:11:09 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-2[52283]: 2024-05-08T23:11:09.063+0000 7f4793301700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:11:09.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:09 smithi195 ceph-mon[46516]: Detected new or changed devices on smithi195 2024-05-08T23:11:09.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:09 smithi195 ceph-mon[46516]: Adjusting osd_memory_target on smithi195 to 17113M 2024-05-08T23:11:09.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:09 smithi195 ceph-mon[46516]: from='osd.2 [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T23:11:09.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:09 smithi195 ceph-mon[46516]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T23:11:09.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:11:09.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:09 smithi195 ceph-mon[46516]: from='osd.2 [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:11:09.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:09 smithi135 ceph-mon[42440]: Detected new or changed devices on smithi195 2024-05-08T23:11:09.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:09 smithi135 ceph-mon[42440]: Adjusting osd_memory_target on smithi195 to 17113M 2024-05-08T23:11:09.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:09 smithi135 ceph-mon[42440]: from='osd.2 [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T23:11:09.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:09 smithi135 ceph-mon[42440]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T23:11:09.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:11:09.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:09 smithi135 ceph-mon[42440]: from='osd.2 [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:11:10.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:10 smithi179 ceph-mon[46314]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:10.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:10 smithi179 ceph-mon[46314]: from='osd.2 [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-05-08T23:11:10.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:10 smithi179 ceph-mon[46314]: osdmap e17: 3 total, 2 up, 3 in 2024-05-08T23:11:10.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:10 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:11:10.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:10 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:11:10.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:10 smithi179 ceph-mon[46314]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:11:10.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:10 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:11:10.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:10 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:11:10.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:10 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:10.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:10 smithi195 ceph-mon[46516]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:10.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:10 smithi195 ceph-mon[46516]: from='osd.2 [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-05-08T23:11:10.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:10 smithi195 ceph-mon[46516]: osdmap e17: 3 total, 2 up, 3 in 2024-05-08T23:11:10.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:10 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:11:10.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:10 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:11:10.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:10 smithi195 ceph-mon[46516]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:11:10.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:10 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:11:10.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:10 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:11:10.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:10 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:10.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:10 smithi135 ceph-mon[42440]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:10.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:10 smithi135 ceph-mon[42440]: from='osd.2 [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-05-08T23:11:10.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:10 smithi135 ceph-mon[42440]: osdmap e17: 3 total, 2 up, 3 in 2024-05-08T23:11:10.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:10 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:11:10.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:10 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:11:10.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:10 smithi135 ceph-mon[42440]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:11:10.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:10 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:11:10.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:10 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:11:10.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:10 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:11.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:11 smithi179 ceph-mon[46314]: purged_snaps scrub starts 2024-05-08T23:11:11.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:11 smithi179 ceph-mon[46314]: purged_snaps scrub ok 2024-05-08T23:11:11.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:11 smithi179 ceph-mon[46314]: osd.2 [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232] boot 2024-05-08T23:11:11.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:11 smithi179 ceph-mon[46314]: osdmap e18: 3 total, 3 up, 3 in 2024-05-08T23:11:11.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:11:11.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:11 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/4178243253' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b31fd07-08f3-491b-b0ef-e898a7f4a2fb"}]: dispatch 2024-05-08T23:11:11.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:11 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/4178243253' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b31fd07-08f3-491b-b0ef-e898a7f4a2fb"}]': finished 2024-05-08T23:11:11.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:11 smithi179 ceph-mon[46314]: osdmap e19: 4 total, 3 up, 4 in 2024-05-08T23:11:11.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:11.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:11 smithi195 ceph-mon[46516]: purged_snaps scrub starts 2024-05-08T23:11:11.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:11 smithi195 ceph-mon[46516]: purged_snaps scrub ok 2024-05-08T23:11:11.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:11 smithi195 ceph-mon[46516]: osd.2 [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232] boot 2024-05-08T23:11:11.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:11 smithi195 ceph-mon[46516]: osdmap e18: 3 total, 3 up, 3 in 2024-05-08T23:11:11.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:11:11.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:11 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/4178243253' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b31fd07-08f3-491b-b0ef-e898a7f4a2fb"}]: dispatch 2024-05-08T23:11:11.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:11 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/4178243253' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b31fd07-08f3-491b-b0ef-e898a7f4a2fb"}]': finished 2024-05-08T23:11:11.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:11 smithi195 ceph-mon[46516]: osdmap e19: 4 total, 3 up, 4 in 2024-05-08T23:11:11.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:11.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:11 smithi135 ceph-mon[42440]: purged_snaps scrub starts 2024-05-08T23:11:11.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:11 smithi135 ceph-mon[42440]: purged_snaps scrub ok 2024-05-08T23:11:11.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:11 smithi135 ceph-mon[42440]: osd.2 [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232] boot 2024-05-08T23:11:11.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:11 smithi135 ceph-mon[42440]: osdmap e18: 3 total, 3 up, 3 in 2024-05-08T23:11:11.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:11:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:11 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/4178243253' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b31fd07-08f3-491b-b0ef-e898a7f4a2fb"}]: dispatch 2024-05-08T23:11:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:11 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/4178243253' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b31fd07-08f3-491b-b0ef-e898a7f4a2fb"}]': finished 2024-05-08T23:11:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:11 smithi135 ceph-mon[42440]: osdmap e19: 4 total, 3 up, 4 in 2024-05-08T23:11:11.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:12.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:12 smithi179 ceph-mon[46314]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T23:11:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:12 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1159838886' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:11:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T23:11:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:12 smithi179 ceph-mon[46314]: osdmap e20: 4 total, 3 up, 4 in 2024-05-08T23:11:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T23:11:12.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:12 smithi195 ceph-mon[46516]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:12.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T23:11:12.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:12 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1159838886' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:11:12.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T23:11:12.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:12 smithi195 ceph-mon[46516]: osdmap e20: 4 total, 3 up, 4 in 2024-05-08T23:11:12.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:12.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T23:11:12.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:12 smithi135 ceph-mon[42440]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:11:12.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T23:11:12.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:12 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1159838886' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:11:12.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T23:11:12.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:12 smithi135 ceph-mon[42440]: osdmap e20: 4 total, 3 up, 4 in 2024-05-08T23:11:12.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:12.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T23:11:13.755 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:11:13 smithi135 sudo[66640]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T23:11:13.755 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:11:13 smithi135 sudo[66640]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:11:13.755 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:11:13 smithi135 sudo[66640]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:11:13.756 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:11:13 smithi135 sudo[66640]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:11:13.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:13.962+0000 7efda4ff9700 1 -- 172.21.15.135:0/4291072976 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7efd98096390 con 0x7efda8101000 2024-05-08T23:11:14.203 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:11:13 smithi135 sudo[66829]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T23:11:14.203 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:11:13 smithi135 sudo[66829]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:11:14.203 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:11:13 smithi135 sudo[66829]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:11:14.203 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:11:13 smithi135 sudo[66829]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:11:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:13 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T23:11:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:13 smithi135 ceph-mon[42440]: osdmap e21: 4 total, 3 up, 4 in 2024-05-08T23:11:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:13 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:13 smithi135 ceph-mon[42440]: pgmap v67: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:13 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:14.264 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:11:14 smithi179 sudo[56171]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T23:11:14.264 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:11:14 smithi179 sudo[56171]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:11:14.264 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:11:14 smithi179 sudo[56171]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:11:14.264 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:11:14 smithi179 sudo[56171]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:11:14.264 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:13 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T23:11:14.264 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:13 smithi179 ceph-mon[46314]: osdmap e21: 4 total, 3 up, 4 in 2024-05-08T23:11:14.265 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:13 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:14.265 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:13 smithi179 ceph-mon[46314]: pgmap v67: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:14.265 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:13 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:13 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T23:11:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:13 smithi195 ceph-mon[46516]: osdmap e21: 4 total, 3 up, 4 in 2024-05-08T23:11:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:13 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:13 smithi195 ceph-mon[46516]: pgmap v67: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:13 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:14.599 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:11:14 smithi179 sudo[56174]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T23:11:14.600 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:11:14 smithi179 sudo[56174]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:11:14.600 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:11:14 smithi179 sudo[56174]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:11:14.600 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:11:14 smithi179 sudo[56174]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:11:14.880 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:11:14 smithi195 sudo[57091]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T23:11:14.880 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:11:14 smithi195 sudo[57091]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:11:14.880 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:11:14 smithi195 sudo[57091]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:11:14.880 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:11:14 smithi195 sudo[57091]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:11:14.880 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:11:14 smithi195 sudo[57094]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T23:11:14.881 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:11:14 smithi195 sudo[57094]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:11:14.881 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:11:14 smithi195 sudo[57094]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:11:14.881 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:11:14 smithi195 sudo[57094]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:11:15.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:15 smithi135 sudo[67215]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T23:11:15.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:15 smithi135 sudo[67215]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:11:15.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:15 smithi135 sudo[67215]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:11:15.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:15 smithi135 sudo[67215]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:11:15.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:15 smithi179 ceph-mon[46314]: osdmap e22: 4 total, 3 up, 4 in 2024-05-08T23:11:15.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:15 smithi179 ceph-mon[46314]: mgrmap e16: x(active, since 112s), standbys: z, y 2024-05-08T23:11:15.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:15.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:15.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:15.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:15 smithi179 ceph-mon[46314]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:11:15.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:15 smithi195 ceph-mon[46516]: osdmap e22: 4 total, 3 up, 4 in 2024-05-08T23:11:15.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:15 smithi195 ceph-mon[46516]: mgrmap e16: x(active, since 112s), standbys: z, y 2024-05-08T23:11:15.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:15.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:15.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:15.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:15 smithi195 ceph-mon[46516]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:11:15.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:15 smithi195 sudo[57097]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T23:11:15.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:15 smithi195 sudo[57097]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:11:15.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:15 smithi195 sudo[57097]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:11:15.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:15 smithi195 sudo[57097]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:11:15.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:15 smithi135 sudo[67284]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T23:11:15.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:15 smithi135 sudo[67284]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:11:15.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:15 smithi135 sudo[67284]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:11:15.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:15 smithi135 sudo[67284]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:11:15.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:15 smithi135 ceph-mon[42440]: osdmap e22: 4 total, 3 up, 4 in 2024-05-08T23:11:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:15 smithi135 ceph-mon[42440]: mgrmap e16: x(active, since 112s), standbys: z, y 2024-05-08T23:11:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:15 smithi135 ceph-mon[42440]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:11:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:15 smithi195 sudo[57100]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T23:11:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:15 smithi195 sudo[57100]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:11:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:15 smithi195 sudo[57100]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:11:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:15 smithi195 sudo[57100]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:11:16.309 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 sudo[56177]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T23:11:16.310 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 sudo[56177]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:11:16.310 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 sudo[56177]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:11:16.310 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 sudo[56177]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:11:16.310 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 sudo[56180]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T23:11:16.310 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 sudo[56180]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:11:16.310 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 sudo[56180]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:11:16.310 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 sudo[56180]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:11:16.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 ceph-mon[46314]: pgmap v69: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:16.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 ceph-mon[46314]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:11:16.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:11:16.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:11:16.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:11:16.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 ceph-mon[46314]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:11:16.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:11:16.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:11:16.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:11:16.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 ceph-mon[46314]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:11:16.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 ceph-mon[46314]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:11:16.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:11:16.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:11:16.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:11:16.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:16 smithi179 ceph-mon[46314]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:11:16.607 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:16 smithi135 ceph-mon[42440]: pgmap v69: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:16.607 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:16 smithi135 ceph-mon[42440]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:11:16.607 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:16 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:11:16.607 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:16 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:11:16.607 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:16 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:11:16.607 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:16 smithi135 ceph-mon[42440]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:11:16.607 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:16 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:11:16.607 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:16 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:11:16.607 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:16 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:11:16.607 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:16 smithi135 ceph-mon[42440]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:11:16.607 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:16 smithi135 ceph-mon[42440]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:11:16.607 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:16 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:11:16.607 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:16 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:11:16.608 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:16 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:11:16.608 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:16 smithi135 ceph-mon[42440]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:11:16.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:16 smithi195 ceph-mon[46516]: pgmap v69: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:16.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:16 smithi195 ceph-mon[46516]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:11:16.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:16 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:11:16.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:16 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:11:16.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:16 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:11:16.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:16 smithi195 ceph-mon[46516]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:11:16.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:16 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:11:16.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:16 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:11:16.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:16 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:11:16.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:16 smithi195 ceph-mon[46516]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:11:16.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:16 smithi195 ceph-mon[46516]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:11:16.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:16 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:11:16.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:16 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:11:16.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:16 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:11:16.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:16 smithi195 ceph-mon[46516]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:11:17.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T23:11:17.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:17.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:17 smithi135 ceph-mon[42440]: Deploying daemon osd.3 on smithi135 2024-05-08T23:11:17.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:17 smithi135 ceph-mon[42440]: pgmap v70: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:17.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T23:11:17.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:17.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:17 smithi179 ceph-mon[46314]: Deploying daemon osd.3 on smithi135 2024-05-08T23:11:17.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:17 smithi179 ceph-mon[46314]: pgmap v70: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:17.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T23:11:17.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:17.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:17 smithi195 ceph-mon[46516]: Deploying daemon osd.3 on smithi135 2024-05-08T23:11:17.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:17 smithi195 ceph-mon[46516]: pgmap v70: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:20.348 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:20 smithi135 ceph-mon[42440]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:20.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:20 smithi179 ceph-mon[46314]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:20 smithi195 ceph-mon[46516]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:21.598 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:21.598 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:21.598 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:21.598 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:21 smithi135 ceph-mon[42440]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:21.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:21.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:21.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:21.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:21 smithi179 ceph-mon[46314]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:21.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:21.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:21.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:21.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:21 smithi195 ceph-mon[46516]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:22.910 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 3 on host 'smithi135' 2024-05-08T23:11:22.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:22.911+0000 7efda4ff9700 1 -- 172.21.15.135:0/4291072976 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efda802cdf0 con 0x7efd940a1090 2024-05-08T23:11:22.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:22.913+0000 7efdadb2c700 1 -- 172.21.15.135:0/4291072976 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7efd940a1090 msgr2=0x7efd940a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:22.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:22.913+0000 7efdadb2c700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7efd940a1090 0x7efd940a3550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efd90003820 tx=0x7efd90000bc0 comp rx=0 tx=0).stop 2024-05-08T23:11:22.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:22.913+0000 7efdadb2c700 1 -- 172.21.15.135:0/4291072976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda8101000 msgr2=0x7efda8074cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:22.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:22.913+0000 7efdadb2c700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda8101000 0x7efda8074cf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efd9800c970 tx=0x7efd9800cd30 comp rx=0 tx=0).stop 2024-05-08T23:11:22.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:22.913+0000 7efdadb2c700 1 -- 172.21.15.135:0/4291072976 shutdown_connections 2024-05-08T23:11:22.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:22.913+0000 7efdadb2c700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7efd940a1090 0x7efd940a3550 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:22.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:22.913+0000 7efdadb2c700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efda8102ba0 0x7efda80738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:22.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:22.913+0000 7efdadb2c700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efda8101000 0x7efda8074cf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:22.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:22.913+0000 7efdadb2c700 1 --2- 172.21.15.135:0/4291072976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efda8102200 0x7efda8073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:22.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:22.913+0000 7efdadb2c700 1 -- 172.21.15.135:0/4291072976 >> 172.21.15.135:0/4291072976 conn(0x7efda80fc5c0 msgr2=0x7efda8105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:11:22.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:22.913+0000 7efdadb2c700 1 -- 172.21.15.135:0/4291072976 shutdown_connections 2024-05-08T23:11:22.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:11:22.913+0000 7efdadb2c700 1 -- 172.21.15.135:0/4291072976 wait complete. 2024-05-08T23:11:23.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:23 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:23.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:23 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:23.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:23 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:23.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:23 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:23.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:23 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:23.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:23 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:23.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:23 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:23.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:23 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:23.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:23 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:23.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:23 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:23.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:23 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:23.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:23 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:23.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:23 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:23.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:23 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:23.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:23 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:23.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:23 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:23.414 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:23 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:23.414 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:23 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:23.414 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:23 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:23.414 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:23 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:23.414 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:23 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:23.414 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:23 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:23.414 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:23 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:23.414 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:23 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:23.416 DEBUG:teuthology.orchestra.run.smithi135:osd.3> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.3.service 2024-05-08T23:11:23.418 INFO:tasks.cephadm:Deploying osd.4 on smithi179 with /dev/vg_nvme/lv_3... 2024-05-08T23:11:23.418 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T23:11:23.450 INFO:journalctl@ceph.osd.3.smithi135.stdout:-- Logs begin at Wed 2024-05-08 22:52:39 UTC. -- 2024-05-08T23:11:23.655 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:11:24.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:24 smithi179 ceph-mon[46314]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:24.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:24 smithi195 ceph-mon[46516]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:24.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:24 smithi135 ceph-mon[42440]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:24.944 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T23:11:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T23:11:24.945 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10+0 records in 2024-05-08T23:11:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:10+0 records out 2024-05-08T23:11:24.945 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114621 s, 915 MB/s 2024-05-08T23:11:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping successful for: 2024-05-08T23:11:24.953 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 08 23:11:24 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-3[68042]: 2024-05-08T23:11:24.457+0000 7fa8967147c0 -1 osd.3 0 log_to_monitors true 2024-05-08T23:11:25.265 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:25 smithi179 ceph-mon[46314]: from='osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T23:11:25.350 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi179:vg_nvme/lv_3 2024-05-08T23:11:25.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:25 smithi195 ceph-mon[46516]: from='osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T23:11:25.401 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:25 smithi135 ceph-mon[42440]: from='osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T23:11:25.571 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:11:26.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:26 smithi179 ceph-mon[46314]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:26.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:26 smithi179 ceph-mon[46314]: from='osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T23:11:26.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:26 smithi179 ceph-mon[46314]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T23:11:26.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:26 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:26.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:26 smithi179 ceph-mon[46314]: from='osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-08T23:11:26.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:26 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:26.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:26 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:26.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:26 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:11:26.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:26 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:11:26.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:26 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:26.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:26 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:26.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:26 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:26.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:26 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:26 smithi195 ceph-mon[46516]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:26 smithi195 ceph-mon[46516]: from='osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T23:11:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:26 smithi195 ceph-mon[46516]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T23:11:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:26 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:26.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:26 smithi195 ceph-mon[46516]: from='osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-08T23:11:26.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:26 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:26.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:26 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:26.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:26 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:11:26.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:26 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:11:26.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:26 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:26.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:26 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:26.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:26 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:26.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:26 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:26.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:26 smithi135 ceph-mon[42440]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:26.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:26 smithi135 ceph-mon[42440]: from='osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T23:11:26.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:26 smithi135 ceph-mon[42440]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T23:11:26.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:26 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:26.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:26 smithi135 ceph-mon[42440]: from='osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-08T23:11:26.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:26 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:26.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:26 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:26.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:26 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:11:26.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:26 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:11:26.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:26 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:26.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:26 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:26.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:26 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:26.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:26 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:26.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.658+0000 7fedece53700 1 -- 172.21.15.179:0/1203693777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede8101000 msgr2=0x7fede8101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:26.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.658+0000 7fedece53700 1 --2- 172.21.15.179:0/1203693777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede8101000 0x7fede8101420 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feddc0099c0 tx=0x7feddc009cd0 comp rx=0 tx=0).stop 2024-05-08T23:11:26.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.658+0000 7fedece53700 1 -- 172.21.15.179:0/1203693777 shutdown_connections 2024-05-08T23:11:26.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.658+0000 7fedece53700 1 --2- 172.21.15.179:0/1203693777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fede8102ba0 0x7fede8109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:26.660 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.658+0000 7fedece53700 1 --2- 172.21.15.179:0/1203693777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede8101000 0x7fede8101420 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:26.660 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.658+0000 7fedece53700 1 --2- 172.21.15.179:0/1203693777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fede8102200 0x7fede8102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:26.660 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.658+0000 7fedece53700 1 -- 172.21.15.179:0/1203693777 >> 172.21.15.179:0/1203693777 conn(0x7fede80fc5c0 msgr2=0x7fede80fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:11:26.660 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.658+0000 7fedece53700 1 -- 172.21.15.179:0/1203693777 shutdown_connections 2024-05-08T23:11:26.660 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.658+0000 7fedece53700 1 -- 172.21.15.179:0/1203693777 wait complete. 2024-05-08T23:11:26.660 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.658+0000 7fedece53700 1 Processor -- start 2024-05-08T23:11:26.660 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.658+0000 7fedece53700 1 -- start start 2024-05-08T23:11:26.660 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fedece53700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede8101000 0x7fede8196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:11:26.660 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fedece53700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fede8102200 0x7fede8197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:11:26.660 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fedece53700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fede8102ba0 0x7fede819e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:11:26.660 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fedece53700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede819ea60 con 0x7fede8101000 2024-05-08T23:11:26.660 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fedece53700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede819eba0 con 0x7fede8102ba0 2024-05-08T23:11:26.660 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fedece53700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede819ed30 con 0x7fede8102200 2024-05-08T23:11:26.661 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fede6d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fede8102ba0 0x7fede819e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:11:26.661 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fede6d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fede8102ba0 0x7fede819e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:36554/0 (socket says 172.21.15.179:36554) 2024-05-08T23:11:26.661 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fede6d9d700 1 -- 172.21.15.179:0/2944999571 learned_addr learned my addr 172.21.15.179:0/2944999571 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-05-08T23:11:26.661 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fede5d9b700 1 --2- 172.21.15.179:0/2944999571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fede8102200 0x7fede8197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:11:26.661 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fede659c700 1 --2- 172.21.15.179:0/2944999571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede8101000 0x7fede8196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:11:26.661 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fede6d9d700 1 -- 172.21.15.179:0/2944999571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fede8102200 msgr2=0x7fede8197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:26.661 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fede6d9d700 1 --2- 172.21.15.179:0/2944999571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fede8102200 0x7fede8197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:26.661 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fede6d9d700 1 -- 172.21.15.179:0/2944999571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede8101000 msgr2=0x7fede8196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:26.661 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fede6d9d700 1 --2- 172.21.15.179:0/2944999571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede8101000 0x7fede8196f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:26.661 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fede6d9d700 1 -- 172.21.15.179:0/2944999571 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede0009c40 con 0x7fede8102ba0 2024-05-08T23:11:26.661 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fede659c700 1 --2- 172.21.15.179:0/2944999571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede8101000 0x7fede8196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:11:26.661 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fede6d9d700 1 --2- 172.21.15.179:0/2944999571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fede8102ba0 0x7fede819e490 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fede000c370 tx=0x7fede000c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:11:26.661 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fedd77fe700 1 -- 172.21.15.179:0/2944999571 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0017070 con 0x7fede8102ba0 2024-05-08T23:11:26.661 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fedd77fe700 1 -- 172.21.15.179:0/2944999571 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fede000f040 con 0x7fede8102ba0 2024-05-08T23:11:26.662 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fedd77fe700 1 -- 172.21.15.179:0/2944999571 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede000e050 con 0x7fede8102ba0 2024-05-08T23:11:26.662 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.659+0000 7fedece53700 1 -- 172.21.15.179:0/2944999571 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc0095f0 con 0x7fede8102ba0 2024-05-08T23:11:26.662 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.660+0000 7fedece53700 1 -- 172.21.15.179:0/2944999571 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede819f230 con 0x7fede8102ba0 2024-05-08T23:11:26.663 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.660+0000 7fedece53700 1 -- 172.21.15.179:0/2944999571 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede8108530 con 0x7fede8102ba0 2024-05-08T23:11:26.663 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.661+0000 7fedd77fe700 1 -- 172.21.15.179:0/2944999571 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fede000cb60 con 0x7fede8102ba0 2024-05-08T23:11:26.663 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.662+0000 7fedd77fe700 1 --2- 172.21.15.179:0/2944999571 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fedd00a1120 0x7fedd00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:11:26.663 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.662+0000 7fedd77fe700 1 -- 172.21.15.179:0/2944999571 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3422+0+0 (secure 0 0 0) 0x7fede00caee0 con 0x7fede8102ba0 2024-05-08T23:11:26.663 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.662+0000 7fede659c700 1 --2- 172.21.15.179:0/2944999571 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fedd00a1120 0x7fedd00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:11:26.663 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.662+0000 7fede659c700 1 --2- 172.21.15.179:0/2944999571 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fedd00a1120 0x7fedd00a35e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feddc003730 tx=0x7feddc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:11:26.666 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.667+0000 7fedd77fe700 1 -- 172.21.15.179:0/2944999571 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fede0095990 con 0x7fede8102ba0 2024-05-08T23:11:26.865 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:26.866+0000 7fedece53700 1 -- 172.21.15.179:0/2944999571 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fede802ceb0 con 0x7fedd00a1120 2024-05-08T23:11:26.953 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 08 23:11:26 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-3[68042]: 2024-05-08T23:11:26.509+0000 7fa88bd78700 -1 osd.3 0 waiting for initial osdmap 2024-05-08T23:11:26.953 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 08 23:11:26 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-3[68042]: 2024-05-08T23:11:26.515+0000 7fa883b65700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:11:27.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:27 smithi179 ceph-mon[46314]: Detected new or changed devices on smithi135 2024-05-08T23:11:27.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:27 smithi179 ceph-mon[46314]: Adjusting osd_memory_target on smithi135 to 8556M 2024-05-08T23:11:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:27 smithi179 ceph-mon[46314]: from='osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-08T23:11:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:27 smithi179 ceph-mon[46314]: osdmap e24: 4 total, 3 up, 4 in 2024-05-08T23:11:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:27 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:27 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:27 smithi179 ceph-mon[46314]: osdmap e25: 4 total, 3 up, 4 in 2024-05-08T23:11:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:27 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:27 smithi179 ceph-mon[46314]: from='osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817]' entity='osd.3' 2024-05-08T23:11:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:27 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:11:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:27 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:11:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:27 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:27.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:27 smithi195 ceph-mon[46516]: Detected new or changed devices on smithi135 2024-05-08T23:11:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:27 smithi195 ceph-mon[46516]: Adjusting osd_memory_target on smithi135 to 8556M 2024-05-08T23:11:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:27 smithi195 ceph-mon[46516]: from='osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-08T23:11:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:27 smithi195 ceph-mon[46516]: osdmap e24: 4 total, 3 up, 4 in 2024-05-08T23:11:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:27 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:27 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:27 smithi195 ceph-mon[46516]: osdmap e25: 4 total, 3 up, 4 in 2024-05-08T23:11:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:27 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:27 smithi195 ceph-mon[46516]: from='osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817]' entity='osd.3' 2024-05-08T23:11:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:27 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:11:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:27 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:11:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:27 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:27.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:27 smithi135 ceph-mon[42440]: Detected new or changed devices on smithi135 2024-05-08T23:11:27.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:27 smithi135 ceph-mon[42440]: Adjusting osd_memory_target on smithi135 to 8556M 2024-05-08T23:11:27.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:27 smithi135 ceph-mon[42440]: from='osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-08T23:11:27.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:27 smithi135 ceph-mon[42440]: osdmap e24: 4 total, 3 up, 4 in 2024-05-08T23:11:27.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:27 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:27.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:27 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:27 smithi135 ceph-mon[42440]: osdmap e25: 4 total, 3 up, 4 in 2024-05-08T23:11:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:27 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:27 smithi135 ceph-mon[42440]: from='osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817]' entity='osd.3' 2024-05-08T23:11:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:27 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:11:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:27 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:11:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:27 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:28.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:28 smithi179 ceph-mon[46314]: purged_snaps scrub starts 2024-05-08T23:11:28.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:28 smithi179 ceph-mon[46314]: purged_snaps scrub ok 2024-05-08T23:11:28.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:28 smithi179 ceph-mon[46314]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:11:28.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:28 smithi179 ceph-mon[46314]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:28.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:28 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:28.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:28 smithi179 ceph-mon[46314]: osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817] boot 2024-05-08T23:11:28.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:28 smithi179 ceph-mon[46314]: osdmap e26: 4 total, 4 up, 4 in 2024-05-08T23:11:28.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:28 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:28 smithi195 ceph-mon[46516]: purged_snaps scrub starts 2024-05-08T23:11:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:28 smithi195 ceph-mon[46516]: purged_snaps scrub ok 2024-05-08T23:11:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:28 smithi195 ceph-mon[46516]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:11:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:28 smithi195 ceph-mon[46516]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:28 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:28 smithi195 ceph-mon[46516]: osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817] boot 2024-05-08T23:11:28.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:28 smithi195 ceph-mon[46516]: osdmap e26: 4 total, 4 up, 4 in 2024-05-08T23:11:28.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:28 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:28.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:28 smithi135 ceph-mon[42440]: purged_snaps scrub starts 2024-05-08T23:11:28.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:28 smithi135 ceph-mon[42440]: purged_snaps scrub ok 2024-05-08T23:11:28.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:28 smithi135 ceph-mon[42440]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:11:28.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:28 smithi135 ceph-mon[42440]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:11:28.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:28 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:28.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:28 smithi135 ceph-mon[42440]: osd.3 [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817] boot 2024-05-08T23:11:28.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:28 smithi135 ceph-mon[42440]: osdmap e26: 4 total, 4 up, 4 in 2024-05-08T23:11:28.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:28 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:11:29.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:29 smithi179 ceph-mon[46314]: osdmap e27: 4 total, 4 up, 4 in 2024-05-08T23:11:29.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:29 smithi179 ceph-mon[46314]: from='client.? 172.21.15.179:0/858997496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b40ae169-2262-417d-958e-8903b16e89ab"}]: dispatch 2024-05-08T23:11:29.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:29 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b40ae169-2262-417d-958e-8903b16e89ab"}]: dispatch 2024-05-08T23:11:29.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:29 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b40ae169-2262-417d-958e-8903b16e89ab"}]': finished 2024-05-08T23:11:29.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:29 smithi179 ceph-mon[46314]: osdmap e28: 5 total, 4 up, 5 in 2024-05-08T23:11:29.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:29 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:29.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:29 smithi179 ceph-mon[46314]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T23:11:29.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:29 smithi195 ceph-mon[46516]: osdmap e27: 4 total, 4 up, 4 in 2024-05-08T23:11:29.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:29 smithi195 ceph-mon[46516]: from='client.? 172.21.15.179:0/858997496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b40ae169-2262-417d-958e-8903b16e89ab"}]: dispatch 2024-05-08T23:11:29.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:29 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b40ae169-2262-417d-958e-8903b16e89ab"}]: dispatch 2024-05-08T23:11:29.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:29 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b40ae169-2262-417d-958e-8903b16e89ab"}]': finished 2024-05-08T23:11:29.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:29 smithi195 ceph-mon[46516]: osdmap e28: 5 total, 4 up, 5 in 2024-05-08T23:11:29.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:29 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:29.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:29 smithi195 ceph-mon[46516]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T23:11:29.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:29 smithi135 ceph-mon[42440]: osdmap e27: 4 total, 4 up, 4 in 2024-05-08T23:11:29.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:29 smithi135 ceph-mon[42440]: from='client.? 172.21.15.179:0/858997496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b40ae169-2262-417d-958e-8903b16e89ab"}]: dispatch 2024-05-08T23:11:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:29 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b40ae169-2262-417d-958e-8903b16e89ab"}]: dispatch 2024-05-08T23:11:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:29 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b40ae169-2262-417d-958e-8903b16e89ab"}]': finished 2024-05-08T23:11:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:29 smithi135 ceph-mon[42440]: osdmap e28: 5 total, 4 up, 5 in 2024-05-08T23:11:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:29 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:29.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:29 smithi135 ceph-mon[42440]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T23:11:30.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:30 smithi179 ceph-mon[46314]: from='client.? 172.21.15.179:0/768204678' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:11:30.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:30 smithi179 ceph-mon[46314]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T23:11:30.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:30 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:30.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:30 smithi195 ceph-mon[46516]: from='client.? 172.21.15.179:0/768204678' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:11:30.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:30 smithi195 ceph-mon[46516]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T23:11:30.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:30 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:30.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:30 smithi135 ceph-mon[42440]: from='client.? 172.21.15.179:0/768204678' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:11:30.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:30 smithi135 ceph-mon[42440]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T23:11:30.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:30 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:31.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:31 smithi135 ceph-mon[42440]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T23:11:31.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:31.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:31 smithi135 ceph-mon[42440]: pgmap v85: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T23:11:32.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:31 smithi179 ceph-mon[46314]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T23:11:32.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:32.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:31 smithi179 ceph-mon[46314]: pgmap v85: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T23:11:32.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:31 smithi195 ceph-mon[46516]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T23:11:32.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:32.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:31 smithi195 ceph-mon[46516]: pgmap v85: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T23:11:34.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:34 smithi179 ceph-mon[46314]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-05-08T23:11:34.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:34 smithi195 ceph-mon[46516]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-05-08T23:11:34.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:34 smithi135 ceph-mon[42440]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-05-08T23:11:35.243 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:35 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T23:11:35.244 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:35 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:35.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:35 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T23:11:35.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:35 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:35.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:35 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T23:11:35.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:35 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:36.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:36 smithi179 ceph-mon[46314]: Deploying daemon osd.4 on smithi179 2024-05-08T23:11:36.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:36 smithi179 ceph-mon[46314]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-05-08T23:11:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:36 smithi195 ceph-mon[46516]: Deploying daemon osd.4 on smithi179 2024-05-08T23:11:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:36 smithi195 ceph-mon[46516]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-05-08T23:11:36.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:36 smithi135 ceph-mon[42440]: Deploying daemon osd.4 on smithi179 2024-05-08T23:11:36.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:36 smithi135 ceph-mon[42440]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-05-08T23:11:38.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:38 smithi179 ceph-mon[46314]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T23:11:38.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:38 smithi195 ceph-mon[46516]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T23:11:38.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:38 smithi135 ceph-mon[42440]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T23:11:39.338 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:39 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:39.339 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:39 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:39.339 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:39 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:39.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:39 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:39.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:39 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:39.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:39 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:39.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:39 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:39.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:39 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:39.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:39 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:40.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:40 smithi179 ceph-mon[46314]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-08T23:11:40.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:40 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:40.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:40 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:40.297 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:40 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:40.298 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:40 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:40.298 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:40 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:40.421 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 4 on host 'smithi179' 2024-05-08T23:11:40.421 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:40.420+0000 7fedd77fe700 1 -- 172.21.15.179:0/2944999571 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fede802ceb0 con 0x7fedd00a1120 2024-05-08T23:11:40.423 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:40.423+0000 7fedece53700 1 -- 172.21.15.179:0/2944999571 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fedd00a1120 msgr2=0x7fedd00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:40.423 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:40.423+0000 7fedece53700 1 --2- 172.21.15.179:0/2944999571 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fedd00a1120 0x7fedd00a35e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feddc003730 tx=0x7feddc01a040 comp rx=0 tx=0).stop 2024-05-08T23:11:40.424 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:40.423+0000 7fedece53700 1 -- 172.21.15.179:0/2944999571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fede8102ba0 msgr2=0x7fede819e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:40.424 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:40.423+0000 7fedece53700 1 --2- 172.21.15.179:0/2944999571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fede8102ba0 0x7fede819e490 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fede000c370 tx=0x7fede000c680 comp rx=0 tx=0).stop 2024-05-08T23:11:40.424 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:40.423+0000 7fedece53700 1 -- 172.21.15.179:0/2944999571 shutdown_connections 2024-05-08T23:11:40.424 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:40.423+0000 7fedece53700 1 --2- 172.21.15.179:0/2944999571 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fedd00a1120 0x7fedd00a35e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:40.424 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:40.423+0000 7fedece53700 1 --2- 172.21.15.179:0/2944999571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fede8102ba0 0x7fede819e490 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:40.424 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:40.423+0000 7fedece53700 1 --2- 172.21.15.179:0/2944999571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fede8101000 0x7fede8196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:40.424 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:40.423+0000 7fedece53700 1 --2- 172.21.15.179:0/2944999571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fede8102200 0x7fede8197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:40.424 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:40.423+0000 7fedece53700 1 -- 172.21.15.179:0/2944999571 >> 172.21.15.179:0/2944999571 conn(0x7fede80fc5c0 msgr2=0x7fede8105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:11:40.424 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:40.423+0000 7fedece53700 1 -- 172.21.15.179:0/2944999571 shutdown_connections 2024-05-08T23:11:40.424 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:11:40.423+0000 7fedece53700 1 -- 172.21.15.179:0/2944999571 wait complete. 2024-05-08T23:11:40.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:40 smithi195 ceph-mon[46516]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-08T23:11:40.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:40 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:40.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:40 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:40.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:40 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:40.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:40 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:40.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:40 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:40.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:40 smithi135 ceph-mon[42440]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-08T23:11:40.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:40 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:40.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:40 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:40.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:40 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:40.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:40 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:40.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:40 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:40.826 DEBUG:teuthology.orchestra.run.smithi179:osd.4> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.4.service 2024-05-08T23:11:40.829 INFO:tasks.cephadm:Deploying osd.5 on smithi195 with /dev/vg_nvme/lv_3... 2024-05-08T23:11:40.829 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T23:11:40.862 INFO:journalctl@ceph.osd.4.smithi179.stdout:-- Logs begin at Wed 2024-05-08 22:52:32 UTC. -- 2024-05-08T23:11:41.063 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:11:41.519 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:41 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:41.519 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:41 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:41.519 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:41 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:41.519 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:41 smithi195 ceph-mon[46516]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-05-08T23:11:41.669 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:41 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:41.669 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:41 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:41.669 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:41 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:41.669 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:41 smithi179 ceph-mon[46314]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-05-08T23:11:41.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:41 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:41.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:41 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:41.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:41 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:41.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:41 smithi135 ceph-mon[42440]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-05-08T23:11:42.354 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T23:11:42.355 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T23:11:42.355 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-05-08T23:11:42.355 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-05-08T23:11:42.355 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00834458 s, 1.3 GB/s 2024-05-08T23:11:42.355 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-05-08T23:11:42.585 INFO:journalctl@ceph.osd.4.smithi179.stdout:May 08 23:11:42 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-4[59309]: 2024-05-08T23:11:42.221+0000 7ff299b937c0 -1 osd.4 0 log_to_monitors true 2024-05-08T23:11:42.585 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:42 smithi179 ceph-mon[46314]: from='osd.4 [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T23:11:42.586 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:42 smithi179 ceph-mon[46314]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T23:11:42.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:42 smithi195 ceph-mon[46516]: from='osd.4 [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T23:11:42.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:42 smithi195 ceph-mon[46516]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T23:11:42.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:42 smithi135 ceph-mon[42440]: from='osd.4 [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T23:11:42.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:42 smithi135 ceph-mon[42440]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T23:11:42.767 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi195:vg_nvme/lv_3 2024-05-08T23:11:42.988 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:11:43.488 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T23:11:43.488 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: osdmap e31: 5 total, 4 up, 5 in 2024-05-08T23:11:43.488 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:43.488 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: from='osd.4 [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:11:43.488 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:11:43.488 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: Detected new or changed devices on smithi179 2024-05-08T23:11:43.488 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:43.488 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:43.488 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:11:43.489 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:11:43.489 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: Adjusting osd_memory_target on smithi179 to 8556M 2024-05-08T23:11:43.489 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:43.489 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:43.489 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:43.489 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:43.489 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:43 smithi195 ceph-mon[46516]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T23:11:43.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T23:11:43.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: osdmap e31: 5 total, 4 up, 5 in 2024-05-08T23:11:43.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:43.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: from='osd.4 [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:11:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:11:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: Detected new or changed devices on smithi179 2024-05-08T23:11:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:11:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:11:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: Adjusting osd_memory_target on smithi179 to 8556M 2024-05-08T23:11:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:43.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:43 smithi135 ceph-mon[42440]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T23:11:43.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T23:11:43.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: osdmap e31: 5 total, 4 up, 5 in 2024-05-08T23:11:43.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:43.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: from='osd.4 [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:11:43.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:11:43.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: Detected new or changed devices on smithi179 2024-05-08T23:11:43.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:43.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:43.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:11:43.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:11:43.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: Adjusting osd_memory_target on smithi179 to 8556M 2024-05-08T23:11:43.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:43.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:43.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:43.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:43.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:43 smithi179 ceph-mon[46314]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T23:11:44.035 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.033+0000 7f4bf20e8700 1 -- 172.21.15.195:0/1929064076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4bec102210 msgr2=0x7f4bec102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:44.035 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.033+0000 7f4bf20e8700 1 --2- 172.21.15.195:0/1929064076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4bec102210 0x7f4bec102670 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009990 tx=0x7f4bd4009ca0 comp rx=0 tx=0).stop 2024-05-08T23:11:44.035 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.033+0000 7f4bf20e8700 1 -- 172.21.15.195:0/1929064076 shutdown_connections 2024-05-08T23:11:44.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.033+0000 7f4bf20e8700 1 --2- 172.21.15.195:0/1929064076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bec102bb0 0x7f4bec109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:44.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.033+0000 7f4bf20e8700 1 --2- 172.21.15.195:0/1929064076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bec101010 0x7f4bec101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:44.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.033+0000 7f4bf20e8700 1 --2- 172.21.15.195:0/1929064076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4bec102210 0x7f4bec102670 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:44.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.033+0000 7f4bf20e8700 1 -- 172.21.15.195:0/1929064076 >> 172.21.15.195:0/1929064076 conn(0x7f4bec0fc5b0 msgr2=0x7f4bec0fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:11:44.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.033+0000 7f4bf20e8700 1 -- 172.21.15.195:0/1929064076 shutdown_connections 2024-05-08T23:11:44.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.033+0000 7f4bf20e8700 1 -- 172.21.15.195:0/1929064076 wait complete. 2024-05-08T23:11:44.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.033+0000 7f4bf20e8700 1 Processor -- start 2024-05-08T23:11:44.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.033+0000 7f4bf20e8700 1 -- start start 2024-05-08T23:11:44.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4bf20e8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bec101010 0x7f4bec196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:11:44.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4bf20e8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4bec102210 0x7f4bec1974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:11:44.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4bf20e8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bec102bb0 0x7f4bec19e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:11:44.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4bf20e8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec19eab0 con 0x7f4bec102bb0 2024-05-08T23:11:44.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4bf20e8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec19ebf0 con 0x7f4bec101010 2024-05-08T23:11:44.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4bf20e8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec19ed80 con 0x7f4bec102210 2024-05-08T23:11:44.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4beaffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4bec102210 0x7f4bec1974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:11:44.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4beaffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4bec102210 0x7f4bec1974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:57578/0 (socket says 172.21.15.195:57578) 2024-05-08T23:11:44.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4beaffd700 1 -- 172.21.15.195:0/2367320591 learned_addr learned my addr 172.21.15.195:0/2367320591 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T23:11:44.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4beb7fe700 1 --2- 172.21.15.195:0/2367320591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bec101010 0x7f4bec196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:11:44.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4bebfff700 1 --2- 172.21.15.195:0/2367320591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bec102bb0 0x7f4bec19e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:11:44.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4beaffd700 1 -- 172.21.15.195:0/2367320591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bec101010 msgr2=0x7f4bec196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:44.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4beaffd700 1 --2- 172.21.15.195:0/2367320591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bec101010 0x7f4bec196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:44.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4beaffd700 1 -- 172.21.15.195:0/2367320591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bec102bb0 msgr2=0x7f4bec19e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:44.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4beaffd700 1 --2- 172.21.15.195:0/2367320591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bec102bb0 0x7f4bec19e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:44.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4beaffd700 1 -- 172.21.15.195:0/2367320591 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd40095f0 con 0x7f4bec102210 2024-05-08T23:11:44.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4bebfff700 1 --2- 172.21.15.195:0/2367320591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bec102bb0 0x7f4bec19e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:11:44.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4beaffd700 1 --2- 172.21.15.195:0/2367320591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4bec102210 0x7f4bec1974b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400b5c0 tx=0x7f4bd400f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:11:44.038 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4be8ff9700 1 -- 172.21.15.195:0/2367320591 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd401d070 con 0x7f4bec102210 2024-05-08T23:11:44.038 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4be8ff9700 1 -- 172.21.15.195:0/2367320591 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4bd4003e20 con 0x7f4bec102210 2024-05-08T23:11:44.038 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4bf20e8700 1 -- 172.21.15.195:0/2367320591 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bec19f000 con 0x7f4bec102210 2024-05-08T23:11:44.038 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4be8ff9700 1 -- 172.21.15.195:0/2367320591 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd40173f0 con 0x7f4bec102210 2024-05-08T23:11:44.038 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.034+0000 7f4bf20e8700 1 -- 172.21.15.195:0/2367320591 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bec19f470 con 0x7f4bec102210 2024-05-08T23:11:44.038 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.035+0000 7f4bf20e8700 1 -- 172.21.15.195:0/2367320591 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bec1084f0 con 0x7f4bec102210 2024-05-08T23:11:44.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.036+0000 7f4be8ff9700 1 -- 172.21.15.195:0/2367320591 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f4bd4003960 con 0x7f4bec102210 2024-05-08T23:11:44.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.037+0000 7f4be8ff9700 1 --2- 172.21.15.195:0/2367320591 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4bd80a11a0 0x7f4bd80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:11:44.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.037+0000 7f4be8ff9700 1 -- 172.21.15.195:0/2367320591 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 3821+0+0 (secure 0 0 0) 0x7f4bd40cca50 con 0x7f4bec102210 2024-05-08T23:11:44.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.037+0000 7f4beb7fe700 1 --2- 172.21.15.195:0/2367320591 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4bd80a11a0 0x7f4bd80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:11:44.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.038+0000 7f4beb7fe700 1 --2- 172.21.15.195:0/2367320591 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4bd80a11a0 0x7f4bd80a3660 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4bec102070 tx=0x7f4bdc00b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:11:44.041 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.042+0000 7f4be8ff9700 1 -- 172.21.15.195:0/2367320591 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4bd4097400 con 0x7f4bec102210 2024-05-08T23:11:44.099 INFO:journalctl@ceph.osd.4.smithi179.stdout:May 08 23:11:43 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-4[59309]: 2024-05-08T23:11:43.811+0000 7ff28f1f7700 -1 osd.4 0 waiting for initial osdmap 2024-05-08T23:11:44.099 INFO:journalctl@ceph.osd.4.smithi179.stdout:May 08 23:11:43 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-4[59309]: 2024-05-08T23:11:43.819+0000 7ff286fe4700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:11:44.243 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:44.243+0000 7f4bf20e8700 1 -- 172.21.15.195:0/2367320591 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bec0613e0 con 0x7f4bd80a11a0 2024-05-08T23:11:44.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:44 smithi195 ceph-mon[46516]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-05-08T23:11:44.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:44 smithi195 ceph-mon[46516]: osdmap e32: 5 total, 4 up, 5 in 2024-05-08T23:11:44.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:44 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:44.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:44 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:44.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:44 smithi195 ceph-mon[46516]: from='osd.4 ' entity='osd.4' 2024-05-08T23:11:44.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:44 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:11:44.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:44 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:11:44.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:44 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:44.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:44 smithi135 ceph-mon[42440]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-05-08T23:11:44.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:44 smithi135 ceph-mon[42440]: osdmap e32: 5 total, 4 up, 5 in 2024-05-08T23:11:44.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:44 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:44.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:44 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:44.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:44 smithi135 ceph-mon[42440]: from='osd.4 ' entity='osd.4' 2024-05-08T23:11:44.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:44 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:11:44.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:44 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:11:44.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:44 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:44.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:44 smithi179 ceph-mon[46314]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-05-08T23:11:44.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:44 smithi179 ceph-mon[46314]: osdmap e32: 5 total, 4 up, 5 in 2024-05-08T23:11:44.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:44 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:44.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:44 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:44.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:44 smithi179 ceph-mon[46314]: from='osd.4 ' entity='osd.4' 2024-05-08T23:11:44.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:44 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:11:44.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:44 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:11:44.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:44 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:45.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:45 smithi135 ceph-mon[42440]: purged_snaps scrub starts 2024-05-08T23:11:45.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:45 smithi135 ceph-mon[42440]: purged_snaps scrub ok 2024-05-08T23:11:45.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:45 smithi135 ceph-mon[42440]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:11:45.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:45 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:45.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:45 smithi135 ceph-mon[42440]: osd.4 [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342] boot 2024-05-08T23:11:45.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:45 smithi135 ceph-mon[42440]: osdmap e33: 5 total, 5 up, 5 in 2024-05-08T23:11:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:45 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:45.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:45 smithi135 ceph-mon[42440]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T23:11:45.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:45 smithi179 ceph-mon[46314]: purged_snaps scrub starts 2024-05-08T23:11:45.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:45 smithi179 ceph-mon[46314]: purged_snaps scrub ok 2024-05-08T23:11:45.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:45 smithi179 ceph-mon[46314]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:11:45.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:45 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:45.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:45 smithi179 ceph-mon[46314]: osd.4 [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342] boot 2024-05-08T23:11:45.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:45 smithi179 ceph-mon[46314]: osdmap e33: 5 total, 5 up, 5 in 2024-05-08T23:11:45.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:45 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:45.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:45 smithi179 ceph-mon[46314]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T23:11:45.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:45 smithi195 ceph-mon[46516]: purged_snaps scrub starts 2024-05-08T23:11:45.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:45 smithi195 ceph-mon[46516]: purged_snaps scrub ok 2024-05-08T23:11:45.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:45 smithi195 ceph-mon[46516]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:11:45.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:45 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:45.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:45 smithi195 ceph-mon[46516]: osd.4 [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342] boot 2024-05-08T23:11:45.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:45 smithi195 ceph-mon[46516]: osdmap e33: 5 total, 5 up, 5 in 2024-05-08T23:11:45.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:45 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:11:45.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:45 smithi195 ceph-mon[46516]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T23:11:47.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:46 smithi179 ceph-mon[46314]: osdmap e34: 5 total, 5 up, 5 in 2024-05-08T23:11:47.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:46 smithi179 ceph-mon[46314]: from='client.? 172.21.15.195:0/514266221' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26b4c6d5-5a0f-49e2-87cc-08618c3fd833"}]: dispatch 2024-05-08T23:11:47.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:46 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26b4c6d5-5a0f-49e2-87cc-08618c3fd833"}]: dispatch 2024-05-08T23:11:47.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:46 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "26b4c6d5-5a0f-49e2-87cc-08618c3fd833"}]': finished 2024-05-08T23:11:47.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:46 smithi179 ceph-mon[46314]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T23:11:47.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:46 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:11:47.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:46 smithi179 ceph-mon[46314]: from='client.? 172.21.15.195:0/3347465151' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:11:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:46 smithi195 ceph-mon[46516]: osdmap e34: 5 total, 5 up, 5 in 2024-05-08T23:11:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:46 smithi195 ceph-mon[46516]: from='client.? 172.21.15.195:0/514266221' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26b4c6d5-5a0f-49e2-87cc-08618c3fd833"}]: dispatch 2024-05-08T23:11:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:46 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26b4c6d5-5a0f-49e2-87cc-08618c3fd833"}]: dispatch 2024-05-08T23:11:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:46 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "26b4c6d5-5a0f-49e2-87cc-08618c3fd833"}]': finished 2024-05-08T23:11:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:46 smithi195 ceph-mon[46516]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T23:11:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:46 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:11:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:46 smithi195 ceph-mon[46516]: from='client.? 172.21.15.195:0/3347465151' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:11:47.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:46 smithi135 ceph-mon[42440]: osdmap e34: 5 total, 5 up, 5 in 2024-05-08T23:11:47.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:46 smithi135 ceph-mon[42440]: from='client.? 172.21.15.195:0/514266221' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26b4c6d5-5a0f-49e2-87cc-08618c3fd833"}]: dispatch 2024-05-08T23:11:47.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:46 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26b4c6d5-5a0f-49e2-87cc-08618c3fd833"}]: dispatch 2024-05-08T23:11:47.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:46 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "26b4c6d5-5a0f-49e2-87cc-08618c3fd833"}]': finished 2024-05-08T23:11:47.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:46 smithi135 ceph-mon[42440]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T23:11:47.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:46 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:11:47.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:46 smithi135 ceph-mon[42440]: from='client.? 172.21.15.195:0/3347465151' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:11:48.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:47 smithi179 ceph-mon[46314]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:48.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:47 smithi195 ceph-mon[46516]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:48.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:47 smithi135 ceph-mon[42440]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:50.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:50 smithi179 ceph-mon[46314]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:50.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:50 smithi195 ceph-mon[46516]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:50.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:50 smithi135 ceph-mon[42440]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:52.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:52 smithi195 ceph-mon[46516]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:52.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:52 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T23:11:52.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:52 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:52.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:52 smithi179 ceph-mon[46314]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:52.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:52 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T23:11:52.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:52 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:52.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:52 smithi135 ceph-mon[42440]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:52.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:52 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T23:11:52.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:52 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:53.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:53 smithi179 ceph-mon[46314]: Deploying daemon osd.5 on smithi195 2024-05-08T23:11:53.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:53 smithi195 ceph-mon[46516]: Deploying daemon osd.5 on smithi195 2024-05-08T23:11:53.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:53 smithi135 ceph-mon[42440]: Deploying daemon osd.5 on smithi195 2024-05-08T23:11:54.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:54 smithi179 ceph-mon[46314]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:54.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:54 smithi195 ceph-mon[46516]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:54.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:54 smithi135 ceph-mon[42440]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:56.338 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:56 smithi195 ceph-mon[46516]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:56.338 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:56.338 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:56.338 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:56.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:56 smithi179 ceph-mon[46314]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:56.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:56 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:56.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:56 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:56.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:56 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:56.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:56 smithi135 ceph-mon[42440]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:56.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:56.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:56.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:57.949 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:57.948+0000 7f4be8ff9700 1 -- 172.21.15.195:0/2367320591 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4bec0613e0 con 0x7f4bd80a11a0 2024-05-08T23:11:57.949 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 5 on host 'smithi195' 2024-05-08T23:11:57.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:57.950+0000 7f4bf20e8700 1 -- 172.21.15.195:0/2367320591 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4bd80a11a0 msgr2=0x7f4bd80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:57.951 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:57.950+0000 7f4bf20e8700 1 --2- 172.21.15.195:0/2367320591 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4bd80a11a0 0x7f4bd80a3660 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4bec102070 tx=0x7f4bdc00b5b0 comp rx=0 tx=0).stop 2024-05-08T23:11:57.951 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:57.950+0000 7f4bf20e8700 1 -- 172.21.15.195:0/2367320591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4bec102210 msgr2=0x7f4bec1974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:11:57.951 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:57.950+0000 7f4bf20e8700 1 --2- 172.21.15.195:0/2367320591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4bec102210 0x7f4bec1974b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400b5c0 tx=0x7f4bd400f740 comp rx=0 tx=0).stop 2024-05-08T23:11:57.951 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:57.950+0000 7f4bf20e8700 1 -- 172.21.15.195:0/2367320591 shutdown_connections 2024-05-08T23:11:57.951 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:57.950+0000 7f4bf20e8700 1 --2- 172.21.15.195:0/2367320591 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4bd80a11a0 0x7f4bd80a3660 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:57.951 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:57.950+0000 7f4bf20e8700 1 --2- 172.21.15.195:0/2367320591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bec102bb0 0x7f4bec19e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:57.951 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:57.950+0000 7f4bf20e8700 1 --2- 172.21.15.195:0/2367320591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4bec101010 0x7f4bec196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:57.951 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:57.950+0000 7f4bf20e8700 1 --2- 172.21.15.195:0/2367320591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4bec102210 0x7f4bec1974b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:11:57.951 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:57.950+0000 7f4bf20e8700 1 -- 172.21.15.195:0/2367320591 >> 172.21.15.195:0/2367320591 conn(0x7f4bec0fc5b0 msgr2=0x7f4bec105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:11:57.952 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:57.950+0000 7f4bf20e8700 1 -- 172.21.15.195:0/2367320591 shutdown_connections 2024-05-08T23:11:57.952 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:11:57.950+0000 7f4bf20e8700 1 -- 172.21.15.195:0/2367320591 wait complete. 2024-05-08T23:11:58.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:58 smithi195 ceph-mon[46516]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:58.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:58 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:58.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:58 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:58.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:58 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:58.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:58 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:58.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:58 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:58.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:58 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:58.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:58 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:58.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:11:58 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:58.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:58 smithi179 ceph-mon[46314]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:58.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:58 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:58.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:58 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:58.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:58 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:58.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:58 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:58.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:58 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:58.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:58 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:58.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:58 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:58.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:11:58 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:58 smithi135 ceph-mon[42440]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:11:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:58 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:58 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:58.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:58 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:11:58.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:58 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:11:58.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:58 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:58.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:58 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:58.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:58 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:11:58.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:11:58 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:11:58.490 DEBUG:teuthology.orchestra.run.smithi195:osd.5> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.5.service 2024-05-08T23:11:58.493 INFO:tasks.cephadm:Deploying osd.6 on smithi135 with /dev/vg_nvme/lv_2... 2024-05-08T23:11:58.493 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T23:11:58.523 INFO:journalctl@ceph.osd.5.smithi195.stdout:-- Logs begin at Wed 2024-05-08 22:52:38 UTC. -- 2024-05-08T23:11:58.726 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:12:00.053 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T23:12:00.054 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T23:12:00.054 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-05-08T23:12:00.054 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-05-08T23:12:00.054 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111494 s, 940 MB/s 2024-05-08T23:12:00.054 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-05-08T23:12:00.073 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:11:59 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:11:59.754+0000 7f716c1157c0 -1 osd.5 0 log_to_monitors true 2024-05-08T23:12:00.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:00 smithi179 ceph-mon[46314]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:12:00.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:00 smithi179 ceph-mon[46314]: from='osd.5 [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T23:12:00.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:00 smithi179 ceph-mon[46314]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T23:12:00.362 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:00 smithi135 ceph-mon[42440]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:12:00.362 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:00 smithi135 ceph-mon[42440]: from='osd.5 [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T23:12:00.362 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:00 smithi135 ceph-mon[42440]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T23:12:00.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:00 smithi195 ceph-mon[46516]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:12:00.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:00 smithi195 ceph-mon[46516]: from='osd.5 [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T23:12:00.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:00 smithi195 ceph-mon[46516]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T23:12:00.464 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_2 2024-05-08T23:12:00.687 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:12:01.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:01 smithi179 ceph-mon[46314]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T23:12:01.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:01 smithi179 ceph-mon[46314]: osdmap e36: 6 total, 5 up, 6 in 2024-05-08T23:12:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:12:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:01 smithi179 ceph-mon[46314]: from='osd.5 [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:12:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:01 smithi179 ceph-mon[46314]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:12:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:01.380 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:12:01 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:12:01.088+0000 7f7161779700 -1 osd.5 0 waiting for initial osdmap 2024-05-08T23:12:01.380 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:12:01 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:12:01.095+0000 7f715d56e700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:12:01.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:01 smithi195 ceph-mon[46516]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T23:12:01.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:01 smithi195 ceph-mon[46516]: osdmap e36: 6 total, 5 up, 6 in 2024-05-08T23:12:01.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:12:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:01 smithi195 ceph-mon[46516]: from='osd.5 [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:12:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:01 smithi195 ceph-mon[46516]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:12:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:01.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:01 smithi135 ceph-mon[42440]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T23:12:01.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:01 smithi135 ceph-mon[42440]: osdmap e36: 6 total, 5 up, 6 in 2024-05-08T23:12:01.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:12:01.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:01 smithi135 ceph-mon[42440]: from='osd.5 [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:12:01.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:01 smithi135 ceph-mon[42440]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:12:01.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:01.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:01.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:01.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:01.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:01.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:01.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:01.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:01.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.638+0000 7f9dd2f28700 1 -- 172.21.15.135:0/2757757868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc101000 msgr2=0x7f9dcc101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:01.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.638+0000 7f9dd2f28700 1 --2- 172.21.15.135:0/2757757868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc101000 0x7f9dcc101420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00099c0 tx=0x7f9dc0009cd0 comp rx=0 tx=0).stop 2024-05-08T23:12:01.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.638+0000 7f9dd2f28700 1 -- 172.21.15.135:0/2757757868 shutdown_connections 2024-05-08T23:12:01.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.638+0000 7f9dd2f28700 1 --2- 172.21.15.135:0/2757757868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc102ba0 0x7f9dcc109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:01.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.638+0000 7f9dd2f28700 1 --2- 172.21.15.135:0/2757757868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc101000 0x7f9dcc101420 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:01.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.638+0000 7f9dd2f28700 1 --2- 172.21.15.135:0/2757757868 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9dcc102200 0x7f9dcc102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:01.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.638+0000 7f9dd2f28700 1 -- 172.21.15.135:0/2757757868 >> 172.21.15.135:0/2757757868 conn(0x7f9dcc0fc5c0 msgr2=0x7f9dcc0fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:12:01.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.638+0000 7f9dd2f28700 1 -- 172.21.15.135:0/2757757868 shutdown_connections 2024-05-08T23:12:01.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.638+0000 7f9dd2f28700 1 -- 172.21.15.135:0/2757757868 wait complete. 2024-05-08T23:12:01.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.639+0000 7f9dd2f28700 1 Processor -- start 2024-05-08T23:12:01.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.639+0000 7f9dd2f28700 1 -- start start 2024-05-08T23:12:01.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.639+0000 7f9dd2f28700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9dcc101000 0x7f9dcc196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:01.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.639+0000 7f9dd2f28700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc102200 0x7f9dcc197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:01.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.639+0000 7f9dd2f28700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc102ba0 0x7f9dcc19e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:01.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.639+0000 7f9dd2f28700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc19ea60 con 0x7f9dcc102ba0 2024-05-08T23:12:01.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.639+0000 7f9dd2f28700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc19eba0 con 0x7f9dcc102200 2024-05-08T23:12:01.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.639+0000 7f9dd2f28700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc19ed30 con 0x7f9dcc101000 2024-05-08T23:12:01.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.639+0000 7f9dd14c5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc102ba0 0x7f9dcc19e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:01.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.640+0000 7f9dd14c5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc102ba0 0x7f9dcc19e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53480/0 (socket says 172.21.15.135:53480) 2024-05-08T23:12:01.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.640+0000 7f9dd14c5700 1 -- 172.21.15.135:0/3413275371 learned_addr learned my addr 172.21.15.135:0/3413275371 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:12:01.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.640+0000 7f9dd0cc4700 1 --2- 172.21.15.135:0/3413275371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9dcc101000 0x7f9dcc196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:01.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.640+0000 7f9dcbfff700 1 --2- 172.21.15.135:0/3413275371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc102200 0x7f9dcc197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:01.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.640+0000 7f9dd14c5700 1 -- 172.21.15.135:0/3413275371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9dcc101000 msgr2=0x7f9dcc196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:01.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.640+0000 7f9dd14c5700 1 --2- 172.21.15.135:0/3413275371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9dcc101000 0x7f9dcc196f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.640+0000 7f9dd14c5700 1 -- 172.21.15.135:0/3413275371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc102200 msgr2=0x7f9dcc197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.640+0000 7f9dd14c5700 1 --2- 172.21.15.135:0/3413275371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc102200 0x7f9dcc197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.640+0000 7f9dd14c5700 1 -- 172.21.15.135:0/3413275371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc00095f0 con 0x7f9dcc102ba0 2024-05-08T23:12:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.640+0000 7f9dd14c5700 1 --2- 172.21.15.135:0/3413275371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc102ba0 0x7f9dcc19e490 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400ef60 tx=0x7f9dc400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:12:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.640+0000 7f9dc9ffb700 1 -- 172.21.15.135:0/3413275371 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4018070 con 0x7f9dcc102ba0 2024-05-08T23:12:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.640+0000 7f9dc9ffb700 1 -- 172.21.15.135:0/3413275371 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9dc400f040 con 0x7f9dcc102ba0 2024-05-08T23:12:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.640+0000 7f9dc9ffb700 1 -- 172.21.15.135:0/3413275371 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc400ccc0 con 0x7f9dcc102ba0 2024-05-08T23:12:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.640+0000 7f9dd2f28700 1 -- 172.21.15.135:0/3413275371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dcc073290 con 0x7f9dcc102ba0 2024-05-08T23:12:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.640+0000 7f9dd2f28700 1 -- 172.21.15.135:0/3413275371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dcc073740 con 0x7f9dcc102ba0 2024-05-08T23:12:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.641+0000 7f9dd2f28700 1 -- 172.21.15.135:0/3413275371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dcc108530 con 0x7f9dcc102ba0 2024-05-08T23:12:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.642+0000 7f9dc9ffb700 1 -- 172.21.15.135:0/3413275371 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f9dc4003a00 con 0x7f9dcc102ba0 2024-05-08T23:12:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.643+0000 7f9dc9ffb700 1 --2- 172.21.15.135:0/3413275371 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9dbc0a1120 0x7f9dbc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.643+0000 7f9dd0cc4700 1 --2- 172.21.15.135:0/3413275371 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9dbc0a1120 0x7f9dbc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.643+0000 7f9dc9ffb700 1 -- 172.21.15.135:0/3413275371 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4566+0+0 (secure 0 0 0) 0x7f9dc40cb4d0 con 0x7f9dcc102ba0 2024-05-08T23:12:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.643+0000 7f9dd0cc4700 1 --2- 172.21.15.135:0/3413275371 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9dbc0a1120 0x7f9dbc0a35e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0003730 tx=0x7f9dc0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:12:01.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.648+0000 7f9dc9ffb700 1 -- 172.21.15.135:0/3413275371 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9dc4095b90 con 0x7f9dcc102ba0 2024-05-08T23:12:01.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:01.849+0000 7f9dd2f28700 1 -- 172.21.15.135:0/3413275371 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9dcc0613e0 con 0x7f9dbc0a1120 2024-05-08T23:12:02.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:02 smithi179 ceph-mon[46314]: Detected new or changed devices on smithi195 2024-05-08T23:12:02.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:02 smithi179 ceph-mon[46314]: Adjusting osd_memory_target on smithi195 to 8556M 2024-05-08T23:12:02.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:02 smithi179 ceph-mon[46314]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:12:02.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:02 smithi179 ceph-mon[46314]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-05-08T23:12:02.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:02 smithi179 ceph-mon[46314]: osdmap e37: 6 total, 5 up, 6 in 2024-05-08T23:12:02.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:02 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:12:02.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:02 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:12:02.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:02 smithi179 ceph-mon[46314]: osd.5 [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626] boot 2024-05-08T23:12:02.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:02 smithi179 ceph-mon[46314]: osdmap e38: 6 total, 6 up, 6 in 2024-05-08T23:12:02.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:02 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:12:02.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:02 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:12:02.351 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:02 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:12:02.351 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:02 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:02.370 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:02 smithi135 ceph-mon[42440]: Detected new or changed devices on smithi195 2024-05-08T23:12:02.370 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:02 smithi135 ceph-mon[42440]: Adjusting osd_memory_target on smithi195 to 8556M 2024-05-08T23:12:02.370 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:02 smithi135 ceph-mon[42440]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:12:02.370 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:02 smithi135 ceph-mon[42440]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-05-08T23:12:02.370 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:02 smithi135 ceph-mon[42440]: osdmap e37: 6 total, 5 up, 6 in 2024-05-08T23:12:02.370 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:02 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:12:02.370 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:02 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:12:02.371 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:02 smithi135 ceph-mon[42440]: osd.5 [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626] boot 2024-05-08T23:12:02.371 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:02 smithi135 ceph-mon[42440]: osdmap e38: 6 total, 6 up, 6 in 2024-05-08T23:12:02.371 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:02 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:12:02.371 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:02 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:12:02.371 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:02 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:12:02.371 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:02 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:02.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:02 smithi195 ceph-mon[46516]: Detected new or changed devices on smithi195 2024-05-08T23:12:02.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:02 smithi195 ceph-mon[46516]: Adjusting osd_memory_target on smithi195 to 8556M 2024-05-08T23:12:02.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:02 smithi195 ceph-mon[46516]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:12:02.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:02 smithi195 ceph-mon[46516]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-05-08T23:12:02.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:02 smithi195 ceph-mon[46516]: osdmap e37: 6 total, 5 up, 6 in 2024-05-08T23:12:02.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:02 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:12:02.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:02 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:12:02.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:02 smithi195 ceph-mon[46516]: osd.5 [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626] boot 2024-05-08T23:12:02.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:02 smithi195 ceph-mon[46516]: osdmap e38: 6 total, 6 up, 6 in 2024-05-08T23:12:02.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:02 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:12:02.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:02 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:12:02.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:02 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:12:02.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:02 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:03.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:03 smithi179 ceph-mon[46314]: purged_snaps scrub starts 2024-05-08T23:12:03.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:03 smithi179 ceph-mon[46314]: purged_snaps scrub ok 2024-05-08T23:12:03.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:03 smithi179 ceph-mon[46314]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:12:03.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:03 smithi179 ceph-mon[46314]: osdmap e39: 6 total, 6 up, 6 in 2024-05-08T23:12:03.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:03 smithi195 ceph-mon[46516]: purged_snaps scrub starts 2024-05-08T23:12:03.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:03 smithi195 ceph-mon[46516]: purged_snaps scrub ok 2024-05-08T23:12:03.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:03 smithi195 ceph-mon[46516]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:12:03.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:03 smithi195 ceph-mon[46516]: osdmap e39: 6 total, 6 up, 6 in 2024-05-08T23:12:03.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:03 smithi135 ceph-mon[42440]: purged_snaps scrub starts 2024-05-08T23:12:03.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:03 smithi135 ceph-mon[42440]: purged_snaps scrub ok 2024-05-08T23:12:03.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:03 smithi135 ceph-mon[42440]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:12:03.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:03 smithi135 ceph-mon[42440]: osdmap e39: 6 total, 6 up, 6 in 2024-05-08T23:12:04.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:04 smithi179 ceph-mon[46314]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:12:04.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:04 smithi179 ceph-mon[46314]: osdmap e40: 6 total, 6 up, 6 in 2024-05-08T23:12:04.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:04 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/331734095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e506e541-e401-4795-af36-65ef8f53c6a5"}]: dispatch 2024-05-08T23:12:04.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:04 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/331734095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e506e541-e401-4795-af36-65ef8f53c6a5"}]': finished 2024-05-08T23:12:04.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:04 smithi179 ceph-mon[46314]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T23:12:04.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:04 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:04.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:04 smithi195 ceph-mon[46516]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:12:04.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:04 smithi195 ceph-mon[46516]: osdmap e40: 6 total, 6 up, 6 in 2024-05-08T23:12:04.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:04 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/331734095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e506e541-e401-4795-af36-65ef8f53c6a5"}]: dispatch 2024-05-08T23:12:04.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:04 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/331734095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e506e541-e401-4795-af36-65ef8f53c6a5"}]': finished 2024-05-08T23:12:04.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:04 smithi195 ceph-mon[46516]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T23:12:04.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:04.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:04 smithi135 ceph-mon[42440]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:12:04.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:04 smithi135 ceph-mon[42440]: osdmap e40: 6 total, 6 up, 6 in 2024-05-08T23:12:04.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:04 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/331734095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e506e541-e401-4795-af36-65ef8f53c6a5"}]: dispatch 2024-05-08T23:12:04.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:04 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/331734095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e506e541-e401-4795-af36-65ef8f53c6a5"}]': finished 2024-05-08T23:12:04.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:04 smithi135 ceph-mon[42440]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T23:12:04.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:05.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:05 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1811172660' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:12:05.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:05 smithi179 ceph-mon[46314]: osdmap e42: 7 total, 6 up, 7 in 2024-05-08T23:12:05.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:05 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:05.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:05 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1811172660' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:12:05.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:05 smithi195 ceph-mon[46516]: osdmap e42: 7 total, 6 up, 7 in 2024-05-08T23:12:05.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:05 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:05.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:05 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1811172660' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:12:05.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:05 smithi135 ceph-mon[42440]: osdmap e42: 7 total, 6 up, 7 in 2024-05-08T23:12:05.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:05 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:06.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:06 smithi179 ceph-mon[46314]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:12:06.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:06 smithi195 ceph-mon[46516]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:12:06.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:06 smithi135 ceph-mon[42440]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:12:08.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:08 smithi179 ceph-mon[46314]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:12:08.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:08 smithi195 ceph-mon[46516]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:12:08.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:08 smithi135 ceph-mon[42440]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:12:10.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:10 smithi179 ceph-mon[46314]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T23:12:10.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:10 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T23:12:10.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:10 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:10.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:10 smithi195 ceph-mon[46516]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T23:12:10.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:10 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T23:12:10.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:10 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:10.407 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:10 smithi135 ceph-mon[42440]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T23:12:10.407 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:10 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T23:12:10.407 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:10 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:11.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:11 smithi195 ceph-mon[46516]: Deploying daemon osd.6 on smithi135 2024-05-08T23:12:11.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:11 smithi135 ceph-mon[42440]: Deploying daemon osd.6 on smithi135 2024-05-08T23:12:11.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:11 smithi179 ceph-mon[46314]: Deploying daemon osd.6 on smithi135 2024-05-08T23:12:12.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:12 smithi195 ceph-mon[46516]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-08T23:12:12.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:12 smithi135 ceph-mon[42440]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-08T23:12:12.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:12 smithi179 ceph-mon[46314]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-08T23:12:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:14 smithi195 ceph-mon[46516]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-08T23:12:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:14 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:14.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:14 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:14.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:14 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:14.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:14 smithi135 ceph-mon[42440]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-08T23:12:14.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:14 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:14.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:14 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:14.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:14 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:14.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:14 smithi179 ceph-mon[46314]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-08T23:12:14.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:14 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:14.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:14 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:14.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:14 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:15.446 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 6 on host 'smithi135' 2024-05-08T23:12:15.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:15.445+0000 7f9dc9ffb700 1 -- 172.21.15.135:0/3413275371 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9dcc0613e0 con 0x7f9dbc0a1120 2024-05-08T23:12:15.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:15.448+0000 7f9dd2f28700 1 -- 172.21.15.135:0/3413275371 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9dbc0a1120 msgr2=0x7f9dbc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:15.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:15.448+0000 7f9dd2f28700 1 --2- 172.21.15.135:0/3413275371 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9dbc0a1120 0x7f9dbc0a35e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0003730 tx=0x7f9dc0000bc0 comp rx=0 tx=0).stop 2024-05-08T23:12:15.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:15.448+0000 7f9dd2f28700 1 -- 172.21.15.135:0/3413275371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc102ba0 msgr2=0x7f9dcc19e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:15.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:15.448+0000 7f9dd2f28700 1 --2- 172.21.15.135:0/3413275371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc102ba0 0x7f9dcc19e490 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400ef60 tx=0x7f9dc400ef90 comp rx=0 tx=0).stop 2024-05-08T23:12:15.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:15.448+0000 7f9dd2f28700 1 -- 172.21.15.135:0/3413275371 shutdown_connections 2024-05-08T23:12:15.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:15.448+0000 7f9dd2f28700 1 --2- 172.21.15.135:0/3413275371 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9dbc0a1120 0x7f9dbc0a35e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:15.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:15.448+0000 7f9dd2f28700 1 --2- 172.21.15.135:0/3413275371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9dcc101000 0x7f9dcc196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:15.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:15.448+0000 7f9dd2f28700 1 --2- 172.21.15.135:0/3413275371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc102ba0 0x7f9dcc19e490 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:15.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:15.448+0000 7f9dd2f28700 1 --2- 172.21.15.135:0/3413275371 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc102200 0x7f9dcc197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:15.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:15.448+0000 7f9dd2f28700 1 -- 172.21.15.135:0/3413275371 >> 172.21.15.135:0/3413275371 conn(0x7f9dcc0fc5c0 msgr2=0x7f9dcc105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:12:15.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:15.448+0000 7f9dd2f28700 1 -- 172.21.15.135:0/3413275371 shutdown_connections 2024-05-08T23:12:15.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:15.448+0000 7f9dd2f28700 1 -- 172.21.15.135:0/3413275371 wait complete. 2024-05-08T23:12:15.825 DEBUG:teuthology.orchestra.run.smithi135:osd.6> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.6.service 2024-05-08T23:12:15.827 INFO:tasks.cephadm:Deploying osd.7 on smithi179 with /dev/vg_nvme/lv_2... 2024-05-08T23:12:15.827 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T23:12:15.859 INFO:journalctl@ceph.osd.6.smithi135.stdout:-- Logs begin at Wed 2024-05-08 22:52:39 UTC. -- 2024-05-08T23:12:16.063 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:12:16.196 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:16.196 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:16.197 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:16.197 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:16.197 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:16.197 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:15 smithi179 ceph-mon[46314]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-05-08T23:12:16.197 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:16.197 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:16.197 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:16.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:16.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:16.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:16.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:16.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:16.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:15 smithi135 ceph-mon[42440]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-05-08T23:12:16.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:16.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:16.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:16.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:16.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:16.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:16.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:16.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:16.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:15 smithi195 ceph-mon[46516]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-05-08T23:12:16.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:16.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:16.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:17.474 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T23:12:17.474 INFO:teuthology.orchestra.run.smithi179.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T23:12:17.474 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10+0 records in 2024-05-08T23:12:17.474 INFO:teuthology.orchestra.run.smithi179.stderr:10+0 records out 2024-05-08T23:12:17.474 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115166 s, 910 MB/s 2024-05-08T23:12:17.474 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping successful for: 2024-05-08T23:12:17.698 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:12:17 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:12:17.345+0000 7f2305f947c0 -1 osd.6 0 log_to_monitors true 2024-05-08T23:12:17.900 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi179:vg_nvme/lv_2 2024-05-08T23:12:18.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:18 smithi179 ceph-mon[46314]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-08T23:12:18.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:18 smithi179 ceph-mon[46314]: from='osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T23:12:18.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:18.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:18.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:18.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:18.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:18.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:18.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:18.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:18.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:18.123 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:12:18.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:18 smithi135 ceph-mon[42440]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-08T23:12:18.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:18 smithi135 ceph-mon[42440]: from='osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T23:12:18.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:18.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:18.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:18.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:18.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:18.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:18.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:18.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:18.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:18.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:18 smithi195 ceph-mon[46516]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-08T23:12:18.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:18 smithi195 ceph-mon[46516]: from='osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T23:12:18.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:18.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:18.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:18.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:18.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:18.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:18.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:18.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:18.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:19.163 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.162+0000 7f98c92b1700 1 -- 172.21.15.179:0/1461910975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c4101af0 msgr2=0x7f98c4103ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:19.163 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.162+0000 7f98c92b1700 1 --2- 172.21.15.179:0/1461910975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c4101af0 0x7f98c4103ee0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f98b4009990 tx=0x7f98b4009ca0 comp rx=0 tx=0).stop 2024-05-08T23:12:19.164 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.162+0000 7f98c92b1700 1 -- 172.21.15.179:0/1461910975 shutdown_connections 2024-05-08T23:12:19.164 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.162+0000 7f98c92b1700 1 --2- 172.21.15.179:0/1461910975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98c4106d50 0x7f98c4109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:19.164 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.162+0000 7f98c92b1700 1 --2- 172.21.15.179:0/1461910975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c4101af0 0x7f98c4103ee0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:19.164 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.162+0000 7f98c92b1700 1 --2- 172.21.15.179:0/1461910975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98c4104420 0x7f98c4106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:19.164 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.162+0000 7f98c92b1700 1 -- 172.21.15.179:0/1461910975 >> 172.21.15.179:0/1461910975 conn(0x7f98c40fb4a0 msgr2=0x7f98c40fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:12:19.164 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.162+0000 7f98c92b1700 1 -- 172.21.15.179:0/1461910975 shutdown_connections 2024-05-08T23:12:19.164 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.162+0000 7f98c92b1700 1 -- 172.21.15.179:0/1461910975 wait complete. 2024-05-08T23:12:19.164 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.162+0000 7f98c92b1700 1 Processor -- start 2024-05-08T23:12:19.164 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.162+0000 7f98c92b1700 1 -- start start 2024-05-08T23:12:19.164 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c92b1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98c4101af0 0x7f98c4196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:19.164 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c92b1700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c4104420 0x7f98c4197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:19.164 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c92b1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98c4106d50 0x7f98c419e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:19.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c92b1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c419eae0 con 0x7f98c4101af0 2024-05-08T23:12:19.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c92b1700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c419ec20 con 0x7f98c4104420 2024-05-08T23:12:19.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c92b1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c419edb0 con 0x7f98c4106d50 2024-05-08T23:12:19.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c27fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c4104420 0x7f98c4197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:19.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c27fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c4104420 0x7f98c4197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:42636/0 (socket says 172.21.15.179:42636) 2024-05-08T23:12:19.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c27fc700 1 -- 172.21.15.179:0/993127394 learned_addr learned my addr 172.21.15.179:0/993127394 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-05-08T23:12:19.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c2ffd700 1 --2- 172.21.15.179:0/993127394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98c4101af0 0x7f98c4196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:19.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c37fe700 1 --2- 172.21.15.179:0/993127394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98c4106d50 0x7f98c419e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:19.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c27fc700 1 -- 172.21.15.179:0/993127394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98c4106d50 msgr2=0x7f98c419e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:19.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c27fc700 1 --2- 172.21.15.179:0/993127394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98c4106d50 0x7f98c419e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:19.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c27fc700 1 -- 172.21.15.179:0/993127394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98c4101af0 msgr2=0x7f98c4196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:19.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c27fc700 1 --2- 172.21.15.179:0/993127394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98c4101af0 0x7f98c4196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:19.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c27fc700 1 -- 172.21.15.179:0/993127394 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b40095f0 con 0x7f98c4104420 2024-05-08T23:12:19.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c27fc700 1 --2- 172.21.15.179:0/993127394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c4104420 0x7f98c4197530 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f98b800e9a0 tx=0x7f98b800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:12:19.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98abfff700 1 -- 172.21.15.179:0/993127394 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8009790 con 0x7f98c4104420 2024-05-08T23:12:19.166 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98abfff700 1 -- 172.21.15.179:0/993127394 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98b800cbd0 con 0x7f98c4104420 2024-05-08T23:12:19.166 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c92b1700 1 -- 172.21.15.179:0/993127394 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c419f090 con 0x7f98c4104420 2024-05-08T23:12:19.166 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98abfff700 1 -- 172.21.15.179:0/993127394 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8018680 con 0x7f98c4104420 2024-05-08T23:12:19.166 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.163+0000 7f98c92b1700 1 -- 172.21.15.179:0/993127394 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c419f590 con 0x7f98c4104420 2024-05-08T23:12:19.166 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.164+0000 7f98c92b1700 1 -- 172.21.15.179:0/993127394 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c40fd020 con 0x7f98c4104420 2024-05-08T23:12:19.167 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.165+0000 7f98abfff700 1 -- 172.21.15.179:0/993127394 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f98b800cd40 con 0x7f98c4104420 2024-05-08T23:12:19.167 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.166+0000 7f98abfff700 1 --2- 172.21.15.179:0/993127394 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f98ac0a1120 0x7f98ac0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:19.167 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.166+0000 7f98abfff700 1 -- 172.21.15.179:0/993127394 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4685+0+0 (secure 0 0 0) 0x7f98b8014070 con 0x7f98c4104420 2024-05-08T23:12:19.167 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.166+0000 7f98c2ffd700 1 --2- 172.21.15.179:0/993127394 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f98ac0a1120 0x7f98ac0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:19.167 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.167+0000 7f98c2ffd700 1 --2- 172.21.15.179:0/993127394 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f98ac0a1120 0x7f98ac0a35e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98b400b2e0 tx=0x7f98b4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:12:19.168 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.169+0000 7f98abfff700 1 -- 172.21.15.179:0/993127394 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f98b80965f0 con 0x7f98c4104420 2024-05-08T23:12:19.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:19 smithi179 ceph-mon[46314]: Detected new or changed devices on smithi135 2024-05-08T23:12:19.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:19 smithi179 ceph-mon[46314]: Adjusting osd_memory_target on smithi135 to 5704M 2024-05-08T23:12:19.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:19 smithi179 ceph-mon[46314]: from='osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T23:12:19.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:19 smithi179 ceph-mon[46314]: osdmap e43: 7 total, 6 up, 7 in 2024-05-08T23:12:19.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:19 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:19.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:19 smithi179 ceph-mon[46314]: from='osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-08T23:12:19.370 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:19.371+0000 7f98c92b1700 1 -- 172.21.15.179:0/993127394 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f98c402ce10 con 0x7f98ac0a1120 2024-05-08T23:12:19.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:19 smithi195 ceph-mon[46516]: Detected new or changed devices on smithi135 2024-05-08T23:12:19.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:19 smithi195 ceph-mon[46516]: Adjusting osd_memory_target on smithi135 to 5704M 2024-05-08T23:12:19.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:19 smithi195 ceph-mon[46516]: from='osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T23:12:19.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:19 smithi195 ceph-mon[46516]: osdmap e43: 7 total, 6 up, 7 in 2024-05-08T23:12:19.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:19 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:19.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:19 smithi195 ceph-mon[46516]: from='osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-08T23:12:19.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:19 smithi135 ceph-mon[42440]: Detected new or changed devices on smithi135 2024-05-08T23:12:19.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:19 smithi135 ceph-mon[42440]: Adjusting osd_memory_target on smithi135 to 5704M 2024-05-08T23:12:19.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:19 smithi135 ceph-mon[42440]: from='osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T23:12:19.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:19 smithi135 ceph-mon[42440]: osdmap e43: 7 total, 6 up, 7 in 2024-05-08T23:12:19.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:19 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:19.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:19 smithi135 ceph-mon[42440]: from='osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-08T23:12:19.954 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:12:19 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:12:19.508+0000 7f22fbdf9700 -1 osd.6 0 waiting for initial osdmap 2024-05-08T23:12:19.954 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:12:19 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:12:19.518+0000 7f22f33e5700 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:12:20.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:20 smithi179 ceph-mon[46314]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:12:20.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:20 smithi179 ceph-mon[46314]: from='osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-08T23:12:20.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:20 smithi179 ceph-mon[46314]: osdmap e44: 7 total, 6 up, 7 in 2024-05-08T23:12:20.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:20 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:20.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:20 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:20.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:20 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:12:20.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:20 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:12:20.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:20 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:20.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:20 smithi179 ceph-mon[46314]: from='osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578]' entity='osd.6' 2024-05-08T23:12:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:20 smithi195 ceph-mon[46516]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:12:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:20 smithi195 ceph-mon[46516]: from='osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-08T23:12:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:20 smithi195 ceph-mon[46516]: osdmap e44: 7 total, 6 up, 7 in 2024-05-08T23:12:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:20 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:20 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:20 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:12:20.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:20 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:12:20.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:20 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:20.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:20 smithi195 ceph-mon[46516]: from='osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578]' entity='osd.6' 2024-05-08T23:12:20.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:20 smithi135 ceph-mon[42440]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:12:20.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:20 smithi135 ceph-mon[42440]: from='osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-08T23:12:20.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:20 smithi135 ceph-mon[42440]: osdmap e44: 7 total, 6 up, 7 in 2024-05-08T23:12:20.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:20 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:20.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:20 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:20.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:20 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:12:20.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:20 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:12:20.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:20 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:20.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:20 smithi135 ceph-mon[42440]: from='osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578]' entity='osd.6' 2024-05-08T23:12:21.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:21 smithi179 ceph-mon[46314]: purged_snaps scrub starts 2024-05-08T23:12:21.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:21 smithi179 ceph-mon[46314]: purged_snaps scrub ok 2024-05-08T23:12:21.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:21 smithi179 ceph-mon[46314]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:12:21.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:21.351 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:21 smithi179 ceph-mon[46314]: osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578] boot 2024-05-08T23:12:21.351 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:21 smithi179 ceph-mon[46314]: osdmap e45: 7 total, 7 up, 7 in 2024-05-08T23:12:21.351 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:21.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:21 smithi195 ceph-mon[46516]: purged_snaps scrub starts 2024-05-08T23:12:21.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:21 smithi195 ceph-mon[46516]: purged_snaps scrub ok 2024-05-08T23:12:21.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:21 smithi195 ceph-mon[46516]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:12:21.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:21.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:21 smithi195 ceph-mon[46516]: osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578] boot 2024-05-08T23:12:21.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:21 smithi195 ceph-mon[46516]: osdmap e45: 7 total, 7 up, 7 in 2024-05-08T23:12:21.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:21.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:21 smithi135 ceph-mon[42440]: purged_snaps scrub starts 2024-05-08T23:12:21.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:21 smithi135 ceph-mon[42440]: purged_snaps scrub ok 2024-05-08T23:12:21.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:21 smithi135 ceph-mon[42440]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:12:21.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:21.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:21 smithi135 ceph-mon[42440]: osd.6 [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578] boot 2024-05-08T23:12:21.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:21 smithi135 ceph-mon[42440]: osdmap e45: 7 total, 7 up, 7 in 2024-05-08T23:12:21.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:12:22.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:22 smithi179 ceph-mon[46314]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:12:22.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:22 smithi179 ceph-mon[46314]: from='client.? 172.21.15.179:0/3976236828' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9cfe5c66-7d48-4a48-93c6-29781ad96581"}]: dispatch 2024-05-08T23:12:22.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:22 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9cfe5c66-7d48-4a48-93c6-29781ad96581"}]: dispatch 2024-05-08T23:12:22.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:22 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9cfe5c66-7d48-4a48-93c6-29781ad96581"}]': finished 2024-05-08T23:12:22.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:22 smithi179 ceph-mon[46314]: osdmap e46: 8 total, 7 up, 8 in 2024-05-08T23:12:22.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:22.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:22 smithi179 ceph-mon[46314]: from='client.? 172.21.15.179:0/2801139501' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:12:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:22 smithi195 ceph-mon[46516]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:12:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:22 smithi195 ceph-mon[46516]: from='client.? 172.21.15.179:0/3976236828' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9cfe5c66-7d48-4a48-93c6-29781ad96581"}]: dispatch 2024-05-08T23:12:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:22 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9cfe5c66-7d48-4a48-93c6-29781ad96581"}]: dispatch 2024-05-08T23:12:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:22 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9cfe5c66-7d48-4a48-93c6-29781ad96581"}]': finished 2024-05-08T23:12:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:22 smithi195 ceph-mon[46516]: osdmap e46: 8 total, 7 up, 8 in 2024-05-08T23:12:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:22 smithi195 ceph-mon[46516]: from='client.? 172.21.15.179:0/2801139501' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:12:22.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:22 smithi135 ceph-mon[42440]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:12:22.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:22 smithi135 ceph-mon[42440]: from='client.? 172.21.15.179:0/3976236828' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9cfe5c66-7d48-4a48-93c6-29781ad96581"}]: dispatch 2024-05-08T23:12:22.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:22 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9cfe5c66-7d48-4a48-93c6-29781ad96581"}]: dispatch 2024-05-08T23:12:22.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:22 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9cfe5c66-7d48-4a48-93c6-29781ad96581"}]': finished 2024-05-08T23:12:22.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:22 smithi135 ceph-mon[42440]: osdmap e46: 8 total, 7 up, 8 in 2024-05-08T23:12:22.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:22.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:22 smithi135 ceph-mon[42440]: from='client.? 172.21.15.179:0/2801139501' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:12:23.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:23 smithi179 ceph-mon[46314]: osdmap e47: 8 total, 7 up, 8 in 2024-05-08T23:12:23.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:23 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:23.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:23 smithi179 ceph-mon[46314]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:23.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:23 smithi195 ceph-mon[46516]: osdmap e47: 8 total, 7 up, 8 in 2024-05-08T23:12:23.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:23 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:23.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:23 smithi195 ceph-mon[46516]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:23.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:23 smithi135 ceph-mon[42440]: osdmap e47: 8 total, 7 up, 8 in 2024-05-08T23:12:23.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:23 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:23.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:23 smithi135 ceph-mon[42440]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:26.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:26 smithi179 ceph-mon[46314]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:26 smithi195 ceph-mon[46516]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:26.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:26 smithi135 ceph-mon[42440]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:28.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:28 smithi179 ceph-mon[46314]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:28.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:28 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T23:12:28.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:28 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:28 smithi195 ceph-mon[46516]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:28 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T23:12:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:28 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:28.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:28 smithi135 ceph-mon[42440]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:28.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:28 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T23:12:28.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:28 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:29.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:29 smithi179 ceph-mon[46314]: Deploying daemon osd.7 on smithi179 2024-05-08T23:12:29.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:29 smithi195 ceph-mon[46516]: Deploying daemon osd.7 on smithi179 2024-05-08T23:12:29.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:29 smithi135 ceph-mon[42440]: Deploying daemon osd.7 on smithi179 2024-05-08T23:12:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:30 smithi179 ceph-mon[46314]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:30.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:30 smithi195 ceph-mon[46516]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:30.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:30 smithi135 ceph-mon[42440]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:32.034 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:32 smithi179 ceph-mon[46314]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:32.034 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:32 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:32.034 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:32 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:32.035 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:32 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:32 smithi195 ceph-mon[46516]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:32 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:32 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:32 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:32.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:32 smithi135 ceph-mon[42440]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:32.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:32 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:32.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:32 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:32.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:32 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:33.425 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:33.424+0000 7f98abfff700 1 -- 172.21.15.179:0/993127394 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f98c402ce10 con 0x7f98ac0a1120 2024-05-08T23:12:33.425 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 7 on host 'smithi179' 2024-05-08T23:12:33.427 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:33.426+0000 7f98c92b1700 1 -- 172.21.15.179:0/993127394 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f98ac0a1120 msgr2=0x7f98ac0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:33.428 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:33.426+0000 7f98c92b1700 1 --2- 172.21.15.179:0/993127394 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f98ac0a1120 0x7f98ac0a35e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98b400b2e0 tx=0x7f98b4005fb0 comp rx=0 tx=0).stop 2024-05-08T23:12:33.428 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:33.426+0000 7f98c92b1700 1 -- 172.21.15.179:0/993127394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c4104420 msgr2=0x7f98c4197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:33.428 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:33.426+0000 7f98c92b1700 1 --2- 172.21.15.179:0/993127394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c4104420 0x7f98c4197530 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f98b800e9a0 tx=0x7f98b800ecb0 comp rx=0 tx=0).stop 2024-05-08T23:12:33.428 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:33.427+0000 7f98c92b1700 1 -- 172.21.15.179:0/993127394 shutdown_connections 2024-05-08T23:12:33.428 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:33.427+0000 7f98c92b1700 1 --2- 172.21.15.179:0/993127394 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f98ac0a1120 0x7f98ac0a35e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:33.429 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:33.427+0000 7f98c92b1700 1 --2- 172.21.15.179:0/993127394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98c4106d50 0x7f98c419e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:33.429 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:33.427+0000 7f98c92b1700 1 --2- 172.21.15.179:0/993127394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98c4101af0 0x7f98c4196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:33.429 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:33.427+0000 7f98c92b1700 1 --2- 172.21.15.179:0/993127394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c4104420 0x7f98c4197530 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:33.429 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:33.427+0000 7f98c92b1700 1 -- 172.21.15.179:0/993127394 >> 172.21.15.179:0/993127394 conn(0x7f98c40fb4a0 msgr2=0x7f98c41023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:12:33.429 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:33.427+0000 7f98c92b1700 1 -- 172.21.15.179:0/993127394 shutdown_connections 2024-05-08T23:12:33.429 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:12:33.427+0000 7f98c92b1700 1 -- 172.21.15.179:0/993127394 wait complete. 2024-05-08T23:12:33.812 DEBUG:teuthology.orchestra.run.smithi179:osd.7> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.7.service 2024-05-08T23:12:33.815 INFO:tasks.cephadm:Deploying osd.8 on smithi195 with /dev/vg_nvme/lv_2... 2024-05-08T23:12:33.815 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T23:12:33.847 INFO:journalctl@ceph.osd.7.smithi179.stdout:-- Logs begin at Wed 2024-05-08 22:52:32 UTC. -- 2024-05-08T23:12:34.015 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:33 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:34.016 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:33 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:34.016 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:33 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:34.016 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:33 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:34.016 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:33 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:34.016 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:33 smithi179 ceph-mon[46314]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:34.016 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:33 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:34.016 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:33 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:34.016 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:33 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:34.048 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:12:34.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:33 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:34.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:33 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:34.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:33 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:34.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:33 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:34.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:33 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:34.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:33 smithi195 ceph-mon[46516]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:34.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:33 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:34.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:33 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:34.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:33 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:34.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:34.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:34.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:33 smithi135 ceph-mon[42440]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:34.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:35.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:35 smithi179 ceph-mon[46314]: from='osd.7 [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T23:12:35.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:35 smithi179 ceph-mon[46314]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T23:12:35.350 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:12:34 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:12:34.957+0000 7fd5f535b7c0 -1 osd.7 0 log_to_monitors true 2024-05-08T23:12:35.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:35 smithi195 ceph-mon[46516]: from='osd.7 [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T23:12:35.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:35 smithi195 ceph-mon[46516]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T23:12:35.423 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T23:12:35.423 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T23:12:35.423 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-05-08T23:12:35.423 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-05-08T23:12:35.423 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00816768 s, 1.3 GB/s 2024-05-08T23:12:35.423 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-05-08T23:12:35.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:35 smithi135 ceph-mon[42440]: from='osd.7 [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T23:12:35.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:35 smithi135 ceph-mon[42440]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T23:12:35.861 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi195:vg_nvme/lv_2 2024-05-08T23:12:36.081 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:12:36.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:36 smithi195 ceph-mon[46516]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:36.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:36 smithi195 ceph-mon[46516]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-08T23:12:36.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:36 smithi195 ceph-mon[46516]: osdmap e48: 8 total, 7 up, 8 in 2024-05-08T23:12:36.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:36 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:36.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:36 smithi195 ceph-mon[46516]: from='osd.7 [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:12:36.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:36 smithi195 ceph-mon[46516]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:12:36.349 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:12:36 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:12:36.032+0000 7fd5ea9bf700 -1 osd.7 0 waiting for initial osdmap 2024-05-08T23:12:36.349 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:12:36 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:12:36.046+0000 7fd5e67b4700 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:12:36.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:36 smithi179 ceph-mon[46314]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:36.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:36 smithi179 ceph-mon[46314]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-08T23:12:36.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:36 smithi179 ceph-mon[46314]: osdmap e48: 8 total, 7 up, 8 in 2024-05-08T23:12:36.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:36 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:36.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:36 smithi179 ceph-mon[46314]: from='osd.7 [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:12:36.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:36 smithi179 ceph-mon[46314]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:12:36.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:36 smithi135 ceph-mon[42440]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:36.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:36 smithi135 ceph-mon[42440]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-08T23:12:36.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:36 smithi135 ceph-mon[42440]: osdmap e48: 8 total, 7 up, 8 in 2024-05-08T23:12:36.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:36 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:36 smithi135 ceph-mon[42440]: from='osd.7 [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:12:36.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:36 smithi135 ceph-mon[42440]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:12:37.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.118+0000 7fbe6f1d9700 1 -- 172.21.15.195:0/1684630949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe680fff00 msgr2=0x7fbe68100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:37.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.118+0000 7fbe6f1d9700 1 --2- 172.21.15.195:0/1684630949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe680fff00 0x7fbe68100320 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009990 tx=0x7fbe5c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:12:37.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.118+0000 7fbe6f1d9700 1 -- 172.21.15.195:0/1684630949 shutdown_connections 2024-05-08T23:12:37.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.118+0000 7fbe6f1d9700 1 --2- 172.21.15.195:0/1684630949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe680fff00 0x7fbe68100320 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:37.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.118+0000 7fbe6f1d9700 1 --2- 172.21.15.195:0/1684630949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe68101a20 0x7fbe68108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:37.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.118+0000 7fbe6f1d9700 1 --2- 172.21.15.195:0/1684630949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe68101060 0x7fbe681014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:37.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.118+0000 7fbe6f1d9700 1 -- 172.21.15.195:0/1684630949 >> 172.21.15.195:0/1684630949 conn(0x7fbe680fb4a0 msgr2=0x7fbe680fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:12:37.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.118+0000 7fbe6f1d9700 1 -- 172.21.15.195:0/1684630949 shutdown_connections 2024-05-08T23:12:37.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.118+0000 7fbe6f1d9700 1 -- 172.21.15.195:0/1684630949 wait complete. 2024-05-08T23:12:37.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6f1d9700 1 Processor -- start 2024-05-08T23:12:37.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6f1d9700 1 -- start start 2024-05-08T23:12:37.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6f1d9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe680fff00 0x7fbe68196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:37.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6f1d9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe68101060 0x7fbe68197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:37.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6f1d9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe68101a20 0x7fbe6819e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:37.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6f1d9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6819e9b0 con 0x7fbe68101060 2024-05-08T23:12:37.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6f1d9700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6819eaf0 con 0x7fbe68101a20 2024-05-08T23:12:37.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6f1d9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6819ec80 con 0x7fbe680fff00 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe67fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe68101060 0x7fbe68197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe67fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe68101060 0x7fbe68197400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.195:32960/0 (socket says 172.21.15.195:32960) 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe67fff700 1 -- 172.21.15.195:0/3194723261 learned_addr learned my addr 172.21.15.195:0/3194723261 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6d776700 1 --2- 172.21.15.195:0/3194723261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe68101a20 0x7fbe6819e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6cf75700 1 --2- 172.21.15.195:0/3194723261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe680fff00 0x7fbe68196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6cf75700 1 -- 172.21.15.195:0/3194723261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe68101a20 msgr2=0x7fbe6819e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6cf75700 1 --2- 172.21.15.195:0/3194723261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe68101a20 0x7fbe6819e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6cf75700 1 -- 172.21.15.195:0/3194723261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe68101060 msgr2=0x7fbe68197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6cf75700 1 --2- 172.21.15.195:0/3194723261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe68101060 0x7fbe68197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6cf75700 1 -- 172.21.15.195:0/3194723261 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c0095f0 con 0x7fbe680fff00 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.119+0000 7fbe6cf75700 1 --2- 172.21.15.195:0/3194723261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe680fff00 0x7fbe68196ec0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009990 tx=0x7fbe5c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.120+0000 7fbe65ffb700 1 -- 172.21.15.195:0/3194723261 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c01d070 con 0x7fbe680fff00 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.120+0000 7fbe6f1d9700 1 -- 172.21.15.195:0/3194723261 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6819ef00 con 0x7fbe680fff00 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.120+0000 7fbe65ffb700 1 -- 172.21.15.195:0/3194723261 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe5c021410 con 0x7fbe680fff00 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.120+0000 7fbe65ffb700 1 -- 172.21.15.195:0/3194723261 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c017650 con 0x7fbe680fff00 2024-05-08T23:12:37.122 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.120+0000 7fbe6f1d9700 1 -- 172.21.15.195:0/3194723261 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6819f2c0 con 0x7fbe680fff00 2024-05-08T23:12:37.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.121+0000 7fbe6f1d9700 1 -- 172.21.15.195:0/3194723261 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe681073f0 con 0x7fbe680fff00 2024-05-08T23:12:37.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.123+0000 7fbe65ffb700 1 -- 172.21.15.195:0/3194723261 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fbe5c021830 con 0x7fbe680fff00 2024-05-08T23:12:37.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.123+0000 7fbe65ffb700 1 --2- 172.21.15.195:0/3194723261 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fbe580a1120 0x7fbe580a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:37.123 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.123+0000 7fbe65ffb700 1 -- 172.21.15.195:0/3194723261 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5430+0+0 (secure 0 0 0) 0x7fbe5c0cd370 con 0x7fbe680fff00 2024-05-08T23:12:37.124 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.123+0000 7fbe67fff700 1 --2- 172.21.15.195:0/3194723261 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fbe580a1120 0x7fbe580a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:37.124 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.124+0000 7fbe67fff700 1 --2- 172.21.15.195:0/3194723261 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fbe580a1120 0x7fbe580a35e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbe54005950 tx=0x7fbe5400a400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:12:37.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.127+0000 7fbe65ffb700 1 -- 172.21.15.195:0/3194723261 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbe5c0976d0 con 0x7fbe680fff00 2024-05-08T23:12:37.329 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:37.329+0000 7fbe6f1d9700 1 -- 172.21.15.195:0/3194723261 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe6802ceb0 con 0x7fbe580a1120 2024-05-08T23:12:37.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-05-08T23:12:37.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: osdmap e49: 8 total, 7 up, 8 in 2024-05-08T23:12:37.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:37.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:37.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: Detected new or changed devices on smithi179 2024-05-08T23:12:37.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:37.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:37.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:37.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:37.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:37.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: Adjusting osd_memory_target on smithi179 to 5704M 2024-05-08T23:12:37.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:37.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:37.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:37.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:37.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: osd.7 [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625] boot 2024-05-08T23:12:37.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: osdmap e50: 8 total, 8 up, 8 in 2024-05-08T23:12:37.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:37 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:37.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-05-08T23:12:37.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: osdmap e49: 8 total, 7 up, 8 in 2024-05-08T23:12:37.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:37.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:37.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: Detected new or changed devices on smithi179 2024-05-08T23:12:37.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:37.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:37.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:37.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:37.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:37.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: Adjusting osd_memory_target on smithi179 to 5704M 2024-05-08T23:12:37.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:37.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:37.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:37.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:37.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: osd.7 [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625] boot 2024-05-08T23:12:37.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: osdmap e50: 8 total, 8 up, 8 in 2024-05-08T23:12:37.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:37 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:37.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-05-08T23:12:37.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: osdmap e49: 8 total, 7 up, 8 in 2024-05-08T23:12:37.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:37.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:37.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: Detected new or changed devices on smithi179 2024-05-08T23:12:37.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:37.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:37.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:37.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:37.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:37.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: Adjusting osd_memory_target on smithi179 to 5704M 2024-05-08T23:12:37.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:37.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:37.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:37.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:37.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: osd.7 [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625] boot 2024-05-08T23:12:37.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: osdmap e50: 8 total, 8 up, 8 in 2024-05-08T23:12:37.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:37 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:12:38.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:38 smithi179 ceph-mon[46314]: purged_snaps scrub starts 2024-05-08T23:12:38.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:38 smithi179 ceph-mon[46314]: purged_snaps scrub ok 2024-05-08T23:12:38.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:38 smithi179 ceph-mon[46314]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:38.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:38 smithi179 ceph-mon[46314]: osdmap e51: 8 total, 8 up, 8 in 2024-05-08T23:12:38.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:38 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:12:38.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:38 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:12:38.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:38 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:38.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:38 smithi195 ceph-mon[46516]: purged_snaps scrub starts 2024-05-08T23:12:38.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:38 smithi195 ceph-mon[46516]: purged_snaps scrub ok 2024-05-08T23:12:38.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:38 smithi195 ceph-mon[46516]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:38.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:38 smithi195 ceph-mon[46516]: osdmap e51: 8 total, 8 up, 8 in 2024-05-08T23:12:38.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:38 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:12:38.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:38 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:12:38.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:38 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:38.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:38 smithi135 ceph-mon[42440]: purged_snaps scrub starts 2024-05-08T23:12:38.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:38 smithi135 ceph-mon[42440]: purged_snaps scrub ok 2024-05-08T23:12:38.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:38 smithi135 ceph-mon[42440]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:12:38.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:38 smithi135 ceph-mon[42440]: osdmap e51: 8 total, 8 up, 8 in 2024-05-08T23:12:38.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:38 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:12:38.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:38 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:12:38.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:38 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:39.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:39 smithi179 ceph-mon[46314]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:12:39.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:39 smithi179 ceph-mon[46314]: osdmap e52: 8 total, 8 up, 8 in 2024-05-08T23:12:39.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:39 smithi195 ceph-mon[46516]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:12:39.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:39 smithi195 ceph-mon[46516]: osdmap e52: 8 total, 8 up, 8 in 2024-05-08T23:12:39.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:39 smithi135 ceph-mon[42440]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:12:39.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:39 smithi135 ceph-mon[42440]: osdmap e52: 8 total, 8 up, 8 in 2024-05-08T23:12:40.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:40 smithi179 ceph-mon[46314]: pgmap v141: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:40.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:40 smithi179 ceph-mon[46314]: from='client.? 172.21.15.195:0/2545306460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "807e90e4-2d33-4038-952b-97d5203ce08d"}]: dispatch 2024-05-08T23:12:40.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:40 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "807e90e4-2d33-4038-952b-97d5203ce08d"}]: dispatch 2024-05-08T23:12:40.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:40 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "807e90e4-2d33-4038-952b-97d5203ce08d"}]': finished 2024-05-08T23:12:40.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:40 smithi179 ceph-mon[46314]: osdmap e53: 9 total, 8 up, 9 in 2024-05-08T23:12:40.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:40 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:40.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:40 smithi179 ceph-mon[46314]: from='client.? 172.21.15.195:0/3757594637' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:12:40.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:40 smithi195 ceph-mon[46516]: pgmap v141: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:40.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:40 smithi195 ceph-mon[46516]: from='client.? 172.21.15.195:0/2545306460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "807e90e4-2d33-4038-952b-97d5203ce08d"}]: dispatch 2024-05-08T23:12:40.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:40 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "807e90e4-2d33-4038-952b-97d5203ce08d"}]: dispatch 2024-05-08T23:12:40.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:40 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "807e90e4-2d33-4038-952b-97d5203ce08d"}]': finished 2024-05-08T23:12:40.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:40 smithi195 ceph-mon[46516]: osdmap e53: 9 total, 8 up, 9 in 2024-05-08T23:12:40.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:40 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:40.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:40 smithi195 ceph-mon[46516]: from='client.? 172.21.15.195:0/3757594637' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:12:40.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:40 smithi135 ceph-mon[42440]: pgmap v141: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:40.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:40 smithi135 ceph-mon[42440]: from='client.? 172.21.15.195:0/2545306460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "807e90e4-2d33-4038-952b-97d5203ce08d"}]: dispatch 2024-05-08T23:12:40.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:40 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "807e90e4-2d33-4038-952b-97d5203ce08d"}]: dispatch 2024-05-08T23:12:40.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:40 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "807e90e4-2d33-4038-952b-97d5203ce08d"}]': finished 2024-05-08T23:12:40.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:40 smithi135 ceph-mon[42440]: osdmap e53: 9 total, 8 up, 9 in 2024-05-08T23:12:40.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:40 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:40.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:40 smithi135 ceph-mon[42440]: from='client.? 172.21.15.195:0/3757594637' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:12:41.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:41 smithi135 ceph-mon[42440]: osdmap e54: 9 total, 8 up, 9 in 2024-05-08T23:12:41.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:41 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:41.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:41 smithi179 ceph-mon[46314]: osdmap e54: 9 total, 8 up, 9 in 2024-05-08T23:12:41.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:41 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:41.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:41 smithi195 ceph-mon[46516]: osdmap e54: 9 total, 8 up, 9 in 2024-05-08T23:12:41.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:41 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:42.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:42 smithi135 ceph-mon[42440]: pgmap v144: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:42.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:42 smithi179 ceph-mon[46314]: pgmap v144: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:42.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:42 smithi195 ceph-mon[46516]: pgmap v144: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:44.312 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:44 smithi195 ceph-mon[46516]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:44.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:44 smithi135 ceph-mon[42440]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:44.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:44 smithi179 ceph-mon[46314]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:45.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:45 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-08T23:12:45.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:45 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:45.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:45 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-08T23:12:45.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:45 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:45.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:45 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-08T23:12:45.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:45 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:46.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:46 smithi135 ceph-mon[42440]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:46.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:46 smithi135 ceph-mon[42440]: Deploying daemon osd.8 on smithi195 2024-05-08T23:12:46.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:46 smithi179 ceph-mon[46314]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:46.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:46 smithi179 ceph-mon[46314]: Deploying daemon osd.8 on smithi195 2024-05-08T23:12:46.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:46 smithi195 ceph-mon[46516]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:46.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:46 smithi195 ceph-mon[46516]: Deploying daemon osd.8 on smithi195 2024-05-08T23:12:48.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:48 smithi135 ceph-mon[42440]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:48.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:48 smithi179 ceph-mon[46314]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:48.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:48 smithi195 ceph-mon[46516]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:50 smithi195 ceph-mon[46516]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:50 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:50 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:50 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:50.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:50 smithi179 ceph-mon[46314]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:50.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:50 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:50.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:50 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:50.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:50 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:50.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:50 smithi135 ceph-mon[42440]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:50.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:50 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:50.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:50 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:50.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:50 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:51.385 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 8 on host 'smithi195' 2024-05-08T23:12:51.385 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:51.383+0000 7fbe65ffb700 1 -- 172.21.15.195:0/3194723261 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fbe6802ceb0 con 0x7fbe580a1120 2024-05-08T23:12:51.387 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:51.386+0000 7fbe6f1d9700 1 -- 172.21.15.195:0/3194723261 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fbe580a1120 msgr2=0x7fbe580a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:51.387 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:51.386+0000 7fbe6f1d9700 1 --2- 172.21.15.195:0/3194723261 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fbe580a1120 0x7fbe580a35e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbe54005950 tx=0x7fbe5400a400 comp rx=0 tx=0).stop 2024-05-08T23:12:51.387 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:51.386+0000 7fbe6f1d9700 1 -- 172.21.15.195:0/3194723261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe680fff00 msgr2=0x7fbe68196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:51.387 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:51.386+0000 7fbe6f1d9700 1 --2- 172.21.15.195:0/3194723261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe680fff00 0x7fbe68196ec0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009990 tx=0x7fbe5c004730 comp rx=0 tx=0).stop 2024-05-08T23:12:51.387 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:51.386+0000 7fbe6f1d9700 1 -- 172.21.15.195:0/3194723261 shutdown_connections 2024-05-08T23:12:51.387 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:51.386+0000 7fbe6f1d9700 1 --2- 172.21.15.195:0/3194723261 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fbe580a1120 0x7fbe580a35e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:51.387 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:51.386+0000 7fbe6f1d9700 1 --2- 172.21.15.195:0/3194723261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe680fff00 0x7fbe68196ec0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:51.387 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:51.386+0000 7fbe6f1d9700 1 --2- 172.21.15.195:0/3194723261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe68101a20 0x7fbe6819e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:51.387 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:51.386+0000 7fbe6f1d9700 1 --2- 172.21.15.195:0/3194723261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe68101060 0x7fbe68197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:51.387 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:51.386+0000 7fbe6f1d9700 1 -- 172.21.15.195:0/3194723261 >> 172.21.15.195:0/3194723261 conn(0x7fbe680fb4a0 msgr2=0x7fbe68104530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:12:51.388 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:51.386+0000 7fbe6f1d9700 1 -- 172.21.15.195:0/3194723261 shutdown_connections 2024-05-08T23:12:51.388 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:12:51.386+0000 7fbe6f1d9700 1 -- 172.21.15.195:0/3194723261 wait complete. 2024-05-08T23:12:51.947 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:51.947 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:51.948 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:51.948 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:51.948 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:51.948 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:51 smithi195 ceph-mon[46516]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:51.948 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:51.948 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:51.948 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:51 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:51.949 DEBUG:teuthology.orchestra.run.smithi195:osd.8> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.8.service 2024-05-08T23:12:51.951 INFO:tasks.cephadm:Deploying osd.9 on smithi135 with /dev/vg_nvme/lv_1... 2024-05-08T23:12:51.951 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-08T23:12:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:51 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:51 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:51 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:51.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:51 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:51.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:51 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:51.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:51 smithi135 ceph-mon[42440]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:51.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:51 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:51.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:51 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:51.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:51 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:51.995 INFO:journalctl@ceph.osd.8.smithi195.stdout:-- Logs begin at Wed 2024-05-08 22:52:38 UTC. -- 2024-05-08T23:12:52.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:51 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:52.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:51 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:52.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:51 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:52.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:51 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:52.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:51 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:52.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:51 smithi179 ceph-mon[46314]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:52.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:51 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:52.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:51 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:52.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:51 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:12:52.198 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:12:53.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:53 smithi179 ceph-mon[46314]: from='osd.8 [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T23:12:53.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:53 smithi179 ceph-mon[46314]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T23:12:53.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:53 smithi195 ceph-mon[46516]: from='osd.8 [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T23:12:53.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:53 smithi195 ceph-mon[46516]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T23:12:53.381 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:12:53 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:12:53.030+0000 7f9dc2fe67c0 -1 osd.8 0 log_to_monitors true 2024-05-08T23:12:53.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:53 smithi135 ceph-mon[42440]: from='osd.8 [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T23:12:53.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:53 smithi135 ceph-mon[42440]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T23:12:53.533 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-08T23:12:53.533 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-08T23:12:53.533 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-05-08T23:12:53.533 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-05-08T23:12:53.533 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0152012 s, 690 MB/s 2024-05-08T23:12:53.533 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-05-08T23:12:53.861 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_1 2024-05-08T23:12:54.095 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:12:54.130 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:12:54 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:12:54.101+0000 7f9db864a700 -1 osd.8 0 waiting for initial osdmap 2024-05-08T23:12:54.130 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:12:54 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:12:54.112+0000 7f9db443f700 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:12:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:54 smithi195 ceph-mon[46516]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:54 smithi195 ceph-mon[46516]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-08T23:12:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:54 smithi195 ceph-mon[46516]: osdmap e55: 9 total, 8 up, 9 in 2024-05-08T23:12:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:54 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:54 smithi195 ceph-mon[46516]: from='osd.8 [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:12:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:54 smithi195 ceph-mon[46516]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:12:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:54 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:54 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:54 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:54 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:54 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:54 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:54.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:54 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:54.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:54 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:54.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:54 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:54.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:54 smithi179 ceph-mon[46314]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:54.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:54 smithi179 ceph-mon[46314]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-08T23:12:54.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:54 smithi179 ceph-mon[46314]: osdmap e55: 9 total, 8 up, 9 in 2024-05-08T23:12:54.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:54 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:54.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:54 smithi179 ceph-mon[46314]: from='osd.8 [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:12:54.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:54 smithi179 ceph-mon[46314]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:12:54.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:54 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:54.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:54 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:54.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:54 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:54.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:54 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:54.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:54 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:54.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:54 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:54.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:54 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:54.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:54 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:54.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:54 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:54.386 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:54 smithi135 ceph-mon[42440]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:54.387 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:54 smithi135 ceph-mon[42440]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-08T23:12:54.387 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:54 smithi135 ceph-mon[42440]: osdmap e55: 9 total, 8 up, 9 in 2024-05-08T23:12:54.387 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:54 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:54.387 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:54 smithi135 ceph-mon[42440]: from='osd.8 [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:12:54.387 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:54 smithi135 ceph-mon[42440]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:12:54.387 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:54 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:54.387 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:54 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:54.387 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:54 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:54.387 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:54 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:54.387 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:54 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:12:54.387 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:54 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:54.388 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:54 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:54.388 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:54 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:12:54.388 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:54 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:12:55.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.089+0000 7f2b4b0f2700 1 -- 172.21.15.135:0/134362823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101060 msgr2=0x7f2b441014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:55.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.089+0000 7f2b4b0f2700 1 --2- 172.21.15.135:0/134362823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101060 0x7f2b441014e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009990 tx=0x7f2b30009ca0 comp rx=0 tx=0).stop 2024-05-08T23:12:55.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.089+0000 7f2b4b0f2700 1 -- 172.21.15.135:0/134362823 shutdown_connections 2024-05-08T23:12:55.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.089+0000 7f2b4b0f2700 1 --2- 172.21.15.135:0/134362823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b44101a20 0x7f2b44108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:55.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.089+0000 7f2b4b0f2700 1 --2- 172.21.15.135:0/134362823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b440fff00 0x7f2b44100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:55.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.089+0000 7f2b4b0f2700 1 --2- 172.21.15.135:0/134362823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101060 0x7f2b441014e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:55.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.089+0000 7f2b4b0f2700 1 -- 172.21.15.135:0/134362823 >> 172.21.15.135:0/134362823 conn(0x7f2b440fb4a0 msgr2=0x7f2b440fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:12:55.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.090+0000 7f2b4b0f2700 1 -- 172.21.15.135:0/134362823 shutdown_connections 2024-05-08T23:12:55.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.090+0000 7f2b4b0f2700 1 -- 172.21.15.135:0/134362823 wait complete. 2024-05-08T23:12:55.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.090+0000 7f2b4b0f2700 1 Processor -- start 2024-05-08T23:12:55.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.090+0000 7f2b4b0f2700 1 -- start start 2024-05-08T23:12:55.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.090+0000 7f2b4b0f2700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b440fff00 0x7f2b44103e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:55.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.090+0000 7f2b4b0f2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b44101060 0x7f2b441024d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:55.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.090+0000 7f2b4b0f2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101a20 0x7f2b44102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:55.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.090+0000 7f2b4b0f2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b441031b0 con 0x7f2b44101a20 2024-05-08T23:12:55.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.090+0000 7f2b4b0f2700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b44103320 con 0x7f2b440fff00 2024-05-08T23:12:55.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.090+0000 7f2b4b0f2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b441a0fb0 con 0x7f2b44101060 2024-05-08T23:12:55.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.090+0000 7f2b4968f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101a20 0x7f2b44102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:55.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.090+0000 7f2b4968f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101a20 0x7f2b44102a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59356/0 (socket says 172.21.15.135:59356) 2024-05-08T23:12:55.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.090+0000 7f2b4968f700 1 -- 172.21.15.135:0/2928096800 learned_addr learned my addr 172.21.15.135:0/2928096800 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:12:55.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.091+0000 7f2b48e8e700 1 --2- 172.21.15.135:0/2928096800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b440fff00 0x7f2b44103e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:55.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.091+0000 7f2b43fff700 1 --2- 172.21.15.135:0/2928096800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b44101060 0x7f2b441024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:55.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.091+0000 7f2b4968f700 1 -- 172.21.15.135:0/2928096800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b44101060 msgr2=0x7f2b441024d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:55.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.091+0000 7f2b4968f700 1 --2- 172.21.15.135:0/2928096800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b44101060 0x7f2b441024d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:55.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.091+0000 7f2b4968f700 1 -- 172.21.15.135:0/2928096800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b440fff00 msgr2=0x7f2b44103e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:12:55.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.091+0000 7f2b4968f700 1 --2- 172.21.15.135:0/2928096800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b440fff00 0x7f2b44103e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:12:55.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.091+0000 7f2b4968f700 1 -- 172.21.15.135:0/2928096800 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b300095f0 con 0x7f2b44101a20 2024-05-08T23:12:55.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.091+0000 7f2b43fff700 1 --2- 172.21.15.135:0/2928096800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b44101060 0x7f2b441024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:12:55.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.091+0000 7f2b4968f700 1 --2- 172.21.15.135:0/2928096800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101a20 0x7f2b44102a10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c007ee0 tx=0x7f2b3c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:12:55.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.091+0000 7f2b41ffb700 1 -- 172.21.15.135:0/2928096800 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c017070 con 0x7f2b44101a20 2024-05-08T23:12:55.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.091+0000 7f2b4b0f2700 1 -- 172.21.15.135:0/2928096800 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b441a1240 con 0x7f2b44101a20 2024-05-08T23:12:55.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.091+0000 7f2b41ffb700 1 -- 172.21.15.135:0/2928096800 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b3c00f040 con 0x7f2b44101a20 2024-05-08T23:12:55.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.091+0000 7f2b41ffb700 1 -- 172.21.15.135:0/2928096800 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c005740 con 0x7f2b44101a20 2024-05-08T23:12:55.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.091+0000 7f2b4b0f2700 1 -- 172.21.15.135:0/2928096800 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b441a1790 con 0x7f2b44101a20 2024-05-08T23:12:55.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.092+0000 7f2b4b0f2700 1 -- 172.21.15.135:0/2928096800 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4404ec60 con 0x7f2b44101a20 2024-05-08T23:12:55.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.094+0000 7f2b41ffb700 1 -- 172.21.15.135:0/2928096800 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f2b3c00dc60 con 0x7f2b44101a20 2024-05-08T23:12:55.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.094+0000 7f2b41ffb700 1 --2- 172.21.15.135:0/2928096800 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2b340a1120 0x7f2b340a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:12:55.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.094+0000 7f2b48e8e700 1 --2- 172.21.15.135:0/2928096800 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2b340a1120 0x7f2b340a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:12:55.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.094+0000 7f2b41ffb700 1 -- 172.21.15.135:0/2928096800 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f2b3c0cbc50 con 0x7f2b44101a20 2024-05-08T23:12:55.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.095+0000 7f2b48e8e700 1 --2- 172.21.15.135:0/2928096800 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2b340a1120 0x7f2b340a35e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2b38005950 tx=0x7f2b3800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:12:55.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.098+0000 7f2b41ffb700 1 -- 172.21.15.135:0/2928096800 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2b3c095eb0 con 0x7f2b44101a20 2024-05-08T23:12:55.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:55 smithi135 ceph-mon[42440]: Detected new or changed devices on smithi195 2024-05-08T23:12:55.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:55 smithi135 ceph-mon[42440]: Adjusting osd_memory_target on smithi195 to 5704M 2024-05-08T23:12:55.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:55 smithi135 ceph-mon[42440]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-05-08T23:12:55.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:55 smithi135 ceph-mon[42440]: osdmap e56: 9 total, 8 up, 9 in 2024-05-08T23:12:55.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:55 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:55.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:55 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:55.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:12:55.309+0000 7f2b4b0f2700 1 -- 172.21.15.135:0/2928096800 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b44069150 con 0x7f2b340a1120 2024-05-08T23:12:55.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:55 smithi195 ceph-mon[46516]: Detected new or changed devices on smithi195 2024-05-08T23:12:55.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:55 smithi195 ceph-mon[46516]: Adjusting osd_memory_target on smithi195 to 5704M 2024-05-08T23:12:55.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:55 smithi195 ceph-mon[46516]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-05-08T23:12:55.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:55 smithi195 ceph-mon[46516]: osdmap e56: 9 total, 8 up, 9 in 2024-05-08T23:12:55.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:55 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:55.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:55 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:55.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:55 smithi179 ceph-mon[46314]: Detected new or changed devices on smithi195 2024-05-08T23:12:55.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:55 smithi179 ceph-mon[46314]: Adjusting osd_memory_target on smithi195 to 5704M 2024-05-08T23:12:55.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:55 smithi179 ceph-mon[46314]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-05-08T23:12:55.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:55 smithi179 ceph-mon[46314]: osdmap e56: 9 total, 8 up, 9 in 2024-05-08T23:12:55.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:55 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:55.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:55 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:56.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:56 smithi135 ceph-mon[42440]: purged_snaps scrub starts 2024-05-08T23:12:56.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:56 smithi135 ceph-mon[42440]: purged_snaps scrub ok 2024-05-08T23:12:56.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:56 smithi135 ceph-mon[42440]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:56.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:56.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:56 smithi135 ceph-mon[42440]: osd.8 [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376] boot 2024-05-08T23:12:56.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:56 smithi135 ceph-mon[42440]: osdmap e57: 9 total, 9 up, 9 in 2024-05-08T23:12:56.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:56.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:12:56.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:12:56.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:56 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:56.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:56 smithi195 ceph-mon[46516]: purged_snaps scrub starts 2024-05-08T23:12:56.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:56 smithi195 ceph-mon[46516]: purged_snaps scrub ok 2024-05-08T23:12:56.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:56 smithi195 ceph-mon[46516]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:56.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:56.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:56 smithi195 ceph-mon[46516]: osd.8 [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376] boot 2024-05-08T23:12:56.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:56 smithi195 ceph-mon[46516]: osdmap e57: 9 total, 9 up, 9 in 2024-05-08T23:12:56.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:56.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:12:56.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:12:56.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:56 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:56.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:56 smithi179 ceph-mon[46314]: purged_snaps scrub starts 2024-05-08T23:12:56.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:56 smithi179 ceph-mon[46314]: purged_snaps scrub ok 2024-05-08T23:12:56.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:56 smithi179 ceph-mon[46314]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T23:12:56.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:56 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:56.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:56 smithi179 ceph-mon[46314]: osd.8 [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376] boot 2024-05-08T23:12:56.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:56 smithi179 ceph-mon[46314]: osdmap e57: 9 total, 9 up, 9 in 2024-05-08T23:12:56.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:56 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T23:12:56.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:56 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:12:56.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:56 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:12:56.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:56 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:12:57.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:57 smithi195 ceph-mon[46516]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:12:57.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:57 smithi195 ceph-mon[46516]: osdmap e58: 9 total, 9 up, 9 in 2024-05-08T23:12:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:57 smithi135 ceph-mon[42440]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:12:57.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:57 smithi135 ceph-mon[42440]: osdmap e58: 9 total, 9 up, 9 in 2024-05-08T23:12:57.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:57 smithi179 ceph-mon[46314]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:12:57.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:57 smithi179 ceph-mon[46314]: osdmap e58: 9 total, 9 up, 9 in 2024-05-08T23:12:58.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:58 smithi195 ceph-mon[46516]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-05-08T23:12:58.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:58 smithi195 ceph-mon[46516]: osdmap e59: 9 total, 9 up, 9 in 2024-05-08T23:12:58.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:58 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3615191442' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d499d4b-5921-4bbb-8179-549ec18bbf21"}]: dispatch 2024-05-08T23:12:58.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:58 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3615191442' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d499d4b-5921-4bbb-8179-549ec18bbf21"}]': finished 2024-05-08T23:12:58.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:58 smithi195 ceph-mon[46516]: osdmap e60: 10 total, 9 up, 10 in 2024-05-08T23:12:58.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:58 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:12:58.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:58 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/744872760' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:12:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:58 smithi135 ceph-mon[42440]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-05-08T23:12:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:58 smithi135 ceph-mon[42440]: osdmap e59: 9 total, 9 up, 9 in 2024-05-08T23:12:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:58 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3615191442' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d499d4b-5921-4bbb-8179-549ec18bbf21"}]: dispatch 2024-05-08T23:12:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:58 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3615191442' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d499d4b-5921-4bbb-8179-549ec18bbf21"}]': finished 2024-05-08T23:12:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:58 smithi135 ceph-mon[42440]: osdmap e60: 10 total, 9 up, 10 in 2024-05-08T23:12:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:58 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:12:58.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:58 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/744872760' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:12:58.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:58 smithi179 ceph-mon[46314]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-05-08T23:12:58.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:58 smithi179 ceph-mon[46314]: osdmap e59: 9 total, 9 up, 9 in 2024-05-08T23:12:58.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:58 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3615191442' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d499d4b-5921-4bbb-8179-549ec18bbf21"}]: dispatch 2024-05-08T23:12:58.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:58 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3615191442' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d499d4b-5921-4bbb-8179-549ec18bbf21"}]': finished 2024-05-08T23:12:58.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:58 smithi179 ceph-mon[46314]: osdmap e60: 10 total, 9 up, 10 in 2024-05-08T23:12:58.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:58 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:12:58.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:58 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/744872760' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:12:59.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:59 smithi135 ceph-mon[42440]: osdmap e61: 10 total, 9 up, 10 in 2024-05-08T23:12:59.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:12:59 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:12:59.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:59 smithi179 ceph-mon[46314]: osdmap e61: 10 total, 9 up, 10 in 2024-05-08T23:12:59.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:12:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:12:59.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:59 smithi195 ceph-mon[46516]: osdmap e61: 10 total, 9 up, 10 in 2024-05-08T23:12:59.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:12:59 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:00.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:00 smithi135 ceph-mon[42440]: pgmap v160: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T23:13:00.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:00 smithi135 ceph-mon[42440]: osdmap e62: 10 total, 9 up, 10 in 2024-05-08T23:13:00.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:00 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:00.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:00 smithi179 ceph-mon[46314]: pgmap v160: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T23:13:00.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:00 smithi179 ceph-mon[46314]: osdmap e62: 10 total, 9 up, 10 in 2024-05-08T23:13:00.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:00 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:00.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:00 smithi195 ceph-mon[46516]: pgmap v160: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T23:13:00.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:00 smithi195 ceph-mon[46516]: osdmap e62: 10 total, 9 up, 10 in 2024-05-08T23:13:00.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:00 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:02.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:02 smithi135 ceph-mon[42440]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T23:13:02.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:02 smithi179 ceph-mon[46314]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T23:13:02.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:02 smithi195 ceph-mon[46516]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T23:13:03.419 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:03 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-08T23:13:03.419 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:03 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:03.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:03 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-08T23:13:03.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:03 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:03.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:03 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-08T23:13:03.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:03 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:04.359 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:04 smithi135 ceph-mon[42440]: Deploying daemon osd.9 on smithi135 2024-05-08T23:13:04.359 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:04 smithi135 ceph-mon[42440]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-08T23:13:04.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:04 smithi179 ceph-mon[46314]: Deploying daemon osd.9 on smithi135 2024-05-08T23:13:04.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:04 smithi179 ceph-mon[46314]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-08T23:13:04.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:04 smithi195 ceph-mon[46516]: Deploying daemon osd.9 on smithi135 2024-05-08T23:13:04.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:04 smithi195 ceph-mon[46516]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-08T23:13:06.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:06 smithi135 ceph-mon[42440]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-05-08T23:13:06.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:06 smithi179 ceph-mon[46314]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-05-08T23:13:06.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:06 smithi195 ceph-mon[46516]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-05-08T23:13:07.952 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:07 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:07.952 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:07 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:07.952 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:07 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:07.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:07 smithi135 ceph-mon[42440]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-05-08T23:13:08.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:07 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:08.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:07 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:08.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:07 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:08.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:07 smithi179 ceph-mon[46314]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-05-08T23:13:08.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:07 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:08.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:07 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:08.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:07 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:08.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:07 smithi195 ceph-mon[46516]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-05-08T23:13:09.056 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 9 on host 'smithi135' 2024-05-08T23:13:09.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:09.056+0000 7f2b41ffb700 1 -- 172.21.15.135:0/2928096800 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2b44069150 con 0x7f2b340a1120 2024-05-08T23:13:09.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:09.058+0000 7f2b4b0f2700 1 -- 172.21.15.135:0/2928096800 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2b340a1120 msgr2=0x7f2b340a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:09.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:09.058+0000 7f2b4b0f2700 1 --2- 172.21.15.135:0/2928096800 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2b340a1120 0x7f2b340a35e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2b38005950 tx=0x7f2b3800a300 comp rx=0 tx=0).stop 2024-05-08T23:13:09.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:09.058+0000 7f2b4b0f2700 1 -- 172.21.15.135:0/2928096800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101a20 msgr2=0x7f2b44102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:09.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:09.058+0000 7f2b4b0f2700 1 --2- 172.21.15.135:0/2928096800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101a20 0x7f2b44102a10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c007ee0 tx=0x7f2b3c00d3b0 comp rx=0 tx=0).stop 2024-05-08T23:13:09.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:09.058+0000 7f2b4b0f2700 1 -- 172.21.15.135:0/2928096800 shutdown_connections 2024-05-08T23:13:09.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:09.058+0000 7f2b4b0f2700 1 --2- 172.21.15.135:0/2928096800 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2b340a1120 0x7f2b340a35e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:09.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:09.058+0000 7f2b4b0f2700 1 --2- 172.21.15.135:0/2928096800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101a20 0x7f2b44102a10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:09.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:09.058+0000 7f2b4b0f2700 1 --2- 172.21.15.135:0/2928096800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b440fff00 0x7f2b44103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:09.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:09.058+0000 7f2b4b0f2700 1 --2- 172.21.15.135:0/2928096800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b44101060 0x7f2b441024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:09.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:09.058+0000 7f2b4b0f2700 1 -- 172.21.15.135:0/2928096800 >> 172.21.15.135:0/2928096800 conn(0x7f2b440fb4a0 msgr2=0x7f2b44068a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:09.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:09.058+0000 7f2b4b0f2700 1 -- 172.21.15.135:0/2928096800 shutdown_connections 2024-05-08T23:13:09.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:09.058+0000 7f2b4b0f2700 1 -- 172.21.15.135:0/2928096800 wait complete. 2024-05-08T23:13:09.390 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:09.390 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:09.391 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:09.391 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:09.391 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:09.391 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:09 smithi135 ceph-mon[42440]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:13:09.391 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:09.391 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:09.391 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:09.467 DEBUG:teuthology.orchestra.run.smithi135:osd.9> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.9.service 2024-05-08T23:13:09.469 INFO:tasks.cephadm:Deploying osd.10 on smithi179 with /dev/vg_nvme/lv_1... 2024-05-08T23:13:09.469 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-08T23:13:09.502 INFO:journalctl@ceph.osd.9.smithi135.stdout:-- Logs begin at Wed 2024-05-08 22:52:39 UTC. -- 2024-05-08T23:13:09.516 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:09.516 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:09.516 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:09.516 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:09.516 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:09.516 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:09 smithi179 ceph-mon[46314]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:13:09.516 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:09.516 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:09.517 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:09.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:09.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:09.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:09.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:09.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:09.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:09 smithi195 ceph-mon[46516]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:13:09.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:09.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:09.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:09.715 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:13:11.016 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-08T23:13:11.016 INFO:teuthology.orchestra.run.smithi179.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-08T23:13:11.016 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10+0 records in 2024-05-08T23:13:11.016 INFO:teuthology.orchestra.run.smithi179.stderr:10+0 records out 2024-05-08T23:13:11.017 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113694 s, 922 MB/s 2024-05-08T23:13:11.017 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping successful for: 2024-05-08T23:13:11.054 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:10 smithi179 ceph-mon[46314]: from='osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T23:13:11.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:10 smithi195 ceph-mon[46516]: from='osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T23:13:11.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:10 smithi135 ceph-mon[42440]: from='osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T23:13:11.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:13:10 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:13:10.744+0000 7f81e4ce57c0 -1 osd.9 0 log_to_monitors true 2024-05-08T23:13:11.453 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi179:vg_nvme/lv_1 2024-05-08T23:13:11.677 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:13:11.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:11 smithi135 ceph-mon[42440]: from='osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-08T23:13:11.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:11 smithi135 ceph-mon[42440]: osdmap e63: 10 total, 9 up, 10 in 2024-05-08T23:13:11.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:11.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:11 smithi135 ceph-mon[42440]: from='osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-08T23:13:11.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:11 smithi135 ceph-mon[42440]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:13:11.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:11.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:11.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:11.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:11.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:11.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:11.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:11.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:11.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:11.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:12.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:11 smithi179 ceph-mon[46314]: from='osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-08T23:13:12.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:11 smithi179 ceph-mon[46314]: osdmap e63: 10 total, 9 up, 10 in 2024-05-08T23:13:12.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:12.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:11 smithi179 ceph-mon[46314]: from='osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-08T23:13:12.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:11 smithi179 ceph-mon[46314]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:13:12.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:12.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:12.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:12.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:12.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:12.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:12.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:12.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:12.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:12.101 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:12.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:11 smithi195 ceph-mon[46516]: from='osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-08T23:13:12.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:11 smithi195 ceph-mon[46516]: osdmap e63: 10 total, 9 up, 10 in 2024-05-08T23:13:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:11 smithi195 ceph-mon[46516]: from='osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-08T23:13:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:11 smithi195 ceph-mon[46516]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:13:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:12.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:12.667 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.666+0000 7fafc59d6700 1 -- 172.21.15.179:0/521139150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafc00ffe90 msgr2=0x7fafc01002b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:12.667 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.666+0000 7fafc59d6700 1 --2- 172.21.15.179:0/521139150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafc00ffe90 0x7fafc01002b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009990 tx=0x7fafb0009ca0 comp rx=0 tx=0).stop 2024-05-08T23:13:12.667 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.666+0000 7fafc59d6700 1 -- 172.21.15.179:0/521139150 shutdown_connections 2024-05-08T23:13:12.667 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.666+0000 7fafc59d6700 1 --2- 172.21.15.179:0/521139150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc0101a40 0x7fafc0108360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:12.667 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.666+0000 7fafc59d6700 1 --2- 172.21.15.179:0/521139150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafc00ffe90 0x7fafc01002b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:12.668 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.666+0000 7fafc59d6700 1 --2- 172.21.15.179:0/521139150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fafc0101080 0x7fafc0101500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:12.668 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.666+0000 7fafc59d6700 1 -- 172.21.15.179:0/521139150 >> 172.21.15.179:0/521139150 conn(0x7fafc00fb4a0 msgr2=0x7fafc00fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:12.668 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.666+0000 7fafc59d6700 1 -- 172.21.15.179:0/521139150 shutdown_connections 2024-05-08T23:13:12.668 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.666+0000 7fafc59d6700 1 -- 172.21.15.179:0/521139150 wait complete. 2024-05-08T23:13:12.668 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.667+0000 7fafc59d6700 1 Processor -- start 2024-05-08T23:13:12.668 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.667+0000 7fafc59d6700 1 -- start start 2024-05-08T23:13:12.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.667+0000 7fafc59d6700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafc00ffe90 0x7fafc006a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:12.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.667+0000 7fafc59d6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc0101080 0x7fafc019bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:12.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.667+0000 7fafc59d6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fafc0101a40 0x7fafc019e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:12.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.667+0000 7fafc59d6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc019e9f0 con 0x7fafc0101080 2024-05-08T23:13:12.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.667+0000 7fafc59d6700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc019eb60 con 0x7fafc00ffe90 2024-05-08T23:13:12.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.667+0000 7fafc59d6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc019ed20 con 0x7fafc0101a40 2024-05-08T23:13:12.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafbeffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafc00ffe90 0x7fafc006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:12.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafbeffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafc00ffe90 0x7fafc006a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39924/0 (socket says 172.21.15.179:39924) 2024-05-08T23:13:12.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafbeffd700 1 -- 172.21.15.179:0/1788821907 learned_addr learned my addr 172.21.15.179:0/1788821907 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-05-08T23:13:12.670 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafbe7fc700 1 --2- 172.21.15.179:0/1788821907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc0101080 0x7fafc019bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:12.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafbf7fe700 1 --2- 172.21.15.179:0/1788821907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fafc0101a40 0x7fafc019e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:12.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafbeffd700 1 -- 172.21.15.179:0/1788821907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fafc0101a40 msgr2=0x7fafc019e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:12.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafbeffd700 1 --2- 172.21.15.179:0/1788821907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fafc0101a40 0x7fafc019e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:12.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafbeffd700 1 -- 172.21.15.179:0/1788821907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc0101080 msgr2=0x7fafc019bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:12.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafbeffd700 1 --2- 172.21.15.179:0/1788821907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc0101080 0x7fafc019bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:12.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafbeffd700 1 -- 172.21.15.179:0/1788821907 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb00095f0 con 0x7fafc00ffe90 2024-05-08T23:13:12.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafbeffd700 1 --2- 172.21.15.179:0/1788821907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafc00ffe90 0x7fafc006a190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fafb0004760 tx=0x7fafb0004790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:12.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafc49d4700 1 -- 172.21.15.179:0/1788821907 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb001d070 con 0x7fafc00ffe90 2024-05-08T23:13:12.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafc49d4700 1 -- 172.21.15.179:0/1788821907 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafb00041a0 con 0x7fafc00ffe90 2024-05-08T23:13:12.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafc59d6700 1 -- 172.21.15.179:0/1788821907 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc019efa0 con 0x7fafc00ffe90 2024-05-08T23:13:12.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafc49d4700 1 -- 172.21.15.179:0/1788821907 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000f460 con 0x7fafc00ffe90 2024-05-08T23:13:12.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.668+0000 7fafc59d6700 1 -- 172.21.15.179:0/1788821907 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc019f350 con 0x7fafc00ffe90 2024-05-08T23:13:12.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.669+0000 7fafc59d6700 1 -- 172.21.15.179:0/1788821907 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc0107490 con 0x7fafc00ffe90 2024-05-08T23:13:12.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.670+0000 7fafc49d4700 1 -- 172.21.15.179:0/1788821907 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fafb0022600 con 0x7fafc00ffe90 2024-05-08T23:13:12.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.671+0000 7fafc49d4700 1 --2- 172.21.15.179:0/1788821907 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fafa80a11a0 0x7fafa80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:12.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.671+0000 7fafc49d4700 1 -- 172.21.15.179:0/1788821907 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5981+0+0 (secure 0 0 0) 0x7fafb00cdd30 con 0x7fafc00ffe90 2024-05-08T23:13:12.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.671+0000 7fafbe7fc700 1 --2- 172.21.15.179:0/1788821907 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fafa80a11a0 0x7fafa80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:12.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.671+0000 7fafbe7fc700 1 --2- 172.21.15.179:0/1788821907 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fafa80a11a0 0x7fafa80a3660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fafc00ffbc0 tx=0x7fafb400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:12.674 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.674+0000 7fafc49d4700 1 -- 172.21.15.179:0/1788821907 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fafb0097e70 con 0x7fafc00ffe90 2024-05-08T23:13:12.705 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:13:12 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:13:12.247+0000 7f81da349700 -1 osd.9 0 waiting for initial osdmap 2024-05-08T23:13:12.705 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:13:12 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:13:12.259+0000 7f81d2136700 -1 osd.9 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:13:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:12.877+0000 7fafc59d6700 1 -- 172.21.15.179:0/1788821907 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fafc002ce10 con 0x7fafa80a11a0 2024-05-08T23:13:13.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:12 smithi179 ceph-mon[46314]: Detected new or changed devices on smithi135 2024-05-08T23:13:13.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:12 smithi179 ceph-mon[46314]: Adjusting osd_memory_target on smithi135 to 4278M 2024-05-08T23:13:13.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:12 smithi179 ceph-mon[46314]: from='osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-08T23:13:13.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:12 smithi179 ceph-mon[46314]: osdmap e64: 10 total, 9 up, 10 in 2024-05-08T23:13:13.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:13.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:13.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:12 smithi179 ceph-mon[46314]: from='osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951]' entity='osd.9' 2024-05-08T23:13:13.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:13.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:12 smithi195 ceph-mon[46516]: Detected new or changed devices on smithi135 2024-05-08T23:13:13.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:12 smithi195 ceph-mon[46516]: Adjusting osd_memory_target on smithi135 to 4278M 2024-05-08T23:13:13.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:12 smithi195 ceph-mon[46516]: from='osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-08T23:13:13.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:12 smithi195 ceph-mon[46516]: osdmap e64: 10 total, 9 up, 10 in 2024-05-08T23:13:13.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:13.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:13.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:12 smithi195 ceph-mon[46516]: from='osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951]' entity='osd.9' 2024-05-08T23:13:13.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:13.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:12 smithi135 ceph-mon[42440]: Detected new or changed devices on smithi135 2024-05-08T23:13:13.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:12 smithi135 ceph-mon[42440]: Adjusting osd_memory_target on smithi135 to 4278M 2024-05-08T23:13:13.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:12 smithi135 ceph-mon[42440]: from='osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-08T23:13:13.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:12 smithi135 ceph-mon[42440]: osdmap e64: 10 total, 9 up, 10 in 2024-05-08T23:13:13.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:13.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:13.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:12 smithi135 ceph-mon[42440]: from='osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951]' entity='osd.9' 2024-05-08T23:13:13.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:13.987 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:13 smithi179 ceph-mon[46314]: purged_snaps scrub starts 2024-05-08T23:13:13.988 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:13 smithi179 ceph-mon[46314]: purged_snaps scrub ok 2024-05-08T23:13:13.988 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:13 smithi179 ceph-mon[46314]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:13:13.988 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:13 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:13:13.988 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:13 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:13:13.988 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:13 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:13.988 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:13 smithi179 ceph-mon[46314]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T23:13:13.988 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:13 smithi179 ceph-mon[46314]: osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951] boot 2024-05-08T23:13:13.988 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:13 smithi179 ceph-mon[46314]: osdmap e65: 10 total, 10 up, 10 in 2024-05-08T23:13:13.988 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:13 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:14.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:13 smithi195 ceph-mon[46516]: purged_snaps scrub starts 2024-05-08T23:13:14.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:13 smithi195 ceph-mon[46516]: purged_snaps scrub ok 2024-05-08T23:13:14.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:13 smithi195 ceph-mon[46516]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:13:14.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:13 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:13:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:13 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:13:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:13 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:13 smithi195 ceph-mon[46516]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T23:13:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:13 smithi195 ceph-mon[46516]: osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951] boot 2024-05-08T23:13:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:13 smithi195 ceph-mon[46516]: osdmap e65: 10 total, 10 up, 10 in 2024-05-08T23:13:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:13 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:14.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:13 smithi135 ceph-mon[42440]: purged_snaps scrub starts 2024-05-08T23:13:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:13 smithi135 ceph-mon[42440]: purged_snaps scrub ok 2024-05-08T23:13:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:13 smithi135 ceph-mon[42440]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:13:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:13 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:13:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:13 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:13:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:13 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:14.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:13 smithi135 ceph-mon[42440]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T23:13:14.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:13 smithi135 ceph-mon[42440]: osd.9 [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951] boot 2024-05-08T23:13:14.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:13 smithi135 ceph-mon[42440]: osdmap e65: 10 total, 10 up, 10 in 2024-05-08T23:13:14.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:13 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T23:13:15.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:15 smithi179 ceph-mon[46314]: osdmap e66: 10 total, 10 up, 10 in 2024-05-08T23:13:15.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:15 smithi179 ceph-mon[46314]: from='client.? 172.21.15.179:0/2765359212' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a22f21ea-57b8-4b21-8cd5-e06007c87c4e"}]: dispatch 2024-05-08T23:13:15.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:15 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a22f21ea-57b8-4b21-8cd5-e06007c87c4e"}]: dispatch 2024-05-08T23:13:15.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:15 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a22f21ea-57b8-4b21-8cd5-e06007c87c4e"}]': finished 2024-05-08T23:13:15.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:15 smithi179 ceph-mon[46314]: osdmap e67: 11 total, 10 up, 11 in 2024-05-08T23:13:15.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:15.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:15 smithi179 ceph-mon[46314]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:15.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:15 smithi195 ceph-mon[46516]: osdmap e66: 10 total, 10 up, 10 in 2024-05-08T23:13:15.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:15 smithi195 ceph-mon[46516]: from='client.? 172.21.15.179:0/2765359212' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a22f21ea-57b8-4b21-8cd5-e06007c87c4e"}]: dispatch 2024-05-08T23:13:15.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:15 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a22f21ea-57b8-4b21-8cd5-e06007c87c4e"}]: dispatch 2024-05-08T23:13:15.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:15 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a22f21ea-57b8-4b21-8cd5-e06007c87c4e"}]': finished 2024-05-08T23:13:15.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:15 smithi195 ceph-mon[46516]: osdmap e67: 11 total, 10 up, 11 in 2024-05-08T23:13:15.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:15.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:15 smithi195 ceph-mon[46516]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:15.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:15 smithi135 ceph-mon[42440]: osdmap e66: 10 total, 10 up, 10 in 2024-05-08T23:13:15.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:15 smithi135 ceph-mon[42440]: from='client.? 172.21.15.179:0/2765359212' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a22f21ea-57b8-4b21-8cd5-e06007c87c4e"}]: dispatch 2024-05-08T23:13:15.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:15 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a22f21ea-57b8-4b21-8cd5-e06007c87c4e"}]: dispatch 2024-05-08T23:13:15.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:15 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a22f21ea-57b8-4b21-8cd5-e06007c87c4e"}]': finished 2024-05-08T23:13:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:15 smithi135 ceph-mon[42440]: osdmap e67: 11 total, 10 up, 11 in 2024-05-08T23:13:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:15 smithi135 ceph-mon[42440]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:16.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:16 smithi179 ceph-mon[46314]: from='client.? 172.21.15.179:0/1499072632' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:13:16.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:16 smithi195 ceph-mon[46516]: from='client.? 172.21.15.179:0/1499072632' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:13:16.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:16 smithi135 ceph-mon[42440]: from='client.? 172.21.15.179:0/1499072632' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:13:17.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:17 smithi179 ceph-mon[46314]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:17.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:17 smithi195 ceph-mon[46516]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:17.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:17 smithi135 ceph-mon[42440]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:20.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:20 smithi179 ceph-mon[46314]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:20 smithi195 ceph-mon[46516]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:20.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:20 smithi135 ceph-mon[42440]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:21.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-08T23:13:21.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:21.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-08T23:13:21.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:21.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-08T23:13:21.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:22.328 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:22 smithi179 ceph-mon[46314]: Deploying daemon osd.10 on smithi179 2024-05-08T23:13:22.328 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:22 smithi179 ceph-mon[46314]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:22 smithi195 ceph-mon[46516]: Deploying daemon osd.10 on smithi179 2024-05-08T23:13:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:22 smithi195 ceph-mon[46516]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:22.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:22 smithi135 ceph-mon[42440]: Deploying daemon osd.10 on smithi179 2024-05-08T23:13:22.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:22 smithi135 ceph-mon[42440]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:24.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:24 smithi179 ceph-mon[46314]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:24.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:24 smithi195 ceph-mon[46516]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:24.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:24 smithi135 ceph-mon[42440]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:25.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:25 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:25.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:25 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:25.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:25 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:25.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:25 smithi179 ceph-mon[46314]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:25.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:25 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:25.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:25 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:25.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:25 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:25.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:25 smithi195 ceph-mon[46516]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:25.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:25 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:25 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:25 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:25 smithi135 ceph-mon[42440]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:26.677 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:26.677+0000 7fafc49d4700 1 -- 172.21.15.179:0/1788821907 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fafc002ce10 con 0x7fafa80a11a0 2024-05-08T23:13:26.678 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 10 on host 'smithi179' 2024-05-08T23:13:26.680 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:26.679+0000 7fafc59d6700 1 -- 172.21.15.179:0/1788821907 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fafa80a11a0 msgr2=0x7fafa80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:26.680 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:26.679+0000 7fafc59d6700 1 --2- 172.21.15.179:0/1788821907 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fafa80a11a0 0x7fafa80a3660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fafc00ffbc0 tx=0x7fafb400a380 comp rx=0 tx=0).stop 2024-05-08T23:13:26.680 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:26.679+0000 7fafc59d6700 1 -- 172.21.15.179:0/1788821907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafc00ffe90 msgr2=0x7fafc006a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:26.680 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:26.679+0000 7fafc59d6700 1 --2- 172.21.15.179:0/1788821907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafc00ffe90 0x7fafc006a190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fafb0004760 tx=0x7fafb0004790 comp rx=0 tx=0).stop 2024-05-08T23:13:26.680 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:26.679+0000 7fafc59d6700 1 -- 172.21.15.179:0/1788821907 shutdown_connections 2024-05-08T23:13:26.680 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:26.679+0000 7fafc59d6700 1 --2- 172.21.15.179:0/1788821907 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fafa80a11a0 0x7fafa80a3660 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:26.680 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:26.679+0000 7fafc59d6700 1 --2- 172.21.15.179:0/1788821907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fafc0101a40 0x7fafc019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:26.680 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:26.679+0000 7fafc59d6700 1 --2- 172.21.15.179:0/1788821907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fafc00ffe90 0x7fafc006a190 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:26.681 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:26.679+0000 7fafc59d6700 1 --2- 172.21.15.179:0/1788821907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc0101080 0x7fafc019bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:26.681 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:26.679+0000 7fafc59d6700 1 -- 172.21.15.179:0/1788821907 >> 172.21.15.179:0/1788821907 conn(0x7fafc00fb4a0 msgr2=0x7fafc01045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:26.681 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:26.680+0000 7fafc59d6700 1 -- 172.21.15.179:0/1788821907 shutdown_connections 2024-05-08T23:13:26.681 INFO:teuthology.orchestra.run.smithi179.stderr:2024-05-08T23:13:26.680+0000 7fafc59d6700 1 -- 172.21.15.179:0/1788821907 wait complete. 2024-05-08T23:13:27.124 DEBUG:teuthology.orchestra.run.smithi179:osd.10> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.10.service 2024-05-08T23:13:27.127 INFO:tasks.cephadm:Deploying osd.11 on smithi195 with /dev/vg_nvme/lv_1... 2024-05-08T23:13:27.127 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-08T23:13:27.158 INFO:journalctl@ceph.osd.10.smithi179.stdout:-- Logs begin at Wed 2024-05-08 22:52:32 UTC. -- 2024-05-08T23:13:27.326 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:27 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:27.326 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:27 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:27.326 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:27 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:27.326 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:27 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:27.326 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:27 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:27.326 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:27 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:27.327 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:27 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:27.327 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:27 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:27.360 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:13:27.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:27 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:27.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:27 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:27.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:27 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:27.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:27 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:27.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:27 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:27 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:27 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:27 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:27.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:27 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:27 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:27 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:27 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:27 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:27 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:27 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:27.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:27 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:28.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:28 smithi195 ceph-mon[46516]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:28.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:28 smithi179 ceph-mon[46314]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:28.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:28 smithi135 ceph-mon[42440]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:28.736 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-08T23:13:28.736 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-08T23:13:28.736 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-05-08T23:13:28.736 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-05-08T23:13:28.736 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00833437 s, 1.3 GB/s 2024-05-08T23:13:28.736 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-05-08T23:13:28.850 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:13:28 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:13:28.404+0000 7f19cc5957c0 -1 osd.10 0 log_to_monitors true 2024-05-08T23:13:29.094 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi195:vg_nvme/lv_1 2024-05-08T23:13:29.306 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:29 smithi179 ceph-mon[46314]: from='osd.10 [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T23:13:29.306 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:29 smithi179 ceph-mon[46314]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T23:13:29.313 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:13:29.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:29 smithi195 ceph-mon[46516]: from='osd.10 [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T23:13:29.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:29 smithi195 ceph-mon[46516]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T23:13:29.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:29 smithi135 ceph-mon[42440]: from='osd.10 [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T23:13:29.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:29 smithi135 ceph-mon[42440]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T23:13:30.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-08T23:13:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: osdmap e68: 11 total, 10 up, 11 in 2024-05-08T23:13:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: from='osd.10 [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:13:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:13:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:30.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:30.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:30 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:30.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:30.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-08T23:13:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: osdmap e68: 11 total, 10 up, 11 in 2024-05-08T23:13:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: from='osd.10 [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:13:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:13:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:30 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:30.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.408+0000 7f4ce613a700 1 -- 172.21.15.195:0/3658659033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ce0106d50 msgr2=0x7f4ce0109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:30.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.408+0000 7f4ce613a700 1 --2- 172.21.15.195:0/3658659033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ce0106d50 0x7f4ce0109160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800b0a0 tx=0x7f4cd800b3b0 comp rx=0 tx=0).stop 2024-05-08T23:13:30.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.408+0000 7f4ce613a700 1 -- 172.21.15.195:0/3658659033 shutdown_connections 2024-05-08T23:13:30.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.408+0000 7f4ce613a700 1 --2- 172.21.15.195:0/3658659033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ce0106d50 0x7f4ce0109160 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:30.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.408+0000 7f4ce613a700 1 --2- 172.21.15.195:0/3658659033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce0101af0 0x7f4ce0103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:30.409 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.408+0000 7f4ce613a700 1 --2- 172.21.15.195:0/3658659033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce0104420 0x7f4ce0106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:30.410 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.408+0000 7f4ce613a700 1 -- 172.21.15.195:0/3658659033 >> 172.21.15.195:0/3658659033 conn(0x7f4ce00fb4a0 msgr2=0x7f4ce00fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:30.410 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.408+0000 7f4ce613a700 1 -- 172.21.15.195:0/3658659033 shutdown_connections 2024-05-08T23:13:30.410 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.408+0000 7f4ce613a700 1 -- 172.21.15.195:0/3658659033 wait complete. 2024-05-08T23:13:30.410 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.409+0000 7f4ce613a700 1 Processor -- start 2024-05-08T23:13:30.412 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.409+0000 7f4ce613a700 1 -- start start 2024-05-08T23:13:30.412 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.409+0000 7f4ce613a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce0101af0 0x7f4ce0197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:30.412 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.409+0000 7f4ce613a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce0104420 0x7f4ce0197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:30.412 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.409+0000 7f4ce613a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ce0106d50 0x7f4ce019e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:30.412 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.409+0000 7f4ce613a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce019eb30 con 0x7f4ce0104420 2024-05-08T23:13:30.412 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.409+0000 7f4ce613a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce019ec70 con 0x7f4ce0101af0 2024-05-08T23:13:30.412 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.409+0000 7f4ce613a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce019ee00 con 0x7f4ce0106d50 2024-05-08T23:13:30.412 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4cdf7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce0101af0 0x7f4ce0197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:30.412 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4cdffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ce0106d50 0x7f4ce019e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:30.412 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4cdf7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce0101af0 0x7f4ce0197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.195:51008/0 (socket says 172.21.15.195:51008) 2024-05-08T23:13:30.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4cdf7fe700 1 -- 172.21.15.195:0/1928658881 learned_addr learned my addr 172.21.15.195:0/1928658881 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T23:13:30.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4cdffff700 1 --2- 172.21.15.195:0/1928658881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ce0106d50 0x7f4ce019e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:46132/0 (socket says 172.21.15.195:46132) 2024-05-08T23:13:30.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4cdeffd700 1 --2- 172.21.15.195:0/1928658881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce0104420 0x7f4ce0197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:30.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4cdf7fe700 1 -- 172.21.15.195:0/1928658881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ce0106d50 msgr2=0x7f4ce019e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:30.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4cdf7fe700 1 --2- 172.21.15.195:0/1928658881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ce0106d50 0x7f4ce019e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:30.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4cdf7fe700 1 -- 172.21.15.195:0/1928658881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce0104420 msgr2=0x7f4ce0197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:30.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4cdf7fe700 1 --2- 172.21.15.195:0/1928658881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce0104420 0x7f4ce0197580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:30.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4cdf7fe700 1 -- 172.21.15.195:0/1928658881 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd8009d00 con 0x7f4ce0101af0 2024-05-08T23:13:30.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4cdf7fe700 1 --2- 172.21.15.195:0/1928658881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce0101af0 0x7f4ce0197040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800e9a0 tx=0x7f4cc800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:30.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4cdcff9700 1 -- 172.21.15.195:0/1928658881 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc8009790 con 0x7f4ce0101af0 2024-05-08T23:13:30.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4ce613a700 1 -- 172.21.15.195:0/1928658881 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce019f0e0 con 0x7f4ce0101af0 2024-05-08T23:13:30.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4cdcff9700 1 -- 172.21.15.195:0/1928658881 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4cc8010430 con 0x7f4ce0101af0 2024-05-08T23:13:30.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4ce613a700 1 -- 172.21.15.195:0/1928658881 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce019f630 con 0x7f4ce0101af0 2024-05-08T23:13:30.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.410+0000 7f4cdcff9700 1 -- 172.21.15.195:0/1928658881 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc8018620 con 0x7f4ce0101af0 2024-05-08T23:13:30.414 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.411+0000 7f4ce613a700 1 -- 172.21.15.195:0/1928658881 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce00fd020 con 0x7f4ce0101af0 2024-05-08T23:13:30.414 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.412+0000 7f4cdcff9700 1 -- 172.21.15.195:0/1928658881 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f4cc80105a0 con 0x7f4ce0101af0 2024-05-08T23:13:30.414 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.413+0000 7f4cdcff9700 1 --2- 172.21.15.195:0/1928658881 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4ccc0a1120 0x7f4ccc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:30.415 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.413+0000 7f4cdcff9700 1 -- 172.21.15.195:0/1928658881 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4cc8014070 con 0x7f4ce0101af0 2024-05-08T23:13:30.415 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.413+0000 7f4cdeffd700 1 --2- 172.21.15.195:0/1928658881 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4ccc0a1120 0x7f4ccc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:30.415 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.413+0000 7f4cdeffd700 1 --2- 172.21.15.195:0/1928658881 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4ccc0a1120 0x7f4ccc0a35e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009c60 tx=0x7f4cd0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:30.416 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.416+0000 7f4cdcff9700 1 -- 172.21.15.195:0/1928658881 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4cc80961a0 con 0x7f4ce0101af0 2024-05-08T23:13:30.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:30.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-08T23:13:30.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: osdmap e68: 11 total, 10 up, 11 in 2024-05-08T23:13:30.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:30.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: from='osd.10 [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:13:30.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-05-08T23:13:30.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:30.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:30.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:30.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:30.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:30.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:30.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:30.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:30.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:30.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:30 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:30.621 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:30.621+0000 7f4ce613a700 1 -- 172.21.15.195:0/1928658881 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ce002ce10 con 0x7f4ccc0a1120 2024-05-08T23:13:30.849 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:13:30 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:13:30.507+0000 7f19c23fa700 -1 osd.10 0 waiting for initial osdmap 2024-05-08T23:13:30.849 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:13:30 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:13:30.520+0000 7f19b99e6700 -1 osd.10 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:13:31.279 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:31 smithi195 ceph-mon[46516]: Detected new or changed devices on smithi179 2024-05-08T23:13:31.280 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:31 smithi195 ceph-mon[46516]: Adjusting osd_memory_target on smithi179 to 4278M 2024-05-08T23:13:31.280 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:31 smithi195 ceph-mon[46516]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-05-08T23:13:31.280 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:31 smithi195 ceph-mon[46516]: osdmap e69: 11 total, 10 up, 11 in 2024-05-08T23:13:31.280 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:31.280 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:31.280 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:31 smithi195 ceph-mon[46516]: from='osd.10 ' entity='osd.10' 2024-05-08T23:13:31.280 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:13:31.280 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:13:31.280 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:31.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:31 smithi179 ceph-mon[46314]: Detected new or changed devices on smithi179 2024-05-08T23:13:31.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:31 smithi179 ceph-mon[46314]: Adjusting osd_memory_target on smithi179 to 4278M 2024-05-08T23:13:31.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:31 smithi179 ceph-mon[46314]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-05-08T23:13:31.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:31 smithi179 ceph-mon[46314]: osdmap e69: 11 total, 10 up, 11 in 2024-05-08T23:13:31.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:31.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:31.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:31 smithi179 ceph-mon[46314]: from='osd.10 ' entity='osd.10' 2024-05-08T23:13:31.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:13:31.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:13:31.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:31.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:31 smithi135 ceph-mon[42440]: Detected new or changed devices on smithi179 2024-05-08T23:13:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:31 smithi135 ceph-mon[42440]: Adjusting osd_memory_target on smithi179 to 4278M 2024-05-08T23:13:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:31 smithi135 ceph-mon[42440]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-05-08T23:13:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:31 smithi135 ceph-mon[42440]: osdmap e69: 11 total, 10 up, 11 in 2024-05-08T23:13:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:31 smithi135 ceph-mon[42440]: from='osd.10 ' entity='osd.10' 2024-05-08T23:13:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:13:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:13:31.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:32.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:32 smithi179 ceph-mon[46314]: purged_snaps scrub starts 2024-05-08T23:13:32.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:32 smithi179 ceph-mon[46314]: purged_snaps scrub ok 2024-05-08T23:13:32.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:32 smithi179 ceph-mon[46314]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:13:32.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:32 smithi179 ceph-mon[46314]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:32.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:32 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:32.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:32 smithi179 ceph-mon[46314]: osd.10 [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864] boot 2024-05-08T23:13:32.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:32 smithi179 ceph-mon[46314]: osdmap e70: 11 total, 11 up, 11 in 2024-05-08T23:13:32.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:32 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:32.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:32 smithi179 ceph-mon[46314]: osdmap e71: 11 total, 11 up, 11 in 2024-05-08T23:13:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:32 smithi195 ceph-mon[46516]: purged_snaps scrub starts 2024-05-08T23:13:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:32 smithi195 ceph-mon[46516]: purged_snaps scrub ok 2024-05-08T23:13:32.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:32 smithi195 ceph-mon[46516]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:13:32.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:32 smithi195 ceph-mon[46516]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:32.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:32 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:32.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:32 smithi195 ceph-mon[46516]: osd.10 [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864] boot 2024-05-08T23:13:32.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:32 smithi195 ceph-mon[46516]: osdmap e70: 11 total, 11 up, 11 in 2024-05-08T23:13:32.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:32 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:32.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:32 smithi195 ceph-mon[46516]: osdmap e71: 11 total, 11 up, 11 in 2024-05-08T23:13:32.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:32 smithi135 ceph-mon[42440]: purged_snaps scrub starts 2024-05-08T23:13:32.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:32 smithi135 ceph-mon[42440]: purged_snaps scrub ok 2024-05-08T23:13:32.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:32 smithi135 ceph-mon[42440]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:13:32.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:32 smithi135 ceph-mon[42440]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-05-08T23:13:32.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:32 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:32.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:32 smithi135 ceph-mon[42440]: osd.10 [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864] boot 2024-05-08T23:13:32.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:32 smithi135 ceph-mon[42440]: osdmap e70: 11 total, 11 up, 11 in 2024-05-08T23:13:32.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:32 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T23:13:32.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:32 smithi135 ceph-mon[42440]: osdmap e71: 11 total, 11 up, 11 in 2024-05-08T23:13:33.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:33 smithi179 ceph-mon[46314]: osdmap e72: 11 total, 11 up, 11 in 2024-05-08T23:13:33.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:33 smithi179 ceph-mon[46314]: from='client.? 172.21.15.195:0/1431842032' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cf992e4-6fcd-4c77-a726-4f111d2b9368"}]: dispatch 2024-05-08T23:13:33.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:33 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cf992e4-6fcd-4c77-a726-4f111d2b9368"}]: dispatch 2024-05-08T23:13:33.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:33 smithi179 ceph-mon[46314]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cf992e4-6fcd-4c77-a726-4f111d2b9368"}]': finished 2024-05-08T23:13:33.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:33 smithi179 ceph-mon[46314]: osdmap e73: 12 total, 11 up, 12 in 2024-05-08T23:13:33.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:33 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:33.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:33 smithi179 ceph-mon[46314]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T23:13:33.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:33 smithi179 ceph-mon[46314]: from='client.? 172.21.15.195:0/1912248640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:13:33.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:33 smithi195 ceph-mon[46516]: osdmap e72: 11 total, 11 up, 11 in 2024-05-08T23:13:33.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:33 smithi195 ceph-mon[46516]: from='client.? 172.21.15.195:0/1431842032' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cf992e4-6fcd-4c77-a726-4f111d2b9368"}]: dispatch 2024-05-08T23:13:33.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:33 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cf992e4-6fcd-4c77-a726-4f111d2b9368"}]: dispatch 2024-05-08T23:13:33.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:33 smithi195 ceph-mon[46516]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cf992e4-6fcd-4c77-a726-4f111d2b9368"}]': finished 2024-05-08T23:13:33.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:33 smithi195 ceph-mon[46516]: osdmap e73: 12 total, 11 up, 12 in 2024-05-08T23:13:33.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:33 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:33.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:33 smithi195 ceph-mon[46516]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T23:13:33.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:33 smithi195 ceph-mon[46516]: from='client.? 172.21.15.195:0/1912248640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:13:33.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:33 smithi135 ceph-mon[42440]: osdmap e72: 11 total, 11 up, 11 in 2024-05-08T23:13:33.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:33 smithi135 ceph-mon[42440]: from='client.? 172.21.15.195:0/1431842032' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cf992e4-6fcd-4c77-a726-4f111d2b9368"}]: dispatch 2024-05-08T23:13:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:33 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cf992e4-6fcd-4c77-a726-4f111d2b9368"}]: dispatch 2024-05-08T23:13:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:33 smithi135 ceph-mon[42440]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cf992e4-6fcd-4c77-a726-4f111d2b9368"}]': finished 2024-05-08T23:13:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:33 smithi135 ceph-mon[42440]: osdmap e73: 12 total, 11 up, 12 in 2024-05-08T23:13:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:33 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:33 smithi135 ceph-mon[42440]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T23:13:33.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:33 smithi135 ceph-mon[42440]: from='client.? 172.21.15.195:0/1912248640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:13:34.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:34 smithi135 ceph-mon[42440]: osdmap e74: 12 total, 11 up, 12 in 2024-05-08T23:13:34.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:34 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:34.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:34 smithi179 ceph-mon[46314]: osdmap e74: 12 total, 11 up, 12 in 2024-05-08T23:13:34.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:34 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:34.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:34 smithi195 ceph-mon[46516]: osdmap e74: 12 total, 11 up, 12 in 2024-05-08T23:13:34.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:34 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:35.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:35 smithi135 ceph-mon[42440]: osdmap e75: 12 total, 11 up, 12 in 2024-05-08T23:13:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:35 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:35.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:35 smithi135 ceph-mon[42440]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T23:13:35.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:35 smithi179 ceph-mon[46314]: osdmap e75: 12 total, 11 up, 12 in 2024-05-08T23:13:35.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:35 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:35.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:35 smithi179 ceph-mon[46314]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T23:13:35.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:35 smithi195 ceph-mon[46516]: osdmap e75: 12 total, 11 up, 12 in 2024-05-08T23:13:35.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:35 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:35.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:35 smithi195 ceph-mon[46516]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T23:13:38.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:38 smithi179 ceph-mon[46314]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T23:13:38.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:38 smithi195 ceph-mon[46516]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T23:13:38.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:38 smithi135 ceph-mon[42440]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T23:13:39.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:39 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-08T23:13:39.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:39 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:39.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:39 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-08T23:13:39.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:39 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:39.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:39 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-08T23:13:39.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:39 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:40.299 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:40 smithi195 ceph-mon[46516]: Deploying daemon osd.11 on smithi195 2024-05-08T23:13:40.299 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:40 smithi195 ceph-mon[46516]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-05-08T23:13:40.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:40 smithi179 ceph-mon[46314]: Deploying daemon osd.11 on smithi195 2024-05-08T23:13:40.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:40 smithi179 ceph-mon[46314]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-05-08T23:13:40.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:40 smithi135 ceph-mon[42440]: Deploying daemon osd.11 on smithi195 2024-05-08T23:13:40.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:40 smithi135 ceph-mon[42440]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-05-08T23:13:42.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:42 smithi179 ceph-mon[46314]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T23:13:42.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:42 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:42.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:42 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:42.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:42 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:42.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:42 smithi195 ceph-mon[46516]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T23:13:42.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:42 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:42.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:42 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:42.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:42 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:42.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:42 smithi135 ceph-mon[42440]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T23:13:42.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:42 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:42.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:42 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:42.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:42 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:44.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:44 smithi179 ceph-mon[46314]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-08T23:13:44.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:44 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:44.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:44 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:44.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:44 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:44.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:44 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:44.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:44 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:44.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:44 smithi195 ceph-mon[46516]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-08T23:13:44.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:44 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:44.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:44 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:44.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:44 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:44.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:44 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:44.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:44 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:44.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:44 smithi135 ceph-mon[42440]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-08T23:13:44.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:44 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:44.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:44 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:44.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:44 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:44.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:44 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:44.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:44 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:44.527 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 11 on host 'smithi195' 2024-05-08T23:13:44.527 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:44.526+0000 7f4cdcff9700 1 -- 172.21.15.195:0/1928658881 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f4ce002ce10 con 0x7f4ccc0a1120 2024-05-08T23:13:44.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:44.528+0000 7f4ce613a700 1 -- 172.21.15.195:0/1928658881 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4ccc0a1120 msgr2=0x7f4ccc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:44.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:44.528+0000 7f4ce613a700 1 --2- 172.21.15.195:0/1928658881 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4ccc0a1120 0x7f4ccc0a35e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009c60 tx=0x7f4cd0009260 comp rx=0 tx=0).stop 2024-05-08T23:13:44.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:44.528+0000 7f4ce613a700 1 -- 172.21.15.195:0/1928658881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce0101af0 msgr2=0x7f4ce0197040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:44.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:44.528+0000 7f4ce613a700 1 --2- 172.21.15.195:0/1928658881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce0101af0 0x7f4ce0197040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800e9a0 tx=0x7f4cc800ecb0 comp rx=0 tx=0).stop 2024-05-08T23:13:44.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:44.529+0000 7f4ce613a700 1 -- 172.21.15.195:0/1928658881 shutdown_connections 2024-05-08T23:13:44.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:44.529+0000 7f4ce613a700 1 --2- 172.21.15.195:0/1928658881 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4ccc0a1120 0x7f4ccc0a35e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:44.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:44.529+0000 7f4ce613a700 1 --2- 172.21.15.195:0/1928658881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ce0106d50 0x7f4ce019e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:44.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:44.529+0000 7f4ce613a700 1 --2- 172.21.15.195:0/1928658881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ce0101af0 0x7f4ce0197040 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:44.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:44.529+0000 7f4ce613a700 1 --2- 172.21.15.195:0/1928658881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce0104420 0x7f4ce0197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:44.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:44.529+0000 7f4ce613a700 1 -- 172.21.15.195:0/1928658881 >> 172.21.15.195:0/1928658881 conn(0x7f4ce00fb4a0 msgr2=0x7f4ce0102430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:44.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:44.529+0000 7f4ce613a700 1 -- 172.21.15.195:0/1928658881 shutdown_connections 2024-05-08T23:13:44.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:44.529+0000 7f4ce613a700 1 -- 172.21.15.195:0/1928658881 wait complete. 2024-05-08T23:13:44.948 DEBUG:teuthology.orchestra.run.smithi195:osd.11> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.11.service 2024-05-08T23:13:44.951 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-08T23:13:44.951 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-08T23:13:44.983 INFO:journalctl@ceph.osd.11.smithi195.stdout:-- Logs begin at Wed 2024-05-08 22:52:38 UTC. -- 2024-05-08T23:13:45.191 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:13:45.601 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:45 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:45.601 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:45 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:45.601 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:45 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:45.601 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:45 smithi135 ceph-mon[42440]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-05-08T23:13:45.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:45 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:45.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:45 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:45.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:45 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:45.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:45 smithi179 ceph-mon[46314]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-05-08T23:13:45.862 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:45 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:45.862 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:45 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:45.862 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:45 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:45.862 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:45 smithi195 ceph-mon[46516]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-05-08T23:13:46.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:13:45 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:13:45.965+0000 7f8aec7bc7c0 -1 osd.11 0 log_to_monitors true 2024-05-08T23:13:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.145+0000 7f032891f700 1 -- 172.21.15.135:0/2686742601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0324100fe0 msgr2=0x7f0324101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.145+0000 7f032891f700 1 --2- 172.21.15.135:0/2686742601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0324100fe0 0x7f0324101400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f03140099c0 tx=0x7f0314009cd0 comp rx=0 tx=0).stop 2024-05-08T23:13:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.145+0000 7f032891f700 1 -- 172.21.15.135:0/2686742601 shutdown_connections 2024-05-08T23:13:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.145+0000 7f032891f700 1 --2- 172.21.15.135:0/2686742601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0324102b80 0x7f0324109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.145+0000 7f032891f700 1 --2- 172.21.15.135:0/2686742601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0324100fe0 0x7f0324101400 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.145+0000 7f032891f700 1 --2- 172.21.15.135:0/2686742601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03241021e0 0x7f0324102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.145+0000 7f032891f700 1 -- 172.21.15.135:0/2686742601 >> 172.21.15.135:0/2686742601 conn(0x7f03240fc580 msgr2=0x7f03240fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.145+0000 7f032891f700 1 -- 172.21.15.135:0/2686742601 shutdown_connections 2024-05-08T23:13:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.145+0000 7f032891f700 1 -- 172.21.15.135:0/2686742601 wait complete. 2024-05-08T23:13:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.146+0000 7f032891f700 1 Processor -- start 2024-05-08T23:13:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.146+0000 7f032891f700 1 -- start start 2024-05-08T23:13:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f032891f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0324100fe0 0x7f0324196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f032891f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03241021e0 0x7f0324197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f032891f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0324102b80 0x7f032419e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f032891f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032419ea60 con 0x7f0324100fe0 2024-05-08T23:13:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f032891f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032419eba0 con 0x7f03241021e0 2024-05-08T23:13:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f032891f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032419ed30 con 0x7f0324102b80 2024-05-08T23:13:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f0322d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0324102b80 0x7f032419e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f0321d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03241021e0 0x7f0324197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f0322d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0324102b80 0x7f032419e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.135:33728/0 (socket says 172.21.15.135:33728) 2024-05-08T23:13:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f0321d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03241021e0 0x7f0324197460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.135:39580/0 (socket says 172.21.15.135:39580) 2024-05-08T23:13:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f0322d9d700 1 -- 172.21.15.135:0/3042792423 learned_addr learned my addr 172.21.15.135:0/3042792423 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:13:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f032259c700 1 --2- 172.21.15.135:0/3042792423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0324100fe0 0x7f0324196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f0322d9d700 1 -- 172.21.15.135:0/3042792423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03241021e0 msgr2=0x7f0324197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f0322d9d700 1 --2- 172.21.15.135:0/3042792423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03241021e0 0x7f0324197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f0322d9d700 1 -- 172.21.15.135:0/3042792423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0324100fe0 msgr2=0x7f0324196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f0322d9d700 1 --2- 172.21.15.135:0/3042792423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0324100fe0 0x7f0324196f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:46.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f0322d9d700 1 -- 172.21.15.135:0/3042792423 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03140095f0 con 0x7f0324102b80 2024-05-08T23:13:46.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f0322d9d700 1 --2- 172.21.15.135:0/3042792423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0324102b80 0x7f032419e490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f031c00ef60 tx=0x7f031c00ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:46.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f03137fe700 1 -- 172.21.15.135:0/3042792423 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c018070 con 0x7f0324102b80 2024-05-08T23:13:46.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f032891f700 1 -- 172.21.15.135:0/3042792423 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032419efb0 con 0x7f0324102b80 2024-05-08T23:13:46.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.147+0000 7f03137fe700 1 -- 172.21.15.135:0/3042792423 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f031c00f040 con 0x7f0324102b80 2024-05-08T23:13:46.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.148+0000 7f03137fe700 1 -- 172.21.15.135:0/3042792423 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c00ccc0 con 0x7f0324102b80 2024-05-08T23:13:46.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.148+0000 7f032891f700 1 -- 172.21.15.135:0/3042792423 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032419f3d0 con 0x7f0324102b80 2024-05-08T23:13:46.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.149+0000 7f032891f700 1 -- 172.21.15.135:0/3042792423 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03241084b0 con 0x7f0324102b80 2024-05-08T23:13:46.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.150+0000 7f03137fe700 1 -- 172.21.15.135:0/3042792423 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f031c003a00 con 0x7f0324102b80 2024-05-08T23:13:46.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.150+0000 7f03137fe700 1 --2- 172.21.15.135:0/3042792423 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f030c0a1120 0x7f030c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:46.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.150+0000 7f032259c700 1 --2- 172.21.15.135:0/3042792423 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f030c0a1120 0x7f030c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:46.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.150+0000 7f03137fe700 1 -- 172.21.15.135:0/3042792423 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f031c0cbe70 con 0x7f0324102b80 2024-05-08T23:13:46.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.151+0000 7f032259c700 1 --2- 172.21.15.135:0/3042792423 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f030c0a1120 0x7f030c0a35e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0314003730 tx=0x7f0314000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:46.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.158+0000 7f03137fe700 1 -- 172.21.15.135:0/3042792423 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f031c095c50 con 0x7f0324102b80 2024-05-08T23:13:46.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.353+0000 7f032891f700 1 -- 172.21.15.135:0/3042792423 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f032410c7e0 con 0x7f0324102b80 2024-05-08T23:13:46.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.354+0000 7f03137fe700 1 -- 172.21.15.135:0/3042792423 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) v1 ==== 74+0+133 (secure 0 0 0) 0x7f031c099270 con 0x7f0324102b80 2024-05-08T23:13:46.353 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:13:46.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.356+0000 7f032891f700 1 -- 172.21.15.135:0/3042792423 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f030c0a1120 msgr2=0x7f030c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:46.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.356+0000 7f032891f700 1 --2- 172.21.15.135:0/3042792423 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f030c0a1120 0x7f030c0a35e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0314003730 tx=0x7f0314000bc0 comp rx=0 tx=0).stop 2024-05-08T23:13:46.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.356+0000 7f032891f700 1 -- 172.21.15.135:0/3042792423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0324102b80 msgr2=0x7f032419e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:46.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.356+0000 7f032891f700 1 --2- 172.21.15.135:0/3042792423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0324102b80 0x7f032419e490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f031c00ef60 tx=0x7f031c00ef90 comp rx=0 tx=0).stop 2024-05-08T23:13:46.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.356+0000 7f032891f700 1 -- 172.21.15.135:0/3042792423 shutdown_connections 2024-05-08T23:13:46.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.356+0000 7f032891f700 1 --2- 172.21.15.135:0/3042792423 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f030c0a1120 0x7f030c0a35e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:46.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.356+0000 7f032891f700 1 --2- 172.21.15.135:0/3042792423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0324102b80 0x7f032419e490 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:46.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.356+0000 7f032891f700 1 --2- 172.21.15.135:0/3042792423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0324100fe0 0x7f0324196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:46.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.356+0000 7f032891f700 1 --2- 172.21.15.135:0/3042792423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03241021e0 0x7f0324197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:46.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.356+0000 7f032891f700 1 -- 172.21.15.135:0/3042792423 >> 172.21.15.135:0/3042792423 conn(0x7f03240fc580 msgr2=0x7f03241055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:46.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.356+0000 7f032891f700 1 -- 172.21.15.135:0/3042792423 shutdown_connections 2024-05-08T23:13:46.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:46.356+0000 7f032891f700 1 -- 172.21.15.135:0/3042792423 wait complete. 2024-05-08T23:13:46.638 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:46 smithi135 ceph-mon[42440]: from='osd.11 [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T23:13:46.638 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:46 smithi135 ceph-mon[42440]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T23:13:46.638 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:46 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3042792423' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T23:13:46.738 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1715210011,"num_in_osds":12,"osd_in_since":1715210012,"num_remapped_pgs":0} 2024-05-08T23:13:46.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:46 smithi179 ceph-mon[46314]: from='osd.11 [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T23:13:46.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:46 smithi179 ceph-mon[46314]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T23:13:46.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:46 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3042792423' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T23:13:46.850 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:46 smithi195 ceph-mon[46516]: from='osd.11 [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T23:13:46.850 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:46 smithi195 ceph-mon[46516]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T23:13:46.850 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:46 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3042792423' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T23:13:47.739 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-08T23:13:47.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-08T23:13:47.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: osdmap e76: 12 total, 11 up, 12 in 2024-05-08T23:13:47.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:47.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: from='osd.11 [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:13:47.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:13:47.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:13:47.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: Detected new or changed devices on smithi195 2024-05-08T23:13:47.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:47.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:47.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:47.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:47.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:47.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:47.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: Adjusting osd_memory_target on smithi195 to 4278M 2024-05-08T23:13:47.851 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:47.851 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:47.851 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:47.851 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:47 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:47.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-08T23:13:47.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: osdmap e76: 12 total, 11 up, 12 in 2024-05-08T23:13:47.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:47.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: from='osd.11 [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:13:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:13:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:13:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: Detected new or changed devices on smithi195 2024-05-08T23:13:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: Adjusting osd_memory_target on smithi195 to 4278M 2024-05-08T23:13:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:47 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:47.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-08T23:13:47.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: osdmap e76: 12 total, 11 up, 12 in 2024-05-08T23:13:47.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:47.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: from='osd.11 [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:13:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-05-08T23:13:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:13:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: Detected new or changed devices on smithi195 2024-05-08T23:13:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:13:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: Adjusting osd_memory_target on smithi195 to 4278M 2024-05-08T23:13:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:47.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:47 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:47.962 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:13:48.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:13:47 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:13:47.977+0000 7f8ae1e20700 -1 osd.11 0 waiting for initial osdmap 2024-05-08T23:13:48.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:13:47 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:13:47.994+0000 7f8ad9c0d700 -1 osd.11 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:13:48.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:48 smithi135 ceph-mon[42440]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-05-08T23:13:48.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:48 smithi135 ceph-mon[42440]: osdmap e77: 12 total, 11 up, 12 in 2024-05-08T23:13:48.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:48 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:48.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:48 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:48.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:48 smithi135 ceph-mon[42440]: from='osd.11 ' entity='osd.11' 2024-05-08T23:13:48.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:48 smithi179 ceph-mon[46314]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-05-08T23:13:48.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:48 smithi179 ceph-mon[46314]: osdmap e77: 12 total, 11 up, 12 in 2024-05-08T23:13:48.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:48 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:48.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:48 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:48.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:48 smithi179 ceph-mon[46314]: from='osd.11 ' entity='osd.11' 2024-05-08T23:13:48.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:48 smithi195 ceph-mon[46516]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-05-08T23:13:48.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:48 smithi195 ceph-mon[46516]: osdmap e77: 12 total, 11 up, 12 in 2024-05-08T23:13:48.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:48 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:48.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:48 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:48.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:48 smithi195 ceph-mon[46516]: from='osd.11 ' entity='osd.11' 2024-05-08T23:13:48.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.902+0000 7f1e370fd700 1 -- 172.21.15.135:0/111221394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e30106cd0 msgr2=0x7f1e30109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:48.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.902+0000 7f1e370fd700 1 --2- 172.21.15.135:0/111221394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e30106cd0 0x7f1e30109140 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800b0a0 tx=0x7f1e2800b3b0 comp rx=0 tx=0).stop 2024-05-08T23:13:48.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.902+0000 7f1e370fd700 1 -- 172.21.15.135:0/111221394 shutdown_connections 2024-05-08T23:13:48.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.902+0000 7f1e370fd700 1 --2- 172.21.15.135:0/111221394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e30106cd0 0x7f1e30109140 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:48.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.902+0000 7f1e370fd700 1 --2- 172.21.15.135:0/111221394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e30101a70 0x7f1e30103e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:48.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.902+0000 7f1e370fd700 1 --2- 172.21.15.135:0/111221394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e301043a0 0x7f1e30106790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:48.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.902+0000 7f1e370fd700 1 -- 172.21.15.135:0/111221394 >> 172.21.15.135:0/111221394 conn(0x7f1e300fb4a0 msgr2=0x7f1e300fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:48.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.902+0000 7f1e370fd700 1 -- 172.21.15.135:0/111221394 shutdown_connections 2024-05-08T23:13:48.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.902+0000 7f1e370fd700 1 -- 172.21.15.135:0/111221394 wait complete. 2024-05-08T23:13:48.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.902+0000 7f1e370fd700 1 Processor -- start 2024-05-08T23:13:48.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.902+0000 7f1e370fd700 1 -- start start 2024-05-08T23:13:48.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e370fd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e30101a70 0x7f1e30197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:48.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e370fd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e301043a0 0x7f1e30197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:48.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e370fd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e30106cd0 0x7f1e3019e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:48.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e370fd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3019eb60 con 0x7f1e30101a70 2024-05-08T23:13:48.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e370fd700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3019eca0 con 0x7f1e301043a0 2024-05-08T23:13:48.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e370fd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3019ee30 con 0x7f1e30106cd0 2024-05-08T23:13:48.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e34e99700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e30101a70 0x7f1e30197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:48.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e34e99700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e30101a70 0x7f1e30197020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54632/0 (socket says 172.21.15.135:54632) 2024-05-08T23:13:48.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e34e99700 1 -- 172.21.15.135:0/1058162718 learned_addr learned my addr 172.21.15.135:0/1058162718 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:13:48.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e3569a700 1 --2- 172.21.15.135:0/1058162718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e30106cd0 0x7f1e3019e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:48.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e34e99700 1 -- 172.21.15.135:0/1058162718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e30106cd0 msgr2=0x7f1e3019e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:48.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e34e99700 1 --2- 172.21.15.135:0/1058162718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e30106cd0 0x7f1e3019e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:48.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e2ffff700 1 --2- 172.21.15.135:0/1058162718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e301043a0 0x7f1e30197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:48.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e34e99700 1 -- 172.21.15.135:0/1058162718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e301043a0 msgr2=0x7f1e30197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:48.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e34e99700 1 --2- 172.21.15.135:0/1058162718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e301043a0 0x7f1e30197560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:48.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e34e99700 1 -- 172.21.15.135:0/1058162718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e28009d00 con 0x7f1e30101a70 2024-05-08T23:13:48.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e34e99700 1 --2- 172.21.15.135:0/1058162718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e30101a70 0x7f1e30197020 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400e9d0 tx=0x7f1e2400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:48.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e2dffb700 1 -- 172.21.15.135:0/1058162718 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24009790 con 0x7f1e30101a70 2024-05-08T23:13:48.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e2dffb700 1 -- 172.21.15.135:0/1058162718 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e2400cbd0 con 0x7f1e30101a70 2024-05-08T23:13:48.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e2dffb700 1 -- 172.21.15.135:0/1058162718 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24018680 con 0x7f1e30101a70 2024-05-08T23:13:48.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.903+0000 7f1e370fd700 1 -- 172.21.15.135:0/1058162718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3019f110 con 0x7f1e30101a70 2024-05-08T23:13:48.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.904+0000 7f1e370fd700 1 -- 172.21.15.135:0/1058162718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3019f610 con 0x7f1e30101a70 2024-05-08T23:13:48.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.904+0000 7f1e370fd700 1 -- 172.21.15.135:0/1058162718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e300fd020 con 0x7f1e30101a70 2024-05-08T23:13:48.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.906+0000 7f1e2dffb700 1 -- 172.21.15.135:0/1058162718 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f1e24010430 con 0x7f1e30101a70 2024-05-08T23:13:48.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.906+0000 7f1e2dffb700 1 --2- 172.21.15.135:0/1058162718 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f1e200a11a0 0x7f1e200a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:48.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.906+0000 7f1e2dffb700 1 -- 172.21.15.135:0/1058162718 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f1e24014070 con 0x7f1e30101a70 2024-05-08T23:13:48.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.906+0000 7f1e2ffff700 1 --2- 172.21.15.135:0/1058162718 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f1e200a11a0 0x7f1e200a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:48.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.906+0000 7f1e2ffff700 1 --2- 172.21.15.135:0/1058162718 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f1e200a11a0 0x7f1e200a3660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009b30 tx=0x7f1e1c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:48.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:48.910+0000 7f1e2dffb700 1 -- 172.21.15.135:0/1058162718 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1e24096550 con 0x7f1e30101a70 2024-05-08T23:13:49.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:49.109+0000 7f1e370fd700 1 -- 172.21.15.135:0/1058162718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f1e3004ec60 con 0x7f1e30101a70 2024-05-08T23:13:49.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:49.109+0000 7f1e2dffb700 1 -- 172.21.15.135:0/1058162718 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v78) v1 ==== 74+0+133 (secure 0 0 0) 0x7f1e24099b70 con 0x7f1e30101a70 2024-05-08T23:13:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:13:49.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:49.112+0000 7f1e370fd700 1 -- 172.21.15.135:0/1058162718 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f1e200a11a0 msgr2=0x7f1e200a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:49.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:49.112+0000 7f1e370fd700 1 --2- 172.21.15.135:0/1058162718 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f1e200a11a0 0x7f1e200a3660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009b30 tx=0x7f1e1c009260 comp rx=0 tx=0).stop 2024-05-08T23:13:49.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:49.112+0000 7f1e370fd700 1 -- 172.21.15.135:0/1058162718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e30101a70 msgr2=0x7f1e30197020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:49.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:49.112+0000 7f1e370fd700 1 --2- 172.21.15.135:0/1058162718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e30101a70 0x7f1e30197020 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400e9d0 tx=0x7f1e2400ed90 comp rx=0 tx=0).stop 2024-05-08T23:13:49.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:49.112+0000 7f1e370fd700 1 -- 172.21.15.135:0/1058162718 shutdown_connections 2024-05-08T23:13:49.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:49.112+0000 7f1e370fd700 1 --2- 172.21.15.135:0/1058162718 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f1e200a11a0 0x7f1e200a3660 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:49.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:49.112+0000 7f1e370fd700 1 --2- 172.21.15.135:0/1058162718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e30106cd0 0x7f1e3019e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:49.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:49.112+0000 7f1e370fd700 1 --2- 172.21.15.135:0/1058162718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e30101a70 0x7f1e30197020 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:49.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:49.112+0000 7f1e370fd700 1 --2- 172.21.15.135:0/1058162718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e301043a0 0x7f1e30197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:49.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:49.112+0000 7f1e370fd700 1 -- 172.21.15.135:0/1058162718 >> 172.21.15.135:0/1058162718 conn(0x7f1e300fb4a0 msgr2=0x7f1e30102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:49.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:49.112+0000 7f1e370fd700 1 -- 172.21.15.135:0/1058162718 shutdown_connections 2024-05-08T23:13:49.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:49.112+0000 7f1e370fd700 1 -- 172.21.15.135:0/1058162718 wait complete. 2024-05-08T23:13:49.488 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":78,"num_osds":12,"num_up_osds":12,"osd_up_since":1715210028,"num_in_osds":12,"osd_in_since":1715210012,"num_remapped_pgs":0} 2024-05-08T23:13:49.488 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T23:13:49.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:49 smithi135 ceph-mon[42440]: purged_snaps scrub starts 2024-05-08T23:13:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:49 smithi135 ceph-mon[42440]: purged_snaps scrub ok 2024-05-08T23:13:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:49 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:49 smithi135 ceph-mon[42440]: osd.11 [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459] boot 2024-05-08T23:13:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:49 smithi135 ceph-mon[42440]: osdmap e78: 12 total, 12 up, 12 in 2024-05-08T23:13:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:49 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:49 smithi135 ceph-mon[42440]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-05-08T23:13:49.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:49 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1058162718' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T23:13:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:13:49.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:49 smithi179 ceph-mon[46314]: purged_snaps scrub starts 2024-05-08T23:13:49.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:49 smithi179 ceph-mon[46314]: purged_snaps scrub ok 2024-05-08T23:13:49.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:49 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:49.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:49 smithi179 ceph-mon[46314]: osd.11 [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459] boot 2024-05-08T23:13:49.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:49 smithi179 ceph-mon[46314]: osdmap e78: 12 total, 12 up, 12 in 2024-05-08T23:13:49.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:49 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:49.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:49 smithi179 ceph-mon[46314]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-05-08T23:13:49.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:49 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1058162718' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T23:13:49.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:49 smithi195 ceph-mon[46516]: purged_snaps scrub starts 2024-05-08T23:13:49.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:49 smithi195 ceph-mon[46516]: purged_snaps scrub ok 2024-05-08T23:13:49.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:49 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:49.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:49 smithi195 ceph-mon[46516]: osd.11 [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459] boot 2024-05-08T23:13:49.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:49 smithi195 ceph-mon[46516]: osdmap e78: 12 total, 12 up, 12 in 2024-05-08T23:13:49.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:49 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T23:13:49.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:49 smithi195 ceph-mon[46516]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-05-08T23:13:49.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:49 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1058162718' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T23:13:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.626+0000 7ff9ca2e4700 1 -- 172.21.15.135:0/2426208292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9c4101410 msgr2=0x7ff9c410cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.626+0000 7ff9ca2e4700 1 --2- 172.21.15.135:0/2426208292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9c4101410 0x7ff9c410cd70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00b0d0 tx=0x7ff9bc00b3e0 comp rx=0 tx=0).stop 2024-05-08T23:13:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.626+0000 7ff9ca2e4700 1 -- 172.21.15.135:0/2426208292 shutdown_connections 2024-05-08T23:13:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.626+0000 7ff9ca2e4700 1 --2- 172.21.15.135:0/2426208292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c4104ed0 0x7ff9c41052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.626+0000 7ff9ca2e4700 1 --2- 172.21.15.135:0/2426208292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9c4101410 0x7ff9c410cd70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.626+0000 7ff9ca2e4700 1 --2- 172.21.15.135:0/2426208292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9c4100a50 0x7ff9c4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.626+0000 7ff9ca2e4700 1 -- 172.21.15.135:0/2426208292 >> 172.21.15.135:0/2426208292 conn(0x7ff9c4075260 msgr2=0x7ff9c4075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:50.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.626+0000 7ff9ca2e4700 1 -- 172.21.15.135:0/2426208292 shutdown_connections 2024-05-08T23:13:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.626+0000 7ff9ca2e4700 1 -- 172.21.15.135:0/2426208292 wait complete. 2024-05-08T23:13:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.627+0000 7ff9ca2e4700 1 Processor -- start 2024-05-08T23:13:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.627+0000 7ff9ca2e4700 1 -- start start 2024-05-08T23:13:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.627+0000 7ff9ca2e4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9c4100a50 0x7ff9c4101bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.627+0000 7ff9ca2e4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c4101410 0x7ff9c4102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.627+0000 7ff9ca2e4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9c4104ed0 0x7ff9c4102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.627+0000 7ff9ca2e4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c41a58e0 con 0x7ff9c4104ed0 2024-05-08T23:13:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.627+0000 7ff9ca2e4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c41a5a50 con 0x7ff9c4100a50 2024-05-08T23:13:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.627+0000 7ff9ca2e4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c41a5c10 con 0x7ff9c4101410 2024-05-08T23:13:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.627+0000 7ff9c8881700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9c4104ed0 0x7ff9c4102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.627+0000 7ff9c8881700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9c4104ed0 0x7ff9c4102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54658/0 (socket says 172.21.15.135:54658) 2024-05-08T23:13:50.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.627+0000 7ff9c8881700 1 -- 172.21.15.135:0/2456890265 learned_addr learned my addr 172.21.15.135:0/2456890265 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:13:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.628+0000 7ff9c37fe700 1 --2- 172.21.15.135:0/2456890265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c4101410 0x7ff9c4102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.628+0000 7ff9c3fff700 1 --2- 172.21.15.135:0/2456890265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9c4100a50 0x7ff9c4101bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.628+0000 7ff9c8881700 1 -- 172.21.15.135:0/2456890265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c4101410 msgr2=0x7ff9c4102110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.628+0000 7ff9c8881700 1 --2- 172.21.15.135:0/2456890265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c4101410 0x7ff9c4102110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.628+0000 7ff9c8881700 1 -- 172.21.15.135:0/2456890265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9c4100a50 msgr2=0x7ff9c4101bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.628+0000 7ff9c8881700 1 --2- 172.21.15.135:0/2456890265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9c4100a50 0x7ff9c4101bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.628+0000 7ff9c8881700 1 -- 172.21.15.135:0/2456890265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc009d00 con 0x7ff9c4104ed0 2024-05-08T23:13:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.628+0000 7ff9c8881700 1 --2- 172.21.15.135:0/2456890265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9c4104ed0 0x7ff9c4102650 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0094c0 tx=0x7ff9bc0094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.628+0000 7ff9c17fa700 1 -- 172.21.15.135:0/2456890265 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc00e040 con 0x7ff9c4104ed0 2024-05-08T23:13:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.628+0000 7ff9ca2e4700 1 -- 172.21.15.135:0/2456890265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c41a5e90 con 0x7ff9c4104ed0 2024-05-08T23:13:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.628+0000 7ff9c17fa700 1 -- 172.21.15.135:0/2456890265 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9bc01d940 con 0x7ff9c4104ed0 2024-05-08T23:13:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.628+0000 7ff9c17fa700 1 -- 172.21.15.135:0/2456890265 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc01b9f0 con 0x7ff9c4104ed0 2024-05-08T23:13:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.628+0000 7ff9ca2e4700 1 -- 172.21.15.135:0/2456890265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c41a6300 con 0x7ff9c4104ed0 2024-05-08T23:13:50.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.629+0000 7ff9ca2e4700 1 -- 172.21.15.135:0/2456890265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c41094d0 con 0x7ff9c4104ed0 2024-05-08T23:13:50.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.630+0000 7ff9c17fa700 1 -- 172.21.15.135:0/2456890265 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7ff9bc01bb50 con 0x7ff9c4104ed0 2024-05-08T23:13:50.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.631+0000 7ff9c17fa700 1 --2- 172.21.15.135:0/2456890265 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff9ac0a1120 0x7ff9ac0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:50.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.631+0000 7ff9c3fff700 1 --2- 172.21.15.135:0/2456890265 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff9ac0a1120 0x7ff9ac0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:50.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.631+0000 7ff9c17fa700 1 -- 172.21.15.135:0/2456890265 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff9bc0cdd30 con 0x7ff9c4104ed0 2024-05-08T23:13:50.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.631+0000 7ff9c3fff700 1 --2- 172.21.15.135:0/2456890265 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff9ac0a1120 0x7ff9ac0a35e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4007be0 tx=0x7ff9b40073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:50.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.636+0000 7ff9c17fa700 1 -- 172.21.15.135:0/2456890265 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff9bc0979f0 con 0x7ff9c4104ed0 2024-05-08T23:13:50.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.830+0000 7ff9ca2e4700 1 -- 172.21.15.135:0/2456890265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9c40684d0 con 0x7ff9c4104ed0 2024-05-08T23:13:50.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.831+0000 7ff9c17fa700 1 -- 172.21.15.135:0/2456890265 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18479 (secure 0 0 0) 0x7ff9bc09b010 con 0x7ff9c4104ed0 2024-05-08T23:13:50.831 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:13:50.831 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":79,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:13:49.981881+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:13:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.833+0000 7ff9ca2e4700 1 -- 172.21.15.135:0/2456890265 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff9ac0a1120 msgr2=0x7ff9ac0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.833+0000 7ff9ca2e4700 1 --2- 172.21.15.135:0/2456890265 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff9ac0a1120 0x7ff9ac0a35e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4007be0 tx=0x7ff9b40073d0 comp rx=0 tx=0).stop 2024-05-08T23:13:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.833+0000 7ff9ca2e4700 1 -- 172.21.15.135:0/2456890265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9c4104ed0 msgr2=0x7ff9c4102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.833+0000 7ff9ca2e4700 1 --2- 172.21.15.135:0/2456890265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9c4104ed0 0x7ff9c4102650 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0094c0 tx=0x7ff9bc0094f0 comp rx=0 tx=0).stop 2024-05-08T23:13:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.833+0000 7ff9ca2e4700 1 -- 172.21.15.135:0/2456890265 shutdown_connections 2024-05-08T23:13:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.833+0000 7ff9ca2e4700 1 --2- 172.21.15.135:0/2456890265 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff9ac0a1120 0x7ff9ac0a35e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.833+0000 7ff9ca2e4700 1 --2- 172.21.15.135:0/2456890265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9c4104ed0 0x7ff9c4102650 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.833+0000 7ff9ca2e4700 1 --2- 172.21.15.135:0/2456890265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9c4100a50 0x7ff9c4101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.833+0000 7ff9ca2e4700 1 --2- 172.21.15.135:0/2456890265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c4101410 0x7ff9c4102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.833+0000 7ff9ca2e4700 1 -- 172.21.15.135:0/2456890265 >> 172.21.15.135:0/2456890265 conn(0x7ff9c4075260 msgr2=0x7ff9c40ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.833+0000 7ff9ca2e4700 1 -- 172.21.15.135:0/2456890265 shutdown_connections 2024-05-08T23:13:50.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:50.833+0000 7ff9ca2e4700 1 -- 172.21.15.135:0/2456890265 wait complete. 2024-05-08T23:13:51.153 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:50 smithi135 ceph-mon[42440]: osdmap e79: 12 total, 12 up, 12 in 2024-05-08T23:13:51.154 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:50 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2456890265' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:13:51.214 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:11:11.282550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T23:13:51.215 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-08T23:13:51.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:50 smithi179 ceph-mon[46314]: osdmap e79: 12 total, 12 up, 12 in 2024-05-08T23:13:51.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:50 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2456890265' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:13:51.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:50 smithi195 ceph-mon[46516]: osdmap e79: 12 total, 12 up, 12 in 2024-05-08T23:13:51.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:50 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2456890265' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:13:51.436 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:13:52.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:51 smithi135 ceph-mon[42440]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:13:52.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:51 smithi179 ceph-mon[46314]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:13:52.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:51 smithi195 ceph-mon[46516]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:13:52.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.395+0000 7f04f6fa7700 1 -- 172.21.15.135:0/2629059281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04f0069bd0 msgr2=0x7f04f010de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:52.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.395+0000 7f04f6fa7700 1 --2- 172.21.15.135:0/2629059281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04f0069bd0 0x7f04f010de00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f04e800b0d0 tx=0x7f04e800b3e0 comp rx=0 tx=0).stop 2024-05-08T23:13:52.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.395+0000 7f04f6fa7700 1 -- 172.21.15.135:0/2629059281 shutdown_connections 2024-05-08T23:13:52.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.395+0000 7f04f6fa7700 1 --2- 172.21.15.135:0/2629059281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04f0069bd0 0x7f04f010de00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:52.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.395+0000 7f04f6fa7700 1 --2- 172.21.15.135:0/2629059281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f0106fe0 0x7f04f01073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:52.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.395+0000 7f04f6fa7700 1 --2- 172.21.15.135:0/2629059281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04f0069210 0x7f04f0069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:52.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.395+0000 7f04f6fa7700 1 -- 172.21.15.135:0/2629059281 >> 172.21.15.135:0/2629059281 conn(0x7f04f0076e70 msgr2=0x7f04f0077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:52.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.395+0000 7f04f6fa7700 1 -- 172.21.15.135:0/2629059281 shutdown_connections 2024-05-08T23:13:52.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.395+0000 7f04f6fa7700 1 -- 172.21.15.135:0/2629059281 wait complete. 2024-05-08T23:13:52.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f6fa7700 1 Processor -- start 2024-05-08T23:13:52.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f6fa7700 1 -- start start 2024-05-08T23:13:52.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f6fa7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04f0069210 0x7f04f01973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:52.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f6fa7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04f0069bd0 0x7f04f0197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:52.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f6fa7700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f0106fe0 0x7f04f019bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:52.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f6fa7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f019c280 con 0x7f04f0069210 2024-05-08T23:13:52.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f6fa7700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f019c3f0 con 0x7f04f0106fe0 2024-05-08T23:13:52.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f6fa7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f019c5b0 con 0x7f04f0069bd0 2024-05-08T23:13:52.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f4d43700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04f0069210 0x7f04f01973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:52.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f4d43700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04f0069210 0x7f04f01973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54666/0 (socket says 172.21.15.135:54666) 2024-05-08T23:13:52.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f4d43700 1 -- 172.21.15.135:0/1719297195 learned_addr learned my addr 172.21.15.135:0/1719297195 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:13:52.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04effff700 1 --2- 172.21.15.135:0/1719297195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04f0069bd0 0x7f04f0197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:52.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f5544700 1 --2- 172.21.15.135:0/1719297195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f0106fe0 0x7f04f019bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:52.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f4d43700 1 -- 172.21.15.135:0/1719297195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04f0069bd0 msgr2=0x7f04f0197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:52.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f4d43700 1 --2- 172.21.15.135:0/1719297195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04f0069bd0 0x7f04f0197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:52.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f4d43700 1 -- 172.21.15.135:0/1719297195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f0106fe0 msgr2=0x7f04f019bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:52.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f4d43700 1 --2- 172.21.15.135:0/1719297195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f0106fe0 0x7f04f019bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:52.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f4d43700 1 -- 172.21.15.135:0/1719297195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e8009d00 con 0x7f04f0069210 2024-05-08T23:13:52.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f5544700 1 --2- 172.21.15.135:0/1719297195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f0106fe0 0x7f04f019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:13:52.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.396+0000 7f04f4d43700 1 --2- 172.21.15.135:0/1719297195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04f0069210 0x7f04f01973f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f04e400d950 tx=0x7f04e400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:52.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.397+0000 7f04edffb700 1 -- 172.21.15.135:0/1719297195 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4009940 con 0x7f04f0069210 2024-05-08T23:13:52.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.397+0000 7f04edffb700 1 -- 172.21.15.135:0/1719297195 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04e4010460 con 0x7f04f0069210 2024-05-08T23:13:52.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.397+0000 7f04f6fa7700 1 -- 172.21.15.135:0/1719297195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f019c890 con 0x7f04f0069210 2024-05-08T23:13:52.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.397+0000 7f04edffb700 1 -- 172.21.15.135:0/1719297195 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e400f620 con 0x7f04f0069210 2024-05-08T23:13:52.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.397+0000 7f04f6fa7700 1 -- 172.21.15.135:0/1719297195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f01a40f0 con 0x7f04f0069210 2024-05-08T23:13:52.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.398+0000 7f04f6fa7700 1 -- 172.21.15.135:0/1719297195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f01094e0 con 0x7f04f0069210 2024-05-08T23:13:52.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.399+0000 7f04edffb700 1 -- 172.21.15.135:0/1719297195 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f04e40108d0 con 0x7f04f0069210 2024-05-08T23:13:52.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.399+0000 7f04edffb700 1 --2- 172.21.15.135:0/1719297195 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f04e00a11a0 0x7f04e00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:52.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.399+0000 7f04effff700 1 --2- 172.21.15.135:0/1719297195 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f04e00a11a0 0x7f04e00a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:52.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.399+0000 7f04edffb700 1 -- 172.21.15.135:0/1719297195 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f04e40cc240 con 0x7f04f0069210 2024-05-08T23:13:52.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.400+0000 7f04effff700 1 --2- 172.21.15.135:0/1719297195 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f04e00a11a0 0x7f04e00a3660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f04f0077470 tx=0x7f04dc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:52.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.404+0000 7f04edffb700 1 -- 172.21.15.135:0/1719297195 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f04e4095e70 con 0x7f04f0069210 2024-05-08T23:13:52.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.596+0000 7f04f6fa7700 1 -- 172.21.15.135:0/1719297195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04f0198700 con 0x7f04f0069210 2024-05-08T23:13:52.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.597+0000 7f04edffb700 1 -- 172.21.15.135:0/1719297195 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04e4099490 con 0x7f04f0069210 2024-05-08T23:13:52.597 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T23:13:52.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.599+0000 7f04f6fa7700 1 -- 172.21.15.135:0/1719297195 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f04e00a11a0 msgr2=0x7f04e00a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:52.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.599+0000 7f04f6fa7700 1 --2- 172.21.15.135:0/1719297195 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f04e00a11a0 0x7f04e00a3660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f04f0077470 tx=0x7f04dc00b410 comp rx=0 tx=0).stop 2024-05-08T23:13:52.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.599+0000 7f04f6fa7700 1 -- 172.21.15.135:0/1719297195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04f0069210 msgr2=0x7f04f01973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:52.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.599+0000 7f04f6fa7700 1 --2- 172.21.15.135:0/1719297195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04f0069210 0x7f04f01973f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f04e400d950 tx=0x7f04e400dc60 comp rx=0 tx=0).stop 2024-05-08T23:13:52.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.599+0000 7f04f6fa7700 1 -- 172.21.15.135:0/1719297195 shutdown_connections 2024-05-08T23:13:52.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.599+0000 7f04f6fa7700 1 --2- 172.21.15.135:0/1719297195 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f04e00a11a0 0x7f04e00a3660 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:52.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.599+0000 7f04f6fa7700 1 --2- 172.21.15.135:0/1719297195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f0106fe0 0x7f04f019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:52.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.599+0000 7f04f6fa7700 1 --2- 172.21.15.135:0/1719297195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04f0069210 0x7f04f01973f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:52.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.599+0000 7f04f6fa7700 1 --2- 172.21.15.135:0/1719297195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04f0069bd0 0x7f04f0197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:52.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.599+0000 7f04f6fa7700 1 -- 172.21.15.135:0/1719297195 >> 172.21.15.135:0/1719297195 conn(0x7f04f0076e70 msgr2=0x7f04f00feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:52.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.599+0000 7f04f6fa7700 1 -- 172.21.15.135:0/1719297195 shutdown_connections 2024-05-08T23:13:52.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:52.599+0000 7f04f6fa7700 1 -- 172.21.15.135:0/1719297195 wait complete. 2024-05-08T23:13:52.996 INFO:tasks.cephadm:Adding mds.a on smithi135 2024-05-08T23:13:52.996 INFO:tasks.cephadm:Adding mds.d on smithi135 2024-05-08T23:13:52.996 INFO:tasks.cephadm:Adding mds.g on smithi135 2024-05-08T23:13:52.997 INFO:tasks.cephadm:Adding mds.j on smithi135 2024-05-08T23:13:52.997 INFO:tasks.cephadm:Adding mds.b on smithi179 2024-05-08T23:13:52.997 INFO:tasks.cephadm:Adding mds.e on smithi179 2024-05-08T23:13:52.997 INFO:tasks.cephadm:Adding mds.h on smithi179 2024-05-08T23:13:52.997 INFO:tasks.cephadm:Adding mds.k on smithi179 2024-05-08T23:13:52.997 INFO:tasks.cephadm:Adding mds.c on smithi195 2024-05-08T23:13:52.997 INFO:tasks.cephadm:Adding mds.f on smithi195 2024-05-08T23:13:52.997 INFO:tasks.cephadm:Adding mds.i on smithi195 2024-05-08T23:13:52.997 INFO:tasks.cephadm:Adding mds.l on smithi195 2024-05-08T23:13:52.997 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph orch apply mds all '12;smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l' 2024-05-08T23:13:53.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:52 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1719297195' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:13:53.232 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:13:53.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:52 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1719297195' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:13:53.360 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:52 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1719297195' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:13:54.204 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.205+0000 7f791d956700 1 -- 172.21.15.195:0/3119501478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7918100170 msgr2=0x7f79181005f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:54.204 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.205+0000 7f791d956700 1 --2- 172.21.15.195:0/3119501478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7918100170 0x7f79181005f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7908009990 tx=0x7f7908009ca0 comp rx=0 tx=0).stop 2024-05-08T23:13:54.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.205+0000 7f791d956700 1 -- 172.21.15.195:0/3119501478 shutdown_connections 2024-05-08T23:13:54.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.205+0000 7f791d956700 1 --2- 172.21.15.195:0/3119501478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7918100b30 0x7f79181083d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:54.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.205+0000 7f791d956700 1 --2- 172.21.15.195:0/3119501478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7918101510 0x7f7918101930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:54.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.205+0000 7f791d956700 1 --2- 172.21.15.195:0/3119501478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7918100170 0x7f79181005f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:54.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.205+0000 7f791d956700 1 -- 172.21.15.195:0/3119501478 >> 172.21.15.195:0/3119501478 conn(0x7f79180fac40 msgr2=0x7f79180fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:54.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.205+0000 7f791d956700 1 -- 172.21.15.195:0/3119501478 shutdown_connections 2024-05-08T23:13:54.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.205+0000 7f791d956700 1 -- 172.21.15.195:0/3119501478 wait complete. 2024-05-08T23:13:54.207 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f791d956700 1 Processor -- start 2024-05-08T23:13:54.207 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f791d956700 1 -- start start 2024-05-08T23:13:54.207 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f791d956700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7918100170 0x7f79180ffb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:54.207 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f791d956700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7918100b30 0x7f791819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:54.207 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f791d956700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7918101510 0x7f791819e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:54.207 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f791d956700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791819eaa0 con 0x7f7918100b30 2024-05-08T23:13:54.207 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f791d956700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791819ec10 con 0x7f7918101510 2024-05-08T23:13:54.207 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f791d956700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791819edd0 con 0x7f7918100170 2024-05-08T23:13:54.207 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f7916ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7918100170 0x7f79180ffb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:54.207 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f7916ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7918100170 0x7f79180ffb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:60330/0 (socket says 172.21.15.195:60330) 2024-05-08T23:13:54.207 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f7916ffd700 1 -- 172.21.15.195:0/177887027 learned_addr learned my addr 172.21.15.195:0/177887027 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T23:13:54.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f79167fc700 1 --2- 172.21.15.195:0/177887027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7918100b30 0x7f791819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:54.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f79177fe700 1 --2- 172.21.15.195:0/177887027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7918101510 0x7f791819e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:54.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f7916ffd700 1 -- 172.21.15.195:0/177887027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7918101510 msgr2=0x7f791819e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:54.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f7916ffd700 1 --2- 172.21.15.195:0/177887027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7918101510 0x7f791819e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:54.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f7916ffd700 1 -- 172.21.15.195:0/177887027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7918100b30 msgr2=0x7f791819bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:54.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f7916ffd700 1 --2- 172.21.15.195:0/177887027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7918100b30 0x7f791819bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:54.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.206+0000 7f7916ffd700 1 -- 172.21.15.195:0/177887027 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79080095f0 con 0x7f7918100170 2024-05-08T23:13:54.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.207+0000 7f7916ffd700 1 --2- 172.21.15.195:0/177887027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7918100170 0x7f79180ffb90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f790c00b500 tx=0x7f790c00b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:54.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.207+0000 7f791c954700 1 -- 172.21.15.195:0/177887027 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c011830 con 0x7f7918100170 2024-05-08T23:13:54.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.207+0000 7f791c954700 1 -- 172.21.15.195:0/177887027 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f790c011e50 con 0x7f7918100170 2024-05-08T23:13:54.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.207+0000 7f791d956700 1 -- 172.21.15.195:0/177887027 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791819f0b0 con 0x7f7918100170 2024-05-08T23:13:54.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.207+0000 7f791c954700 1 -- 172.21.15.195:0/177887027 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c00f2e0 con 0x7f7918100170 2024-05-08T23:13:54.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.207+0000 7f791d956700 1 -- 172.21.15.195:0/177887027 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791819f560 con 0x7f7918100170 2024-05-08T23:13:54.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.208+0000 7f791d956700 1 -- 172.21.15.195:0/177887027 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7918107450 con 0x7f7918100170 2024-05-08T23:13:54.209 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.209+0000 7f791c954700 1 -- 172.21.15.195:0/177887027 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f790c010580 con 0x7f7918100170 2024-05-08T23:13:54.209 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.210+0000 7f791c954700 1 --2- 172.21.15.195:0/177887027 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f79000a1120 0x7f79000a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:54.209 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.210+0000 7f791c954700 1 -- 172.21.15.195:0/177887027 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f790c0cc540 con 0x7f7918100170 2024-05-08T23:13:54.209 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.210+0000 7f79167fc700 1 --2- 172.21.15.195:0/177887027 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f79000a1120 0x7f79000a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:54.210 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.210+0000 7f79167fc700 1 --2- 172.21.15.195:0/177887027 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f79000a1120 0x7f79000a35e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f790800b5c0 tx=0x7f7908003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:54.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.213+0000 7f791c954700 1 -- 172.21.15.195:0/177887027 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f790c0960d0 con 0x7f7918100170 2024-05-08T23:13:54.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:54 smithi179 ceph-mon[46314]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:13:54.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:54 smithi195 ceph-mon[46516]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:13:54.414 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.414+0000 7f791d956700 1 -- 172.21.15.195:0/177887027 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f79180614e0 con 0x7f79000a1120 2024-05-08T23:13:54.422 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.423+0000 7f791c954700 1 -- 172.21.15.195:0/177887027 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f79180614e0 con 0x7f79000a1120 2024-05-08T23:13:54.422 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mds.all update... 2024-05-08T23:13:54.424 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.425+0000 7f791d956700 1 -- 172.21.15.195:0/177887027 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f79000a1120 msgr2=0x7f79000a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:54.425 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.425+0000 7f791d956700 1 --2- 172.21.15.195:0/177887027 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f79000a1120 0x7f79000a35e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f790800b5c0 tx=0x7f7908003790 comp rx=0 tx=0).stop 2024-05-08T23:13:54.425 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.425+0000 7f791d956700 1 -- 172.21.15.195:0/177887027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7918100170 msgr2=0x7f79180ffb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:54.425 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.425+0000 7f791d956700 1 --2- 172.21.15.195:0/177887027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7918100170 0x7f79180ffb90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f790c00b500 tx=0x7f790c00b810 comp rx=0 tx=0).stop 2024-05-08T23:13:54.425 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.425+0000 7f791d956700 1 -- 172.21.15.195:0/177887027 shutdown_connections 2024-05-08T23:13:54.425 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.425+0000 7f791d956700 1 --2- 172.21.15.195:0/177887027 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f79000a1120 0x7f79000a35e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:54.425 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.425+0000 7f791d956700 1 --2- 172.21.15.195:0/177887027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7918100170 0x7f79180ffb90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:54.425 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.425+0000 7f791d956700 1 --2- 172.21.15.195:0/177887027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7918101510 0x7f791819e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:54.425 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.425+0000 7f791d956700 1 --2- 172.21.15.195:0/177887027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7918100b30 0x7f791819bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:54.425 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.425+0000 7f791d956700 1 -- 172.21.15.195:0/177887027 >> 172.21.15.195:0/177887027 conn(0x7f79180fac40 msgr2=0x7f7918104590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:54.425 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.425+0000 7f791d956700 1 -- 172.21.15.195:0/177887027 shutdown_connections 2024-05-08T23:13:54.425 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T23:13:54.425+0000 7f791d956700 1 -- 172.21.15.195:0/177887027 wait complete. 2024-05-08T23:13:54.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:54 smithi135 ceph-mon[42440]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:13:54.797 DEBUG:teuthology.orchestra.run.smithi135:mds.a> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.a.service 2024-05-08T23:13:54.800 DEBUG:teuthology.orchestra.run.smithi135:mds.d> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.d.service 2024-05-08T23:13:54.832 INFO:journalctl@ceph.mds.a.smithi135.stdout:-- Logs begin at Wed 2024-05-08 22:52:39 UTC. -- 2024-05-08T23:13:54.833 DEBUG:teuthology.orchestra.run.smithi135:mds.g> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.g.service 2024-05-08T23:13:54.859 INFO:journalctl@ceph.mds.d.smithi135.stdout:-- Logs begin at Wed 2024-05-08 22:52:39 UTC. -- 2024-05-08T23:13:54.860 DEBUG:teuthology.orchestra.run.smithi135:mds.j> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.j.service 2024-05-08T23:13:54.886 INFO:journalctl@ceph.mds.g.smithi135.stdout:-- Logs begin at Wed 2024-05-08 22:52:39 UTC. -- 2024-05-08T23:13:54.887 DEBUG:teuthology.orchestra.run.smithi179:mds.b> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.b.service 2024-05-08T23:13:54.890 DEBUG:teuthology.orchestra.run.smithi179:mds.e> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.e.service 2024-05-08T23:13:54.912 INFO:journalctl@ceph.mds.j.smithi135.stdout:-- Logs begin at Wed 2024-05-08 22:52:39 UTC. -- 2024-05-08T23:13:54.927 INFO:journalctl@ceph.mds.b.smithi179.stdout:-- Logs begin at Wed 2024-05-08 22:52:32 UTC. -- 2024-05-08T23:13:54.928 DEBUG:teuthology.orchestra.run.smithi179:mds.h> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.h.service 2024-05-08T23:13:54.958 INFO:journalctl@ceph.mds.e.smithi179.stdout:-- Logs begin at Wed 2024-05-08 22:52:32 UTC. -- 2024-05-08T23:13:54.959 DEBUG:teuthology.orchestra.run.smithi179:mds.k> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.k.service 2024-05-08T23:13:54.987 INFO:journalctl@ceph.mds.h.smithi179.stdout:-- Logs begin at Wed 2024-05-08 22:52:32 UTC. -- 2024-05-08T23:13:54.988 DEBUG:teuthology.orchestra.run.smithi195:mds.c> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.c.service 2024-05-08T23:13:54.990 DEBUG:teuthology.orchestra.run.smithi195:mds.f> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.f.service 2024-05-08T23:13:55.014 INFO:journalctl@ceph.mds.k.smithi179.stdout:-- Logs begin at Wed 2024-05-08 22:52:32 UTC. -- 2024-05-08T23:13:55.021 INFO:journalctl@ceph.mds.c.smithi195.stdout:-- Logs begin at Wed 2024-05-08 22:52:38 UTC. -- 2024-05-08T23:13:55.023 DEBUG:teuthology.orchestra.run.smithi195:mds.i> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.i.service 2024-05-08T23:13:55.049 INFO:journalctl@ceph.mds.f.smithi195.stdout:-- Logs begin at Wed 2024-05-08 22:52:38 UTC. -- 2024-05-08T23:13:55.050 DEBUG:teuthology.orchestra.run.smithi195:mds.l> sudo journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.l.service 2024-05-08T23:13:55.078 INFO:journalctl@ceph.mds.i.smithi195.stdout:-- Logs begin at Wed 2024-05-08 22:52:38 UTC. -- 2024-05-08T23:13:55.079 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-08T23:13:55.079 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T23:13:55.108 INFO:journalctl@ceph.mds.l.smithi195.stdout:-- Logs begin at Wed 2024-05-08 22:52:38 UTC. -- 2024-05-08T23:13:55.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.216+0000 7f3d0e252700 1 -- 172.21.15.135:0/3979387476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d081019a0 msgr2=0x7f3d08103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:55.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.216+0000 7f3d0e252700 1 --2- 172.21.15.135:0/3979387476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d081019a0 0x7f3d08103d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009990 tx=0x7f3cf8009ca0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.216+0000 7f3d0e252700 1 -- 172.21.15.135:0/3979387476 shutdown_connections 2024-05-08T23:13:55.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.216+0000 7f3d0e252700 1 --2- 172.21.15.135:0/3979387476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d08106c00 0x7f3d08108ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.216+0000 7f3d0e252700 1 --2- 172.21.15.135:0/3979387476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d081019a0 0x7f3d08103d90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.216+0000 7f3d0e252700 1 --2- 172.21.15.135:0/3979387476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d081042d0 0x7f3d081066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.216+0000 7f3d0e252700 1 -- 172.21.15.135:0/3979387476 >> 172.21.15.135:0/3979387476 conn(0x7f3d080fb2f0 msgr2=0x7f3d080fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:55.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.216+0000 7f3d0e252700 1 -- 172.21.15.135:0/3979387476 shutdown_connections 2024-05-08T23:13:55.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.216+0000 7f3d0e252700 1 -- 172.21.15.135:0/3979387476 wait complete. 2024-05-08T23:13:55.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d0e252700 1 Processor -- start 2024-05-08T23:13:55.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d0e252700 1 -- start start 2024-05-08T23:13:55.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d0e252700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d081019a0 0x7f3d08196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:55.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d0e252700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d081042d0 0x7f3d08197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:55.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d0e252700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d08106c00 0x7f3d0819e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:55.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d0e252700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0819e940 con 0x7f3d081019a0 2024-05-08T23:13:55.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d0e252700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0819ea80 con 0x7f3d08106c00 2024-05-08T23:13:55.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d0e252700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0819ec10 con 0x7f3d081042d0 2024-05-08T23:13:55.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d077fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d081019a0 0x7f3d08196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:55.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d077fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d081019a0 0x7f3d08196e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54672/0 (socket says 172.21.15.135:54672) 2024-05-08T23:13:55.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d077fe700 1 -- 172.21.15.135:0/1401496798 learned_addr learned my addr 172.21.15.135:0/1401496798 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:13:55.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d06ffd700 1 --2- 172.21.15.135:0/1401496798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d081042d0 0x7f3d08197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:55.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d077fe700 1 -- 172.21.15.135:0/1401496798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d081042d0 msgr2=0x7f3d08197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:55.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d077fe700 1 --2- 172.21.15.135:0/1401496798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d081042d0 0x7f3d08197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d077fe700 1 -- 172.21.15.135:0/1401496798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d08106c00 msgr2=0x7f3d0819e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:55.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d077fe700 1 --2- 172.21.15.135:0/1401496798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d08106c00 0x7f3d0819e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d077fe700 1 -- 172.21.15.135:0/1401496798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf80095f0 con 0x7f3d081019a0 2024-05-08T23:13:55.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.217+0000 7f3d077fe700 1 --2- 172.21.15.135:0/1401496798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d081019a0 0x7f3d08196e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8006010 tx=0x7f3cf8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:55.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.218+0000 7f3d04ff9700 1 -- 172.21.15.135:0/1401496798 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf801d070 con 0x7f3d081019a0 2024-05-08T23:13:55.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.218+0000 7f3d04ff9700 1 -- 172.21.15.135:0/1401496798 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3cf80054f0 con 0x7f3d081019a0 2024-05-08T23:13:55.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.218+0000 7f3d0e252700 1 -- 172.21.15.135:0/1401496798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0819ee90 con 0x7f3d081019a0 2024-05-08T23:13:55.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.218+0000 7f3d04ff9700 1 -- 172.21.15.135:0/1401496798 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8004bd0 con 0x7f3d081019a0 2024-05-08T23:13:55.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.218+0000 7f3d0e252700 1 -- 172.21.15.135:0/1401496798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0819f250 con 0x7f3d081019a0 2024-05-08T23:13:55.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.219+0000 7f3d0e252700 1 -- 172.21.15.135:0/1401496798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d08067c80 con 0x7f3d081019a0 2024-05-08T23:13:55.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.220+0000 7f3d04ff9700 1 -- 172.21.15.135:0/1401496798 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f3cf800fb80 con 0x7f3d081019a0 2024-05-08T23:13:55.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.220+0000 7f3d04ff9700 1 --2- 172.21.15.135:0/1401496798 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3cf00a11a0 0x7f3cf00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:55.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.221+0000 7f3d06ffd700 1 --2- 172.21.15.135:0/1401496798 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3cf00a11a0 0x7f3cf00a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:55.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.221+0000 7f3d04ff9700 1 -- 172.21.15.135:0/1401496798 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3cf80cd720 con 0x7f3d081019a0 2024-05-08T23:13:55.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.221+0000 7f3d06ffd700 1 --2- 172.21.15.135:0/1401496798 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3cf00a11a0 0x7f3cf00a3660 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc007c60 tx=0x7f3cfc0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:55.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.224+0000 7f3d04ff9700 1 -- 172.21.15.135:0/1401496798 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3cf80973c0 con 0x7f3d081019a0 2024-05-08T23:13:55.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.423+0000 7f3d0e252700 1 -- 172.21.15.135:0/1401496798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d080fce70 con 0x7f3d081019a0 2024-05-08T23:13:55.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.424+0000 7f3d04ff9700 1 -- 172.21.15.135:0/1401496798 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18479 (secure 0 0 0) 0x7f3cf809a9e0 con 0x7f3d081019a0 2024-05-08T23:13:55.424 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:13:55.425 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":79,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:13:49.981881+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:13:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.426+0000 7f3d0e252700 1 -- 172.21.15.135:0/1401496798 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3cf00a11a0 msgr2=0x7f3cf00a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.426+0000 7f3d0e252700 1 --2- 172.21.15.135:0/1401496798 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3cf00a11a0 0x7f3cf00a3660 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc007c60 tx=0x7f3cfc0073d0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.426+0000 7f3d0e252700 1 -- 172.21.15.135:0/1401496798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d081019a0 msgr2=0x7f3d08196e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.426+0000 7f3d0e252700 1 --2- 172.21.15.135:0/1401496798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d081019a0 0x7f3d08196e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8006010 tx=0x7f3cf8004730 comp rx=0 tx=0).stop 2024-05-08T23:13:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.426+0000 7f3d0e252700 1 -- 172.21.15.135:0/1401496798 shutdown_connections 2024-05-08T23:13:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.426+0000 7f3d0e252700 1 --2- 172.21.15.135:0/1401496798 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3cf00a11a0 0x7f3cf00a3660 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.426+0000 7f3d0e252700 1 --2- 172.21.15.135:0/1401496798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d08106c00 0x7f3d0819e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.426+0000 7f3d0e252700 1 --2- 172.21.15.135:0/1401496798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d081019a0 0x7f3d08196e10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.426+0000 7f3d0e252700 1 --2- 172.21.15.135:0/1401496798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d081042d0 0x7f3d08197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.426+0000 7f3d0e252700 1 -- 172.21.15.135:0/1401496798 >> 172.21.15.135:0/1401496798 conn(0x7f3d080fb2f0 msgr2=0x7f3d08102440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:55.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.426+0000 7f3d0e252700 1 -- 172.21.15.135:0/1401496798 shutdown_connections 2024-05-08T23:13:55.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.426+0000 7f3d0e252700 1 -- 172.21.15.135:0/1401496798 wait complete. 2024-05-08T23:13:55.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:11:11.282550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T23:13:55.439 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T23:13:55.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.563+0000 7f51e584f700 1 -- 172.21.15.135:0/1660663594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e01011a0 msgr2=0x7f51e0107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:55.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.563+0000 7f51e584f700 1 --2- 172.21.15.135:0/1660663594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e01011a0 0x7f51e0107a50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f51d800b0a0 tx=0x7f51d800b3b0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.564+0000 7f51e584f700 1 -- 172.21.15.135:0/1660663594 shutdown_connections 2024-05-08T23:13:55.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.564+0000 7f51e584f700 1 --2- 172.21.15.135:0/1660663594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51e00ff610 0x7f51e00ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.564+0000 7f51e584f700 1 --2- 172.21.15.135:0/1660663594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e01011a0 0x7f51e0107a50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.564+0000 7f51e584f700 1 --2- 172.21.15.135:0/1660663594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e0100800 0x7f51e0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.564+0000 7f51e584f700 1 -- 172.21.15.135:0/1660663594 >> 172.21.15.135:0/1660663594 conn(0x7f51e00fab80 msgr2=0x7f51e00fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:55.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.564+0000 7f51e584f700 1 -- 172.21.15.135:0/1660663594 shutdown_connections 2024-05-08T23:13:55.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.564+0000 7f51e584f700 1 -- 172.21.15.135:0/1660663594 wait complete. 2024-05-08T23:13:55.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.564+0000 7f51e584f700 1 Processor -- start 2024-05-08T23:13:55.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.564+0000 7f51e584f700 1 -- start start 2024-05-08T23:13:55.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.564+0000 7f51e584f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e00ff610 0x7f51e0196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:55.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.564+0000 7f51e584f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51e0100800 0x7f51e0197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:55.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.564+0000 7f51e584f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e01011a0 0x7f51e019e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:55.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.564+0000 7f51e584f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e019eaf0 con 0x7f51e00ff610 2024-05-08T23:13:55.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.564+0000 7f51e584f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e019ec30 con 0x7f51e01011a0 2024-05-08T23:13:55.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.564+0000 7f51e584f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e019edc0 con 0x7f51e0100800 2024-05-08T23:13:55.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51deffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e00ff610 0x7f51e0196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:55.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51deffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e00ff610 0x7f51e0196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54694/0 (socket says 172.21.15.135:54694) 2024-05-08T23:13:55.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51deffd700 1 -- 172.21.15.135:0/3056851365 learned_addr learned my addr 172.21.15.135:0/3056851365 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:13:55.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51de7fc700 1 --2- 172.21.15.135:0/3056851365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51e0100800 0x7f51e0197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:55.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51df7fe700 1 --2- 172.21.15.135:0/3056851365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e01011a0 0x7f51e019e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:55.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51deffd700 1 -- 172.21.15.135:0/3056851365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51e0100800 msgr2=0x7f51e0197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:55.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51deffd700 1 --2- 172.21.15.135:0/3056851365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51e0100800 0x7f51e0197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51deffd700 1 -- 172.21.15.135:0/3056851365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e01011a0 msgr2=0x7f51e019e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:55.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51deffd700 1 --2- 172.21.15.135:0/3056851365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e01011a0 0x7f51e019e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51deffd700 1 -- 172.21.15.135:0/3056851365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d8009d00 con 0x7f51e00ff610 2024-05-08T23:13:55.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51deffd700 1 --2- 172.21.15.135:0/3056851365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e00ff610 0x7f51e0196fc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f51d000e970 tx=0x7f51d000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:55.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51e484d700 1 -- 172.21.15.135:0/3056851365 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0009790 con 0x7f51e00ff610 2024-05-08T23:13:55.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51e484d700 1 -- 172.21.15.135:0/3056851365 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51d000eec0 con 0x7f51e00ff610 2024-05-08T23:13:55.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51e484d700 1 -- 172.21.15.135:0/3056851365 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0003cf0 con 0x7f51e00ff610 2024-05-08T23:13:55.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51e584f700 1 -- 172.21.15.135:0/3056851365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e019f0a0 con 0x7f51e00ff610 2024-05-08T23:13:55.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.565+0000 7f51e584f700 1 -- 172.21.15.135:0/3056851365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e019f560 con 0x7f51e00ff610 2024-05-08T23:13:55.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.566+0000 7f51e584f700 1 -- 172.21.15.135:0/3056851365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e0108b70 con 0x7f51e00ff610 2024-05-08T23:13:55.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.567+0000 7f51e484d700 1 -- 172.21.15.135:0/3056851365 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f51d000ccd0 con 0x7f51e00ff610 2024-05-08T23:13:55.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.568+0000 7f51e484d700 1 --2- 172.21.15.135:0/3056851365 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f51c80a1120 0x7f51c80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:55.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.568+0000 7f51de7fc700 1 --2- 172.21.15.135:0/3056851365 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f51c80a1120 0x7f51c80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:55.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.568+0000 7f51e484d700 1 -- 172.21.15.135:0/3056851365 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f51d0014070 con 0x7f51e00ff610 2024-05-08T23:13:55.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.568+0000 7f51de7fc700 1 --2- 172.21.15.135:0/3056851365 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f51c80a1120 0x7f51c80a35e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f51d400ac50 tx=0x7f51d400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:55.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.572+0000 7f51e484d700 1 -- 172.21.15.135:0/3056851365 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f51d00962f0 con 0x7f51e00ff610 2024-05-08T23:13:55.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:55 smithi195 ceph-mon[46516]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:13:55.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:55 smithi195 ceph-mon[46516]: Saving service mds.all spec with placement smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2024-05-08T23:13:55.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:55 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:55.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:55 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:55.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:55 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:55.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:55 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:55.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:55 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:55.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:55 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:13:55.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:55 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:13:55.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:55 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:55.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:55 smithi195 ceph-mon[46516]: Deploying daemon mds.l on smithi195 2024-05-08T23:13:55.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:55 smithi195 ceph-mon[46516]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:13:55.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:55 smithi135 ceph-mon[42440]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:13:55.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:55 smithi135 ceph-mon[42440]: Saving service mds.all spec with placement smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2024-05-08T23:13:55.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:55 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:55 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:55 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:55 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:55 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:55 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:13:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:55 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:13:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:55 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:55 smithi135 ceph-mon[42440]: Deploying daemon mds.l on smithi195 2024-05-08T23:13:55.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:55 smithi135 ceph-mon[42440]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:13:55.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.770+0000 7f51e584f700 1 -- 172.21.15.135:0/3056851365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51e010b990 con 0x7f51e00ff610 2024-05-08T23:13:55.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.770+0000 7f51e484d700 1 -- 172.21.15.135:0/3056851365 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51d0099910 con 0x7f51e00ff610 2024-05-08T23:13:55.771 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T23:13:55.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.772+0000 7f51e584f700 1 -- 172.21.15.135:0/3056851365 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f51c80a1120 msgr2=0x7f51c80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:55.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.772+0000 7f51e584f700 1 --2- 172.21.15.135:0/3056851365 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f51c80a1120 0x7f51c80a35e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f51d400ac50 tx=0x7f51d400a380 comp rx=0 tx=0).stop 2024-05-08T23:13:55.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.773+0000 7f51e584f700 1 -- 172.21.15.135:0/3056851365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e00ff610 msgr2=0x7f51e0196fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:55.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.773+0000 7f51e584f700 1 --2- 172.21.15.135:0/3056851365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e00ff610 0x7f51e0196fc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f51d000e970 tx=0x7f51d000ec80 comp rx=0 tx=0).stop 2024-05-08T23:13:55.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.773+0000 7f51e584f700 1 -- 172.21.15.135:0/3056851365 shutdown_connections 2024-05-08T23:13:55.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.773+0000 7f51e584f700 1 --2- 172.21.15.135:0/3056851365 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f51c80a1120 0x7f51c80a35e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.773+0000 7f51e584f700 1 --2- 172.21.15.135:0/3056851365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e01011a0 0x7f51e019e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.773+0000 7f51e584f700 1 --2- 172.21.15.135:0/3056851365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e00ff610 0x7f51e0196fc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.773+0000 7f51e584f700 1 --2- 172.21.15.135:0/3056851365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51e0100800 0x7f51e0197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.773+0000 7f51e584f700 1 -- 172.21.15.135:0/3056851365 >> 172.21.15.135:0/3056851365 conn(0x7f51e00fab80 msgr2=0x7f51e0105cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:55.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.773+0000 7f51e584f700 1 -- 172.21.15.135:0/3056851365 shutdown_connections 2024-05-08T23:13:55.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.773+0000 7f51e584f700 1 -- 172.21.15.135:0/3056851365 wait complete. 2024-05-08T23:13:55.786 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:13:55.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:55 smithi179 ceph-mon[46314]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:13:55.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:55 smithi179 ceph-mon[46314]: Saving service mds.all spec with placement smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2024-05-08T23:13:55.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:55 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:55.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:55 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:13:55.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:55 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:55.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:55 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:13:55.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:55 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:55.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:55 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:13:55.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:55 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:13:55.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:55 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:55.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:55 smithi179 ceph-mon[46314]: Deploying daemon mds.l on smithi195 2024-05-08T23:13:55.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:55 smithi179 ceph-mon[46314]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:13:55.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.907+0000 7f4ca6485700 1 -- 172.21.15.135:0/2807783232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca00ffd80 msgr2=0x7f4ca01001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:55.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.907+0000 7f4ca6485700 1 --2- 172.21.15.135:0/2807783232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca00ffd80 0x7f4ca01001a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4c900099c0 tx=0x7f4c90009cd0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.907+0000 7f4ca6485700 1 -- 172.21.15.135:0/2807783232 shutdown_connections 2024-05-08T23:13:55.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.907+0000 7f4ca6485700 1 --2- 172.21.15.135:0/2807783232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca0101910 0x7f4ca01081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.907+0000 7f4ca6485700 1 --2- 172.21.15.135:0/2807783232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca00ffd80 0x7f4ca01001a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.907+0000 7f4ca6485700 1 --2- 172.21.15.135:0/2807783232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ca0100f70 0x7f4ca01013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.907+0000 7f4ca6485700 1 -- 172.21.15.135:0/2807783232 >> 172.21.15.135:0/2807783232 conn(0x7f4ca00fb2f0 msgr2=0x7f4ca00fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:55.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.907+0000 7f4ca6485700 1 -- 172.21.15.135:0/2807783232 shutdown_connections 2024-05-08T23:13:55.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.907+0000 7f4ca6485700 1 -- 172.21.15.135:0/2807783232 wait complete. 2024-05-08T23:13:55.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.908+0000 7f4ca6485700 1 Processor -- start 2024-05-08T23:13:55.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.908+0000 7f4ca6485700 1 -- start start 2024-05-08T23:13:55.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.908+0000 7f4ca6485700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca00ffd80 0x7f4ca0195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:55.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.908+0000 7f4ca6485700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ca0100f70 0x7f4ca0196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:55.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4ca6485700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca0101910 0x7f4ca019d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:55.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4ca6485700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca019d8e0 con 0x7f4ca0101910 2024-05-08T23:13:55.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4ca6485700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca019da50 con 0x7f4ca0100f70 2024-05-08T23:13:55.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4ca6485700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca019dc10 con 0x7f4ca00ffd80 2024-05-08T23:13:55.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4ca4a22700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca0101910 0x7f4ca019d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:55.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4c9ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca00ffd80 0x7f4ca0195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:55.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4ca4a22700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca0101910 0x7f4ca019d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54708/0 (socket says 172.21.15.135:54708) 2024-05-08T23:13:55.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4c9ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca00ffd80 0x7f4ca0195df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.135:40472/0 (socket says 172.21.15.135:40472) 2024-05-08T23:13:55.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4ca4a22700 1 -- 172.21.15.135:0/2963386718 learned_addr learned my addr 172.21.15.135:0/2963386718 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:13:55.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4c9f7fe700 1 --2- 172.21.15.135:0/2963386718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ca0100f70 0x7f4ca0196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:55.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4ca4a22700 1 -- 172.21.15.135:0/2963386718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca00ffd80 msgr2=0x7f4ca0195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:55.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4ca4a22700 1 --2- 172.21.15.135:0/2963386718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca00ffd80 0x7f4ca0195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4ca4a22700 1 -- 172.21.15.135:0/2963386718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ca0100f70 msgr2=0x7f4ca0196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:55.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4ca4a22700 1 --2- 172.21.15.135:0/2963386718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ca0100f70 0x7f4ca0196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:55.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4ca4a22700 1 -- 172.21.15.135:0/2963386718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c900095f0 con 0x7f4ca0101910 2024-05-08T23:13:55.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4ca4a22700 1 --2- 172.21.15.135:0/2963386718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca0101910 0x7f4ca019d310 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800b970 tx=0x7f4c9800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:55.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4c9d7fa700 1 -- 172.21.15.135:0/2963386718 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9800d860 con 0x7f4ca0101910 2024-05-08T23:13:55.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4ca6485700 1 -- 172.21.15.135:0/2963386718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca019def0 con 0x7f4ca0101910 2024-05-08T23:13:55.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4c9d7fa700 1 -- 172.21.15.135:0/2963386718 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c9800de80 con 0x7f4ca0101910 2024-05-08T23:13:55.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4c9d7fa700 1 -- 172.21.15.135:0/2963386718 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98017400 con 0x7f4ca0101910 2024-05-08T23:13:55.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.909+0000 7f4ca6485700 1 -- 172.21.15.135:0/2963386718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca019e340 con 0x7f4ca0101910 2024-05-08T23:13:55.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.910+0000 7f4ca6485700 1 -- 172.21.15.135:0/2963386718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca01071d0 con 0x7f4ca0101910 2024-05-08T23:13:55.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.911+0000 7f4c9d7fa700 1 -- 172.21.15.135:0/2963386718 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f4c9800e630 con 0x7f4ca0101910 2024-05-08T23:13:55.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.912+0000 7f4c9d7fa700 1 --2- 172.21.15.135:0/2963386718 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4c880a1120 0x7f4c880a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:55.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.912+0000 7f4c9ffff700 1 --2- 172.21.15.135:0/2963386718 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4c880a1120 0x7f4c880a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:55.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.912+0000 7f4c9d7fa700 1 -- 172.21.15.135:0/2963386718 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4c98006e40 con 0x7f4ca0101910 2024-05-08T23:13:55.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.912+0000 7f4c9ffff700 1 --2- 172.21.15.135:0/2963386718 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4c880a1120 0x7f4c880a35e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4c90003820 tx=0x7f4c90005ec0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:55.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:55.916+0000 7f4c9d7fa700 1 -- 172.21.15.135:0/2963386718 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4c98095ca0 con 0x7f4ca0101910 2024-05-08T23:13:56.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:56.160+0000 7f4ca6485700 1 -- 172.21.15.135:0/2963386718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ca0068060 con 0x7f4ca0101910 2024-05-08T23:13:56.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:56.160+0000 7f4c9d7fa700 1 -- 172.21.15.135:0/2963386718 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f4c980992c0 con 0x7f4ca0101910 2024-05-08T23:13:56.161 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:13:56.161 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-08T23:13:56.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:56.162+0000 7f4ca6485700 1 -- 172.21.15.135:0/2963386718 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4c880a1120 msgr2=0x7f4c880a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:56.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:56.162+0000 7f4ca6485700 1 --2- 172.21.15.135:0/2963386718 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4c880a1120 0x7f4c880a35e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4c90003820 tx=0x7f4c90005ec0 comp rx=0 tx=0).stop 2024-05-08T23:13:56.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:56.162+0000 7f4ca6485700 1 -- 172.21.15.135:0/2963386718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca0101910 msgr2=0x7f4ca019d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:56.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:56.162+0000 7f4ca6485700 1 --2- 172.21.15.135:0/2963386718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca0101910 0x7f4ca019d310 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800b970 tx=0x7f4c9800bc80 comp rx=0 tx=0).stop 2024-05-08T23:13:56.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:56.162+0000 7f4ca6485700 1 -- 172.21.15.135:0/2963386718 shutdown_connections 2024-05-08T23:13:56.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:56.162+0000 7f4ca6485700 1 --2- 172.21.15.135:0/2963386718 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4c880a1120 0x7f4c880a35e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:56.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:56.163+0000 7f4ca6485700 1 --2- 172.21.15.135:0/2963386718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca00ffd80 0x7f4ca0195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:56.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:56.163+0000 7f4ca6485700 1 --2- 172.21.15.135:0/2963386718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca0101910 0x7f4ca019d310 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:56.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:56.163+0000 7f4ca6485700 1 --2- 172.21.15.135:0/2963386718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ca0100f70 0x7f4ca0196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:56.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:56.163+0000 7f4ca6485700 1 -- 172.21.15.135:0/2963386718 >> 172.21.15.135:0/2963386718 conn(0x7f4ca00fb2f0 msgr2=0x7f4ca0104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:56.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:56.163+0000 7f4ca6485700 1 -- 172.21.15.135:0/2963386718 shutdown_connections 2024-05-08T23:13:56.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:56.163+0000 7f4ca6485700 1 -- 172.21.15.135:0/2963386718 wait complete. 2024-05-08T23:13:56.164 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 1 2024-05-08T23:13:56.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:56 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1401496798' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:13:56.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:56 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3056851365' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:13:56.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:56 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2963386718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:13:56.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:56 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1401496798' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:13:56.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:56 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3056851365' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:13:56.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:56 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2963386718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:13:56.631 INFO:journalctl@ceph.mds.l.smithi195.stdout:May 08 23:13:56 smithi195 bash[83568]: 1d1e8b03ecb84c6d0a6104d8805246f1f8c2603cf2c1b4edd52ddd7b47fd8cfd 2024-05-08T23:13:56.631 INFO:journalctl@ceph.mds.l.smithi195.stdout:May 08 23:13:56 smithi195 systemd[1]: Started Ceph mds.l for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:13:56.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:56 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1401496798' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:13:56.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:56 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3056851365' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:13:56.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:56 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2963386718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:13:57.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:57 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] up:boot 2024-05-08T23:13:57.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:57 smithi179 ceph-mon[46314]: fsmap 1 up:standby 2024-05-08T23:13:57.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:57 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T23:13:57.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:57 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:57.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:57 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:57.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:57 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:57.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:57 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:13:57.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:57 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:13:57.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:57 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:57.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:57 smithi179 ceph-mon[46314]: Deploying daemon mds.k on smithi179 2024-05-08T23:13:57.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:57 smithi179 ceph-mon[46314]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:13:57.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:57 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] up:boot 2024-05-08T23:13:57.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:57 smithi195 ceph-mon[46516]: fsmap 1 up:standby 2024-05-08T23:13:57.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:57 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T23:13:57.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:57 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:57.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:57 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:57.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:57 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:57.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:57 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:13:57.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:57 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:13:57.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:57 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:57.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:57 smithi195 ceph-mon[46516]: Deploying daemon mds.k on smithi179 2024-05-08T23:13:57.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:57 smithi195 ceph-mon[46516]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:13:57.901 INFO:journalctl@ceph.mds.k.smithi179.stdout:May 08 23:13:57 smithi179 systemd[1]: Starting Ceph mds.k for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:13:57.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:57 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] up:boot 2024-05-08T23:13:57.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:57 smithi135 ceph-mon[42440]: fsmap 1 up:standby 2024-05-08T23:13:57.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:57 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T23:13:57.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:57 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:57 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:57 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:57 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:13:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:57 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:13:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:57 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:57 smithi135 ceph-mon[42440]: Deploying daemon mds.k on smithi179 2024-05-08T23:13:57.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:57 smithi135 ceph-mon[42440]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:13:58.176 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:13:58.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.312+0000 7f9b8c616700 1 -- 172.21.15.135:0/3792099546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b84101900 msgr2=0x7f9b841081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:58.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.312+0000 7f9b8c616700 1 --2- 172.21.15.135:0/3792099546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b84101900 0x7f9b841081b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00b0d0 tx=0x7f9b7c00b3e0 comp rx=0 tx=0).stop 2024-05-08T23:13:58.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.312+0000 7f9b8c616700 1 -- 172.21.15.135:0/3792099546 shutdown_connections 2024-05-08T23:13:58.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.312+0000 7f9b8c616700 1 --2- 172.21.15.135:0/3792099546 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b840ffd70 0x7f9b84100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:58.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.312+0000 7f9b8c616700 1 --2- 172.21.15.135:0/3792099546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b84101900 0x7f9b841081b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:58.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.312+0000 7f9b8c616700 1 --2- 172.21.15.135:0/3792099546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b84100f60 0x7f9b841013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:58.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.312+0000 7f9b8c616700 1 -- 172.21.15.135:0/3792099546 >> 172.21.15.135:0/3792099546 conn(0x7f9b840fb300 msgr2=0x7f9b840fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:58.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.312+0000 7f9b8c616700 1 -- 172.21.15.135:0/3792099546 shutdown_connections 2024-05-08T23:13:58.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.312+0000 7f9b8c616700 1 -- 172.21.15.135:0/3792099546 wait complete. 2024-05-08T23:13:58.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.313+0000 7f9b8c616700 1 Processor -- start 2024-05-08T23:13:58.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.313+0000 7f9b8c616700 1 -- start start 2024-05-08T23:13:58.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.313+0000 7f9b8c616700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b840ffd70 0x7f9b84069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:58.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.313+0000 7f9b8c616700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b84100f60 0x7f9b8419bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:58.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.313+0000 7f9b8c616700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b84101900 0x7f9b8419e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:58.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.313+0000 7f9b8c616700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8419ea00 con 0x7f9b84100f60 2024-05-08T23:13:58.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.313+0000 7f9b8c616700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8419eb70 con 0x7f9b84101900 2024-05-08T23:13:58.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.313+0000 7f9b8c616700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8419ed30 con 0x7f9b840ffd70 2024-05-08T23:13:58.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b89bb1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b84100f60 0x7f9b8419bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:58.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b89bb1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b84100f60 0x7f9b8419bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51092/0 (socket says 172.21.15.135:51092) 2024-05-08T23:13:58.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b89bb1700 1 -- 172.21.15.135:0/4212787327 learned_addr learned my addr 172.21.15.135:0/4212787327 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:13:58.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b8a3b2700 1 --2- 172.21.15.135:0/4212787327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b840ffd70 0x7f9b84069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:58.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b8abb3700 1 --2- 172.21.15.135:0/4212787327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b84101900 0x7f9b8419e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:58.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b89bb1700 1 -- 172.21.15.135:0/4212787327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b840ffd70 msgr2=0x7f9b84069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:58.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b89bb1700 1 --2- 172.21.15.135:0/4212787327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b840ffd70 0x7f9b84069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:58.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b89bb1700 1 -- 172.21.15.135:0/4212787327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b84101900 msgr2=0x7f9b8419e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:58.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b89bb1700 1 --2- 172.21.15.135:0/4212787327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b84101900 0x7f9b8419e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:58.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b89bb1700 1 -- 172.21.15.135:0/4212787327 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c009d00 con 0x7f9b84100f60 2024-05-08T23:13:58.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b89bb1700 1 --2- 172.21.15.135:0/4212787327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b84100f60 0x7f9b8419bbf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000d950 tx=0x7f9b8000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:58.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b777fe700 1 -- 172.21.15.135:0/4212787327 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000f890 con 0x7f9b84100f60 2024-05-08T23:13:58.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b777fe700 1 -- 172.21.15.135:0/4212787327 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b80010460 con 0x7f9b84100f60 2024-05-08T23:13:58.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b8c616700 1 -- 172.21.15.135:0/4212787327 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8419efb0 con 0x7f9b84100f60 2024-05-08T23:13:58.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b777fe700 1 -- 172.21.15.135:0/4212787327 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000e610 con 0x7f9b84100f60 2024-05-08T23:13:58.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.314+0000 7f9b8c616700 1 -- 172.21.15.135:0/4212787327 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8419f430 con 0x7f9b84100f60 2024-05-08T23:13:58.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.315+0000 7f9b8c616700 1 -- 172.21.15.135:0/4212787327 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b84107120 con 0x7f9b84100f60 2024-05-08T23:13:58.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.316+0000 7f9b777fe700 1 -- 172.21.15.135:0/4212787327 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f9b800108d0 con 0x7f9b84100f60 2024-05-08T23:13:58.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.317+0000 7f9b777fe700 1 --2- 172.21.15.135:0/4212787327 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9b700a1120 0x7f9b700a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:13:58.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.317+0000 7f9b8a3b2700 1 --2- 172.21.15.135:0/4212787327 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9b700a1120 0x7f9b700a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:13:58.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.317+0000 7f9b777fe700 1 -- 172.21.15.135:0/4212787327 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9b800cc1d0 con 0x7f9b84100f60 2024-05-08T23:13:58.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.317+0000 7f9b8a3b2700 1 --2- 172.21.15.135:0/4212787327 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9b700a1120 0x7f9b700a35e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9b84100dc0 tx=0x7f9b7800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:13:58.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.323+0000 7f9b777fe700 1 -- 172.21.15.135:0/4212787327 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9b80095e00 con 0x7f9b84100f60 2024-05-08T23:13:58.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.579+0000 7f9b8c616700 1 -- 172.21.15.135:0/4212787327 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b84068060 con 0x7f9b84100f60 2024-05-08T23:13:58.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.580+0000 7f9b777fe700 1 -- 172.21.15.135:0/4212787327 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f9b80099420 con 0x7f9b84100f60 2024-05-08T23:13:58.580 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:13:58.581 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-05-08T23:13:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.582+0000 7f9b8c616700 1 -- 172.21.15.135:0/4212787327 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9b700a1120 msgr2=0x7f9b700a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.582+0000 7f9b8c616700 1 --2- 172.21.15.135:0/4212787327 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9b700a1120 0x7f9b700a35e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9b84100dc0 tx=0x7f9b7800b410 comp rx=0 tx=0).stop 2024-05-08T23:13:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.582+0000 7f9b8c616700 1 -- 172.21.15.135:0/4212787327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b84100f60 msgr2=0x7f9b8419bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:13:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.582+0000 7f9b8c616700 1 --2- 172.21.15.135:0/4212787327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b84100f60 0x7f9b8419bbf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000d950 tx=0x7f9b8000dc60 comp rx=0 tx=0).stop 2024-05-08T23:13:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.582+0000 7f9b8c616700 1 -- 172.21.15.135:0/4212787327 shutdown_connections 2024-05-08T23:13:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.582+0000 7f9b8c616700 1 --2- 172.21.15.135:0/4212787327 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9b700a1120 0x7f9b700a35e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.582+0000 7f9b8c616700 1 --2- 172.21.15.135:0/4212787327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b840ffd70 0x7f9b84069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.582+0000 7f9b8c616700 1 --2- 172.21.15.135:0/4212787327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b84101900 0x7f9b8419e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.582+0000 7f9b8c616700 1 --2- 172.21.15.135:0/4212787327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b84100f60 0x7f9b8419bbf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:13:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.582+0000 7f9b8c616700 1 -- 172.21.15.135:0/4212787327 >> 172.21.15.135:0/4212787327 conn(0x7f9b840fb300 msgr2=0x7f9b84104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:13:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.582+0000 7f9b8c616700 1 -- 172.21.15.135:0/4212787327 shutdown_connections 2024-05-08T23:13:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:13:58.582+0000 7f9b8c616700 1 -- 172.21.15.135:0/4212787327 wait complete. 2024-05-08T23:13:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 2 2024-05-08T23:13:58.599 INFO:journalctl@ceph.mds.k.smithi179.stdout:May 08 23:13:58 smithi179 ceph-mds[82220]: -- 172.21.15.179:0/1061342 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f6bc4741a0 con 0x55f6bc44a800 2024-05-08T23:13:58.599 INFO:journalctl@ceph.mds.k.smithi179.stdout:May 08 23:13:58 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-k[82197]: starting mds.k at 2024-05-08T23:13:58.599 INFO:journalctl@ceph.mds.k.smithi179.stdout:May 08 23:13:58 smithi179 bash[82182]: 87c1835e9a88ac8f3663fa77a360275c7a2da5f1a003dffd34f6ce0e8195af35 2024-05-08T23:13:58.599 INFO:journalctl@ceph.mds.k.smithi179.stdout:May 08 23:13:58 smithi179 systemd[1]: Started Ceph mds.k for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:13:59.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:59 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:59.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:59 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:59.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:59 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:59.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:59 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:13:59.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:59 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:13:59.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:59 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:59.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:59 smithi135 ceph-mon[42440]: Deploying daemon mds.j on smithi135 2024-05-08T23:13:59.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:59 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/4212787327' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:13:59.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:59 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] up:boot 2024-05-08T23:13:59.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:59 smithi135 ceph-mon[42440]: fsmap 2 up:standby 2024-05-08T23:13:59.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:59 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T23:13:59.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:13:59 smithi135 ceph-mon[42440]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:13:59.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:59.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:59.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:59.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:13:59.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:13:59.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:59.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:59 smithi179 ceph-mon[46314]: Deploying daemon mds.j on smithi135 2024-05-08T23:13:59.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:59 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/4212787327' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:13:59.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:59 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] up:boot 2024-05-08T23:13:59.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:59 smithi179 ceph-mon[46314]: fsmap 2 up:standby 2024-05-08T23:13:59.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:59 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T23:13:59.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:13:59 smithi179 ceph-mon[46314]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:13:59.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:59 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:59.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:59 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:59.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:59 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:13:59.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:59 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:13:59.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:59 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:13:59.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:59 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:13:59.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:59 smithi195 ceph-mon[46516]: Deploying daemon mds.j on smithi135 2024-05-08T23:13:59.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:59 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/4212787327' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:13:59.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:59 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] up:boot 2024-05-08T23:13:59.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:59 smithi195 ceph-mon[46516]: fsmap 2 up:standby 2024-05-08T23:13:59.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:59 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T23:13:59.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:13:59 smithi195 ceph-mon[46516]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:00.203 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 08 23:13:59 smithi135 bash[91779]: c3502239fff3b7807d7eba50a3a046ed409a9dc179e754f5508cb1030520fbd9 2024-05-08T23:14:00.203 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 08 23:13:59 smithi135 systemd[1]: Started Ceph mds.j for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:14:00.597 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:14:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.726+0000 7f54e26ea700 1 -- 172.21.15.135:0/4182307749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54dc0ffd90 msgr2=0x7f54dc1001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.726+0000 7f54e26ea700 1 --2- 172.21.15.135:0/4182307749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54dc0ffd90 0x7f54dc1001b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0099c0 tx=0x7f54cc009cd0 comp rx=0 tx=0).stop 2024-05-08T23:14:00.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.726+0000 7f54e26ea700 1 -- 172.21.15.135:0/4182307749 shutdown_connections 2024-05-08T23:14:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.726+0000 7f54e26ea700 1 --2- 172.21.15.135:0/4182307749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54dc101920 0x7f54dc1081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.726+0000 7f54e26ea700 1 --2- 172.21.15.135:0/4182307749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54dc0ffd90 0x7f54dc1001b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.726+0000 7f54e26ea700 1 --2- 172.21.15.135:0/4182307749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54dc100f80 0x7f54dc1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.726+0000 7f54e26ea700 1 -- 172.21.15.135:0/4182307749 >> 172.21.15.135:0/4182307749 conn(0x7f54dc0fb300 msgr2=0x7f54dc0fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.726+0000 7f54e26ea700 1 -- 172.21.15.135:0/4182307749 shutdown_connections 2024-05-08T23:14:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.726+0000 7f54e26ea700 1 -- 172.21.15.135:0/4182307749 wait complete. 2024-05-08T23:14:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.727+0000 7f54e26ea700 1 Processor -- start 2024-05-08T23:14:00.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.727+0000 7f54e26ea700 1 -- start start 2024-05-08T23:14:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.727+0000 7f54e26ea700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54dc0ffd90 0x7f54dc069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54e26ea700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54dc100f80 0x7f54dc19bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54e26ea700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54dc101920 0x7f54dc19e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54e26ea700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc19e920 con 0x7f54dc0ffd90 2024-05-08T23:14:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54e26ea700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc19ea90 con 0x7f54dc100f80 2024-05-08T23:14:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54e26ea700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc19ec50 con 0x7f54dc101920 2024-05-08T23:14:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54dbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54dc0ffd90 0x7f54dc069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54dbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54dc0ffd90 0x7f54dc069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51142/0 (socket says 172.21.15.135:51142) 2024-05-08T23:14:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54dbfff700 1 -- 172.21.15.135:0/1959990933 learned_addr learned my addr 172.21.15.135:0/1959990933 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:00.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54db7fe700 1 --2- 172.21.15.135:0/1959990933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54dc100f80 0x7f54dc19bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:00.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54dbfff700 1 -- 172.21.15.135:0/1959990933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54dc101920 msgr2=0x7f54dc19e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:00.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54e0c87700 1 --2- 172.21.15.135:0/1959990933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54dc101920 0x7f54dc19e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:00.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54dbfff700 1 --2- 172.21.15.135:0/1959990933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54dc101920 0x7f54dc19e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:00.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54dbfff700 1 -- 172.21.15.135:0/1959990933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54dc100f80 msgr2=0x7f54dc19bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:00.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54dbfff700 1 --2- 172.21.15.135:0/1959990933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54dc100f80 0x7f54dc19bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:00.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54dbfff700 1 -- 172.21.15.135:0/1959990933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc0095f0 con 0x7f54dc0ffd90 2024-05-08T23:14:00.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54e0c87700 1 --2- 172.21.15.135:0/1959990933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54dc101920 0x7f54dc19e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:14:00.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54dbfff700 1 --2- 172.21.15.135:0/1959990933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54dc0ffd90 0x7f54dc069f10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009f50 tx=0x7f54cc0047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:00.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54d97fa700 1 -- 172.21.15.135:0/1959990933 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc01d070 con 0x7f54dc0ffd90 2024-05-08T23:14:00.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54d97fa700 1 -- 172.21.15.135:0/1959990933 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54cc004200 con 0x7f54dc0ffd90 2024-05-08T23:14:00.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54e26ea700 1 -- 172.21.15.135:0/1959990933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54dc19ee70 con 0x7f54dc0ffd90 2024-05-08T23:14:00.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54d97fa700 1 -- 172.21.15.135:0/1959990933 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc00f460 con 0x7f54dc0ffd90 2024-05-08T23:14:00.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.728+0000 7f54e26ea700 1 -- 172.21.15.135:0/1959990933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54dc19f290 con 0x7f54dc0ffd90 2024-05-08T23:14:00.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.729+0000 7f54e26ea700 1 -- 172.21.15.135:0/1959990933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54dc1071e0 con 0x7f54dc0ffd90 2024-05-08T23:14:00.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.731+0000 7f54d97fa700 1 -- 172.21.15.135:0/1959990933 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f54cc003d40 con 0x7f54dc0ffd90 2024-05-08T23:14:00.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.731+0000 7f54d97fa700 1 --2- 172.21.15.135:0/1959990933 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f54c40a1120 0x7f54c40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:00.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.731+0000 7f54db7fe700 1 --2- 172.21.15.135:0/1959990933 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f54c40a1120 0x7f54c40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:00.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.731+0000 7f54d97fa700 1 -- 172.21.15.135:0/1959990933 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f54cc0cdca0 con 0x7f54dc0ffd90 2024-05-08T23:14:00.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.732+0000 7f54db7fe700 1 --2- 172.21.15.135:0/1959990933 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f54c40a1120 0x7f54c40a35e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f54dc06a4b0 tx=0x7f54d000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:00.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.735+0000 7f54d97fa700 1 -- 172.21.15.135:0/1959990933 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f54cc097960 con 0x7f54dc0ffd90 2024-05-08T23:14:00.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.987+0000 7f54e26ea700 1 -- 172.21.15.135:0/1959990933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54dc068060 con 0x7f54dc0ffd90 2024-05-08T23:14:00.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.987+0000 7f54d97fa700 1 -- 172.21.15.135:0/1959990933 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2780 (secure 0 0 0) 0x7f54cc09af80 con 0x7f54dc0ffd90 2024-05-08T23:14:00.988 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:00.988 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-05-08T23:14:00.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.989+0000 7f54e26ea700 1 -- 172.21.15.135:0/1959990933 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f54c40a1120 msgr2=0x7f54c40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:00.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.989+0000 7f54e26ea700 1 --2- 172.21.15.135:0/1959990933 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f54c40a1120 0x7f54c40a35e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f54dc06a4b0 tx=0x7f54d000a300 comp rx=0 tx=0).stop 2024-05-08T23:14:00.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.989+0000 7f54e26ea700 1 -- 172.21.15.135:0/1959990933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54dc0ffd90 msgr2=0x7f54dc069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:00.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.989+0000 7f54e26ea700 1 --2- 172.21.15.135:0/1959990933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54dc0ffd90 0x7f54dc069f10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009f50 tx=0x7f54cc0047a0 comp rx=0 tx=0).stop 2024-05-08T23:14:00.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.989+0000 7f54e26ea700 1 -- 172.21.15.135:0/1959990933 shutdown_connections 2024-05-08T23:14:00.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.989+0000 7f54e26ea700 1 --2- 172.21.15.135:0/1959990933 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f54c40a1120 0x7f54c40a35e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:00.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.989+0000 7f54e26ea700 1 --2- 172.21.15.135:0/1959990933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54dc101920 0x7f54dc19e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:00.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.989+0000 7f54e26ea700 1 --2- 172.21.15.135:0/1959990933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54dc0ffd90 0x7f54dc069f10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:00.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.989+0000 7f54e26ea700 1 --2- 172.21.15.135:0/1959990933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54dc100f80 0x7f54dc19bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:00.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.989+0000 7f54e26ea700 1 -- 172.21.15.135:0/1959990933 >> 172.21.15.135:0/1959990933 conn(0x7f54dc0fb300 msgr2=0x7f54dc104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:00.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.990+0000 7f54e26ea700 1 -- 172.21.15.135:0/1959990933 shutdown_connections 2024-05-08T23:14:00.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:00.990+0000 7f54e26ea700 1 -- 172.21.15.135:0/1959990933 wait complete. 2024-05-08T23:14:00.991 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 4 2024-05-08T23:14:01.038 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:01.038 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:01.038 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:01.038 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:01.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:01.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:01.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:01 smithi135 ceph-mon[42440]: Deploying daemon mds.d on smithi135 2024-05-08T23:14:01.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:01 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.135:6834/2842983323,v1:172.21.15.135:6835/2842983323] up:boot 2024-05-08T23:14:01.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:01 smithi135 ceph-mon[42440]: fsmap 3 up:standby 2024-05-08T23:14:01.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:01 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T23:14:01.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:01 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1959990933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:01.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:01 smithi179 ceph-mon[46314]: Deploying daemon mds.d on smithi135 2024-05-08T23:14:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:01 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.135:6834/2842983323,v1:172.21.15.135:6835/2842983323] up:boot 2024-05-08T23:14:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:01 smithi179 ceph-mon[46314]: fsmap 3 up:standby 2024-05-08T23:14:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:01 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T23:14:01.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:01 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1959990933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:01.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:01.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:01.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:01.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:01 smithi195 ceph-mon[46516]: Deploying daemon mds.d on smithi135 2024-05-08T23:14:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:01 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.135:6834/2842983323,v1:172.21.15.135:6835/2842983323] up:boot 2024-05-08T23:14:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:01 smithi195 ceph-mon[46516]: fsmap 3 up:standby 2024-05-08T23:14:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:01 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T23:14:01.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:01 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1959990933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:01.553 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 08 23:14:01 smithi135 systemd[1]: Starting Ceph mds.d for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:14:01.953 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 08 23:14:01 smithi135 ceph-mds[92204]: -- 172.21.15.135:0/1652601921 <== mon.0 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558b064c81a0 con 0x558b0649e800 2024-05-08T23:14:01.954 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 08 23:14:01 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-d[92182]: starting mds.d at 2024-05-08T23:14:01.954 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 08 23:14:01 smithi135 bash[92167]: 68f454290ede9ee4509ebc5e39da1e99753661a5e68857537d9a1c87866aeffc 2024-05-08T23:14:01.954 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 08 23:14:01 smithi135 systemd[1]: Started Ceph mds.d for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:14:02.330 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:02 smithi179 ceph-mon[46314]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:02.330 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:02 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:02.330 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:02 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:02.330 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:02 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:02.330 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:02 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:02.331 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:02 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:02.331 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:02 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:02.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:02 smithi195 ceph-mon[46516]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:02.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:02 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:02.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:02 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:02.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:02 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:02.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:02 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:02.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:02 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:02.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:02 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:02.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:02 smithi135 ceph-mon[42440]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:02.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:02 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:02.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:02 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:02.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:02 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:02.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:02 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:02.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:02 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:02.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:02 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:03.003 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:14:03.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.143+0000 7efbf3c70700 1 -- 172.21.15.135:0/887763998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbec100f60 msgr2=0x7efbec1013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:03.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.143+0000 7efbf3c70700 1 --2- 172.21.15.135:0/887763998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbec100f60 0x7efbec1013c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efbe80099c0 tx=0x7efbe8009cd0 comp rx=0 tx=0).stop 2024-05-08T23:14:03.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.143+0000 7efbf3c70700 1 -- 172.21.15.135:0/887763998 shutdown_connections 2024-05-08T23:14:03.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.143+0000 7efbf3c70700 1 --2- 172.21.15.135:0/887763998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbec0ffd70 0x7efbec100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:03.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.143+0000 7efbf3c70700 1 --2- 172.21.15.135:0/887763998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbec101900 0x7efbec1081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:03.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.143+0000 7efbf3c70700 1 --2- 172.21.15.135:0/887763998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbec100f60 0x7efbec1013c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:03.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.143+0000 7efbf3c70700 1 -- 172.21.15.135:0/887763998 >> 172.21.15.135:0/887763998 conn(0x7efbec0fb2e0 msgr2=0x7efbec0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:03.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.143+0000 7efbf3c70700 1 -- 172.21.15.135:0/887763998 shutdown_connections 2024-05-08T23:14:03.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.143+0000 7efbf3c70700 1 -- 172.21.15.135:0/887763998 wait complete. 2024-05-08T23:14:03.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.144+0000 7efbf3c70700 1 Processor -- start 2024-05-08T23:14:03.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.144+0000 7efbf3c70700 1 -- start start 2024-05-08T23:14:03.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.144+0000 7efbf3c70700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbec0ffd70 0x7efbec069d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:03.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.144+0000 7efbf3c70700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbec100f60 0x7efbec19bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:03.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.144+0000 7efbf3c70700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbec101900 0x7efbec19e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:03.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.144+0000 7efbf3c70700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbec19e8e0 con 0x7efbec0ffd70 2024-05-08T23:14:03.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.144+0000 7efbf3c70700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbec19ea50 con 0x7efbec100f60 2024-05-08T23:14:03.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.144+0000 7efbf3c70700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbec19ec10 con 0x7efbec101900 2024-05-08T23:14:03.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.144+0000 7efbf1a0c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbec0ffd70 0x7efbec069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:03.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.144+0000 7efbf1a0c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbec0ffd70 0x7efbec069d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51176/0 (socket says 172.21.15.135:51176) 2024-05-08T23:14:03.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.144+0000 7efbf1a0c700 1 -- 172.21.15.135:0/4066340579 learned_addr learned my addr 172.21.15.135:0/4066340579 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:03.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.144+0000 7efbf120b700 1 --2- 172.21.15.135:0/4066340579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbec100f60 0x7efbec19bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:03.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.144+0000 7efbf220d700 1 --2- 172.21.15.135:0/4066340579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbec101900 0x7efbec19e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:03.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.145+0000 7efbf1a0c700 1 -- 172.21.15.135:0/4066340579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbec101900 msgr2=0x7efbec19e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:03.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.145+0000 7efbf1a0c700 1 --2- 172.21.15.135:0/4066340579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbec101900 0x7efbec19e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:03.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.145+0000 7efbf1a0c700 1 -- 172.21.15.135:0/4066340579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbec100f60 msgr2=0x7efbec19bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:03.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.145+0000 7efbf1a0c700 1 --2- 172.21.15.135:0/4066340579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbec100f60 0x7efbec19bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:03.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.145+0000 7efbf1a0c700 1 -- 172.21.15.135:0/4066340579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe80095f0 con 0x7efbec0ffd70 2024-05-08T23:14:03.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.145+0000 7efbf1a0c700 1 --2- 172.21.15.135:0/4066340579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbec0ffd70 0x7efbec069d70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efbdc00d980 tx=0x7efbdc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:03.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.145+0000 7efbe2ffd700 1 -- 172.21.15.135:0/4066340579 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbdc004020 con 0x7efbec0ffd70 2024-05-08T23:14:03.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.145+0000 7efbe2ffd700 1 -- 172.21.15.135:0/4066340579 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efbdc00f690 con 0x7efbec0ffd70 2024-05-08T23:14:03.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.145+0000 7efbf3c70700 1 -- 172.21.15.135:0/4066340579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbec19eef0 con 0x7efbec0ffd70 2024-05-08T23:14:03.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.145+0000 7efbe2ffd700 1 -- 172.21.15.135:0/4066340579 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbdc003a60 con 0x7efbec0ffd70 2024-05-08T23:14:03.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.145+0000 7efbf3c70700 1 -- 172.21.15.135:0/4066340579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbec19f2c0 con 0x7efbec0ffd70 2024-05-08T23:14:03.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.146+0000 7efbf3c70700 1 -- 172.21.15.135:0/4066340579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbec0673f0 con 0x7efbec0ffd70 2024-05-08T23:14:03.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.147+0000 7efbe2ffd700 1 -- 172.21.15.135:0/4066340579 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7efbdc00fb00 con 0x7efbec0ffd70 2024-05-08T23:14:03.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.147+0000 7efbe2ffd700 1 --2- 172.21.15.135:0/4066340579 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7efbd80a1120 0x7efbd80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:03.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.148+0000 7efbe2ffd700 1 -- 172.21.15.135:0/4066340579 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7efbdc0cc210 con 0x7efbec0ffd70 2024-05-08T23:14:03.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.148+0000 7efbf120b700 1 --2- 172.21.15.135:0/4066340579 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7efbd80a1120 0x7efbd80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:03.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.148+0000 7efbf120b700 1 --2- 172.21.15.135:0/4066340579 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7efbd80a1120 0x7efbd80a35e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efbe8003730 tx=0x7efbe800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:03.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.151+0000 7efbe2ffd700 1 -- 172.21.15.135:0/4066340579 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efbdc095e20 con 0x7efbec0ffd70 2024-05-08T23:14:03.323 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:03 smithi179 ceph-mon[46314]: Deploying daemon mds.e on smithi179 2024-05-08T23:14:03.324 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:03 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.135:6836/2432614311,v1:172.21.15.135:6837/2432614311] up:boot 2024-05-08T23:14:03.324 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:03 smithi179 ceph-mon[46314]: fsmap 4 up:standby 2024-05-08T23:14:03.324 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:03 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T23:14:03.324 INFO:journalctl@ceph.mds.e.smithi179.stdout:May 08 23:14:03 smithi179 systemd[1]: Starting Ceph mds.e for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:14:03.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:03 smithi195 ceph-mon[46516]: Deploying daemon mds.e on smithi179 2024-05-08T23:14:03.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:03 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.135:6836/2432614311,v1:172.21.15.135:6837/2432614311] up:boot 2024-05-08T23:14:03.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:03 smithi195 ceph-mon[46516]: fsmap 4 up:standby 2024-05-08T23:14:03.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:03 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T23:14:03.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.394+0000 7efbf3c70700 1 -- 172.21.15.135:0/4066340579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efbec107210 con 0x7efbec0ffd70 2024-05-08T23:14:03.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.394+0000 7efbe2ffd700 1 -- 172.21.15.135:0/4066340579 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3540 (secure 0 0 0) 0x7efbdc017df0 con 0x7efbec0ffd70 2024-05-08T23:14:03.395 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:03.395 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2432614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2432614311},{"type":"v1","addr":"172.21.15.135:6837","nonce":2432614311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-05-08T23:14:03.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.396+0000 7efbf3c70700 1 -- 172.21.15.135:0/4066340579 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7efbd80a1120 msgr2=0x7efbd80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:03.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.396+0000 7efbf3c70700 1 --2- 172.21.15.135:0/4066340579 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7efbd80a1120 0x7efbd80a35e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efbe8003730 tx=0x7efbe800b540 comp rx=0 tx=0).stop 2024-05-08T23:14:03.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.396+0000 7efbf3c70700 1 -- 172.21.15.135:0/4066340579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbec0ffd70 msgr2=0x7efbec069d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:03.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.396+0000 7efbf3c70700 1 --2- 172.21.15.135:0/4066340579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbec0ffd70 0x7efbec069d70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efbdc00d980 tx=0x7efbdc00dc90 comp rx=0 tx=0).stop 2024-05-08T23:14:03.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.397+0000 7efbf3c70700 1 -- 172.21.15.135:0/4066340579 shutdown_connections 2024-05-08T23:14:03.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.397+0000 7efbf3c70700 1 --2- 172.21.15.135:0/4066340579 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7efbd80a1120 0x7efbd80a35e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:03.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.397+0000 7efbf3c70700 1 --2- 172.21.15.135:0/4066340579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbec101900 0x7efbec19e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:03.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.397+0000 7efbf3c70700 1 --2- 172.21.15.135:0/4066340579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbec0ffd70 0x7efbec069d70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:03.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.397+0000 7efbf3c70700 1 --2- 172.21.15.135:0/4066340579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbec100f60 0x7efbec19bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:03.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.397+0000 7efbf3c70700 1 -- 172.21.15.135:0/4066340579 >> 172.21.15.135:0/4066340579 conn(0x7efbec0fb2e0 msgr2=0x7efbec104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:03.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.397+0000 7efbf3c70700 1 -- 172.21.15.135:0/4066340579 shutdown_connections 2024-05-08T23:14:03.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:03.397+0000 7efbf3c70700 1 -- 172.21.15.135:0/4066340579 wait complete. 2024-05-08T23:14:03.398 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 5 2024-05-08T23:14:03.408 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:03 smithi135 ceph-mon[42440]: Deploying daemon mds.e on smithi179 2024-05-08T23:14:03.408 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:03 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.135:6836/2432614311,v1:172.21.15.135:6837/2432614311] up:boot 2024-05-08T23:14:03.408 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:03 smithi135 ceph-mon[42440]: fsmap 4 up:standby 2024-05-08T23:14:03.408 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:03 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T23:14:03.849 INFO:journalctl@ceph.mds.e.smithi179.stdout:May 08 23:14:03 smithi179 ceph-mds[82564]: -- 172.21.15.179:0/1091660804 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d479dd81a0 con 0x55d479dae800 2024-05-08T23:14:03.850 INFO:journalctl@ceph.mds.e.smithi179.stdout:May 08 23:14:03 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-e[82541]: starting mds.e at 2024-05-08T23:14:03.850 INFO:journalctl@ceph.mds.e.smithi179.stdout:May 08 23:14:03 smithi179 bash[82526]: 8da23a755cd3780da5caabd2b6ac1f315c3dcd08b8daba37129c8dce7df9aafa 2024-05-08T23:14:03.850 INFO:journalctl@ceph.mds.e.smithi179.stdout:May 08 23:14:03 smithi179 systemd[1]: Started Ceph mds.e for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:14:04.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:04 smithi179 ceph-mon[46314]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:04.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:04 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/4066340579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:04.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:04 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:04.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:04 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:04.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:04 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:04.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:04 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:04.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:04 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:04.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:04 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:04.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:04 smithi195 ceph-mon[46516]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:04.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:04 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/4066340579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:04.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:04.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:04.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:04.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:04.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:04.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:04 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:04.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:04 smithi135 ceph-mon[42440]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:04.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:04 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/4066340579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:04.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:04.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:04.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:04.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:04.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:04.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:04 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:05.176 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:05 smithi195 ceph-mon[46516]: Deploying daemon mds.f on smithi195 2024-05-08T23:14:05.176 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:05 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.179:6834/1024532,v1:172.21.15.179:6835/1024532] up:boot 2024-05-08T23:14:05.176 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:05 smithi195 ceph-mon[46516]: fsmap 5 up:standby 2024-05-08T23:14:05.176 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:05 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T23:14:05.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:05 smithi179 ceph-mon[46314]: Deploying daemon mds.f on smithi195 2024-05-08T23:14:05.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:05 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.179:6834/1024532,v1:172.21.15.179:6835/1024532] up:boot 2024-05-08T23:14:05.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:05 smithi179 ceph-mon[46314]: fsmap 5 up:standby 2024-05-08T23:14:05.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:05 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T23:14:05.410 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:14:05.438 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:05 smithi135 ceph-mon[42440]: Deploying daemon mds.f on smithi195 2024-05-08T23:14:05.438 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:05 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.179:6834/1024532,v1:172.21.15.179:6835/1024532] up:boot 2024-05-08T23:14:05.438 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:05 smithi135 ceph-mon[42440]: fsmap 5 up:standby 2024-05-08T23:14:05.438 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:05 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T23:14:05.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.541+0000 7fa22014c700 1 -- 172.21.15.135:0/2369006118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2180ff6e0 msgr2=0x7fa218101b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:05.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.541+0000 7fa22014c700 1 --2- 172.21.15.135:0/2369006118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2180ff6e0 0x7fa218101b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa214009990 tx=0x7fa214009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:05.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.541+0000 7fa22014c700 1 -- 172.21.15.135:0/2369006118 shutdown_connections 2024-05-08T23:14:05.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.541+0000 7fa22014c700 1 --2- 172.21.15.135:0/2369006118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa218104a20 0x7fa218104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:05.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.541+0000 7fa22014c700 1 --2- 172.21.15.135:0/2369006118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2180ff6e0 0x7fa218101b10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:05.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.541+0000 7fa22014c700 1 --2- 172.21.15.135:0/2369006118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa218102050 0x7fa2181044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:05.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.541+0000 7fa22014c700 1 -- 172.21.15.135:0/2369006118 >> 172.21.15.135:0/2369006118 conn(0x7fa2180fb2e0 msgr2=0x7fa2180fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:05.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.541+0000 7fa22014c700 1 -- 172.21.15.135:0/2369006118 shutdown_connections 2024-05-08T23:14:05.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.541+0000 7fa22014c700 1 -- 172.21.15.135:0/2369006118 wait complete. 2024-05-08T23:14:05.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.541+0000 7fa22014c700 1 Processor -- start 2024-05-08T23:14:05.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa22014c700 1 -- start start 2024-05-08T23:14:05.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa22014c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2180ff6e0 0x7fa21819d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:05.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa22014c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa218102050 0x7fa21819d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:05.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa22014c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa218104a20 0x7fa2181a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:05.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa22014c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2181a4f50 con 0x7fa218102050 2024-05-08T23:14:05.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa22014c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2181a5090 con 0x7fa218104a20 2024-05-08T23:14:05.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa22014c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2181a5220 con 0x7fa2180ff6e0 2024-05-08T23:14:05.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa21d6e7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa218102050 0x7fa21819d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:05.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa21d6e7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa218102050 0x7fa21819d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51194/0 (socket says 172.21.15.135:51194) 2024-05-08T23:14:05.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa21d6e7700 1 -- 172.21.15.135:0/3354765156 learned_addr learned my addr 172.21.15.135:0/3354765156 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:05.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa21dee8700 1 --2- 172.21.15.135:0/3354765156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2180ff6e0 0x7fa21819d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:05.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa21e6e9700 1 --2- 172.21.15.135:0/3354765156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa218104a20 0x7fa2181a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:05.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa21d6e7700 1 -- 172.21.15.135:0/3354765156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2180ff6e0 msgr2=0x7fa21819d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:05.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa21d6e7700 1 --2- 172.21.15.135:0/3354765156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2180ff6e0 0x7fa21819d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:05.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa21d6e7700 1 -- 172.21.15.135:0/3354765156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa218104a20 msgr2=0x7fa2181a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:05.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa21d6e7700 1 --2- 172.21.15.135:0/3354765156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa218104a20 0x7fa2181a4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:05.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa21d6e7700 1 -- 172.21.15.135:0/3354765156 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2140095f0 con 0x7fa218102050 2024-05-08T23:14:05.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa21d6e7700 1 --2- 172.21.15.135:0/3354765156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa218102050 0x7fa21819d960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa20800e9a0 tx=0x7fa20800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:05.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa20effd700 1 -- 172.21.15.135:0/3354765156 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa208009790 con 0x7fa218102050 2024-05-08T23:14:05.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa20effd700 1 -- 172.21.15.135:0/3354765156 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa208010430 con 0x7fa218102050 2024-05-08T23:14:05.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa22014c700 1 -- 172.21.15.135:0/3354765156 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2181a5500 con 0x7fa218102050 2024-05-08T23:14:05.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa20effd700 1 -- 172.21.15.135:0/3354765156 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa208018680 con 0x7fa218102050 2024-05-08T23:14:05.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.542+0000 7fa22014c700 1 -- 172.21.15.135:0/3354765156 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2181a5a10 con 0x7fa218102050 2024-05-08T23:14:05.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.543+0000 7fa22014c700 1 -- 172.21.15.135:0/3354765156 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2180fce60 con 0x7fa218102050 2024-05-08T23:14:05.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.544+0000 7fa20effd700 1 -- 172.21.15.135:0/3354765156 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fa2080105a0 con 0x7fa218102050 2024-05-08T23:14:05.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.545+0000 7fa20effd700 1 --2- 172.21.15.135:0/3354765156 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa2040a1120 0x7fa2040a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:05.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.545+0000 7fa21dee8700 1 --2- 172.21.15.135:0/3354765156 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa2040a1120 0x7fa2040a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:05.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.545+0000 7fa20effd700 1 -- 172.21.15.135:0/3354765156 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa208014070 con 0x7fa218102050 2024-05-08T23:14:05.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.545+0000 7fa21dee8700 1 --2- 172.21.15.135:0/3354765156 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa2040a1120 0x7fa2040a35e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa21400b2e0 tx=0x7fa214005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:05.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.549+0000 7fa20effd700 1 -- 172.21.15.135:0/3354765156 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa208052d60 con 0x7fa218102050 2024-05-08T23:14:05.630 INFO:journalctl@ceph.mds.f.smithi195.stdout:May 08 23:14:05 smithi195 bash[83908]: 5a89a31f32166ea705efee45b13725fda08106c7315bf1922d6136f912905d62 2024-05-08T23:14:05.630 INFO:journalctl@ceph.mds.f.smithi195.stdout:May 08 23:14:05 smithi195 systemd[1]: Started Ceph mds.f for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:14:05.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.798+0000 7fa22014c700 1 -- 172.21.15.135:0/3354765156 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa218067380 con 0x7fa218102050 2024-05-08T23:14:05.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.799+0000 7fa20effd700 1 -- 172.21.15.135:0/3354765156 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4291 (secure 0 0 0) 0x7fa208096230 con 0x7fa218102050 2024-05-08T23:14:05.799 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:05.799 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2432614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2432614311},{"type":"v1","addr":"172.21.15.135:6837","nonce":2432614311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1024532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1024532},{"type":"v1","addr":"172.21.15.179:6835","nonce":1024532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2024-05-08T23:14:05.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.801+0000 7fa22014c700 1 -- 172.21.15.135:0/3354765156 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa2040a1120 msgr2=0x7fa2040a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:05.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.801+0000 7fa22014c700 1 --2- 172.21.15.135:0/3354765156 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa2040a1120 0x7fa2040a35e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa21400b2e0 tx=0x7fa214005fb0 comp rx=0 tx=0).stop 2024-05-08T23:14:05.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.801+0000 7fa22014c700 1 -- 172.21.15.135:0/3354765156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa218102050 msgr2=0x7fa21819d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:05.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.801+0000 7fa22014c700 1 --2- 172.21.15.135:0/3354765156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa218102050 0x7fa21819d960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa20800e9a0 tx=0x7fa20800ecb0 comp rx=0 tx=0).stop 2024-05-08T23:14:05.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.801+0000 7fa22014c700 1 -- 172.21.15.135:0/3354765156 shutdown_connections 2024-05-08T23:14:05.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.801+0000 7fa22014c700 1 --2- 172.21.15.135:0/3354765156 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa2040a1120 0x7fa2040a35e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:05.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.801+0000 7fa22014c700 1 --2- 172.21.15.135:0/3354765156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2180ff6e0 0x7fa21819d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:05.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.801+0000 7fa22014c700 1 --2- 172.21.15.135:0/3354765156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa218104a20 0x7fa2181a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:05.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.801+0000 7fa22014c700 1 --2- 172.21.15.135:0/3354765156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa218102050 0x7fa21819d960 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:05.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.801+0000 7fa22014c700 1 -- 172.21.15.135:0/3354765156 >> 172.21.15.135:0/3354765156 conn(0x7fa2180fb2e0 msgr2=0x7fa218102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:05.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.801+0000 7fa22014c700 1 -- 172.21.15.135:0/3354765156 shutdown_connections 2024-05-08T23:14:05.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:05.801+0000 7fa22014c700 1 -- 172.21.15.135:0/3354765156 wait complete. 2024-05-08T23:14:05.802 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 6 2024-05-08T23:14:06.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:06 smithi135 ceph-mon[42440]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:06.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:06 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:06.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:06 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:06.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:06 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:06.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:06 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:06.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:06 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:06.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:06 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:06.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:06 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3354765156' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:06.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:06 smithi179 ceph-mon[46314]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:06.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:06.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:06.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:06.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:06.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:06.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:06 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:06.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:06 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3354765156' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:06.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:06 smithi195 ceph-mon[46516]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:06.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:06 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:06.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:06 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:06.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:06 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:06.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:06 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:06.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:06 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:06.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:06 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:06.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:06 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3354765156' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:07.104 INFO:journalctl@ceph.mds.c.smithi195.stdout:May 08 23:14:07 smithi195 systemd[1]: Starting Ceph mds.c for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:14:07.104 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:07 smithi195 ceph-mon[46516]: Deploying daemon mds.c on smithi195 2024-05-08T23:14:07.104 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:07 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.195:6834/4199708510,v1:172.21.15.195:6835/4199708510] up:boot 2024-05-08T23:14:07.104 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:07 smithi195 ceph-mon[46516]: fsmap 6 up:standby 2024-05-08T23:14:07.104 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:07 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T23:14:07.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:07 smithi179 ceph-mon[46314]: Deploying daemon mds.c on smithi195 2024-05-08T23:14:07.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:07 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.195:6834/4199708510,v1:172.21.15.195:6835/4199708510] up:boot 2024-05-08T23:14:07.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:07 smithi179 ceph-mon[46314]: fsmap 6 up:standby 2024-05-08T23:14:07.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:07 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T23:14:07.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:07 smithi135 ceph-mon[42440]: Deploying daemon mds.c on smithi195 2024-05-08T23:14:07.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:07 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.195:6834/4199708510,v1:172.21.15.195:6835/4199708510] up:boot 2024-05-08T23:14:07.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:07 smithi135 ceph-mon[42440]: fsmap 6 up:standby 2024-05-08T23:14:07.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:07 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T23:14:07.814 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:14:07.880 INFO:journalctl@ceph.mds.c.smithi195.stdout:May 08 23:14:07 smithi195 ceph-mds[84289]: -- 172.21.15.195:0/2382892176 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561d6ca161a0 con 0x561d6c9ec800 2024-05-08T23:14:07.880 INFO:journalctl@ceph.mds.c.smithi195.stdout:May 08 23:14:07 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-c[84266]: starting mds.c at 2024-05-08T23:14:07.881 INFO:journalctl@ceph.mds.c.smithi195.stdout:May 08 23:14:07 smithi195 bash[84251]: 9e7c1086bc57a3b8ef874f7d92fdd5d80f8d68422a2565341c0462f5b112827b 2024-05-08T23:14:07.881 INFO:journalctl@ceph.mds.c.smithi195.stdout:May 08 23:14:07 smithi195 systemd[1]: Started Ceph mds.c for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:14:07.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.949+0000 7fb537963700 1 -- 172.21.15.135:0/2787084980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb530100f50 msgr2=0x7fb5301013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:07.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.949+0000 7fb537963700 1 --2- 172.21.15.135:0/2787084980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb530100f50 0x7fb5301013b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb5200099c0 tx=0x7fb520009cd0 comp rx=0 tx=0).stop 2024-05-08T23:14:07.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.949+0000 7fb537963700 1 -- 172.21.15.135:0/2787084980 shutdown_connections 2024-05-08T23:14:07.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.949+0000 7fb537963700 1 --2- 172.21.15.135:0/2787084980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5301018f0 0x7fb5301081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:07.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.949+0000 7fb537963700 1 --2- 172.21.15.135:0/2787084980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5300ffd60 0x7fb530100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:07.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.949+0000 7fb537963700 1 --2- 172.21.15.135:0/2787084980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb530100f50 0x7fb5301013b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:07.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.949+0000 7fb537963700 1 -- 172.21.15.135:0/2787084980 >> 172.21.15.135:0/2787084980 conn(0x7fb5300fb2f0 msgr2=0x7fb5300fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:07.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.949+0000 7fb537963700 1 -- 172.21.15.135:0/2787084980 shutdown_connections 2024-05-08T23:14:07.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.949+0000 7fb537963700 1 -- 172.21.15.135:0/2787084980 wait complete. 2024-05-08T23:14:07.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb537963700 1 Processor -- start 2024-05-08T23:14:07.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb537963700 1 -- start start 2024-05-08T23:14:07.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb537963700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5300ffd60 0x7fb530195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:07.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb537963700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb530100f50 0x7fb5301961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:07.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb537963700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5301018f0 0x7fb53019d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:07.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb537963700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53019d7a0 con 0x7fb5300ffd60 2024-05-08T23:14:07.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb537963700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53019d910 con 0x7fb5301018f0 2024-05-08T23:14:07.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb537963700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53019dad0 con 0x7fb530100f50 2024-05-08T23:14:07.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb5356ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5300ffd60 0x7fb530195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:07.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb5356ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5300ffd60 0x7fb530195cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51220/0 (socket says 172.21.15.135:51220) 2024-05-08T23:14:07.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb5356ff700 1 -- 172.21.15.135:0/1689268830 learned_addr learned my addr 172.21.15.135:0/1689268830 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:07.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb534efe700 1 --2- 172.21.15.135:0/1689268830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb530100f50 0x7fb5301961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:07.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb535f00700 1 --2- 172.21.15.135:0/1689268830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5301018f0 0x7fb53019d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:07.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb5356ff700 1 -- 172.21.15.135:0/1689268830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb530100f50 msgr2=0x7fb5301961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:07.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb5356ff700 1 --2- 172.21.15.135:0/1689268830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb530100f50 0x7fb5301961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:07.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb5356ff700 1 -- 172.21.15.135:0/1689268830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5301018f0 msgr2=0x7fb53019d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:07.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb5356ff700 1 --2- 172.21.15.135:0/1689268830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5301018f0 0x7fb53019d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:07.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb5356ff700 1 -- 172.21.15.135:0/1689268830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5200095f0 con 0x7fb5300ffd60 2024-05-08T23:14:07.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.950+0000 7fb535f00700 1 --2- 172.21.15.135:0/1689268830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5301018f0 0x7fb53019d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:14:07.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.951+0000 7fb5356ff700 1 --2- 172.21.15.135:0/1689268830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5300ffd60 0x7fb530195cb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb52c007ee0 tx=0x7fb52c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:07.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.951+0000 7fb5267fc700 1 -- 172.21.15.135:0/1689268830 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c00ddd0 con 0x7fb5300ffd60 2024-05-08T23:14:07.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.951+0000 7fb5267fc700 1 -- 172.21.15.135:0/1689268830 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb52c00f040 con 0x7fb5300ffd60 2024-05-08T23:14:07.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.951+0000 7fb537963700 1 -- 172.21.15.135:0/1689268830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53019ddb0 con 0x7fb5300ffd60 2024-05-08T23:14:07.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.951+0000 7fb5267fc700 1 -- 172.21.15.135:0/1689268830 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c014690 con 0x7fb5300ffd60 2024-05-08T23:14:07.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.951+0000 7fb537963700 1 -- 172.21.15.135:0/1689268830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53019e200 con 0x7fb5300ffd60 2024-05-08T23:14:07.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.952+0000 7fb537963700 1 -- 172.21.15.135:0/1689268830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5301071e0 con 0x7fb5300ffd60 2024-05-08T23:14:07.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.953+0000 7fb5267fc700 1 -- 172.21.15.135:0/1689268830 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fb52c0159c0 con 0x7fb5300ffd60 2024-05-08T23:14:07.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.953+0000 7fb5267fc700 1 --2- 172.21.15.135:0/1689268830 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb51c0a1120 0x7fb51c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:07.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.953+0000 7fb534efe700 1 --2- 172.21.15.135:0/1689268830 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb51c0a1120 0x7fb51c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:07.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.953+0000 7fb5267fc700 1 -- 172.21.15.135:0/1689268830 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb52c0cc430 con 0x7fb5300ffd60 2024-05-08T23:14:07.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.954+0000 7fb534efe700 1 --2- 172.21.15.135:0/1689268830 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb51c0a1120 0x7fb51c0a35e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb520009990 tx=0x7fb520000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:07.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:07.957+0000 7fb5267fc700 1 -- 172.21.15.135:0/1689268830 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb52c096060 con 0x7fb5300ffd60 2024-05-08T23:14:08.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:08.202+0000 7fb537963700 1 -- 172.21.15.135:0/1689268830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb530067c10 con 0x7fb5300ffd60 2024-05-08T23:14:08.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:08 smithi135 ceph-mon[42440]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:08.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:08.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:08.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:08.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:08.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:08.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:08 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:08.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:08.203+0000 7fb5267fc700 1 -- 172.21.15.135:0/1689268830 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5811 (secure 0 0 0) 0x7fb52c099680 con 0x7fb5300ffd60 2024-05-08T23:14:08.204 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:08.204 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2432614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2432614311},{"type":"v1","addr":"172.21.15.135:6837","nonce":2432614311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1024532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1024532},{"type":"v1","addr":"172.21.15.179:6835","nonce":1024532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/4199708510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":4199708510},{"type":"v1","addr":"172.21.15.195:6835","nonce":4199708510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/2390721751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2390721751},{"type":"v1","addr":"172.21.15.195:6837","nonce":2390721751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-05-08T23:14:08.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:08.205+0000 7fb537963700 1 -- 172.21.15.135:0/1689268830 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb51c0a1120 msgr2=0x7fb51c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:08.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:08.205+0000 7fb537963700 1 --2- 172.21.15.135:0/1689268830 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb51c0a1120 0x7fb51c0a35e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb520009990 tx=0x7fb520000bc0 comp rx=0 tx=0).stop 2024-05-08T23:14:08.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:08.205+0000 7fb537963700 1 -- 172.21.15.135:0/1689268830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5300ffd60 msgr2=0x7fb530195cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:08.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:08.205+0000 7fb537963700 1 --2- 172.21.15.135:0/1689268830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5300ffd60 0x7fb530195cb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb52c007ee0 tx=0x7fb52c00d3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:08.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:08.205+0000 7fb537963700 1 -- 172.21.15.135:0/1689268830 shutdown_connections 2024-05-08T23:14:08.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:08.205+0000 7fb537963700 1 --2- 172.21.15.135:0/1689268830 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb51c0a1120 0x7fb51c0a35e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:08.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:08.205+0000 7fb537963700 1 --2- 172.21.15.135:0/1689268830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5301018f0 0x7fb53019d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:08.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:08.205+0000 7fb537963700 1 --2- 172.21.15.135:0/1689268830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5300ffd60 0x7fb530195cb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:08.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:08.205+0000 7fb537963700 1 --2- 172.21.15.135:0/1689268830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb530100f50 0x7fb5301961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:08.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:08.205+0000 7fb537963700 1 -- 172.21.15.135:0/1689268830 >> 172.21.15.135:0/1689268830 conn(0x7fb5300fb2f0 msgr2=0x7fb530104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:08.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:08.205+0000 7fb537963700 1 -- 172.21.15.135:0/1689268830 shutdown_connections 2024-05-08T23:14:08.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:08.205+0000 7fb537963700 1 -- 172.21.15.135:0/1689268830 wait complete. 2024-05-08T23:14:08.207 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 8 2024-05-08T23:14:08.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:08 smithi179 ceph-mon[46314]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:08.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:08.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:08.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:08.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:08.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:08.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:08 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:08.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:08 smithi195 ceph-mon[46516]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:08.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:08.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:08.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:08.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:08.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:08.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:08 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:08.932 INFO:journalctl@ceph.mds.h.smithi179.stdout:May 08 23:14:08 smithi179 systemd[1]: Starting Ceph mds.h for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:14:09.190 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:09 smithi179 ceph-mon[46314]: Deploying daemon mds.h on smithi179 2024-05-08T23:14:09.190 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:09 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] up:boot 2024-05-08T23:14:09.190 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:09 smithi179 ceph-mon[46314]: fsmap 7 up:standby 2024-05-08T23:14:09.190 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:09 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T23:14:09.190 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:09 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1689268830' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:09.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:09 smithi195 ceph-mon[46516]: Deploying daemon mds.h on smithi179 2024-05-08T23:14:09.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:09 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] up:boot 2024-05-08T23:14:09.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:09 smithi195 ceph-mon[46516]: fsmap 7 up:standby 2024-05-08T23:14:09.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:09 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T23:14:09.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:09 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1689268830' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:09.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:09 smithi135 ceph-mon[42440]: Deploying daemon mds.h on smithi179 2024-05-08T23:14:09.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:09 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] up:boot 2024-05-08T23:14:09.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:09 smithi135 ceph-mon[42440]: fsmap 7 up:standby 2024-05-08T23:14:09.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:09 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T23:14:09.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:09 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1689268830' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:09.599 INFO:journalctl@ceph.mds.h.smithi179.stdout:May 08 23:14:09 smithi179 ceph-mds[82908]: -- 172.21.15.179:0/193808552 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c0178a01a0 con 0x55c017877000 2024-05-08T23:14:09.599 INFO:journalctl@ceph.mds.h.smithi179.stdout:May 08 23:14:09 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-h[82885]: starting mds.h at 2024-05-08T23:14:09.600 INFO:journalctl@ceph.mds.h.smithi179.stdout:May 08 23:14:09 smithi179 bash[82870]: e24105bf00de083a3a4a076c610e822997458c73bfe649e6b3836ba3883d40b6 2024-05-08T23:14:09.600 INFO:journalctl@ceph.mds.h.smithi179.stdout:May 08 23:14:09 smithi179 systemd[1]: Started Ceph mds.h for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:14:10.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:10 smithi195 ceph-mon[46516]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:10.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:10 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:10.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:10 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:10.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:10 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:10.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:10 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:10.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:10 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:10.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:10 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:10.218 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:14:10.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:10 smithi179 ceph-mon[46314]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:10.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:10 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:10.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:10 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:10.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:10 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:10.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:10 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:10.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:10 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:10.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:10 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:10.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.353+0000 7fdb7306f700 1 -- 172.21.15.135:0/165279520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb6c1012f0 msgr2=0x7fdb6c101710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:10.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.353+0000 7fdb7306f700 1 --2- 172.21.15.135:0/165279520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb6c1012f0 0x7fdb6c101710 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009990 tx=0x7fdb60009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:10.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.353+0000 7fdb7306f700 1 -- 172.21.15.135:0/165279520 shutdown_connections 2024-05-08T23:14:10.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.353+0000 7fdb7306f700 1 --2- 172.21.15.135:0/165279520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb6c1009c0 0x7fdb6c108280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:10.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.353+0000 7fdb7306f700 1 --2- 172.21.15.135:0/165279520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb6c1012f0 0x7fdb6c101710 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:10.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.353+0000 7fdb7306f700 1 --2- 172.21.15.135:0/165279520 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c100020 0x7fdb6c100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:10.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.353+0000 7fdb7306f700 1 -- 172.21.15.135:0/165279520 >> 172.21.15.135:0/165279520 conn(0x7fdb6c0faa70 msgr2=0x7fdb6c0fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:10.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.353+0000 7fdb7306f700 1 -- 172.21.15.135:0/165279520 shutdown_connections 2024-05-08T23:14:10.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.353+0000 7fdb7306f700 1 -- 172.21.15.135:0/165279520 wait complete. 2024-05-08T23:14:10.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.353+0000 7fdb7306f700 1 Processor -- start 2024-05-08T23:14:10.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb7306f700 1 -- start start 2024-05-08T23:14:10.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb7306f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c100020 0x7fdb6c196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:10.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb7306f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb6c1009c0 0x7fdb6c197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:10.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb7306f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb6c1012f0 0x7fdb6c19e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:10.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb7306f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c19e980 con 0x7fdb6c1009c0 2024-05-08T23:14:10.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb7306f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c19eac0 con 0x7fdb6c1012f0 2024-05-08T23:14:10.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb7306f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c19ec50 con 0x7fdb6c100020 2024-05-08T23:14:10.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb6bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb6c1009c0 0x7fdb6c197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:10.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb6bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb6c1009c0 0x7fdb6c197390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34284/0 (socket says 172.21.15.135:34284) 2024-05-08T23:14:10.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb6bfff700 1 -- 172.21.15.135:0/2494071492 learned_addr learned my addr 172.21.15.135:0/2494071492 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:10.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb70e0b700 1 --2- 172.21.15.135:0/2494071492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c100020 0x7fdb6c196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:10.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb6bfff700 1 -- 172.21.15.135:0/2494071492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c100020 msgr2=0x7fdb6c196e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:10.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb6bfff700 1 --2- 172.21.15.135:0/2494071492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c100020 0x7fdb6c196e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:10.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb6bfff700 1 -- 172.21.15.135:0/2494071492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb6c1012f0 msgr2=0x7fdb6c19e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:10.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb6bfff700 1 --2- 172.21.15.135:0/2494071492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb6c1012f0 0x7fdb6c19e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:10.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb6bfff700 1 -- 172.21.15.135:0/2494071492 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb600095f0 con 0x7fdb6c1009c0 2024-05-08T23:14:10.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb70e0b700 1 --2- 172.21.15.135:0/2494071492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c100020 0x7fdb6c196e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:14:10.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb6bfff700 1 --2- 172.21.15.135:0/2494071492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb6c1009c0 0x7fdb6c197390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800e9a0 tx=0x7fdb5800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:10.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb69ffb700 1 -- 172.21.15.135:0/2494071492 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb58009790 con 0x7fdb6c1009c0 2024-05-08T23:14:10.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb69ffb700 1 -- 172.21.15.135:0/2494071492 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb5800cb50 con 0x7fdb6c1009c0 2024-05-08T23:14:10.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb7306f700 1 -- 172.21.15.135:0/2494071492 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6c19ef30 con 0x7fdb6c1009c0 2024-05-08T23:14:10.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.354+0000 7fdb69ffb700 1 -- 172.21.15.135:0/2494071492 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb58018680 con 0x7fdb6c1009c0 2024-05-08T23:14:10.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.355+0000 7fdb7306f700 1 -- 172.21.15.135:0/2494071492 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c19f400 con 0x7fdb6c1009c0 2024-05-08T23:14:10.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.356+0000 7fdb7306f700 1 -- 172.21.15.135:0/2494071492 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c067380 con 0x7fdb6c1009c0 2024-05-08T23:14:10.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.357+0000 7fdb69ffb700 1 -- 172.21.15.135:0/2494071492 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fdb5800ccc0 con 0x7fdb6c1009c0 2024-05-08T23:14:10.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.357+0000 7fdb69ffb700 1 --2- 172.21.15.135:0/2494071492 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdb5c0a11a0 0x7fdb5c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:10.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.358+0000 7fdb70e0b700 1 --2- 172.21.15.135:0/2494071492 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdb5c0a11a0 0x7fdb5c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:10.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.358+0000 7fdb69ffb700 1 -- 172.21.15.135:0/2494071492 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdb58014070 con 0x7fdb6c1009c0 2024-05-08T23:14:10.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.358+0000 7fdb70e0b700 1 --2- 172.21.15.135:0/2494071492 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdb5c0a11a0 0x7fdb5c0a3660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000b7b0 tx=0x7fdb60005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:10.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.361+0000 7fdb69ffb700 1 -- 172.21.15.135:0/2494071492 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fdb58096460 con 0x7fdb6c1009c0 2024-05-08T23:14:10.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:10 smithi135 ceph-mon[42440]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:10.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:10 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:10.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:10 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:10.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:10 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:10.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:10 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:10.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:10 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:10.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:10 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:10.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.605+0000 7fdb7306f700 1 -- 172.21.15.135:0/2494071492 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb6c10b7f0 con 0x7fdb6c1009c0 2024-05-08T23:14:10.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.606+0000 7fdb69ffb700 1 -- 172.21.15.135:0/2494071492 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6571 (secure 0 0 0) 0x7fdb58099a80 con 0x7fdb6c1009c0 2024-05-08T23:14:10.606 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:10.606 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2432614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2432614311},{"type":"v1","addr":"172.21.15.135:6837","nonce":2432614311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1024532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1024532},{"type":"v1","addr":"172.21.15.179:6835","nonce":1024532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2957410160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2957410160},{"type":"v1","addr":"172.21.15.179:6837","nonce":2957410160}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/4199708510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":4199708510},{"type":"v1","addr":"172.21.15.195:6835","nonce":4199708510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/2390721751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2390721751},{"type":"v1","addr":"172.21.15.195:6837","nonce":2390721751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-05-08T23:14:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.608+0000 7fdb7306f700 1 -- 172.21.15.135:0/2494071492 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdb5c0a11a0 msgr2=0x7fdb5c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.608+0000 7fdb7306f700 1 --2- 172.21.15.135:0/2494071492 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdb5c0a11a0 0x7fdb5c0a3660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000b7b0 tx=0x7fdb60005fb0 comp rx=0 tx=0).stop 2024-05-08T23:14:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.608+0000 7fdb7306f700 1 -- 172.21.15.135:0/2494071492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb6c1009c0 msgr2=0x7fdb6c197390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.608+0000 7fdb7306f700 1 --2- 172.21.15.135:0/2494071492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb6c1009c0 0x7fdb6c197390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800e9a0 tx=0x7fdb5800ed60 comp rx=0 tx=0).stop 2024-05-08T23:14:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.608+0000 7fdb7306f700 1 -- 172.21.15.135:0/2494071492 shutdown_connections 2024-05-08T23:14:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.608+0000 7fdb7306f700 1 --2- 172.21.15.135:0/2494071492 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdb5c0a11a0 0x7fdb5c0a3660 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.608+0000 7fdb7306f700 1 --2- 172.21.15.135:0/2494071492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb6c100020 0x7fdb6c196e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.608+0000 7fdb7306f700 1 --2- 172.21.15.135:0/2494071492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb6c1012f0 0x7fdb6c19e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.608+0000 7fdb7306f700 1 --2- 172.21.15.135:0/2494071492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb6c1009c0 0x7fdb6c197390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.608+0000 7fdb7306f700 1 -- 172.21.15.135:0/2494071492 >> 172.21.15.135:0/2494071492 conn(0x7fdb6c0faa70 msgr2=0x7fdb6c0fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.608+0000 7fdb7306f700 1 -- 172.21.15.135:0/2494071492 shutdown_connections 2024-05-08T23:14:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:10.608+0000 7fdb7306f700 1 -- 172.21.15.135:0/2494071492 wait complete. 2024-05-08T23:14:10.610 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 9 2024-05-08T23:14:10.998 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:14:10 smithi195 systemd[1]: Starting Ceph mds.i for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:14:11.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:11 smithi179 ceph-mon[46314]: Deploying daemon mds.i on smithi195 2024-05-08T23:14:11.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:11 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.179:6836/2957410160,v1:172.21.15.179:6837/2957410160] up:boot 2024-05-08T23:14:11.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:11 smithi179 ceph-mon[46314]: fsmap 8 up:standby 2024-05-08T23:14:11.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:11 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T23:14:11.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:11 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2494071492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:11.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:11 smithi195 ceph-mon[46516]: Deploying daemon mds.i on smithi195 2024-05-08T23:14:11.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:11 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.179:6836/2957410160,v1:172.21.15.179:6837/2957410160] up:boot 2024-05-08T23:14:11.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:11 smithi195 ceph-mon[46516]: fsmap 8 up:standby 2024-05-08T23:14:11.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:11 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T23:14:11.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:11 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2494071492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:11.381 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:14:11 smithi195 ceph-mds[84629]: -- 172.21.15.195:0/1044202529 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fd326e01a0 con 0x55fd326b6c00 2024-05-08T23:14:11.381 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:14:11 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-i[84605]: starting mds.i at 2024-05-08T23:14:11.381 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:14:11 smithi195 bash[84590]: a967ae849d9291bebafd5ec6778b795e94797e6a0225a3e7de7ebbcffb4cace8 2024-05-08T23:14:11.381 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:14:11 smithi195 systemd[1]: Started Ceph mds.i for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:14:11.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:11 smithi135 ceph-mon[42440]: Deploying daemon mds.i on smithi195 2024-05-08T23:14:11.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:11 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.179:6836/2957410160,v1:172.21.15.179:6837/2957410160] up:boot 2024-05-08T23:14:11.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:11 smithi135 ceph-mon[42440]: fsmap 8 up:standby 2024-05-08T23:14:11.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:11 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T23:14:11.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:11 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2494071492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:12.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:12 smithi135 ceph-mon[42440]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:12.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:12.520 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:12.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:12.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:12.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:12.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:12.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:12 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] up:boot 2024-05-08T23:14:12.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:12 smithi135 ceph-mon[42440]: fsmap 9 up:standby 2024-05-08T23:14:12.521 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:12 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T23:14:12.521 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 08 23:14:12 smithi135 systemd[1]: Starting Ceph mds.g for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:14:12.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:12 smithi179 ceph-mon[46314]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:12 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] up:boot 2024-05-08T23:14:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:12 smithi179 ceph-mon[46314]: fsmap 9 up:standby 2024-05-08T23:14:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:12 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T23:14:12.622 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:14:12.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:12 smithi195 ceph-mon[46516]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:12.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:12.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:12.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:12.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:12.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:12.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:12.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:12 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] up:boot 2024-05-08T23:14:12.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:12 smithi195 ceph-mon[46516]: fsmap 9 up:standby 2024-05-08T23:14:12.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:12 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T23:14:12.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.756+0000 7f11ee8f2700 1 -- 172.21.15.135:0/1696638518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e81029a0 msgr2=0x7f11e81092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:12.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.756+0000 7f11ee8f2700 1 --2- 172.21.15.135:0/1696638518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e81029a0 0x7f11e81092c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f11e000b0a0 tx=0x7f11e000b3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:12.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.756+0000 7f11ee8f2700 1 -- 172.21.15.135:0/1696638518 shutdown_connections 2024-05-08T23:14:12.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.756+0000 7f11ee8f2700 1 --2- 172.21.15.135:0/1696638518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e81029a0 0x7f11e81092c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:12.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.756+0000 7f11ee8f2700 1 --2- 172.21.15.135:0/1696638518 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11e8100e90 0x7f11e81012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:12.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.756+0000 7f11ee8f2700 1 --2- 172.21.15.135:0/1696638518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11e8101fe0 0x7f11e8102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:12.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.756+0000 7f11ee8f2700 1 -- 172.21.15.135:0/1696638518 >> 172.21.15.135:0/1696638518 conn(0x7f11e80fc400 msgr2=0x7f11e80fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:12.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.756+0000 7f11ee8f2700 1 -- 172.21.15.135:0/1696638518 shutdown_connections 2024-05-08T23:14:12.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.756+0000 7f11ee8f2700 1 -- 172.21.15.135:0/1696638518 wait complete. 2024-05-08T23:14:12.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.757+0000 7f11ee8f2700 1 Processor -- start 2024-05-08T23:14:12.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.757+0000 7f11ee8f2700 1 -- start start 2024-05-08T23:14:12.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.757+0000 7f11ee8f2700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11e8100e90 0x7f11e8196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:12.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.757+0000 7f11ee8f2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e8101fe0 0x7f11e81973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:12.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.757+0000 7f11ee8f2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11e81029a0 0x7f11e819e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:12.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.757+0000 7f11ee8f2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e819e9c0 con 0x7f11e8101fe0 2024-05-08T23:14:12.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.757+0000 7f11ee8f2700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e819eb00 con 0x7f11e8100e90 2024-05-08T23:14:12.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.757+0000 7f11ee8f2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e819ec90 con 0x7f11e81029a0 2024-05-08T23:14:12.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.757+0000 7f11e77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e8101fe0 0x7f11e81973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:12.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.757+0000 7f11e77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e8101fe0 0x7f11e81973d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34304/0 (socket says 172.21.15.135:34304) 2024-05-08T23:14:12.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.757+0000 7f11e77fe700 1 -- 172.21.15.135:0/3763801029 learned_addr learned my addr 172.21.15.135:0/3763801029 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:12.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.758+0000 7f11ece8f700 1 --2- 172.21.15.135:0/3763801029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11e81029a0 0x7f11e819e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:12.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.758+0000 7f11e7fff700 1 --2- 172.21.15.135:0/3763801029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11e8100e90 0x7f11e8196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:12.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.758+0000 7f11e77fe700 1 -- 172.21.15.135:0/3763801029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11e81029a0 msgr2=0x7f11e819e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:12.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.758+0000 7f11e77fe700 1 --2- 172.21.15.135:0/3763801029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11e81029a0 0x7f11e819e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:12.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.758+0000 7f11e77fe700 1 -- 172.21.15.135:0/3763801029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11e8100e90 msgr2=0x7f11e8196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:12.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.758+0000 7f11e77fe700 1 --2- 172.21.15.135:0/3763801029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11e8100e90 0x7f11e8196e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:12.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.758+0000 7f11e77fe700 1 -- 172.21.15.135:0/3763801029 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e0009d00 con 0x7f11e8101fe0 2024-05-08T23:14:12.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.758+0000 7f11e77fe700 1 --2- 172.21.15.135:0/3763801029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e8101fe0 0x7f11e81973d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00d950 tx=0x7f11dc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:12.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.758+0000 7f11e57fa700 1 -- 172.21.15.135:0/3763801029 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc009940 con 0x7f11e8101fe0 2024-05-08T23:14:12.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.758+0000 7f11ee8f2700 1 -- 172.21.15.135:0/3763801029 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e819ef70 con 0x7f11e8101fe0 2024-05-08T23:14:12.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.758+0000 7f11e57fa700 1 -- 172.21.15.135:0/3763801029 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11dc010460 con 0x7f11e8101fe0 2024-05-08T23:14:12.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.758+0000 7f11e57fa700 1 -- 172.21.15.135:0/3763801029 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc00f620 con 0x7f11e8101fe0 2024-05-08T23:14:12.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.758+0000 7f11ee8f2700 1 -- 172.21.15.135:0/3763801029 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e819f440 con 0x7f11e8101fe0 2024-05-08T23:14:12.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.760+0000 7f11ee8f2700 1 -- 172.21.15.135:0/3763801029 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e8108230 con 0x7f11e8101fe0 2024-05-08T23:14:12.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.760+0000 7f11e57fa700 1 -- 172.21.15.135:0/3763801029 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f11dc0108d0 con 0x7f11e8101fe0 2024-05-08T23:14:12.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.761+0000 7f11e57fa700 1 --2- 172.21.15.135:0/3763801029 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f11d00a1120 0x7f11d00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:12.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.761+0000 7f11e7fff700 1 --2- 172.21.15.135:0/3763801029 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f11d00a1120 0x7f11d00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:12.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.761+0000 7f11e57fa700 1 -- 172.21.15.135:0/3763801029 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f11dc0cc290 con 0x7f11e8101fe0 2024-05-08T23:14:12.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.761+0000 7f11e7fff700 1 --2- 172.21.15.135:0/3763801029 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f11d00a1120 0x7f11d00a35e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f11d8005fd0 tx=0x7f11d800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:12.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:12.765+0000 7f11e57fa700 1 -- 172.21.15.135:0/3763801029 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f11dc095ec0 con 0x7f11e8101fe0 2024-05-08T23:14:13.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:13.035+0000 7f11ee8f2700 1 -- 172.21.15.135:0/3763801029 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11e810c7a0 con 0x7f11e8101fe0 2024-05-08T23:14:13.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:13.037+0000 7f11e57fa700 1 -- 172.21.15.135:0/3763801029 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7333 (secure 0 0 0) 0x7f11dc0b9070 con 0x7f11e8101fe0 2024-05-08T23:14:13.037 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:13.038 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2432614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2432614311},{"type":"v1","addr":"172.21.15.135:6837","nonce":2432614311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1024532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1024532},{"type":"v1","addr":"172.21.15.179:6835","nonce":1024532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2957410160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2957410160},{"type":"v1","addr":"172.21.15.179:6837","nonce":2957410160}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/4199708510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":4199708510},{"type":"v1","addr":"172.21.15.195:6835","nonce":4199708510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/2390721751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2390721751},{"type":"v1","addr":"172.21.15.195:6837","nonce":2390721751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/1730571841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1730571841},{"type":"v1","addr":"172.21.15.195:6839","nonce":1730571841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-05-08T23:14:13.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:13.039+0000 7f11ee8f2700 1 -- 172.21.15.135:0/3763801029 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f11d00a1120 msgr2=0x7f11d00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:13.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:13.039+0000 7f11ee8f2700 1 --2- 172.21.15.135:0/3763801029 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f11d00a1120 0x7f11d00a35e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f11d8005fd0 tx=0x7f11d800a560 comp rx=0 tx=0).stop 2024-05-08T23:14:13.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:13.039+0000 7f11ee8f2700 1 -- 172.21.15.135:0/3763801029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e8101fe0 msgr2=0x7f11e81973d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:13.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:13.039+0000 7f11ee8f2700 1 --2- 172.21.15.135:0/3763801029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e8101fe0 0x7f11e81973d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00d950 tx=0x7f11dc00dc60 comp rx=0 tx=0).stop 2024-05-08T23:14:13.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:13.039+0000 7f11ee8f2700 1 -- 172.21.15.135:0/3763801029 shutdown_connections 2024-05-08T23:14:13.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:13.039+0000 7f11ee8f2700 1 --2- 172.21.15.135:0/3763801029 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f11d00a1120 0x7f11d00a35e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:13.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:13.039+0000 7f11ee8f2700 1 --2- 172.21.15.135:0/3763801029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11e81029a0 0x7f11e819e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:13.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:13.039+0000 7f11ee8f2700 1 --2- 172.21.15.135:0/3763801029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11e8100e90 0x7f11e8196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:13.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:13.040+0000 7f11ee8f2700 1 --2- 172.21.15.135:0/3763801029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11e8101fe0 0x7f11e81973d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:13.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:13.040+0000 7f11ee8f2700 1 -- 172.21.15.135:0/3763801029 >> 172.21.15.135:0/3763801029 conn(0x7f11e80fc400 msgr2=0x7f11e8105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:13.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:13.040+0000 7f11ee8f2700 1 -- 172.21.15.135:0/3763801029 shutdown_connections 2024-05-08T23:14:13.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:13.040+0000 7f11ee8f2700 1 -- 172.21.15.135:0/3763801029 wait complete. 2024-05-08T23:14:13.041 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 10 2024-05-08T23:14:13.203 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 08 23:14:12 smithi135 ceph-mds[92768]: -- 172.21.15.135:0/1011064895 <== mon.0 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5588041481a0 con 0x55880411e800 2024-05-08T23:14:13.203 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 08 23:14:12 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-g[92725]: starting mds.g at 2024-05-08T23:14:13.203 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 08 23:14:12 smithi135 bash[92688]: fc5b4d9c065a5e35dfec4a69728eaf96b68f491991ff2c8a3e6573e57c17d285 2024-05-08T23:14:13.204 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 08 23:14:12 smithi135 systemd[1]: Started Ceph mds.g for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:14:13.579 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:13 smithi135 ceph-mon[42440]: Deploying daemon mds.g on smithi135 2024-05-08T23:14:13.579 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:13 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:13.579 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:13 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:13.579 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:13 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:13.579 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:13 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3763801029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:13.579 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:13 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:13.580 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:13 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:13.580 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:13 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:13.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:13 smithi179 ceph-mon[46314]: Deploying daemon mds.g on smithi135 2024-05-08T23:14:13.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:13 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:13.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:13 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:13.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:13 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:13.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:13 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3763801029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:13.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:13 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:13.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:13 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:13.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:13 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:13.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:13 smithi195 ceph-mon[46516]: Deploying daemon mds.g on smithi135 2024-05-08T23:14:13.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:13 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:13.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:13 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:13.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:13 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:13.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:13 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3763801029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:13.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:13 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:13.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:13 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:13.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:13 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:14.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:14 smithi179 ceph-mon[46314]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:14.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:14 smithi179 ceph-mon[46314]: Deploying daemon mds.a on smithi135 2024-05-08T23:14:14.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:14 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.135:6838/360966092,v1:172.21.15.135:6839/360966092] up:boot 2024-05-08T23:14:14.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:14 smithi179 ceph-mon[46314]: fsmap 10 up:standby 2024-05-08T23:14:14.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:14 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T23:14:14.616 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:14 smithi135 ceph-mon[42440]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:14.617 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:14 smithi135 ceph-mon[42440]: Deploying daemon mds.a on smithi135 2024-05-08T23:14:14.617 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:14 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.135:6838/360966092,v1:172.21.15.135:6839/360966092] up:boot 2024-05-08T23:14:14.617 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:14 smithi135 ceph-mon[42440]: fsmap 10 up:standby 2024-05-08T23:14:14.617 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:14 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T23:14:14.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:14 smithi195 ceph-mon[46516]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:14.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:14 smithi195 ceph-mon[46516]: Deploying daemon mds.a on smithi135 2024-05-08T23:14:14.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:14 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.135:6838/360966092,v1:172.21.15.135:6839/360966092] up:boot 2024-05-08T23:14:14.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:14 smithi195 ceph-mon[46516]: fsmap 10 up:standby 2024-05-08T23:14:14.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:14 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T23:14:14.953 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 08 23:14:14 smithi135 bash[93074]: ace262159b0cfa20306ac6a14ecc9688dd90999a7ae89c2b2097dbfdfbe2649a 2024-05-08T23:14:14.953 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 08 23:14:14 smithi135 systemd[1]: Started Ceph mds.a for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:14:15.054 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:14:15.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.183+0000 7fb2765a5700 1 -- 172.21.15.135:0/1637768716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb270101900 msgr2=0x7fb2701081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:15.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.183+0000 7fb2765a5700 1 --2- 172.21.15.135:0/1637768716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb270101900 0x7fb2701081b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb26800b0d0 tx=0x7fb26800b3e0 comp rx=0 tx=0).stop 2024-05-08T23:14:15.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.183+0000 7fb2765a5700 1 -- 172.21.15.135:0/1637768716 shutdown_connections 2024-05-08T23:14:15.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.183+0000 7fb2765a5700 1 --2- 172.21.15.135:0/1637768716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2700ffd70 0x7fb270100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:15.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.183+0000 7fb2765a5700 1 --2- 172.21.15.135:0/1637768716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb270101900 0x7fb2701081b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:15.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.183+0000 7fb2765a5700 1 --2- 172.21.15.135:0/1637768716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb270100f60 0x7fb2701013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:15.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.183+0000 7fb2765a5700 1 -- 172.21.15.135:0/1637768716 >> 172.21.15.135:0/1637768716 conn(0x7fb2700fb2e0 msgr2=0x7fb2700fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:15.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.183+0000 7fb2765a5700 1 -- 172.21.15.135:0/1637768716 shutdown_connections 2024-05-08T23:14:15.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.183+0000 7fb2765a5700 1 -- 172.21.15.135:0/1637768716 wait complete. 2024-05-08T23:14:15.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.184+0000 7fb2765a5700 1 Processor -- start 2024-05-08T23:14:15.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.184+0000 7fb2765a5700 1 -- start start 2024-05-08T23:14:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.184+0000 7fb2765a5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2700ffd70 0x7fb270069f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.184+0000 7fb2765a5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb270100f60 0x7fb27019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.184+0000 7fb2765a5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb270101900 0x7fb27019e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.184+0000 7fb2765a5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27019e9c0 con 0x7fb2700ffd70 2024-05-08T23:14:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.184+0000 7fb2765a5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27019eb30 con 0x7fb270101900 2024-05-08T23:14:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.184+0000 7fb2765a5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27019ecf0 con 0x7fb270100f60 2024-05-08T23:14:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.184+0000 7fb26ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2700ffd70 0x7fb270069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:15.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.184+0000 7fb26ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2700ffd70 0x7fb270069f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34360/0 (socket says 172.21.15.135:34360) 2024-05-08T23:14:15.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.184+0000 7fb26ffff700 1 -- 172.21.15.135:0/3293548369 learned_addr learned my addr 172.21.15.135:0/3293548369 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:15.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.185+0000 7fb274b42700 1 --2- 172.21.15.135:0/3293548369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb270101900 0x7fb27019e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:15.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.185+0000 7fb26ffff700 1 -- 172.21.15.135:0/3293548369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb270100f60 msgr2=0x7fb27019bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:15.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.185+0000 7fb26ffff700 1 --2- 172.21.15.135:0/3293548369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb270100f60 0x7fb27019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:15.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.185+0000 7fb26ffff700 1 -- 172.21.15.135:0/3293548369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb270101900 msgr2=0x7fb27019e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:15.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.185+0000 7fb26ffff700 1 --2- 172.21.15.135:0/3293548369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb270101900 0x7fb27019e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:15.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.185+0000 7fb26ffff700 1 -- 172.21.15.135:0/3293548369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb268009d00 con 0x7fb2700ffd70 2024-05-08T23:14:15.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.185+0000 7fb26ffff700 1 --2- 172.21.15.135:0/3293548369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2700ffd70 0x7fb270069f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb26000d980 tx=0x7fb26000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:15.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.185+0000 7fb26d7fa700 1 -- 172.21.15.135:0/3293548369 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb260009b40 con 0x7fb2700ffd70 2024-05-08T23:14:15.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.185+0000 7fb26d7fa700 1 -- 172.21.15.135:0/3293548369 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb26000de60 con 0x7fb2700ffd70 2024-05-08T23:14:15.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.185+0000 7fb2765a5700 1 -- 172.21.15.135:0/3293548369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27019efd0 con 0x7fb2700ffd70 2024-05-08T23:14:15.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.185+0000 7fb26d7fa700 1 -- 172.21.15.135:0/3293548369 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26000f620 con 0x7fb2700ffd70 2024-05-08T23:14:15.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.185+0000 7fb2765a5700 1 -- 172.21.15.135:0/3293548369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27019f450 con 0x7fb2700ffd70 2024-05-08T23:14:15.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.186+0000 7fb2765a5700 1 -- 172.21.15.135:0/3293548369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb270107120 con 0x7fb2700ffd70 2024-05-08T23:14:15.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.187+0000 7fb26d7fa700 1 -- 172.21.15.135:0/3293548369 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fb260010460 con 0x7fb2700ffd70 2024-05-08T23:14:15.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.187+0000 7fb26d7fa700 1 --2- 172.21.15.135:0/3293548369 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb2580a11a0 0x7fb2580a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:15.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.188+0000 7fb26f7fe700 1 --2- 172.21.15.135:0/3293548369 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb2580a11a0 0x7fb2580a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:15.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.188+0000 7fb26d7fa700 1 -- 172.21.15.135:0/3293548369 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb2600cc050 con 0x7fb2700ffd70 2024-05-08T23:14:15.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.188+0000 7fb26f7fe700 1 --2- 172.21.15.135:0/3293548369 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb2580a11a0 0x7fb2580a3660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb264005950 tx=0x7fb2640058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:15.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.192+0000 7fb26d7fa700 1 -- 172.21.15.135:0/3293548369 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb2600ffd60 con 0x7fb2700ffd70 2024-05-08T23:14:15.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.438+0000 7fb2765a5700 1 -- 172.21.15.135:0/3293548369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb270068060 con 0x7fb2700ffd70 2024-05-08T23:14:15.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.439+0000 7fb26d7fa700 1 -- 172.21.15.135:0/3293548369 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8852 (secure 0 0 0) 0x7fb260095be0 con 0x7fb2700ffd70 2024-05-08T23:14:15.439 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:15.439 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2432614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2432614311},{"type":"v1","addr":"172.21.15.135:6837","nonce":2432614311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/360966092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":360966092},{"type":"v1","addr":"172.21.15.135:6839","nonce":360966092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/1831266531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":1831266531},{"type":"v1","addr":"172.21.15.135:6841","nonce":1831266531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1024532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1024532},{"type":"v1","addr":"172.21.15.179:6835","nonce":1024532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2957410160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2957410160},{"type":"v1","addr":"172.21.15.179:6837","nonce":2957410160}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/4199708510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":4199708510},{"type":"v1","addr":"172.21.15.195:6835","nonce":4199708510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/2390721751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2390721751},{"type":"v1","addr":"172.21.15.195:6837","nonce":2390721751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/1730571841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1730571841},{"type":"v1","addr":"172.21.15.195:6839","nonce":1730571841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-05-08T23:14:15.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.441+0000 7fb2765a5700 1 -- 172.21.15.135:0/3293548369 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb2580a11a0 msgr2=0x7fb2580a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:15.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.441+0000 7fb2765a5700 1 --2- 172.21.15.135:0/3293548369 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb2580a11a0 0x7fb2580a3660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb264005950 tx=0x7fb2640058e0 comp rx=0 tx=0).stop 2024-05-08T23:14:15.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.441+0000 7fb2765a5700 1 -- 172.21.15.135:0/3293548369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2700ffd70 msgr2=0x7fb270069f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:15.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.441+0000 7fb2765a5700 1 --2- 172.21.15.135:0/3293548369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2700ffd70 0x7fb270069f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb26000d980 tx=0x7fb26000dd40 comp rx=0 tx=0).stop 2024-05-08T23:14:15.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.441+0000 7fb2765a5700 1 -- 172.21.15.135:0/3293548369 shutdown_connections 2024-05-08T23:14:15.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.441+0000 7fb2765a5700 1 --2- 172.21.15.135:0/3293548369 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb2580a11a0 0x7fb2580a3660 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:15.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.441+0000 7fb2765a5700 1 --2- 172.21.15.135:0/3293548369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb270101900 0x7fb27019e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:15.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.441+0000 7fb2765a5700 1 --2- 172.21.15.135:0/3293548369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2700ffd70 0x7fb270069f70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:15.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.441+0000 7fb2765a5700 1 --2- 172.21.15.135:0/3293548369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb270100f60 0x7fb27019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:15.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.441+0000 7fb2765a5700 1 -- 172.21.15.135:0/3293548369 >> 172.21.15.135:0/3293548369 conn(0x7fb2700fb2e0 msgr2=0x7fb270104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:15.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.441+0000 7fb2765a5700 1 -- 172.21.15.135:0/3293548369 shutdown_connections 2024-05-08T23:14:15.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:15.441+0000 7fb2765a5700 1 -- 172.21.15.135:0/3293548369 wait complete. 2024-05-08T23:14:15.443 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 12 2024-05-08T23:14:15.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:15.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:15.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:15 smithi135 ceph-mon[42440]: Deploying daemon mds.b on smithi179 2024-05-08T23:14:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:15 smithi135 ceph-mon[42440]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:15 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.135:6840/1831266531,v1:172.21.15.135:6841/1831266531] up:boot 2024-05-08T23:14:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:15 smithi135 ceph-mon[42440]: fsmap 11 up:standby 2024-05-08T23:14:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:15 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T23:14:15.704 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:15 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3293548369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:15.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:15.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:15.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:15.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:15.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:15.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:15.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:15 smithi179 ceph-mon[46314]: Deploying daemon mds.b on smithi179 2024-05-08T23:14:15.851 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:15 smithi179 ceph-mon[46314]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:15.851 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:15 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.135:6840/1831266531,v1:172.21.15.135:6841/1831266531] up:boot 2024-05-08T23:14:15.851 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:15 smithi179 ceph-mon[46314]: fsmap 11 up:standby 2024-05-08T23:14:15.851 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:15 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T23:14:15.851 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:15 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3293548369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T23:14:16.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T23:14:16.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:16.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:15 smithi195 ceph-mon[46516]: Deploying daemon mds.b on smithi179 2024-05-08T23:14:16.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:15 smithi195 ceph-mon[46516]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:16.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:15 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.135:6840/1831266531,v1:172.21.15.135:6841/1831266531] up:boot 2024-05-08T23:14:16.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:15 smithi195 ceph-mon[46516]: fsmap 11 up:standby 2024-05-08T23:14:16.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:15 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T23:14:16.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:15 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3293548369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:16.297 INFO:journalctl@ceph.mds.b.smithi179.stdout:May 08 23:14:16 smithi179 systemd[1]: Starting Ceph mds.b for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:14:16.849 INFO:journalctl@ceph.mds.b.smithi179.stdout:May 08 23:14:16 smithi179 ceph-mds[83251]: -- 172.21.15.179:0/1529569409 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d7a16f81a0 con 0x55d7a16cf000 2024-05-08T23:14:16.849 INFO:journalctl@ceph.mds.b.smithi179.stdout:May 08 23:14:16 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-b[83229]: starting mds.b at 2024-05-08T23:14:16.850 INFO:journalctl@ceph.mds.b.smithi179.stdout:May 08 23:14:16 smithi179 bash[83214]: 00f89ddc679975f7329cc2b347bb7d22cb7230caf3f0870f54a8c43d254ab969 2024-05-08T23:14:16.850 INFO:journalctl@ceph.mds.b.smithi179.stdout:May 08 23:14:16 smithi179 systemd[1]: Started Ceph mds.b for c804a50a-0d8f-11ef-bc97-c7b262605968. 2024-05-08T23:14:17.454 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:14:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.597+0000 7fcd179ea700 1 -- 172.21.15.135:0/1275533972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd10104230 msgr2=0x7fcd10106620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.597+0000 7fcd179ea700 1 --2- 172.21.15.135:0/1275533972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd10104230 0x7fcd10106620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcd00009990 tx=0x7fcd00009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.597+0000 7fcd179ea700 1 -- 172.21.15.135:0/1275533972 shutdown_connections 2024-05-08T23:14:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.597+0000 7fcd179ea700 1 --2- 172.21.15.135:0/1275533972 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd10106b60 0x7fcd10108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.597+0000 7fcd179ea700 1 --2- 172.21.15.135:0/1275533972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd10101900 0x7fcd10103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.597+0000 7fcd179ea700 1 --2- 172.21.15.135:0/1275533972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd10104230 0x7fcd10106620 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.597+0000 7fcd179ea700 1 -- 172.21.15.135:0/1275533972 >> 172.21.15.135:0/1275533972 conn(0x7fcd100fb2f0 msgr2=0x7fcd100fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.597+0000 7fcd179ea700 1 -- 172.21.15.135:0/1275533972 shutdown_connections 2024-05-08T23:14:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.597+0000 7fcd179ea700 1 -- 172.21.15.135:0/1275533972 wait complete. 2024-05-08T23:14:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd179ea700 1 Processor -- start 2024-05-08T23:14:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd179ea700 1 -- start start 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd179ea700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd10101900 0x7fcd10196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd179ea700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd10104230 0x7fcd10197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd179ea700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd10106b60 0x7fcd1019e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd179ea700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1019e8f0 con 0x7fcd10101900 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd179ea700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1019ea30 con 0x7fcd10104230 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd179ea700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1019ebc0 con 0x7fcd10106b60 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd15786700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd10101900 0x7fcd10196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd15786700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd10101900 0x7fcd10196dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34368/0 (socket says 172.21.15.135:34368) 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd15786700 1 -- 172.21.15.135:0/800066192 learned_addr learned my addr 172.21.15.135:0/800066192 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd14f85700 1 --2- 172.21.15.135:0/800066192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd10104230 0x7fcd10197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd15f87700 1 --2- 172.21.15.135:0/800066192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd10106b60 0x7fcd1019e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd15786700 1 -- 172.21.15.135:0/800066192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd10106b60 msgr2=0x7fcd1019e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd15786700 1 --2- 172.21.15.135:0/800066192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd10106b60 0x7fcd1019e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd15786700 1 -- 172.21.15.135:0/800066192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd10104230 msgr2=0x7fcd10197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd15786700 1 --2- 172.21.15.135:0/800066192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd10104230 0x7fcd10197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.598+0000 7fcd15786700 1 -- 172.21.15.135:0/800066192 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd000095f0 con 0x7fcd10101900 2024-05-08T23:14:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.599+0000 7fcd15786700 1 --2- 172.21.15.135:0/800066192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd10101900 0x7fcd10196dc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00e9a0 tx=0x7fcd0c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.599+0000 7fcd067fc700 1 -- 172.21.15.135:0/800066192 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c009790 con 0x7fcd10101900 2024-05-08T23:14:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.599+0000 7fcd179ea700 1 -- 172.21.15.135:0/800066192 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1019eea0 con 0x7fcd10101900 2024-05-08T23:14:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.599+0000 7fcd067fc700 1 -- 172.21.15.135:0/800066192 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd0c010430 con 0x7fcd10101900 2024-05-08T23:14:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.599+0000 7fcd067fc700 1 -- 172.21.15.135:0/800066192 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c018680 con 0x7fcd10101900 2024-05-08T23:14:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.599+0000 7fcd179ea700 1 -- 172.21.15.135:0/800066192 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1019f2d0 con 0x7fcd10101900 2024-05-08T23:14:17.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.600+0000 7fcd179ea700 1 -- 172.21.15.135:0/800066192 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd100fce70 con 0x7fcd10101900 2024-05-08T23:14:17.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.601+0000 7fcd067fc700 1 -- 172.21.15.135:0/800066192 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fcd0c0105a0 con 0x7fcd10101900 2024-05-08T23:14:17.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.601+0000 7fcd067fc700 1 --2- 172.21.15.135:0/800066192 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fccfc0a1120 0x7fccfc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:17.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.602+0000 7fcd14f85700 1 --2- 172.21.15.135:0/800066192 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fccfc0a1120 0x7fccfc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:17.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.602+0000 7fcd067fc700 1 -- 172.21.15.135:0/800066192 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcd0c014070 con 0x7fcd10101900 2024-05-08T23:14:17.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.602+0000 7fcd14f85700 1 --2- 172.21.15.135:0/800066192 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fccfc0a1120 0x7fccfc0a35e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000b2e0 tx=0x7fcd00005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:17.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.607+0000 7fcd067fc700 1 -- 172.21.15.135:0/800066192 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fcd0c052d60 con 0x7fcd10101900 2024-05-08T23:14:17.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:17.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:17.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:17.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:17.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:17.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:14:17.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:17 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] up:boot 2024-05-08T23:14:17.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:17 smithi179 ceph-mon[46314]: fsmap 12 up:standby 2024-05-08T23:14:17.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:17 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T23:14:17.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:17 smithi179 ceph-mon[46314]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:17.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:17.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:17.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:17.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:17.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:17.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:14:17.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:17 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] up:boot 2024-05-08T23:14:17.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:17 smithi195 ceph-mon[46516]: fsmap 12 up:standby 2024-05-08T23:14:17.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:17 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T23:14:17.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:17 smithi195 ceph-mon[46516]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:17.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.912+0000 7fcd179ea700 1 -- 172.21.15.135:0/800066192 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd10068060 con 0x7fcd10101900 2024-05-08T23:14:17.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.913+0000 7fcd067fc700 1 -- 172.21.15.135:0/800066192 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9613 (secure 0 0 0) 0x7fcd10068060 con 0x7fcd10101900 2024-05-08T23:14:17.912 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:17.912 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2432614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2432614311},{"type":"v1","addr":"172.21.15.135:6837","nonce":2432614311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/360966092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":360966092},{"type":"v1","addr":"172.21.15.135:6839","nonce":360966092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/1831266531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":1831266531},{"type":"v1","addr":"172.21.15.135:6841","nonce":1831266531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1024532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1024532},{"type":"v1","addr":"172.21.15.179:6835","nonce":1024532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2957410160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2957410160},{"type":"v1","addr":"172.21.15.179:6837","nonce":2957410160}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/4199708510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":4199708510},{"type":"v1","addr":"172.21.15.195:6835","nonce":4199708510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/2390721751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2390721751},{"type":"v1","addr":"172.21.15.195:6837","nonce":2390721751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6839/1135239419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":1135239419},{"type":"v1","addr":"172.21.15.179:6839","nonce":1135239419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/1730571841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1730571841},{"type":"v1","addr":"172.21.15.195:6839","nonce":1730571841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-05-08T23:14:17.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.915+0000 7fcd179ea700 1 -- 172.21.15.135:0/800066192 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fccfc0a1120 msgr2=0x7fccfc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:17.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.915+0000 7fcd179ea700 1 --2- 172.21.15.135:0/800066192 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fccfc0a1120 0x7fccfc0a35e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000b2e0 tx=0x7fcd00005fd0 comp rx=0 tx=0).stop 2024-05-08T23:14:17.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.915+0000 7fcd179ea700 1 -- 172.21.15.135:0/800066192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd10101900 msgr2=0x7fcd10196dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:17.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.915+0000 7fcd179ea700 1 --2- 172.21.15.135:0/800066192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd10101900 0x7fcd10196dc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00e9a0 tx=0x7fcd0c00ecb0 comp rx=0 tx=0).stop 2024-05-08T23:14:17.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.915+0000 7fcd179ea700 1 -- 172.21.15.135:0/800066192 shutdown_connections 2024-05-08T23:14:17.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.915+0000 7fcd179ea700 1 --2- 172.21.15.135:0/800066192 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fccfc0a1120 0x7fccfc0a35e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:17.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.915+0000 7fcd179ea700 1 --2- 172.21.15.135:0/800066192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd10106b60 0x7fcd1019e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:17.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.915+0000 7fcd179ea700 1 --2- 172.21.15.135:0/800066192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd10101900 0x7fcd10196dc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:17.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.915+0000 7fcd179ea700 1 --2- 172.21.15.135:0/800066192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd10104230 0x7fcd10197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:17.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.915+0000 7fcd179ea700 1 -- 172.21.15.135:0/800066192 >> 172.21.15.135:0/800066192 conn(0x7fcd100fb2f0 msgr2=0x7fcd101037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:17.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.915+0000 7fcd179ea700 1 -- 172.21.15.135:0/800066192 shutdown_connections 2024-05-08T23:14:17.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:17.915+0000 7fcd179ea700 1 -- 172.21.15.135:0/800066192 wait complete. 2024-05-08T23:14:17.916 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 13 2024-05-08T23:14:17.926 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:17.926 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:17.926 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:17.926 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:17.926 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:17.926 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:14:17.926 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:17 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] up:boot 2024-05-08T23:14:17.926 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:17 smithi135 ceph-mon[42440]: fsmap 12 up:standby 2024-05-08T23:14:17.926 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:17 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T23:14:17.926 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:17 smithi135 ceph-mon[42440]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:17.928 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T23:14:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.051+0000 7f4774f36700 1 -- 172.21.15.135:0/2793175186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47700ffd80 msgr2=0x7f47701001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.051+0000 7f4774f36700 1 --2- 172.21.15.135:0/2793175186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47700ffd80 0x7f47701001a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f47640099c0 tx=0x7f4764009cd0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.051+0000 7f4774f36700 1 -- 172.21.15.135:0/2793175186 shutdown_connections 2024-05-08T23:14:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.051+0000 7f4774f36700 1 --2- 172.21.15.135:0/2793175186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4770101910 0x7f47701081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.051+0000 7f4774f36700 1 --2- 172.21.15.135:0/2793175186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47700ffd80 0x7f47701001a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.051+0000 7f4774f36700 1 --2- 172.21.15.135:0/2793175186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4770100f70 0x7f47701013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.051+0000 7f4774f36700 1 -- 172.21.15.135:0/2793175186 >> 172.21.15.135:0/2793175186 conn(0x7f47700fb330 msgr2=0x7f47700fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.051+0000 7f4774f36700 1 -- 172.21.15.135:0/2793175186 shutdown_connections 2024-05-08T23:14:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.051+0000 7f4774f36700 1 -- 172.21.15.135:0/2793175186 wait complete. 2024-05-08T23:14:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.052+0000 7f4774f36700 1 Processor -- start 2024-05-08T23:14:18.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.052+0000 7f4774f36700 1 -- start start 2024-05-08T23:14:18.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.052+0000 7f4774f36700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47700ffd80 0x7f4770103cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:18.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.052+0000 7f4774f36700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4770100f70 0x7f4770102350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:18.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.052+0000 7f4774f36700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4770101910 0x7f4770102890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:18.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.052+0000 7f4774f36700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4770103030 con 0x7f4770100f70 2024-05-08T23:14:18.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.052+0000 7f4774f36700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47701031a0 con 0x7f4770101910 2024-05-08T23:14:18.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.052+0000 7f4774f36700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47701a0e60 con 0x7f47700ffd80 2024-05-08T23:14:18.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.052+0000 7f476dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4770100f70 0x7f4770102350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:18.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.052+0000 7f476e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47700ffd80 0x7f4770103cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:18.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f476dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4770100f70 0x7f4770102350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34390/0 (socket says 172.21.15.135:34390) 2024-05-08T23:14:18.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f476dd9b700 1 -- 172.21.15.135:0/2309542659 learned_addr learned my addr 172.21.15.135:0/2309542659 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:18.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f476e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47700ffd80 0x7f4770103cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.135:55138/0 (socket says 172.21.15.135:55138) 2024-05-08T23:14:18.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f476ed9d700 1 --2- 172.21.15.135:0/2309542659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4770101910 0x7f4770102890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:18.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f476dd9b700 1 -- 172.21.15.135:0/2309542659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47700ffd80 msgr2=0x7f4770103cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:18.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f476dd9b700 1 --2- 172.21.15.135:0/2309542659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47700ffd80 0x7f4770103cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f476dd9b700 1 -- 172.21.15.135:0/2309542659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4770101910 msgr2=0x7f4770102890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:18.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f476dd9b700 1 --2- 172.21.15.135:0/2309542659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4770101910 0x7f4770102890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f476dd9b700 1 -- 172.21.15.135:0/2309542659 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47640095f0 con 0x7f4770100f70 2024-05-08T23:14:18.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f476ed9d700 1 --2- 172.21.15.135:0/2309542659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4770101910 0x7f4770102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:14:18.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f476e59c700 1 --2- 172.21.15.135:0/2309542659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47700ffd80 0x7f4770103cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:14:18.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f476dd9b700 1 --2- 172.21.15.135:0/2309542659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4770100f70 0x7f4770102350 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f476000e9a0 tx=0x7f476000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:18.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f475f7fe700 1 -- 172.21.15.135:0/2309542659 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4760009790 con 0x7f4770100f70 2024-05-08T23:14:18.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f475f7fe700 1 -- 172.21.15.135:0/2309542659 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f476000ce70 con 0x7f4770100f70 2024-05-08T23:14:18.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f475f7fe700 1 -- 172.21.15.135:0/2309542659 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4760018420 con 0x7f4770100f70 2024-05-08T23:14:18.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f4774f36700 1 -- 172.21.15.135:0/2309542659 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47701a10f0 con 0x7f4770100f70 2024-05-08T23:14:18.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.053+0000 7f4774f36700 1 -- 172.21.15.135:0/2309542659 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47701a15b0 con 0x7f4770100f70 2024-05-08T23:14:18.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.054+0000 7f4774f36700 1 -- 172.21.15.135:0/2309542659 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4770068060 con 0x7f4770100f70 2024-05-08T23:14:18.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.056+0000 7f475f7fe700 1 -- 172.21.15.135:0/2309542659 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f47600106f0 con 0x7f4770100f70 2024-05-08T23:14:18.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.056+0000 7f475f7fe700 1 --2- 172.21.15.135:0/2309542659 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f47580a1120 0x7f47580a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:18.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.057+0000 7f476e59c700 1 --2- 172.21.15.135:0/2309542659 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f47580a1120 0x7f47580a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:18.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.057+0000 7f475f7fe700 1 -- 172.21.15.135:0/2309542659 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4760014070 con 0x7f4770100f70 2024-05-08T23:14:18.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.057+0000 7f476e59c700 1 --2- 172.21.15.135:0/2309542659 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f47580a1120 0x7f47580a35e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4764003730 tx=0x7f476401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:18.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.060+0000 7f475f7fe700 1 -- 172.21.15.135:0/2309542659 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4760096690 con 0x7f4770100f70 2024-05-08T23:14:18.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.275+0000 7f4774f36700 1 -- 172.21.15.135:0/2309542659 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f477010b590 con 0x7f4770100f70 2024-05-08T23:14:18.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.276+0000 7f475f7fe700 1 -- 172.21.15.135:0/2309542659 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18479 (secure 0 0 0) 0x7f4760099cb0 con 0x7f4770100f70 2024-05-08T23:14:18.275 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:18.276 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":79,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:13:49.981881+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:14:18.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.278+0000 7f4774f36700 1 -- 172.21.15.135:0/2309542659 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f47580a1120 msgr2=0x7f47580a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:18.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.278+0000 7f4774f36700 1 --2- 172.21.15.135:0/2309542659 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f47580a1120 0x7f47580a35e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4764003730 tx=0x7f476401a040 comp rx=0 tx=0).stop 2024-05-08T23:14:18.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.278+0000 7f4774f36700 1 -- 172.21.15.135:0/2309542659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4770100f70 msgr2=0x7f4770102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:18.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.278+0000 7f4774f36700 1 --2- 172.21.15.135:0/2309542659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4770100f70 0x7f4770102350 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f476000e9a0 tx=0x7f476000ecb0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.278+0000 7f4774f36700 1 -- 172.21.15.135:0/2309542659 shutdown_connections 2024-05-08T23:14:18.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.278+0000 7f4774f36700 1 --2- 172.21.15.135:0/2309542659 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f47580a1120 0x7f47580a35e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.278+0000 7f4774f36700 1 --2- 172.21.15.135:0/2309542659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47700ffd80 0x7f4770103cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.278+0000 7f4774f36700 1 --2- 172.21.15.135:0/2309542659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4770101910 0x7f4770102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.278+0000 7f4774f36700 1 --2- 172.21.15.135:0/2309542659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4770100f70 0x7f4770102350 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.278+0000 7f4774f36700 1 -- 172.21.15.135:0/2309542659 >> 172.21.15.135:0/2309542659 conn(0x7f47700fb330 msgr2=0x7f4770069520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:18.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.278+0000 7f4774f36700 1 -- 172.21.15.135:0/2309542659 shutdown_connections 2024-05-08T23:14:18.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.278+0000 7f4774f36700 1 -- 172.21.15.135:0/2309542659 wait complete. 2024-05-08T23:14:18.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:11:11.282550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T23:14:18.291 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T23:14:18.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.424+0000 7f13f7e44700 1 -- 172.21.15.135:0/890176905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13f0102170 msgr2=0x7f13f01025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:18.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.424+0000 7f13f7e44700 1 --2- 172.21.15.135:0/890176905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13f0102170 0x7f13f01025d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f13e00099c0 tx=0x7f13e0009cd0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.424+0000 7f13f7e44700 1 -- 172.21.15.135:0/890176905 shutdown_connections 2024-05-08T23:14:18.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.424+0000 7f13f7e44700 1 --2- 172.21.15.135:0/890176905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13f0102b10 0x7f13f01093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.424+0000 7f13f7e44700 1 --2- 172.21.15.135:0/890176905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13f0100f80 0x7f13f01013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.424+0000 7f13f7e44700 1 --2- 172.21.15.135:0/890176905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13f0102170 0x7f13f01025d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.424+0000 7f13f7e44700 1 -- 172.21.15.135:0/890176905 >> 172.21.15.135:0/890176905 conn(0x7f13f00fc4f0 msgr2=0x7f13f00fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:18.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.424+0000 7f13f7e44700 1 -- 172.21.15.135:0/890176905 shutdown_connections 2024-05-08T23:14:18.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.424+0000 7f13f7e44700 1 -- 172.21.15.135:0/890176905 wait complete. 2024-05-08T23:14:18.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.425+0000 7f13f7e44700 1 Processor -- start 2024-05-08T23:14:18.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.425+0000 7f13f7e44700 1 -- start start 2024-05-08T23:14:18.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.425+0000 7f13f7e44700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13f0100f80 0x7f13f0196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:18.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.425+0000 7f13f7e44700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13f0102170 0x7f13f01973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:18.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.425+0000 7f13f7e44700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13f0102b10 0x7f13f019e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:18.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.425+0000 7f13f7e44700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f019e9d0 con 0x7f13f0102170 2024-05-08T23:14:18.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.425+0000 7f13f7e44700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f019eb10 con 0x7f13f0100f80 2024-05-08T23:14:18.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.425+0000 7f13f7e44700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f019eca0 con 0x7f13f0102b10 2024-05-08T23:14:18.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.425+0000 7f13f53df700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13f0102170 0x7f13f01973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:18.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.425+0000 7f13f53df700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13f0102170 0x7f13f01973e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50526/0 (socket says 172.21.15.135:50526) 2024-05-08T23:14:18.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.425+0000 7f13f53df700 1 -- 172.21.15.135:0/1148104836 learned_addr learned my addr 172.21.15.135:0/1148104836 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:18.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.425+0000 7f13f5be0700 1 --2- 172.21.15.135:0/1148104836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13f0100f80 0x7f13f0196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:18.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.425+0000 7f13f63e1700 1 --2- 172.21.15.135:0/1148104836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13f0102b10 0x7f13f019e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:18.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.426+0000 7f13f53df700 1 -- 172.21.15.135:0/1148104836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13f0102b10 msgr2=0x7f13f019e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:18.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.426+0000 7f13f53df700 1 --2- 172.21.15.135:0/1148104836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13f0102b10 0x7f13f019e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.426+0000 7f13f53df700 1 -- 172.21.15.135:0/1148104836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13f0100f80 msgr2=0x7f13f0196ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:18.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.426+0000 7f13f53df700 1 --2- 172.21.15.135:0/1148104836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13f0100f80 0x7f13f0196ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.426+0000 7f13f53df700 1 -- 172.21.15.135:0/1148104836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e00095f0 con 0x7f13f0102170 2024-05-08T23:14:18.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.426+0000 7f13f53df700 1 --2- 172.21.15.135:0/1148104836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13f0102170 0x7f13f01973e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f13e0003730 tx=0x7f13e000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:18.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.426+0000 7f13e6ffd700 1 -- 172.21.15.135:0/1148104836 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e001d070 con 0x7f13f0102170 2024-05-08T23:14:18.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.426+0000 7f13e6ffd700 1 -- 172.21.15.135:0/1148104836 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13e00059a0 con 0x7f13f0102170 2024-05-08T23:14:18.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.426+0000 7f13f7e44700 1 -- 172.21.15.135:0/1148104836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f019ef20 con 0x7f13f0102170 2024-05-08T23:14:18.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.426+0000 7f13e6ffd700 1 -- 172.21.15.135:0/1148104836 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e0004a00 con 0x7f13f0102170 2024-05-08T23:14:18.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.426+0000 7f13f7e44700 1 -- 172.21.15.135:0/1148104836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f019f340 con 0x7f13f0102170 2024-05-08T23:14:18.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.427+0000 7f13f7e44700 1 -- 172.21.15.135:0/1148104836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f01083b0 con 0x7f13f0102170 2024-05-08T23:14:18.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.428+0000 7f13e6ffd700 1 -- 172.21.15.135:0/1148104836 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f13e0005210 con 0x7f13f0102170 2024-05-08T23:14:18.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.429+0000 7f13e6ffd700 1 --2- 172.21.15.135:0/1148104836 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f13dc0a1120 0x7f13dc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:18.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.429+0000 7f13e6ffd700 1 -- 172.21.15.135:0/1148104836 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f13e00cd4d0 con 0x7f13f0102170 2024-05-08T23:14:18.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.429+0000 7f13f5be0700 1 --2- 172.21.15.135:0/1148104836 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f13dc0a1120 0x7f13dc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:18.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.429+0000 7f13f5be0700 1 --2- 172.21.15.135:0/1148104836 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f13dc0a1120 0x7f13dc0a35e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f13f0101fd0 tx=0x7f13ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:18.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.432+0000 7f13e6ffd700 1 -- 172.21.15.135:0/1148104836 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f13e0097190 con 0x7f13f0102170 2024-05-08T23:14:18.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.649+0000 7f13f7e44700 1 -- 172.21.15.135:0/1148104836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13f010c7a0 con 0x7f13f0102170 2024-05-08T23:14:18.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.650+0000 7f13e6ffd700 1 -- 172.21.15.135:0/1148104836 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13e009a7b0 con 0x7f13f0102170 2024-05-08T23:14:18.649 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T23:14:18.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.652+0000 7f13f7e44700 1 -- 172.21.15.135:0/1148104836 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f13dc0a1120 msgr2=0x7f13dc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:18.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.652+0000 7f13f7e44700 1 --2- 172.21.15.135:0/1148104836 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f13dc0a1120 0x7f13dc0a35e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f13f0101fd0 tx=0x7f13ec009260 comp rx=0 tx=0).stop 2024-05-08T23:14:18.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.652+0000 7f13f7e44700 1 -- 172.21.15.135:0/1148104836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13f0102170 msgr2=0x7f13f01973e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:18.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.652+0000 7f13f7e44700 1 --2- 172.21.15.135:0/1148104836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13f0102170 0x7f13f01973e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f13e0003730 tx=0x7f13e000f670 comp rx=0 tx=0).stop 2024-05-08T23:14:18.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.652+0000 7f13f7e44700 1 -- 172.21.15.135:0/1148104836 shutdown_connections 2024-05-08T23:14:18.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.652+0000 7f13f7e44700 1 --2- 172.21.15.135:0/1148104836 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f13dc0a1120 0x7f13dc0a35e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.652+0000 7f13f7e44700 1 --2- 172.21.15.135:0/1148104836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13f0102b10 0x7f13f019e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.652+0000 7f13f7e44700 1 --2- 172.21.15.135:0/1148104836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13f0100f80 0x7f13f0196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.652+0000 7f13f7e44700 1 --2- 172.21.15.135:0/1148104836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13f0102170 0x7f13f01973e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.652+0000 7f13f7e44700 1 -- 172.21.15.135:0/1148104836 >> 172.21.15.135:0/1148104836 conn(0x7f13f00fc4f0 msgr2=0x7f13f01054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:18.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.653+0000 7f13f7e44700 1 -- 172.21.15.135:0/1148104836 shutdown_connections 2024-05-08T23:14:18.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.653+0000 7f13f7e44700 1 -- 172.21.15.135:0/1148104836 wait complete. 2024-05-08T23:14:18.666 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T23:14:18.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.794+0000 7f1758fe0700 1 -- 172.21.15.135:0/860054270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17540ff120 msgr2=0x7f17540ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:18.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.794+0000 7f1758fe0700 1 --2- 172.21.15.135:0/860054270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17540ff120 0x7f17540ff540 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1744009990 tx=0x7f1744009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.794+0000 7f1758fe0700 1 -- 172.21.15.135:0/860054270 shutdown_connections 2024-05-08T23:14:18.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.794+0000 7f1758fe0700 1 --2- 172.21.15.135:0/860054270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1754102a90 0x7f1754109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.794+0000 7f1758fe0700 1 --2- 172.21.15.135:0/860054270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17540ff120 0x7f17540ff540 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.794+0000 7f1758fe0700 1 --2- 172.21.15.135:0/860054270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17541020f0 0x7f1754102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.794+0000 7f1758fe0700 1 -- 172.21.15.135:0/860054270 >> 172.21.15.135:0/860054270 conn(0x7f17540faa70 msgr2=0x7f17540fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:18.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.794+0000 7f1758fe0700 1 -- 172.21.15.135:0/860054270 shutdown_connections 2024-05-08T23:14:18.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.794+0000 7f1758fe0700 1 -- 172.21.15.135:0/860054270 wait complete. 2024-05-08T23:14:18.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.795+0000 7f1758fe0700 1 Processor -- start 2024-05-08T23:14:18.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.795+0000 7f1758fe0700 1 -- start start 2024-05-08T23:14:18.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.795+0000 7f1758fe0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17540ff120 0x7f1754196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:18.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.795+0000 7f1758fe0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17541020f0 0x7f1754197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:18.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.795+0000 7f1758fe0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1754102a90 0x7f175419e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:18.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.795+0000 7f1758fe0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175419e970 con 0x7f17541020f0 2024-05-08T23:14:18.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.795+0000 7f1758fe0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175419eab0 con 0x7f17540ff120 2024-05-08T23:14:18.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.795+0000 7f1758fe0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175419ec40 con 0x7f1754102a90 2024-05-08T23:14:18.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.795+0000 7f1751d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17541020f0 0x7f1754197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:18.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.795+0000 7f175259c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17540ff120 0x7f1754196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:18.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.795+0000 7f1751d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17541020f0 0x7f1754197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50540/0 (socket says 172.21.15.135:50540) 2024-05-08T23:14:18.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.795+0000 7f1751d9b700 1 -- 172.21.15.135:0/4221297692 learned_addr learned my addr 172.21.15.135:0/4221297692 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:18.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.795+0000 7f1752d9d700 1 --2- 172.21.15.135:0/4221297692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1754102a90 0x7f175419e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:18.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.796+0000 7f1751d9b700 1 -- 172.21.15.135:0/4221297692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1754102a90 msgr2=0x7f175419e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:18.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.796+0000 7f1751d9b700 1 --2- 172.21.15.135:0/4221297692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1754102a90 0x7f175419e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.796+0000 7f1751d9b700 1 -- 172.21.15.135:0/4221297692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17540ff120 msgr2=0x7f1754196e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:18.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.796+0000 7f1751d9b700 1 --2- 172.21.15.135:0/4221297692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17540ff120 0x7f1754196e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:18.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.796+0000 7f1751d9b700 1 -- 172.21.15.135:0/4221297692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17440095f0 con 0x7f17541020f0 2024-05-08T23:14:18.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.796+0000 7f175259c700 1 --2- 172.21.15.135:0/4221297692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17540ff120 0x7f1754196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:14:18.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.796+0000 7f1752d9d700 1 --2- 172.21.15.135:0/4221297692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1754102a90 0x7f175419e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:14:18.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.796+0000 7f1751d9b700 1 --2- 172.21.15.135:0/4221297692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17541020f0 0x7f1754197380 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f174800b530 tx=0x7f174800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:18.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.796+0000 7f17437fe700 1 -- 172.21.15.135:0/4221297692 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748011830 con 0x7f17541020f0 2024-05-08T23:14:18.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.796+0000 7f17437fe700 1 -- 172.21.15.135:0/4221297692 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1748011e50 con 0x7f17541020f0 2024-05-08T23:14:18.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.796+0000 7f1758fe0700 1 -- 172.21.15.135:0/4221297692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175419ef20 con 0x7f17541020f0 2024-05-08T23:14:18.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.796+0000 7f17437fe700 1 -- 172.21.15.135:0/4221297692 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174800f2e0 con 0x7f17541020f0 2024-05-08T23:14:18.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.796+0000 7f1758fe0700 1 -- 172.21.15.135:0/4221297692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175419f420 con 0x7f17541020f0 2024-05-08T23:14:18.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.797+0000 7f1758fe0700 1 -- 172.21.15.135:0/4221297692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17541083d0 con 0x7f17541020f0 2024-05-08T23:14:18.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.798+0000 7f17437fe700 1 -- 172.21.15.135:0/4221297692 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f17480105a0 con 0x7f17541020f0 2024-05-08T23:14:18.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.799+0000 7f17437fe700 1 --2- 172.21.15.135:0/4221297692 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f173c0a1120 0x7f173c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:18.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.799+0000 7f175259c700 1 --2- 172.21.15.135:0/4221297692 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f173c0a1120 0x7f173c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:18.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.799+0000 7f17437fe700 1 -- 172.21.15.135:0/4221297692 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f17480cc320 con 0x7f17541020f0 2024-05-08T23:14:18.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.799+0000 7f175259c700 1 --2- 172.21.15.135:0/4221297692 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f173c0a1120 0x7f173c0a35e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f174400b680 tx=0x7f1744005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:18.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:18.802+0000 7f17437fe700 1 -- 172.21.15.135:0/4221297692 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1748095f50 con 0x7f17541020f0 2024-05-08T23:14:18.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:18.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:18.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:18.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:18.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:18.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:18.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:18 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/800066192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:18.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:18.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:14:18.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:18.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:18 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2309542659' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:18.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:18 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:14:18.955 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:18 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1148104836' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:14:19.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.052+0000 7f1758fe0700 1 -- 172.21.15.135:0/4221297692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1754067380 con 0x7f17541020f0 2024-05-08T23:14:19.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.052+0000 7f17437fe700 1 -- 172.21.15.135:0/4221297692 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1748099570 con 0x7f17541020f0 2024-05-08T23:14:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:19.052 INFO:teuthology.orchestra.run.smithi135.stdout:[ 2024-05-08T23:14:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:14:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: "poolnum": 1, 2024-05-08T23:14:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: "poolname": ".mgr" 2024-05-08T23:14:19.052 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:14:19.052 INFO:teuthology.orchestra.run.smithi135.stdout:] 2024-05-08T23:14:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.054+0000 7f1758fe0700 1 -- 172.21.15.135:0/4221297692 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f173c0a1120 msgr2=0x7f173c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.054+0000 7f1758fe0700 1 --2- 172.21.15.135:0/4221297692 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f173c0a1120 0x7f173c0a35e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f174400b680 tx=0x7f1744005fd0 comp rx=0 tx=0).stop 2024-05-08T23:14:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.054+0000 7f1758fe0700 1 -- 172.21.15.135:0/4221297692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17541020f0 msgr2=0x7f1754197380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.054+0000 7f1758fe0700 1 --2- 172.21.15.135:0/4221297692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17541020f0 0x7f1754197380 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f174800b530 tx=0x7f174800b840 comp rx=0 tx=0).stop 2024-05-08T23:14:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.054+0000 7f1758fe0700 1 -- 172.21.15.135:0/4221297692 shutdown_connections 2024-05-08T23:14:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.054+0000 7f1758fe0700 1 --2- 172.21.15.135:0/4221297692 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f173c0a1120 0x7f173c0a35e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.054+0000 7f1758fe0700 1 --2- 172.21.15.135:0/4221297692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1754102a90 0x7f175419e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.054+0000 7f1758fe0700 1 --2- 172.21.15.135:0/4221297692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17540ff120 0x7f1754196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.054+0000 7f1758fe0700 1 --2- 172.21.15.135:0/4221297692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17541020f0 0x7f1754197380 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.054+0000 7f1758fe0700 1 -- 172.21.15.135:0/4221297692 >> 172.21.15.135:0/4221297692 conn(0x7f17540faa70 msgr2=0x7f1754105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.054+0000 7f1758fe0700 1 -- 172.21.15.135:0/4221297692 shutdown_connections 2024-05-08T23:14:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.054+0000 7f1758fe0700 1 -- 172.21.15.135:0/4221297692 wait complete. 2024-05-08T23:14:19.067 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T23:14:19.067 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T23:14:19.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:19.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:19.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:19.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:19.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:19.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:19.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:18 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/800066192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:19.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:19.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:14:19.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:19.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:18 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2309542659' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:19.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:18 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:14:19.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:18 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1148104836' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:14:19.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:19.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:19.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:19.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:19.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:19.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:19.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:18 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/800066192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:19.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:19.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:14:19.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:19.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:18 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2309542659' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:19.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:18 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:14:19.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:18 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1148104836' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:14:19.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.213+0000 7f7e0cc5b700 1 -- 172.21.15.135:0/213014323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e08073980 msgr2=0x7f7e08073e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:19.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.213+0000 7f7e0cc5b700 1 --2- 172.21.15.135:0/213014323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e08073980 0x7f7e08073e00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc009990 tx=0x7f7dfc009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:19.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.213+0000 7f7e0cc5b700 1 -- 172.21.15.135:0/213014323 shutdown_connections 2024-05-08T23:14:19.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.213+0000 7f7e0cc5b700 1 --2- 172.21.15.135:0/213014323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e08108e60 0x7f7e0810b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:19.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.213+0000 7f7e0cc5b700 1 --2- 172.21.15.135:0/213014323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e08074f60 0x7f7e080733b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:19.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.213+0000 7f7e0cc5b700 1 --2- 172.21.15.135:0/213014323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e08073980 0x7f7e08073e00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:19.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.213+0000 7f7e0cc5b700 1 -- 172.21.15.135:0/213014323 >> 172.21.15.135:0/213014323 conn(0x7f7e080fc4e0 msgr2=0x7f7e080fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:19.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.213+0000 7f7e0cc5b700 1 -- 172.21.15.135:0/213014323 shutdown_connections 2024-05-08T23:14:19.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.213+0000 7f7e0cc5b700 1 -- 172.21.15.135:0/213014323 wait complete. 2024-05-08T23:14:19.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.214+0000 7f7e0cc5b700 1 Processor -- start 2024-05-08T23:14:19.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.214+0000 7f7e0cc5b700 1 -- start start 2024-05-08T23:14:19.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.214+0000 7f7e0cc5b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e08073980 0x7f7e08199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:19.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.214+0000 7f7e0cc5b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e08074f60 0x7f7e08199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:19.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.214+0000 7f7e0cc5b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e08108e60 0x7f7e081a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:19.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.214+0000 7f7e0cc5b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e081a0b40 con 0x7f7e08074f60 2024-05-08T23:14:19.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.214+0000 7f7e0cc5b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0806a9c0 con 0x7f7e08073980 2024-05-08T23:14:19.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.214+0000 7f7e0cc5b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0806ab50 con 0x7f7e08108e60 2024-05-08T23:14:19.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.214+0000 7f7e0659c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e08073980 0x7f7e08199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:19.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.214+0000 7f7e0659c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e08073980 0x7f7e08199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.135:49630/0 (socket says 172.21.15.135:49630) 2024-05-08T23:14:19.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.214+0000 7f7e06d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e08108e60 0x7f7e081a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:19.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.214+0000 7f7e0659c700 1 -- 172.21.15.135:0/1302488908 learned_addr learned my addr 172.21.15.135:0/1302488908 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:19.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.214+0000 7f7e05d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e08074f60 0x7f7e08199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:19.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.215+0000 7f7e05d9b700 1 -- 172.21.15.135:0/1302488908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e08108e60 msgr2=0x7f7e081a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:19.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.215+0000 7f7e05d9b700 1 --2- 172.21.15.135:0/1302488908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e08108e60 0x7f7e081a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:19.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.215+0000 7f7e05d9b700 1 -- 172.21.15.135:0/1302488908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e08073980 msgr2=0x7f7e08199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:19.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.215+0000 7f7e05d9b700 1 --2- 172.21.15.135:0/1302488908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e08073980 0x7f7e08199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:19.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.215+0000 7f7e05d9b700 1 -- 172.21.15.135:0/1302488908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc0095f0 con 0x7f7e08074f60 2024-05-08T23:14:19.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.215+0000 7f7e0659c700 1 --2- 172.21.15.135:0/1302488908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e08073980 0x7f7e08199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:14:19.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.215+0000 7f7e05d9b700 1 --2- 172.21.15.135:0/1302488908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e08074f60 0x7f7e08199550 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0098e0 tx=0x7f7dfc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:19.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.215+0000 7f7df77fe700 1 -- 172.21.15.135:0/1302488908 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc01d070 con 0x7f7e08074f60 2024-05-08T23:14:19.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.215+0000 7f7df77fe700 1 -- 172.21.15.135:0/1302488908 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7dfc022470 con 0x7f7e08074f60 2024-05-08T23:14:19.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.215+0000 7f7df77fe700 1 -- 172.21.15.135:0/1302488908 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc017650 con 0x7f7e08074f60 2024-05-08T23:14:19.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.215+0000 7f7e0cc5b700 1 -- 172.21.15.135:0/1302488908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0806add0 con 0x7f7e08074f60 2024-05-08T23:14:19.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.215+0000 7f7e0cc5b700 1 -- 172.21.15.135:0/1302488908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0806b230 con 0x7f7e08074f60 2024-05-08T23:14:19.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.216+0000 7f7e0cc5b700 1 -- 172.21.15.135:0/1302488908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e08107c70 con 0x7f7e08074f60 2024-05-08T23:14:19.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.217+0000 7f7df77fe700 1 -- 172.21.15.135:0/1302488908 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f7dfc022890 con 0x7f7e08074f60 2024-05-08T23:14:19.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.218+0000 7f7df77fe700 1 --2- 172.21.15.135:0/1302488908 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7df00a1120 0x7f7df00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:19.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.218+0000 7f7df77fe700 1 -- 172.21.15.135:0/1302488908 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7dfc0cd8c0 con 0x7f7e08074f60 2024-05-08T23:14:19.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.218+0000 7f7e0659c700 1 --2- 172.21.15.135:0/1302488908 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7df00a1120 0x7f7df00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:19.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.218+0000 7f7e0659c700 1 --2- 172.21.15.135:0/1302488908 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7df00a1120 0x7f7df00a35e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7df800f4d0 tx=0x7f7df8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:19.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.222+0000 7f7df77fe700 1 -- 172.21.15.135:0/1302488908 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7dfc097580 con 0x7f7e08074f60 2024-05-08T23:14:19.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:19.496+0000 7f7e0cc5b700 1 -- 172.21.15.135:0/1302488908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7e08067460 con 0x7f7e08074f60 2024-05-08T23:14:20.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:19 smithi179 ceph-mon[46314]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:20.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:19 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/4221297692' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-08T23:14:20.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:19 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:19 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:19 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:19 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:19 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:19 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1302488908' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T23:14:20.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:19 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:19 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:20.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:19 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:14:20.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:19 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:19 smithi195 ceph-mon[46516]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:19 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/4221297692' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-08T23:14:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:19 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:19 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:19 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:19 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:19 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:19 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1302488908' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T23:14:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:19 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:19 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:19 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:14:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:19 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:19 smithi135 ceph-mon[42440]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:19 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/4221297692' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-08T23:14:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:19 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:19 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:19 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:19 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:19 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:19 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1302488908' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T23:14:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:19 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:19 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:14:20.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:19 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:14:20.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:19 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:20.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.501+0000 7f7df77fe700 1 -- 172.21.15.135:0/1302488908 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7dfc09aba0 con 0x7f7e08074f60 2024-05-08T23:14:20.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.506+0000 7f7e0cc5b700 1 -- 172.21.15.135:0/1302488908 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7df00a1120 msgr2=0x7f7df00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:20.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.506+0000 7f7e0cc5b700 1 --2- 172.21.15.135:0/1302488908 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7df00a1120 0x7f7df00a35e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7df800f4d0 tx=0x7f7df8005f90 comp rx=0 tx=0).stop 2024-05-08T23:14:20.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.506+0000 7f7e0cc5b700 1 -- 172.21.15.135:0/1302488908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e08074f60 msgr2=0x7f7e08199550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:20.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.506+0000 7f7e0cc5b700 1 --2- 172.21.15.135:0/1302488908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e08074f60 0x7f7e08199550 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0098e0 tx=0x7f7dfc00f690 comp rx=0 tx=0).stop 2024-05-08T23:14:20.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.506+0000 7f7e0cc5b700 1 -- 172.21.15.135:0/1302488908 shutdown_connections 2024-05-08T23:14:20.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.506+0000 7f7e0cc5b700 1 --2- 172.21.15.135:0/1302488908 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7df00a1120 0x7f7df00a35e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:20.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.506+0000 7f7e0cc5b700 1 --2- 172.21.15.135:0/1302488908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e08108e60 0x7f7e081a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:20.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.506+0000 7f7e0cc5b700 1 --2- 172.21.15.135:0/1302488908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e08073980 0x7f7e08199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:20.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.506+0000 7f7e0cc5b700 1 --2- 172.21.15.135:0/1302488908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e08074f60 0x7f7e08199550 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:20.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.506+0000 7f7e0cc5b700 1 -- 172.21.15.135:0/1302488908 >> 172.21.15.135:0/1302488908 conn(0x7f7e080fc4e0 msgr2=0x7f7e08104db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:20.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.506+0000 7f7e0cc5b700 1 -- 172.21.15.135:0/1302488908 shutdown_connections 2024-05-08T23:14:20.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.506+0000 7f7e0cc5b700 1 -- 172.21.15.135:0/1302488908 wait complete. 2024-05-08T23:14:20.507 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_metadata' created 2024-05-08T23:14:20.521 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T23:14:20.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.659+0000 7fb3a638d700 1 -- 172.21.15.135:0/3143538625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a0102b90 msgr2=0x7fb3a0109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:20.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.659+0000 7fb3a638d700 1 --2- 172.21.15.135:0/3143538625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a0102b90 0x7fb3a0109440 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb39800b0a0 tx=0x7fb39800b3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:20.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.659+0000 7fb3a638d700 1 -- 172.21.15.135:0/3143538625 shutdown_connections 2024-05-08T23:14:20.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.659+0000 7fb3a638d700 1 --2- 172.21.15.135:0/3143538625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a0102b90 0x7fb3a0109440 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:20.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.659+0000 7fb3a638d700 1 --2- 172.21.15.135:0/3143538625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3a00ff220 0x7fb3a00ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:20.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.659+0000 7fb3a638d700 1 --2- 172.21.15.135:0/3143538625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a01021f0 0x7fb3a0102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:20.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.659+0000 7fb3a638d700 1 -- 172.21.15.135:0/3143538625 >> 172.21.15.135:0/3143538625 conn(0x7fb3a00fab50 msgr2=0x7fb3a00fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:20.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.659+0000 7fb3a638d700 1 -- 172.21.15.135:0/3143538625 shutdown_connections 2024-05-08T23:14:20.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.660+0000 7fb3a638d700 1 -- 172.21.15.135:0/3143538625 wait complete. 2024-05-08T23:14:20.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.660+0000 7fb3a638d700 1 Processor -- start 2024-05-08T23:14:20.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.660+0000 7fb3a638d700 1 -- start start 2024-05-08T23:14:20.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb3a638d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a00ff220 0x7fb3a0196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:20.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb3a638d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a01021f0 0x7fb3a01974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:20.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb3a638d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3a0102b90 0x7fb3a019e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb3a638d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a019eac0 con 0x7fb3a01021f0 2024-05-08T23:14:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb3a638d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a019ec00 con 0x7fb3a0102b90 2024-05-08T23:14:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb3a638d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a019ed90 con 0x7fb3a00ff220 2024-05-08T23:14:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb39f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a01021f0 0x7fb3a01974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb39f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a01021f0 0x7fb3a01974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50566/0 (socket says 172.21.15.135:50566) 2024-05-08T23:14:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb39f7fe700 1 -- 172.21.15.135:0/2762564805 learned_addr learned my addr 172.21.15.135:0/2762564805 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb3a492a700 1 --2- 172.21.15.135:0/2762564805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3a0102b90 0x7fb3a019e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb39ffff700 1 --2- 172.21.15.135:0/2762564805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a00ff220 0x7fb3a0196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb39f7fe700 1 -- 172.21.15.135:0/2762564805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a00ff220 msgr2=0x7fb3a0196f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb39f7fe700 1 --2- 172.21.15.135:0/2762564805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a00ff220 0x7fb3a0196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb39f7fe700 1 -- 172.21.15.135:0/2762564805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3a0102b90 msgr2=0x7fb3a019e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb39f7fe700 1 --2- 172.21.15.135:0/2762564805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3a0102b90 0x7fb3a019e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb39f7fe700 1 -- 172.21.15.135:0/2762564805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb398009d00 con 0x7fb3a01021f0 2024-05-08T23:14:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb3a492a700 1 --2- 172.21.15.135:0/2762564805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3a0102b90 0x7fb3a019e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:14:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb39f7fe700 1 --2- 172.21.15.135:0/2762564805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a01021f0 0x7fb3a01974d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb39400c920 tx=0x7fb39400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb39d7fa700 1 -- 172.21.15.135:0/2762564805 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb394007b00 con 0x7fb3a01021f0 2024-05-08T23:14:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb3a638d700 1 -- 172.21.15.135:0/2762564805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a019f070 con 0x7fb3a01021f0 2024-05-08T23:14:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb39d7fa700 1 -- 172.21.15.135:0/2762564805 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb394004cf0 con 0x7fb3a01021f0 2024-05-08T23:14:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb39d7fa700 1 -- 172.21.15.135:0/2762564805 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb394005520 con 0x7fb3a01021f0 2024-05-08T23:14:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.661+0000 7fb3a638d700 1 -- 172.21.15.135:0/2762564805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a019f5d0 con 0x7fb3a01021f0 2024-05-08T23:14:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.662+0000 7fb3a638d700 1 -- 172.21.15.135:0/2762564805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a0108430 con 0x7fb3a01021f0 2024-05-08T23:14:20.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.664+0000 7fb39d7fa700 1 -- 172.21.15.135:0/2762564805 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fb394004750 con 0x7fb3a01021f0 2024-05-08T23:14:20.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.664+0000 7fb39d7fa700 1 --2- 172.21.15.135:0/2762564805 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb3880a1120 0x7fb3880a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:20.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.664+0000 7fb39d7fa700 1 -- 172.21.15.135:0/2762564805 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7497+0+0 (secure 0 0 0) 0x7fb3940cc6d0 con 0x7fb3a01021f0 2024-05-08T23:14:20.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.664+0000 7fb39ffff700 1 --2- 172.21.15.135:0/2762564805 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb3880a1120 0x7fb3880a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:20.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.665+0000 7fb39ffff700 1 --2- 172.21.15.135:0/2762564805 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb3880a1120 0x7fb3880a35e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb390005950 tx=0x7fb3900058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:20.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.668+0000 7fb39d7fa700 1 -- 172.21.15.135:0/2762564805 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb3940960f0 con 0x7fb3a01021f0 2024-05-08T23:14:20.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:20.869+0000 7fb3a638d700 1 -- 172.21.15.135:0/2762564805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb3a010c990 con 0x7fb3a01021f0 2024-05-08T23:14:21.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.506+0000 7fb39d7fa700 1 -- 172.21.15.135:0/2762564805 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb394099710 con 0x7fb3a01021f0 2024-05-08T23:14:21.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.524+0000 7fb3a638d700 1 -- 172.21.15.135:0/2762564805 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb3880a1120 msgr2=0x7fb3880a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:21.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.524+0000 7fb3a638d700 1 --2- 172.21.15.135:0/2762564805 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb3880a1120 0x7fb3880a35e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb390005950 tx=0x7fb3900058e0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.524+0000 7fb3a638d700 1 -- 172.21.15.135:0/2762564805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a01021f0 msgr2=0x7fb3a01974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:21.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.524+0000 7fb3a638d700 1 --2- 172.21.15.135:0/2762564805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a01021f0 0x7fb3a01974d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb39400c920 tx=0x7fb39400cce0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.525+0000 7fb3a638d700 1 -- 172.21.15.135:0/2762564805 shutdown_connections 2024-05-08T23:14:21.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.525+0000 7fb3a638d700 1 --2- 172.21.15.135:0/2762564805 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb3880a1120 0x7fb3880a35e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.525+0000 7fb3a638d700 1 --2- 172.21.15.135:0/2762564805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a00ff220 0x7fb3a0196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.525+0000 7fb3a638d700 1 --2- 172.21.15.135:0/2762564805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3a0102b90 0x7fb3a019e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.525+0000 7fb3a638d700 1 --2- 172.21.15.135:0/2762564805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a01021f0 0x7fb3a01974d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.525+0000 7fb3a638d700 1 -- 172.21.15.135:0/2762564805 >> 172.21.15.135:0/2762564805 conn(0x7fb3a00fab50 msgr2=0x7fb3a0105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:21.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.525+0000 7fb3a638d700 1 -- 172.21.15.135:0/2762564805 shutdown_connections 2024-05-08T23:14:21.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.525+0000 7fb3a638d700 1 -- 172.21.15.135:0/2762564805 wait complete. 2024-05-08T23:14:21.526 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data' created 2024-05-08T23:14:21.538 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T23:14:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.664+0000 7f0e9e333700 1 -- 172.21.15.135:0/1339034636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e98100f80 msgr2=0x7f0e981013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.664+0000 7f0e9e333700 1 --2- 172.21.15.135:0/1339034636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e98100f80 0x7f0e981013a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0e880099c0 tx=0x7f0e88009cd0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.664+0000 7f0e9e333700 1 -- 172.21.15.135:0/1339034636 shutdown_connections 2024-05-08T23:14:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.664+0000 7f0e9e333700 1 --2- 172.21.15.135:0/1339034636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e98102b10 0x7f0e981093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.664+0000 7f0e9e333700 1 --2- 172.21.15.135:0/1339034636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e98100f80 0x7f0e981013a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.664+0000 7f0e9e333700 1 --2- 172.21.15.135:0/1339034636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e98102170 0x7f0e981025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.664+0000 7f0e9e333700 1 -- 172.21.15.135:0/1339034636 >> 172.21.15.135:0/1339034636 conn(0x7f0e980fc4f0 msgr2=0x7f0e980fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.664+0000 7f0e9e333700 1 -- 172.21.15.135:0/1339034636 shutdown_connections 2024-05-08T23:14:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.664+0000 7f0e9e333700 1 -- 172.21.15.135:0/1339034636 wait complete. 2024-05-08T23:14:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.665+0000 7f0e9e333700 1 Processor -- start 2024-05-08T23:14:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.665+0000 7f0e9e333700 1 -- start start 2024-05-08T23:14:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.665+0000 7f0e9e333700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e98100f80 0x7f0e98196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.665+0000 7f0e9e333700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e98102170 0x7f0e98197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.665+0000 7f0e9e333700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e98102b10 0x7f0e9819e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.665+0000 7f0e9e333700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9819e980 con 0x7f0e98102b10 2024-05-08T23:14:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.665+0000 7f0e9e333700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9819eac0 con 0x7f0e98100f80 2024-05-08T23:14:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.665+0000 7f0e9e333700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9819ec50 con 0x7f0e98102170 2024-05-08T23:14:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.665+0000 7f0e9c8d0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e98102b10 0x7f0e9819e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.665+0000 7f0e9c8d0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e98102b10 0x7f0e9819e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50594/0 (socket says 172.21.15.135:50594) 2024-05-08T23:14:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.665+0000 7f0e9c8d0700 1 -- 172.21.15.135:0/2691721491 learned_addr learned my addr 172.21.15.135:0/2691721491 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.665+0000 7f0e977fe700 1 --2- 172.21.15.135:0/2691721491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e98102170 0x7f0e98197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.666+0000 7f0e97fff700 1 --2- 172.21.15.135:0/2691721491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e98100f80 0x7f0e98196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.666+0000 7f0e9c8d0700 1 -- 172.21.15.135:0/2691721491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e98102170 msgr2=0x7f0e98197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.666+0000 7f0e9c8d0700 1 --2- 172.21.15.135:0/2691721491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e98102170 0x7f0e98197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.666+0000 7f0e9c8d0700 1 -- 172.21.15.135:0/2691721491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e98100f80 msgr2=0x7f0e98196e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.666+0000 7f0e9c8d0700 1 --2- 172.21.15.135:0/2691721491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e98100f80 0x7f0e98196e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.666+0000 7f0e9c8d0700 1 -- 172.21.15.135:0/2691721491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e880095f0 con 0x7f0e98102b10 2024-05-08T23:14:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.666+0000 7f0e9c8d0700 1 --2- 172.21.15.135:0/2691721491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e98102b10 0x7f0e9819e3b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0e90007ee0 tx=0x7f0e9000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.666+0000 7f0e957fa700 1 -- 172.21.15.135:0/2691721491 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90017070 con 0x7f0e98102b10 2024-05-08T23:14:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.666+0000 7f0e957fa700 1 -- 172.21.15.135:0/2691721491 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e9000f040 con 0x7f0e98102b10 2024-05-08T23:14:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.666+0000 7f0e957fa700 1 -- 172.21.15.135:0/2691721491 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90005740 con 0x7f0e98102b10 2024-05-08T23:14:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.666+0000 7f0e9e333700 1 -- 172.21.15.135:0/2691721491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9819ef30 con 0x7f0e98102b10 2024-05-08T23:14:21.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.666+0000 7f0e9e333700 1 -- 172.21.15.135:0/2691721491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9819f300 con 0x7f0e98102b10 2024-05-08T23:14:21.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.667+0000 7f0e9e333700 1 -- 172.21.15.135:0/2691721491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e981083b0 con 0x7f0e98102b10 2024-05-08T23:14:21.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.668+0000 7f0e957fa700 1 -- 172.21.15.135:0/2691721491 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f0e9000dc60 con 0x7f0e98102b10 2024-05-08T23:14:21.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.669+0000 7f0e957fa700 1 --2- 172.21.15.135:0/2691721491 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e800a1120 0x7f0e800a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:21.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.669+0000 7f0e97fff700 1 --2- 172.21.15.135:0/2691721491 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e800a1120 0x7f0e800a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:21.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.669+0000 7f0e957fa700 1 -- 172.21.15.135:0/2691721491 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f0e900cc5c0 con 0x7f0e98102b10 2024-05-08T23:14:21.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.669+0000 7f0e97fff700 1 --2- 172.21.15.135:0/2691721491 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e800a1120 0x7f0e800a35e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800b580 tx=0x7f0e88005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:21.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.673+0000 7f0e957fa700 1 -- 172.21.15.135:0/2691721491 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0e90095ea0 con 0x7f0e98102b10 2024-05-08T23:14:21.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:21 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1302488908' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-08T23:14:21.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:21 smithi179 ceph-mon[46314]: osdmap e80: 12 total, 12 up, 12 in 2024-05-08T23:14:21.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:21 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2762564805' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T23:14:21.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:21 smithi179 ceph-mon[46314]: pgmap v220: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:21.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:21.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:21 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1302488908' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-08T23:14:21.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:21 smithi195 ceph-mon[46516]: osdmap e80: 12 total, 12 up, 12 in 2024-05-08T23:14:21.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:21 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2762564805' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T23:14:21.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:21 smithi195 ceph-mon[46516]: pgmap v220: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:21.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:21.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.920+0000 7f0e9e333700 1 -- 172.21.15.135:0/2691721491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0e98067cf0 con 0x7f0e98102b10 2024-05-08T23:14:21.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.930+0000 7f0e957fa700 1 -- 172.21.15.135:0/2691721491 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0e900994c0 con 0x7f0e98102b10 2024-05-08T23:14:21.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.938+0000 7f0e9e333700 1 -- 172.21.15.135:0/2691721491 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e800a1120 msgr2=0x7f0e800a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:21.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.938+0000 7f0e9e333700 1 --2- 172.21.15.135:0/2691721491 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e800a1120 0x7f0e800a35e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800b580 tx=0x7f0e88005fb0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.938+0000 7f0e9e333700 1 -- 172.21.15.135:0/2691721491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e98102b10 msgr2=0x7f0e9819e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:21.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.938+0000 7f0e9e333700 1 --2- 172.21.15.135:0/2691721491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e98102b10 0x7f0e9819e3b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0e90007ee0 tx=0x7f0e9000d3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.938+0000 7f0e9e333700 1 -- 172.21.15.135:0/2691721491 shutdown_connections 2024-05-08T23:14:21.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.938+0000 7f0e9e333700 1 --2- 172.21.15.135:0/2691721491 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e800a1120 0x7f0e800a35e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.938+0000 7f0e9e333700 1 --2- 172.21.15.135:0/2691721491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e98102b10 0x7f0e9819e3b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.938+0000 7f0e9e333700 1 --2- 172.21.15.135:0/2691721491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e98100f80 0x7f0e98196e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.938+0000 7f0e9e333700 1 --2- 172.21.15.135:0/2691721491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e98102170 0x7f0e98197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:21.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.938+0000 7f0e9e333700 1 -- 172.21.15.135:0/2691721491 >> 172.21.15.135:0/2691721491 conn(0x7f0e980fc4f0 msgr2=0x7f0e981054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:21.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.941+0000 7f0e9e333700 1 -- 172.21.15.135:0/2691721491 shutdown_connections 2024-05-08T23:14:21.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:21.941+0000 7f0e9e333700 1 -- 172.21.15.135:0/2691721491 wait complete. 2024-05-08T23:14:21.953 INFO:teuthology.orchestra.run.smithi135.stderr:new fs with metadata pool 2 and data pool 3 2024-05-08T23:14:21.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:21 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1302488908' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-08T23:14:21.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:21 smithi135 ceph-mon[42440]: osdmap e80: 12 total, 12 up, 12 in 2024-05-08T23:14:21.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:21 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2762564805' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T23:14:21.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:21 smithi135 ceph-mon[42440]: pgmap v220: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T23:14:21.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:14:21.964 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T23:14:22.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.087+0000 7f53c62ad700 1 -- 172.21.15.135:0/935855508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53c0104220 msgr2=0x7f53c0106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:22.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.087+0000 7f53c62ad700 1 --2- 172.21.15.135:0/935855508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53c0104220 0x7f53c0106610 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009990 tx=0x7f53b0009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.088+0000 7f53c62ad700 1 -- 172.21.15.135:0/935855508 shutdown_connections 2024-05-08T23:14:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.088+0000 7f53c62ad700 1 --2- 172.21.15.135:0/935855508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53c0106b50 0x7f53c0108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.088+0000 7f53c62ad700 1 --2- 172.21.15.135:0/935855508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c01018f0 0x7f53c0103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.088+0000 7f53c62ad700 1 --2- 172.21.15.135:0/935855508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53c0104220 0x7f53c0106610 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.088+0000 7f53c62ad700 1 -- 172.21.15.135:0/935855508 >> 172.21.15.135:0/935855508 conn(0x7f53c00fb2e0 msgr2=0x7f53c00fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.088+0000 7f53c62ad700 1 -- 172.21.15.135:0/935855508 shutdown_connections 2024-05-08T23:14:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.088+0000 7f53c62ad700 1 -- 172.21.15.135:0/935855508 wait complete. 2024-05-08T23:14:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.088+0000 7f53c62ad700 1 Processor -- start 2024-05-08T23:14:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.088+0000 7f53c62ad700 1 -- start start 2024-05-08T23:14:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53c62ad700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c01018f0 0x7f53c0101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53c62ad700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53c0104220 0x7f53c00ff8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53c62ad700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53c0106b50 0x7f53c00ffde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53c62ad700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c0100580 con 0x7f53c0104220 2024-05-08T23:14:22.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53c62ad700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c01006f0 con 0x7f53c01018f0 2024-05-08T23:14:22.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53c62ad700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c01a0df0 con 0x7f53c0106b50 2024-05-08T23:14:22.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53bf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53c0104220 0x7f53c00ff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:22.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53bf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53c0104220 0x7f53c00ff8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50598/0 (socket says 172.21.15.135:50598) 2024-05-08T23:14:22.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53bf7fe700 1 -- 172.21.15.135:0/2349955438 learned_addr learned my addr 172.21.15.135:0/2349955438 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:22.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53bffff700 1 --2- 172.21.15.135:0/2349955438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c01018f0 0x7f53c0101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:22.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53c484a700 1 --2- 172.21.15.135:0/2349955438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53c0106b50 0x7f53c00ffde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:22.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53bf7fe700 1 -- 172.21.15.135:0/2349955438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53c0106b50 msgr2=0x7f53c00ffde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:22.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53bf7fe700 1 --2- 172.21.15.135:0/2349955438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53c0106b50 0x7f53c00ffde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53bf7fe700 1 -- 172.21.15.135:0/2349955438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c01018f0 msgr2=0x7f53c0101210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:22.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53bf7fe700 1 --2- 172.21.15.135:0/2349955438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c01018f0 0x7f53c0101210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53bf7fe700 1 -- 172.21.15.135:0/2349955438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b00095f0 con 0x7f53c0104220 2024-05-08T23:14:22.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53c484a700 1 --2- 172.21.15.135:0/2349955438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53c0106b50 0x7f53c00ffde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:14:22.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53bf7fe700 1 --2- 172.21.15.135:0/2349955438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53c0104220 0x7f53c00ff8a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f53b00095c0 tx=0x7f53b000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:22.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53bd7fa700 1 -- 172.21.15.135:0/2349955438 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b001d070 con 0x7f53c0104220 2024-05-08T23:14:22.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53bd7fa700 1 -- 172.21.15.135:0/2349955438 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53b0022470 con 0x7f53c0104220 2024-05-08T23:14:22.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53c62ad700 1 -- 172.21.15.135:0/2349955438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c01a1020 con 0x7f53c0104220 2024-05-08T23:14:22.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53bd7fa700 1 -- 172.21.15.135:0/2349955438 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0017650 con 0x7f53c0104220 2024-05-08T23:14:22.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.089+0000 7f53c62ad700 1 -- 172.21.15.135:0/2349955438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c01a1440 con 0x7f53c0104220 2024-05-08T23:14:22.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.090+0000 7f53c62ad700 1 -- 172.21.15.135:0/2349955438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c00fce60 con 0x7f53c0104220 2024-05-08T23:14:22.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.092+0000 7f53bd7fa700 1 -- 172.21.15.135:0/2349955438 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f53b0022850 con 0x7f53c0104220 2024-05-08T23:14:22.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.093+0000 7f53bd7fa700 1 --2- 172.21.15.135:0/2349955438 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f53ac0a11a0 0x7f53ac0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:22.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.093+0000 7f53bffff700 1 --2- 172.21.15.135:0/2349955438 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f53ac0a11a0 0x7f53ac0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:22.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.093+0000 7f53bd7fa700 1 -- 172.21.15.135:0/2349955438 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f53b00ce030 con 0x7f53c0104220 2024-05-08T23:14:22.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.093+0000 7f53bffff700 1 --2- 172.21.15.135:0/2349955438 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f53ac0a11a0 0x7f53ac0a3660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f53a8005950 tx=0x7f53a800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:22.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.096+0000 7f53bd7fa700 1 -- 172.21.15.135:0/2349955438 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f53b0097900 con 0x7f53c0104220 2024-05-08T23:14:22.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.295+0000 7f53c62ad700 1 -- 172.21.15.135:0/2349955438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53c010c660 con 0x7f53c0104220 2024-05-08T23:14:22.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.296+0000 7f53bd7fa700 1 -- 172.21.15.135:0/2349955438 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22189 (secure 0 0 0) 0x7f53b009af20 con 0x7f53c0104220 2024-05-08T23:14:22.296 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:22.296 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":82,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:14:21.920942+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T23:14:19.726838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T23:14:21.097732+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:14:22.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.299+0000 7f53c62ad700 1 -- 172.21.15.135:0/2349955438 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f53ac0a11a0 msgr2=0x7f53ac0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:22.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.299+0000 7f53c62ad700 1 --2- 172.21.15.135:0/2349955438 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f53ac0a11a0 0x7f53ac0a3660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f53a8005950 tx=0x7f53a800a300 comp rx=0 tx=0).stop 2024-05-08T23:14:22.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.299+0000 7f53c62ad700 1 -- 172.21.15.135:0/2349955438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53c0104220 msgr2=0x7f53c00ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.299+0000 7f53c62ad700 1 --2- 172.21.15.135:0/2349955438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53c0104220 0x7f53c00ff8a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f53b00095c0 tx=0x7f53b000f690 comp rx=0 tx=0).stop 2024-05-08T23:14:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.299+0000 7f53c62ad700 1 -- 172.21.15.135:0/2349955438 shutdown_connections 2024-05-08T23:14:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.299+0000 7f53c62ad700 1 --2- 172.21.15.135:0/2349955438 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f53ac0a11a0 0x7f53ac0a3660 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.299+0000 7f53c62ad700 1 --2- 172.21.15.135:0/2349955438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53c0106b50 0x7f53c00ffde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.299+0000 7f53c62ad700 1 --2- 172.21.15.135:0/2349955438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c01018f0 0x7f53c0101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.299+0000 7f53c62ad700 1 --2- 172.21.15.135:0/2349955438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53c0104220 0x7f53c00ff8a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.299+0000 7f53c62ad700 1 -- 172.21.15.135:0/2349955438 >> 172.21.15.135:0/2349955438 conn(0x7f53c00fb2e0 msgr2=0x7f53c01037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.299+0000 7f53c62ad700 1 -- 172.21.15.135:0/2349955438 shutdown_connections 2024-05-08T23:14:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.299+0000 7f53c62ad700 1 -- 172.21.15.135:0/2349955438 wait complete. 2024-05-08T23:14:22.311 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T23:14:22.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.433+0000 7f7992979700 1 -- 172.21.15.135:0/704766914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f798c0ffd60 msgr2=0x7f798c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:22.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.433+0000 7f7992979700 1 --2- 172.21.15.135:0/704766914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f798c0ffd60 0x7f798c100180 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f79800099c0 tx=0x7f7980009cd0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.433+0000 7f7992979700 1 -- 172.21.15.135:0/704766914 shutdown_connections 2024-05-08T23:14:22.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.433+0000 7f7992979700 1 --2- 172.21.15.135:0/704766914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798c1018f0 0x7f798c1081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.433+0000 7f7992979700 1 --2- 172.21.15.135:0/704766914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f798c0ffd60 0x7f798c100180 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.433+0000 7f7992979700 1 --2- 172.21.15.135:0/704766914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f798c100f50 0x7f798c1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.433+0000 7f7992979700 1 -- 172.21.15.135:0/704766914 >> 172.21.15.135:0/704766914 conn(0x7f798c0fb2f0 msgr2=0x7f798c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:22.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.433+0000 7f7992979700 1 -- 172.21.15.135:0/704766914 shutdown_connections 2024-05-08T23:14:22.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.433+0000 7f7992979700 1 -- 172.21.15.135:0/704766914 wait complete. 2024-05-08T23:14:22.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.433+0000 7f7992979700 1 Processor -- start 2024-05-08T23:14:22.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.433+0000 7f7992979700 1 -- start start 2024-05-08T23:14:22.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f7992979700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f798c0ffd60 0x7f798c195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:22.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f7992979700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798c100f50 0x7f798c1961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:22.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f7992979700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f798c1018f0 0x7f798c19d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:22.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f7992979700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c19d790 con 0x7f798c1018f0 2024-05-08T23:14:22.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f7992979700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c19d900 con 0x7f798c100f50 2024-05-08T23:14:22.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f7992979700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c19dac0 con 0x7f798c0ffd60 2024-05-08T23:14:22.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f7990f16700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f798c1018f0 0x7f798c19d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:22.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f7990f16700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f798c1018f0 0x7f798c19d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50618/0 (socket says 172.21.15.135:50618) 2024-05-08T23:14:22.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f7990f16700 1 -- 172.21.15.135:0/3370080564 learned_addr learned my addr 172.21.15.135:0/3370080564 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:22.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f798bfff700 1 --2- 172.21.15.135:0/3370080564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f798c0ffd60 0x7f798c195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:22.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f798b7fe700 1 --2- 172.21.15.135:0/3370080564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798c100f50 0x7f798c1961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:22.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f7990f16700 1 -- 172.21.15.135:0/3370080564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f798c0ffd60 msgr2=0x7f798c195ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:22.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f7990f16700 1 --2- 172.21.15.135:0/3370080564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f798c0ffd60 0x7f798c195ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f7990f16700 1 -- 172.21.15.135:0/3370080564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798c100f50 msgr2=0x7f798c1961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:22.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f7990f16700 1 --2- 172.21.15.135:0/3370080564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798c100f50 0x7f798c1961e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f7990f16700 1 -- 172.21.15.135:0/3370080564 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79800095f0 con 0x7f798c1018f0 2024-05-08T23:14:22.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.434+0000 7f7990f16700 1 --2- 172.21.15.135:0/3370080564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f798c1018f0 0x7f798c19d1c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7984007d70 tx=0x7f798400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:22.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.435+0000 7f79897fa700 1 -- 172.21.15.135:0/3370080564 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400ac90 con 0x7f798c1018f0 2024-05-08T23:14:22.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.435+0000 7f79897fa700 1 -- 172.21.15.135:0/3370080564 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f798400adf0 con 0x7f798c1018f0 2024-05-08T23:14:22.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.435+0000 7f7992979700 1 -- 172.21.15.135:0/3370080564 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798c19dda0 con 0x7f798c1018f0 2024-05-08T23:14:22.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.435+0000 7f79897fa700 1 -- 172.21.15.135:0/3370080564 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79840115e0 con 0x7f798c1018f0 2024-05-08T23:14:22.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.435+0000 7f7992979700 1 -- 172.21.15.135:0/3370080564 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798c19e1d0 con 0x7f798c1018f0 2024-05-08T23:14:22.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.436+0000 7f7992979700 1 -- 172.21.15.135:0/3370080564 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798c1071e0 con 0x7f798c1018f0 2024-05-08T23:14:22.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.437+0000 7f79897fa700 1 -- 172.21.15.135:0/3370080564 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f7984012420 con 0x7f798c1018f0 2024-05-08T23:14:22.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.437+0000 7f79897fa700 1 --2- 172.21.15.135:0/3370080564 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f79740a11a0 0x7f79740a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:22.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.437+0000 7f798bfff700 1 --2- 172.21.15.135:0/3370080564 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f79740a11a0 0x7f79740a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:22.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.437+0000 7f79897fa700 1 -- 172.21.15.135:0/3370080564 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f79840cc8e0 con 0x7f798c1018f0 2024-05-08T23:14:22.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.438+0000 7f798bfff700 1 --2- 172.21.15.135:0/3370080564 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f79740a11a0 0x7f79740a3660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7980003820 tx=0x7f7980005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:22.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.442+0000 7f79897fa700 1 -- 172.21.15.135:0/3370080564 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f79840961c0 con 0x7f798c1018f0 2024-05-08T23:14:22.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.645+0000 7f7992979700 1 -- 172.21.15.135:0/3370080564 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f798c10b700 con 0x7f798c1018f0 2024-05-08T23:14:22.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.646+0000 7f79897fa700 1 -- 172.21.15.135:0/3370080564 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22189 (secure 0 0 0) 0x7f79840997e0 con 0x7f798c1018f0 2024-05-08T23:14:22.646 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:22.646 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":82,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:14:21.920942+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T23:14:19.726838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T23:14:21.097732+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:14:22.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.648+0000 7f7992979700 1 -- 172.21.15.135:0/3370080564 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f79740a11a0 msgr2=0x7f79740a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:22.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.648+0000 7f7992979700 1 --2- 172.21.15.135:0/3370080564 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f79740a11a0 0x7f79740a3660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7980003820 tx=0x7f7980005900 comp rx=0 tx=0).stop 2024-05-08T23:14:22.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.648+0000 7f7992979700 1 -- 172.21.15.135:0/3370080564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f798c1018f0 msgr2=0x7f798c19d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:22.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.648+0000 7f7992979700 1 --2- 172.21.15.135:0/3370080564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f798c1018f0 0x7f798c19d1c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7984007d70 tx=0x7f798400a340 comp rx=0 tx=0).stop 2024-05-08T23:14:22.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.649+0000 7f7992979700 1 -- 172.21.15.135:0/3370080564 shutdown_connections 2024-05-08T23:14:22.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.649+0000 7f7992979700 1 --2- 172.21.15.135:0/3370080564 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f79740a11a0 0x7f79740a3660 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.649+0000 7f7992979700 1 --2- 172.21.15.135:0/3370080564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f798c0ffd60 0x7f798c195ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.649+0000 7f7992979700 1 --2- 172.21.15.135:0/3370080564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f798c1018f0 0x7f798c19d1c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.649+0000 7f7992979700 1 --2- 172.21.15.135:0/3370080564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798c100f50 0x7f798c1961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.649+0000 7f7992979700 1 -- 172.21.15.135:0/3370080564 >> 172.21.15.135:0/3370080564 conn(0x7f798c0fb2f0 msgr2=0x7f798c104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:22.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.649+0000 7f7992979700 1 -- 172.21.15.135:0/3370080564 shutdown_connections 2024-05-08T23:14:22.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.649+0000 7f7992979700 1 -- 172.21.15.135:0/3370080564 wait complete. 2024-05-08T23:14:22.659 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:22 smithi135 ceph-mon[42440]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T23:14:22.659 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:22 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2762564805' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-08T23:14:22.659 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:22 smithi135 ceph-mon[42440]: osdmap e81: 12 total, 12 up, 12 in 2024-05-08T23:14:22.659 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:22 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2691721491' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T23:14:22.660 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:22 smithi135 ceph-mon[42440]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-05-08T23:14:22.660 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:22 smithi135 ceph-mon[42440]: osdmap e82: 12 total, 12 up, 12 in 2024-05-08T23:14:22.660 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:22 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2691721491' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-08T23:14:22.660 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:22 smithi135 ceph-mon[42440]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-05-08T23:14:22.660 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:22 smithi135 ceph-mon[42440]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-05-08T23:14:22.660 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:22 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2349955438' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:22.661 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-08T23:14:22.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.787+0000 7fc24fd13700 1 -- 172.21.15.135:0/940329179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc248106c40 msgr2=0x7fc2481090b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:22.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.787+0000 7fc24fd13700 1 --2- 172.21.15.135:0/940329179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc248106c40 0x7fc2481090b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc24000b0a0 tx=0x7fc24000b3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.787+0000 7fc24fd13700 1 -- 172.21.15.135:0/940329179 shutdown_connections 2024-05-08T23:14:22.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.787+0000 7fc24fd13700 1 --2- 172.21.15.135:0/940329179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2481019e0 0x7fc248103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.787+0000 7fc24fd13700 1 --2- 172.21.15.135:0/940329179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc248106c40 0x7fc2481090b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.787+0000 7fc24fd13700 1 --2- 172.21.15.135:0/940329179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc248104310 0x7fc248106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.787+0000 7fc24fd13700 1 -- 172.21.15.135:0/940329179 >> 172.21.15.135:0/940329179 conn(0x7fc2480fb3f0 msgr2=0x7fc2480fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:22.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.787+0000 7fc24fd13700 1 -- 172.21.15.135:0/940329179 shutdown_connections 2024-05-08T23:14:22.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.787+0000 7fc24fd13700 1 -- 172.21.15.135:0/940329179 wait complete. 2024-05-08T23:14:22.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24fd13700 1 Processor -- start 2024-05-08T23:14:22.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24fd13700 1 -- start start 2024-05-08T23:14:22.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24fd13700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2481019e0 0x7fc248196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:22.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24fd13700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc248104310 0x7fc2481974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:22.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24fd13700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc248106c40 0x7fc24819e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:22.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24fd13700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24819eaa0 con 0x7fc248104310 2024-05-08T23:14:22.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24fd13700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24819ebe0 con 0x7fc248106c40 2024-05-08T23:14:22.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24fd13700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24819ed70 con 0x7fc2481019e0 2024-05-08T23:14:22.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24d2ae700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc248104310 0x7fc2481974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:22.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24d2ae700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc248104310 0x7fc2481974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50626/0 (socket says 172.21.15.135:50626) 2024-05-08T23:14:22.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24d2ae700 1 -- 172.21.15.135:0/2207417945 learned_addr learned my addr 172.21.15.135:0/2207417945 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:22.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24daaf700 1 --2- 172.21.15.135:0/2207417945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2481019e0 0x7fc248196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:22.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24e2b0700 1 --2- 172.21.15.135:0/2207417945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc248106c40 0x7fc24819e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:22.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24d2ae700 1 -- 172.21.15.135:0/2207417945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2481019e0 msgr2=0x7fc248196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:22.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24d2ae700 1 --2- 172.21.15.135:0/2207417945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2481019e0 0x7fc248196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24d2ae700 1 -- 172.21.15.135:0/2207417945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc248106c40 msgr2=0x7fc24819e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:22.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24d2ae700 1 --2- 172.21.15.135:0/2207417945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc248106c40 0x7fc24819e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:22.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24d2ae700 1 -- 172.21.15.135:0/2207417945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc240009d00 con 0x7fc248104310 2024-05-08T23:14:22.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc24d2ae700 1 --2- 172.21.15.135:0/2207417945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc248104310 0x7fc2481974b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc24400d950 tx=0x7fc24400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:22.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.788+0000 7fc23effd700 1 -- 172.21.15.135:0/2207417945 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24400f890 con 0x7fc248104310 2024-05-08T23:14:22.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.789+0000 7fc23effd700 1 -- 172.21.15.135:0/2207417945 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc244010460 con 0x7fc248104310 2024-05-08T23:14:22.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.789+0000 7fc24fd13700 1 -- 172.21.15.135:0/2207417945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24819eff0 con 0x7fc248104310 2024-05-08T23:14:22.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.789+0000 7fc23effd700 1 -- 172.21.15.135:0/2207417945 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24400e610 con 0x7fc248104310 2024-05-08T23:14:22.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.789+0000 7fc24fd13700 1 -- 172.21.15.135:0/2207417945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24819f520 con 0x7fc248104310 2024-05-08T23:14:22.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.789+0000 7fc24fd13700 1 -- 172.21.15.135:0/2207417945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2480fcf70 con 0x7fc248104310 2024-05-08T23:14:22.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.791+0000 7fc23effd700 1 -- 172.21.15.135:0/2207417945 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fc2440108d0 con 0x7fc248104310 2024-05-08T23:14:22.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.791+0000 7fc23effd700 1 --2- 172.21.15.135:0/2207417945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc2340a11a0 0x7fc2340a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:22.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.791+0000 7fc23effd700 1 -- 172.21.15.135:0/2207417945 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc2440cc500 con 0x7fc248104310 2024-05-08T23:14:22.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.791+0000 7fc24daaf700 1 --2- 172.21.15.135:0/2207417945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc2340a11a0 0x7fc2340a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:22.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.792+0000 7fc24daaf700 1 --2- 172.21.15.135:0/2207417945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc2340a11a0 0x7fc2340a3660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc238009c60 tx=0x7fc238009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:22.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:22.795+0000 7fc23effd700 1 -- 172.21.15.135:0/2207417945 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc244095de0 con 0x7fc248104310 2024-05-08T23:14:22.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:22 smithi179 ceph-mon[46314]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T23:14:22.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:22 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2762564805' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-08T23:14:22.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:22 smithi179 ceph-mon[46314]: osdmap e81: 12 total, 12 up, 12 in 2024-05-08T23:14:22.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:22 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2691721491' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T23:14:22.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:22 smithi179 ceph-mon[46314]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-05-08T23:14:22.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:22 smithi179 ceph-mon[46314]: osdmap e82: 12 total, 12 up, 12 in 2024-05-08T23:14:22.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:22 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2691721491' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-08T23:14:22.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:22 smithi179 ceph-mon[46314]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-05-08T23:14:22.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:22 smithi179 ceph-mon[46314]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-05-08T23:14:22.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:22 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2349955438' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:22.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:22 smithi195 ceph-mon[46516]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T23:14:22.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:22 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2762564805' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-08T23:14:22.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:22 smithi195 ceph-mon[46516]: osdmap e81: 12 total, 12 up, 12 in 2024-05-08T23:14:22.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:22 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2691721491' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T23:14:22.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:22 smithi195 ceph-mon[46516]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-05-08T23:14:22.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:22 smithi195 ceph-mon[46516]: osdmap e82: 12 total, 12 up, 12 in 2024-05-08T23:14:22.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:22 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2691721491' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-08T23:14:22.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:22 smithi195 ceph-mon[46516]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-05-08T23:14:22.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:22 smithi195 ceph-mon[46516]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-05-08T23:14:22.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:22 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2349955438' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:23.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:23.039+0000 7fc24fd13700 1 -- 172.21.15.135:0/2207417945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc248067cc0 con 0x7fc248104310 2024-05-08T23:14:23.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:23 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3370080564' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:23.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:23 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] up:active 2024-05-08T23:14:23.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:23 smithi179 ceph-mon[46314]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-08T23:14:23.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:23 smithi179 ceph-mon[46314]: osdmap e83: 12 total, 12 up, 12 in 2024-05-08T23:14:23.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:23 smithi179 ceph-mon[46314]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-08T23:14:23.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:23 smithi179 ceph-mon[46314]: pgmap v224: 97 pgs: 36 active+clean, 12 creating+peering, 49 unknown; 578 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 2 op/s 2024-05-08T23:14:23.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:23 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2207417945' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T23:14:23.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:23 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3370080564' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:23.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:23 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] up:active 2024-05-08T23:14:23.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:23 smithi195 ceph-mon[46516]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-08T23:14:23.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:23 smithi195 ceph-mon[46516]: osdmap e83: 12 total, 12 up, 12 in 2024-05-08T23:14:23.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:23 smithi195 ceph-mon[46516]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-08T23:14:23.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:23 smithi195 ceph-mon[46516]: pgmap v224: 97 pgs: 36 active+clean, 12 creating+peering, 49 unknown; 578 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 2 op/s 2024-05-08T23:14:23.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:23 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2207417945' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T23:14:23.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:23.939+0000 7fc23effd700 1 -- 172.21.15.135:0/2207417945 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc2440200b0 con 0x7fc248104310 2024-05-08T23:14:23.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:23.942+0000 7fc24fd13700 1 -- 172.21.15.135:0/2207417945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc2340a11a0 msgr2=0x7fc2340a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:23.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:23.942+0000 7fc24fd13700 1 --2- 172.21.15.135:0/2207417945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc2340a11a0 0x7fc2340a3660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc238009c60 tx=0x7fc238009260 comp rx=0 tx=0).stop 2024-05-08T23:14:23.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:23.942+0000 7fc24fd13700 1 -- 172.21.15.135:0/2207417945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc248104310 msgr2=0x7fc2481974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:23.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:23.942+0000 7fc24fd13700 1 --2- 172.21.15.135:0/2207417945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc248104310 0x7fc2481974b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc24400d950 tx=0x7fc24400dc60 comp rx=0 tx=0).stop 2024-05-08T23:14:23.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:23.942+0000 7fc24fd13700 1 -- 172.21.15.135:0/2207417945 shutdown_connections 2024-05-08T23:14:23.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:23.942+0000 7fc24fd13700 1 --2- 172.21.15.135:0/2207417945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc2340a11a0 0x7fc2340a3660 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:23.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:23.942+0000 7fc24fd13700 1 --2- 172.21.15.135:0/2207417945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2481019e0 0x7fc248196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:23.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:23.942+0000 7fc24fd13700 1 --2- 172.21.15.135:0/2207417945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc248106c40 0x7fc24819e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:23.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:23.942+0000 7fc24fd13700 1 --2- 172.21.15.135:0/2207417945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc248104310 0x7fc2481974b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:23.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:23.942+0000 7fc24fd13700 1 -- 172.21.15.135:0/2207417945 >> 172.21.15.135:0/2207417945 conn(0x7fc2480fb3f0 msgr2=0x7fc248102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:23.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:23.942+0000 7fc24fd13700 1 -- 172.21.15.135:0/2207417945 shutdown_connections 2024-05-08T23:14:23.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:23.942+0000 7fc24fd13700 1 -- 172.21.15.135:0/2207417945 wait complete. 2024-05-08T23:14:23.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:23 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3370080564' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:23.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:23 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] up:active 2024-05-08T23:14:23.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:23 smithi135 ceph-mon[42440]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-08T23:14:23.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:23 smithi135 ceph-mon[42440]: osdmap e83: 12 total, 12 up, 12 in 2024-05-08T23:14:23.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:23 smithi135 ceph-mon[42440]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-08T23:14:23.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:23 smithi135 ceph-mon[42440]: pgmap v224: 97 pgs: 36 active+clean, 12 creating+peering, 49 unknown; 578 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 2 op/s 2024-05-08T23:14:23.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:23 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2207417945' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T23:14:23.956 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-05-08T23:14:23.956 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-05-08T23:14:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.088+0000 7fc67bde5700 1 -- 172.21.15.135:0/1251563765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6740ffe80 msgr2=0x7fc6741002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.088+0000 7fc67bde5700 1 --2- 172.21.15.135:0/1251563765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6740ffe80 0x7fc6741002a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc664009990 tx=0x7fc664009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.088+0000 7fc67bde5700 1 -- 172.21.15.135:0/1251563765 shutdown_connections 2024-05-08T23:14:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.088+0000 7fc67bde5700 1 --2- 172.21.15.135:0/1251563765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc674101990 0x7fc6741082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.088+0000 7fc67bde5700 1 --2- 172.21.15.135:0/1251563765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6740ffe80 0x7fc6741002a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.088+0000 7fc67bde5700 1 --2- 172.21.15.135:0/1251563765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc674100fd0 0x7fc674101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.088+0000 7fc67bde5700 1 -- 172.21.15.135:0/1251563765 >> 172.21.15.135:0/1251563765 conn(0x7fc6740fb3f0 msgr2=0x7fc6740fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.088+0000 7fc67bde5700 1 -- 172.21.15.135:0/1251563765 shutdown_connections 2024-05-08T23:14:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.088+0000 7fc67bde5700 1 -- 172.21.15.135:0/1251563765 wait complete. 2024-05-08T23:14:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.089+0000 7fc67bde5700 1 Processor -- start 2024-05-08T23:14:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.089+0000 7fc67bde5700 1 -- start start 2024-05-08T23:14:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.089+0000 7fc67bde5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6740ffe80 0x7fc674195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.089+0000 7fc67bde5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc674100fd0 0x7fc6741962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.089+0000 7fc67bde5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674101990 0x7fc67419d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.089+0000 7fc67bde5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67419d850 con 0x7fc674101990 2024-05-08T23:14:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.089+0000 7fc67bde5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67419d9c0 con 0x7fc674100fd0 2024-05-08T23:14:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.089+0000 7fc67bde5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67419db80 con 0x7fc6740ffe80 2024-05-08T23:14:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc67a382700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674101990 0x7fc67419d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc67a382700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674101990 0x7fc67419d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50650/0 (socket says 172.21.15.135:50650) 2024-05-08T23:14:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc67a382700 1 -- 172.21.15.135:0/1216278947 learned_addr learned my addr 172.21.15.135:0/1216278947 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc679380700 1 --2- 172.21.15.135:0/1216278947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc674100fd0 0x7fc6741962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc679b81700 1 --2- 172.21.15.135:0/1216278947 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6740ffe80 0x7fc674195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc67a382700 1 -- 172.21.15.135:0/1216278947 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6740ffe80 msgr2=0x7fc674195d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc67a382700 1 --2- 172.21.15.135:0/1216278947 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6740ffe80 0x7fc674195d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc67a382700 1 -- 172.21.15.135:0/1216278947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc674100fd0 msgr2=0x7fc6741962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc67a382700 1 --2- 172.21.15.135:0/1216278947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc674100fd0 0x7fc6741962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc67a382700 1 -- 172.21.15.135:0/1216278947 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6640095f0 con 0x7fc674101990 2024-05-08T23:14:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc67a382700 1 --2- 172.21.15.135:0/1216278947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674101990 0x7fc67419d280 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc66c00efb0 tx=0x7fc66c00c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc66affd700 1 -- 172.21.15.135:0/1216278947 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c011670 con 0x7fc674101990 2024-05-08T23:14:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc66affd700 1 -- 172.21.15.135:0/1216278947 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc66c011c90 con 0x7fc674101990 2024-05-08T23:14:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc67bde5700 1 -- 172.21.15.135:0/1216278947 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6740694b0 con 0x7fc674101990 2024-05-08T23:14:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc66affd700 1 -- 172.21.15.135:0/1216278947 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c01ac70 con 0x7fc674101990 2024-05-08T23:14:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.090+0000 7fc67bde5700 1 -- 172.21.15.135:0/1216278947 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc674069970 con 0x7fc674101990 2024-05-08T23:14:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.091+0000 7fc67bde5700 1 -- 172.21.15.135:0/1216278947 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc674068140 con 0x7fc674101990 2024-05-08T23:14:24.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.092+0000 7fc66affd700 1 -- 172.21.15.135:0/1216278947 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fc66c0117d0 con 0x7fc674101990 2024-05-08T23:14:24.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.093+0000 7fc66affd700 1 --2- 172.21.15.135:0/1216278947 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc6600a1120 0x7fc6600a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:24.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.093+0000 7fc679b81700 1 --2- 172.21.15.135:0/1216278947 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc6600a1120 0x7fc6600a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:24.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.093+0000 7fc66affd700 1 -- 172.21.15.135:0/1216278947 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc66c0ceee0 con 0x7fc674101990 2024-05-08T23:14:24.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.093+0000 7fc679b81700 1 --2- 172.21.15.135:0/1216278947 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc6600a1120 0x7fc6600a35e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc66400b5c0 tx=0x7fc664005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:24.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.097+0000 7fc66affd700 1 -- 172.21.15.135:0/1216278947 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc66c0987c0 con 0x7fc674101990 2024-05-08T23:14:24.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.343+0000 7fc67bde5700 1 -- 172.21.15.135:0/1216278947 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7fc674106c80 con 0x7fc674101990 2024-05-08T23:14:24.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:24 smithi179 ceph-mon[46314]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-08T23:14:24.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:24 smithi179 ceph-mon[46314]: Cluster is now healthy 2024-05-08T23:14:24.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:24 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2207417945' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-08T23:14:24.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:24 smithi179 ceph-mon[46314]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-08T23:14:24.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:24 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1216278947' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-08T23:14:24.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:24 smithi195 ceph-mon[46516]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-08T23:14:24.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:24 smithi195 ceph-mon[46516]: Cluster is now healthy 2024-05-08T23:14:24.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:24 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2207417945' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-08T23:14:24.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:24 smithi195 ceph-mon[46516]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-08T23:14:24.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:24 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1216278947' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-08T23:14:24.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.941+0000 7fc66affd700 1 -- 172.21.15.135:0/1216278947 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7fc66c09bde0 con 0x7fc674101990 2024-05-08T23:14:24.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.944+0000 7fc67bde5700 1 -- 172.21.15.135:0/1216278947 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc6600a1120 msgr2=0x7fc6600a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:24.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.944+0000 7fc67bde5700 1 --2- 172.21.15.135:0/1216278947 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc6600a1120 0x7fc6600a35e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc66400b5c0 tx=0x7fc664005fb0 comp rx=0 tx=0).stop 2024-05-08T23:14:24.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.944+0000 7fc67bde5700 1 -- 172.21.15.135:0/1216278947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674101990 msgr2=0x7fc67419d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:24.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.944+0000 7fc67bde5700 1 --2- 172.21.15.135:0/1216278947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674101990 0x7fc67419d280 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc66c00efb0 tx=0x7fc66c00c550 comp rx=0 tx=0).stop 2024-05-08T23:14:24.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.945+0000 7fc67bde5700 1 -- 172.21.15.135:0/1216278947 shutdown_connections 2024-05-08T23:14:24.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.945+0000 7fc67bde5700 1 --2- 172.21.15.135:0/1216278947 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc6600a1120 0x7fc6600a35e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:24.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.945+0000 7fc67bde5700 1 --2- 172.21.15.135:0/1216278947 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6740ffe80 0x7fc674195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:24.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.945+0000 7fc67bde5700 1 --2- 172.21.15.135:0/1216278947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc674101990 0x7fc67419d280 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:24.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.945+0000 7fc67bde5700 1 --2- 172.21.15.135:0/1216278947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc674100fd0 0x7fc6741962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:24.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.945+0000 7fc67bde5700 1 -- 172.21.15.135:0/1216278947 >> 172.21.15.135:0/1216278947 conn(0x7fc6740fb3f0 msgr2=0x7fc6741043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:24.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.945+0000 7fc67bde5700 1 -- 172.21.15.135:0/1216278947 shutdown_connections 2024-05-08T23:14:24.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:24.945+0000 7fc67bde5700 1 -- 172.21.15.135:0/1216278947 wait complete. 2024-05-08T23:14:24.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:24 smithi135 ceph-mon[42440]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-08T23:14:24.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:24 smithi135 ceph-mon[42440]: Cluster is now healthy 2024-05-08T23:14:24.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:24 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2207417945' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-08T23:14:24.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:24 smithi135 ceph-mon[42440]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-08T23:14:24.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:24 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1216278947' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-08T23:14:24.961 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-05-08T23:14:25.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.093+0000 7f7b8850d700 1 -- 172.21.15.135:0/2492100340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b80102b90 msgr2=0x7f7b80109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:25.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.093+0000 7f7b8850d700 1 --2- 172.21.15.135:0/2492100340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b80102b90 0x7f7b80109440 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800b0a0 tx=0x7f7b7800b3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:25.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.093+0000 7f7b8850d700 1 -- 172.21.15.135:0/2492100340 shutdown_connections 2024-05-08T23:14:25.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.093+0000 7f7b8850d700 1 --2- 172.21.15.135:0/2492100340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b80102b90 0x7f7b80109440 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:25.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.093+0000 7f7b8850d700 1 --2- 172.21.15.135:0/2492100340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b800ff220 0x7f7b800ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:25.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.093+0000 7f7b8850d700 1 --2- 172.21.15.135:0/2492100340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b801021f0 0x7f7b80102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:25.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.093+0000 7f7b8850d700 1 -- 172.21.15.135:0/2492100340 >> 172.21.15.135:0/2492100340 conn(0x7f7b800fab50 msgr2=0x7f7b800fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:25.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.093+0000 7f7b8850d700 1 -- 172.21.15.135:0/2492100340 shutdown_connections 2024-05-08T23:14:25.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.093+0000 7f7b8850d700 1 -- 172.21.15.135:0/2492100340 wait complete. 2024-05-08T23:14:25.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b8850d700 1 Processor -- start 2024-05-08T23:14:25.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b8850d700 1 -- start start 2024-05-08T23:14:25.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b8850d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b800ff220 0x7f7b80197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:25.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b8850d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b801021f0 0x7f7b80197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:25.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b8850d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b80102b90 0x7f7b8019e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:25.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b8850d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8019eb40 con 0x7f7b801021f0 2024-05-08T23:14:25.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b8850d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8019ec80 con 0x7f7b80102b90 2024-05-08T23:14:25.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b8850d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8019ee10 con 0x7f7b800ff220 2024-05-08T23:14:25.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b85aa8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b801021f0 0x7f7b80197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:25.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b85aa8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b801021f0 0x7f7b80197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50668/0 (socket says 172.21.15.135:50668) 2024-05-08T23:14:25.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b85aa8700 1 -- 172.21.15.135:0/2177488339 learned_addr learned my addr 172.21.15.135:0/2177488339 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:25.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b862a9700 1 --2- 172.21.15.135:0/2177488339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b800ff220 0x7f7b80197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:25.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b86aaa700 1 --2- 172.21.15.135:0/2177488339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b80102b90 0x7f7b8019e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:25.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b85aa8700 1 -- 172.21.15.135:0/2177488339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b800ff220 msgr2=0x7f7b80197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:25.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b85aa8700 1 --2- 172.21.15.135:0/2177488339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b800ff220 0x7f7b80197010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:25.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b85aa8700 1 -- 172.21.15.135:0/2177488339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b80102b90 msgr2=0x7f7b8019e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:25.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b85aa8700 1 --2- 172.21.15.135:0/2177488339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b80102b90 0x7f7b8019e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:25.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b85aa8700 1 -- 172.21.15.135:0/2177488339 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b78009d00 con 0x7f7b801021f0 2024-05-08T23:14:25.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b85aa8700 1 --2- 172.21.15.135:0/2177488339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b801021f0 0x7f7b80197550 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00d980 tx=0x7f7b7c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:25.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.094+0000 7f7b777fe700 1 -- 172.21.15.135:0/2177488339 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c004220 con 0x7f7b801021f0 2024-05-08T23:14:25.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.095+0000 7f7b8850d700 1 -- 172.21.15.135:0/2177488339 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8019f0f0 con 0x7f7b801021f0 2024-05-08T23:14:25.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.095+0000 7f7b777fe700 1 -- 172.21.15.135:0/2177488339 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b7c007640 con 0x7f7b801021f0 2024-05-08T23:14:25.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.095+0000 7f7b777fe700 1 -- 172.21.15.135:0/2177488339 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c005610 con 0x7f7b801021f0 2024-05-08T23:14:25.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.095+0000 7f7b8850d700 1 -- 172.21.15.135:0/2177488339 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8019f650 con 0x7f7b801021f0 2024-05-08T23:14:25.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.095+0000 7f7b8850d700 1 -- 172.21.15.135:0/2177488339 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b801084d0 con 0x7f7b801021f0 2024-05-08T23:14:25.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.096+0000 7f7b777fe700 1 -- 172.21.15.135:0/2177488339 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f7b7c004750 con 0x7f7b801021f0 2024-05-08T23:14:25.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.097+0000 7f7b777fe700 1 --2- 172.21.15.135:0/2177488339 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7b6c0a11a0 0x7f7b6c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:25.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.097+0000 7f7b862a9700 1 --2- 172.21.15.135:0/2177488339 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7b6c0a11a0 0x7f7b6c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:25.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.097+0000 7f7b777fe700 1 -- 172.21.15.135:0/2177488339 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7b7c0cc560 con 0x7f7b801021f0 2024-05-08T23:14:25.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.097+0000 7f7b862a9700 1 --2- 172.21.15.135:0/2177488339 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7b6c0a11a0 0x7f7b6c0a3660 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b80067df0 tx=0x7f7b70009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:25.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.101+0000 7f7b777fe700 1 -- 172.21.15.135:0/2177488339 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7b7c095e40 con 0x7f7b801021f0 2024-05-08T23:14:25.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.344+0000 7f7b8850d700 1 -- 172.21.15.135:0/2177488339 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f7b80067460 con 0x7f7b801021f0 2024-05-08T23:14:25.849 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:25 smithi179 ceph-mon[46314]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-08T23:14:25.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:25 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1216278947' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-08T23:14:25.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:25 smithi179 ceph-mon[46314]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-08T23:14:25.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:25 smithi179 ceph-mon[46314]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-08T23:14:25.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:25 smithi179 ceph-mon[46314]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-05-08T23:14:25.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:25 smithi179 ceph-mon[46314]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-05-08T23:14:25.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:25 smithi179 ceph-mon[46314]: pgmap v225: 97 pgs: 58 active+clean, 12 creating+peering, 27 unknown; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 3 op/s 2024-05-08T23:14:25.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:25 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2177488339' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T23:14:25.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:25 smithi195 ceph-mon[46516]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-08T23:14:25.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:25 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1216278947' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-08T23:14:25.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:25 smithi195 ceph-mon[46516]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-08T23:14:25.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:25 smithi195 ceph-mon[46516]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-08T23:14:25.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:25 smithi195 ceph-mon[46516]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-05-08T23:14:25.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:25 smithi195 ceph-mon[46516]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-05-08T23:14:25.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:25 smithi195 ceph-mon[46516]: pgmap v225: 97 pgs: 58 active+clean, 12 creating+peering, 27 unknown; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 3 op/s 2024-05-08T23:14:25.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:25 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2177488339' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T23:14:25.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.949+0000 7f7b777fe700 1 -- 172.21.15.135:0/2177488339 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7f7b7c0160c0 con 0x7f7b801021f0 2024-05-08T23:14:25.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.952+0000 7f7b8850d700 1 -- 172.21.15.135:0/2177488339 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7b6c0a11a0 msgr2=0x7f7b6c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:25.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.952+0000 7f7b8850d700 1 --2- 172.21.15.135:0/2177488339 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7b6c0a11a0 0x7f7b6c0a3660 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b80067df0 tx=0x7f7b70009260 comp rx=0 tx=0).stop 2024-05-08T23:14:25.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.952+0000 7f7b8850d700 1 -- 172.21.15.135:0/2177488339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b801021f0 msgr2=0x7f7b80197550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:25.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.952+0000 7f7b8850d700 1 --2- 172.21.15.135:0/2177488339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b801021f0 0x7f7b80197550 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00d980 tx=0x7f7b7c00dc90 comp rx=0 tx=0).stop 2024-05-08T23:14:25.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.952+0000 7f7b8850d700 1 -- 172.21.15.135:0/2177488339 shutdown_connections 2024-05-08T23:14:25.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.952+0000 7f7b8850d700 1 --2- 172.21.15.135:0/2177488339 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7b6c0a11a0 0x7f7b6c0a3660 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:25.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.952+0000 7f7b8850d700 1 --2- 172.21.15.135:0/2177488339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b800ff220 0x7f7b80197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:25.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.952+0000 7f7b8850d700 1 --2- 172.21.15.135:0/2177488339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b80102b90 0x7f7b8019e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:25.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.952+0000 7f7b8850d700 1 --2- 172.21.15.135:0/2177488339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b801021f0 0x7f7b80197550 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:25.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.952+0000 7f7b8850d700 1 -- 172.21.15.135:0/2177488339 >> 172.21.15.135:0/2177488339 conn(0x7f7b800fab50 msgr2=0x7f7b80105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:25.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.952+0000 7f7b8850d700 1 -- 172.21.15.135:0/2177488339 shutdown_connections 2024-05-08T23:14:25.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:25.952+0000 7f7b8850d700 1 -- 172.21.15.135:0/2177488339 wait complete. 2024-05-08T23:14:25.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:25 smithi135 ceph-mon[42440]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-08T23:14:25.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:25 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1216278947' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-08T23:14:25.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:25 smithi135 ceph-mon[42440]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-08T23:14:25.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:25 smithi135 ceph-mon[42440]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-05-08T23:14:25.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:25 smithi135 ceph-mon[42440]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-05-08T23:14:25.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:25 smithi135 ceph-mon[42440]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-05-08T23:14:25.953 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:25 smithi135 ceph-mon[42440]: pgmap v225: 97 pgs: 58 active+clean, 12 creating+peering, 27 unknown; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 3 op/s 2024-05-08T23:14:25.954 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:25 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2177488339' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T23:14:25.969 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-08T23:14:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.099+0000 7f47f9ed5700 1 -- 172.21.15.135:0/3774415577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f40feb50 msgr2=0x7f47f40fef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.099+0000 7f47f9ed5700 1 --2- 172.21.15.135:0/3774415577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f40feb50 0x7f47f40fef70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009990 tx=0x7f47e8009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.099+0000 7f47f9ed5700 1 -- 172.21.15.135:0/3774415577 shutdown_connections 2024-05-08T23:14:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.099+0000 7f47f9ed5700 1 --2- 172.21.15.135:0/3774415577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47f4106c60 0x7f47f4109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.099+0000 7f47f9ed5700 1 --2- 172.21.15.135:0/3774415577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f40feb50 0x7f47f40fef70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.099+0000 7f47f9ed5700 1 --2- 172.21.15.135:0/3774415577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47f40ff4b0 0x7f47f4106720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.099+0000 7f47f9ed5700 1 -- 172.21.15.135:0/3774415577 >> 172.21.15.135:0/3774415577 conn(0x7f47f40fa710 msgr2=0x7f47f40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.099+0000 7f47f9ed5700 1 -- 172.21.15.135:0/3774415577 shutdown_connections 2024-05-08T23:14:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.099+0000 7f47f9ed5700 1 -- 172.21.15.135:0/3774415577 wait complete. 2024-05-08T23:14:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f9ed5700 1 Processor -- start 2024-05-08T23:14:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f9ed5700 1 -- start start 2024-05-08T23:14:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f9ed5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47f40feb50 0x7f47f4196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f9ed5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47f40ff4b0 0x7f47f41973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f9ed5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f4106c60 0x7f47f419e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f9ed5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f419e9a0 con 0x7f47f4106c60 2024-05-08T23:14:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f9ed5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f419eae0 con 0x7f47f40feb50 2024-05-08T23:14:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f9ed5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f419ec70 con 0x7f47f40ff4b0 2024-05-08T23:14:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f4106c60 0x7f47f419e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f4106c60 0x7f47f419e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50676/0 (socket says 172.21.15.135:50676) 2024-05-08T23:14:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f3fff700 1 -- 172.21.15.135:0/2388419871 learned_addr learned my addr 172.21.15.135:0/2388419871 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f37fe700 1 --2- 172.21.15.135:0/2388419871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47f40feb50 0x7f47f4196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f2ffd700 1 --2- 172.21.15.135:0/2388419871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47f40ff4b0 0x7f47f41973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f3fff700 1 -- 172.21.15.135:0/2388419871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47f40ff4b0 msgr2=0x7f47f41973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:26.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f3fff700 1 --2- 172.21.15.135:0/2388419871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47f40ff4b0 0x7f47f41973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:26.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f3fff700 1 -- 172.21.15.135:0/2388419871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47f40feb50 msgr2=0x7f47f4196e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:26.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f3fff700 1 --2- 172.21.15.135:0/2388419871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47f40feb50 0x7f47f4196e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:26.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.100+0000 7f47f3fff700 1 -- 172.21.15.135:0/2388419871 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e80095f0 con 0x7f47f4106c60 2024-05-08T23:14:26.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.101+0000 7f47f3fff700 1 --2- 172.21.15.135:0/2388419871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f4106c60 0x7f47f419e3d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f47ec007d60 tx=0x7f47ec00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:26.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.101+0000 7f47f0ff9700 1 -- 172.21.15.135:0/2388419871 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00ad40 con 0x7f47f4106c60 2024-05-08T23:14:26.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.101+0000 7f47f0ff9700 1 -- 172.21.15.135:0/2388419871 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47ec004030 con 0x7f47f4106c60 2024-05-08T23:14:26.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.101+0000 7f47f9ed5700 1 -- 172.21.15.135:0/2388419871 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f419ef50 con 0x7f47f4106c60 2024-05-08T23:14:26.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.101+0000 7f47f0ff9700 1 -- 172.21.15.135:0/2388419871 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00aea0 con 0x7f47f4106c60 2024-05-08T23:14:26.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.101+0000 7f47f9ed5700 1 -- 172.21.15.135:0/2388419871 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f419f380 con 0x7f47f4106c60 2024-05-08T23:14:26.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.102+0000 7f47f9ed5700 1 -- 172.21.15.135:0/2388419871 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f41055c0 con 0x7f47f4106c60 2024-05-08T23:14:26.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.103+0000 7f47f0ff9700 1 -- 172.21.15.135:0/2388419871 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f47ec0041a0 con 0x7f47f4106c60 2024-05-08T23:14:26.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.103+0000 7f47f0ff9700 1 --2- 172.21.15.135:0/2388419871 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f47dc0a1120 0x7f47dc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:26.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.103+0000 7f47f0ff9700 1 -- 172.21.15.135:0/2388419871 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f47ec0cc940 con 0x7f47f4106c60 2024-05-08T23:14:26.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.103+0000 7f47f37fe700 1 --2- 172.21.15.135:0/2388419871 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f47dc0a1120 0x7f47dc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:26.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.104+0000 7f47f37fe700 1 --2- 172.21.15.135:0/2388419871 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f47dc0a1120 0x7f47dc0a35e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f47e800b5c0 tx=0x7f47e8003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:26.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.108+0000 7f47f0ff9700 1 -- 172.21.15.135:0/2388419871 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f47ec096220 con 0x7f47f4106c60 2024-05-08T23:14:26.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:26.356+0000 7f47f9ed5700 1 -- 172.21.15.135:0/2388419871 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f47f4104fa0 con 0x7f47f4106c60 2024-05-08T23:14:27.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:26 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] up:active 2024-05-08T23:14:27.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:26 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2177488339' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-08T23:14:27.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:26 smithi135 ceph-mon[42440]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-08T23:14:27.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:26 smithi135 ceph-mon[42440]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-05-08T23:14:27.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:26 smithi135 ceph-mon[42440]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-05-08T23:14:27.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:26 smithi135 ceph-mon[42440]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-05-08T23:14:27.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:26 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] up:active 2024-05-08T23:14:27.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:26 smithi135 ceph-mon[42440]: daemon mds.l assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-08T23:14:27.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:26 smithi135 ceph-mon[42440]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T23:14:27.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:26 smithi135 ceph-mon[42440]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=l=up:creating} 3 up:standby-replay 5 up:standby 2024-05-08T23:14:27.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:26 smithi135 ceph-mon[42440]: daemon mds.l is now active in filesystem cephfs as rank 3 2024-05-08T23:14:27.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:26 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2388419871' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T23:14:27.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.340+0000 7f47f0ff9700 1 -- 172.21.15.135:0/2388419871 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) v1 ==== 115+0+0 (secure 0 0 0) 0x7f47ec099840 con 0x7f47f4106c60 2024-05-08T23:14:27.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.343+0000 7f47f9ed5700 1 -- 172.21.15.135:0/2388419871 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f47dc0a1120 msgr2=0x7f47dc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:27.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.343+0000 7f47f9ed5700 1 --2- 172.21.15.135:0/2388419871 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f47dc0a1120 0x7f47dc0a35e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f47e800b5c0 tx=0x7f47e8003790 comp rx=0 tx=0).stop 2024-05-08T23:14:27.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.343+0000 7f47f9ed5700 1 -- 172.21.15.135:0/2388419871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f4106c60 msgr2=0x7f47f419e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:27.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.343+0000 7f47f9ed5700 1 --2- 172.21.15.135:0/2388419871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f4106c60 0x7f47f419e3d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f47ec007d60 tx=0x7f47ec00a340 comp rx=0 tx=0).stop 2024-05-08T23:14:27.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.343+0000 7f47f9ed5700 1 -- 172.21.15.135:0/2388419871 shutdown_connections 2024-05-08T23:14:27.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.343+0000 7f47f9ed5700 1 --2- 172.21.15.135:0/2388419871 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f47dc0a1120 0x7f47dc0a35e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:27.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.343+0000 7f47f9ed5700 1 --2- 172.21.15.135:0/2388419871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47f4106c60 0x7f47f419e3d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:27.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.343+0000 7f47f9ed5700 1 --2- 172.21.15.135:0/2388419871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47f40feb50 0x7f47f4196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:27.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.343+0000 7f47f9ed5700 1 --2- 172.21.15.135:0/2388419871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47f40ff4b0 0x7f47f41973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:27.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.343+0000 7f47f9ed5700 1 -- 172.21.15.135:0/2388419871 >> 172.21.15.135:0/2388419871 conn(0x7f47f40fa710 msgr2=0x7f47f4102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:27.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.344+0000 7f47f9ed5700 1 -- 172.21.15.135:0/2388419871 shutdown_connections 2024-05-08T23:14:27.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.344+0000 7f47f9ed5700 1 -- 172.21.15.135:0/2388419871 wait complete. 2024-05-08T23:14:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:26 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] up:active 2024-05-08T23:14:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:26 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2177488339' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-08T23:14:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:26 smithi179 ceph-mon[46314]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-08T23:14:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:26 smithi179 ceph-mon[46314]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-05-08T23:14:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:26 smithi179 ceph-mon[46314]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-05-08T23:14:27.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:26 smithi179 ceph-mon[46314]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-05-08T23:14:27.351 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:26 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] up:active 2024-05-08T23:14:27.351 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:26 smithi179 ceph-mon[46314]: daemon mds.l assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-08T23:14:27.351 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:26 smithi179 ceph-mon[46314]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T23:14:27.351 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:26 smithi179 ceph-mon[46314]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=l=up:creating} 3 up:standby-replay 5 up:standby 2024-05-08T23:14:27.351 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:26 smithi179 ceph-mon[46314]: daemon mds.l is now active in filesystem cephfs as rank 3 2024-05-08T23:14:27.351 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:26 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2388419871' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T23:14:27.361 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-05-08T23:14:27.361 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-05-08T23:14:27.380 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:14:27 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-i[84605]: 2024-05-08T23:14:27.061+0000 7fecfd07f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T23:14:27.380 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:14:27 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-i[84605]: 2024-05-08T23:14:27.061+0000 7fecfd07f700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-08T23:14:27.381 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:14:27 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-i[84605]: 2024-05-08T23:14:27.061+0000 7fecfd07f700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-05-08T23:14:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:26 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] up:active 2024-05-08T23:14:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:26 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2177488339' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-08T23:14:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:26 smithi195 ceph-mon[46516]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-08T23:14:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:26 smithi195 ceph-mon[46516]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-05-08T23:14:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:26 smithi195 ceph-mon[46516]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-05-08T23:14:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:26 smithi195 ceph-mon[46516]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-05-08T23:14:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:26 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] up:active 2024-05-08T23:14:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:26 smithi195 ceph-mon[46516]: daemon mds.l assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-08T23:14:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:26 smithi195 ceph-mon[46516]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T23:14:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:26 smithi195 ceph-mon[46516]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=l=up:creating} 3 up:standby-replay 5 up:standby 2024-05-08T23:14:27.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:26 smithi195 ceph-mon[46516]: daemon mds.l is now active in filesystem cephfs as rank 3 2024-05-08T23:14:27.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:26 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2388419871' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T23:14:27.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.493+0000 7f768e815700 1 -- 172.21.15.135:0/1583627387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76881020f0 msgr2=0x7f7688102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:27.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.493+0000 7f768e815700 1 --2- 172.21.15.135:0/1583627387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76881020f0 0x7f7688102570 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f767c009990 tx=0x7f767c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:27.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.493+0000 7f768e815700 1 -- 172.21.15.135:0/1583627387 shutdown_connections 2024-05-08T23:14:27.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.493+0000 7f768e815700 1 --2- 172.21.15.135:0/1583627387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7688100f20 0x7f7688101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:27.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.493+0000 7f768e815700 1 --2- 172.21.15.135:0/1583627387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688102ab0 0x7f76881093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:27.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.493+0000 7f768e815700 1 --2- 172.21.15.135:0/1583627387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76881020f0 0x7f7688102570 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:27.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.493+0000 7f768e815700 1 -- 172.21.15.135:0/1583627387 >> 172.21.15.135:0/1583627387 conn(0x7f76880fc4e0 msgr2=0x7f76880fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:27.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.493+0000 7f768e815700 1 -- 172.21.15.135:0/1583627387 shutdown_connections 2024-05-08T23:14:27.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.493+0000 7f768e815700 1 -- 172.21.15.135:0/1583627387 wait complete. 2024-05-08T23:14:27.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f768e815700 1 Processor -- start 2024-05-08T23:14:27.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f768e815700 1 -- start start 2024-05-08T23:14:27.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f768e815700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688100f20 0x7f7688074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:27.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f768e815700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76881020f0 0x7f7688073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:27.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f768e815700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7688102ab0 0x7f76880738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:27.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f768e815700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7688074070 con 0x7f7688102ab0 2024-05-08T23:14:27.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f768e815700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76880741e0 con 0x7f7688100f20 2024-05-08T23:14:27.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f768e815700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76881a0f60 con 0x7f76881020f0 2024-05-08T23:14:27.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f768cdb2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7688102ab0 0x7f76880738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:27.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f768cdb2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7688102ab0 0x7f76880738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50686/0 (socket says 172.21.15.135:50686) 2024-05-08T23:14:27.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f768cdb2700 1 -- 172.21.15.135:0/982219607 learned_addr learned my addr 172.21.15.135:0/982219607 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:27.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f7687fff700 1 --2- 172.21.15.135:0/982219607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688100f20 0x7f7688074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:27.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f76877fe700 1 --2- 172.21.15.135:0/982219607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76881020f0 0x7f7688073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:27.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f768cdb2700 1 -- 172.21.15.135:0/982219607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76881020f0 msgr2=0x7f7688073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:27.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f768cdb2700 1 --2- 172.21.15.135:0/982219607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76881020f0 0x7f7688073390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:27.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f768cdb2700 1 -- 172.21.15.135:0/982219607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688100f20 msgr2=0x7f7688074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:27.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.494+0000 7f768cdb2700 1 --2- 172.21.15.135:0/982219607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688100f20 0x7f7688074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:27.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.495+0000 7f768cdb2700 1 -- 172.21.15.135:0/982219607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c0095f0 con 0x7f7688102ab0 2024-05-08T23:14:27.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.495+0000 7f7687fff700 1 --2- 172.21.15.135:0/982219607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688100f20 0x7f7688074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:14:27.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.495+0000 7f768cdb2700 1 --2- 172.21.15.135:0/982219607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7688102ab0 0x7f76880738d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7680007d70 tx=0x7f768000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:27.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.495+0000 7f76857fa700 1 -- 172.21.15.135:0/982219607 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768000ad40 con 0x7f7688102ab0 2024-05-08T23:14:27.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.495+0000 7f76857fa700 1 -- 172.21.15.135:0/982219607 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76800128e0 con 0x7f7688102ab0 2024-05-08T23:14:27.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.495+0000 7f768e815700 1 -- 172.21.15.135:0/982219607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76881a11f0 con 0x7f7688102ab0 2024-05-08T23:14:27.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.495+0000 7f76857fa700 1 -- 172.21.15.135:0/982219607 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76800116f0 con 0x7f7688102ab0 2024-05-08T23:14:27.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.495+0000 7f768e815700 1 -- 172.21.15.135:0/982219607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76881a16b0 con 0x7f7688102ab0 2024-05-08T23:14:27.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.496+0000 7f768e815700 1 -- 172.21.15.135:0/982219607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7688108460 con 0x7f7688102ab0 2024-05-08T23:14:27.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.497+0000 7f76857fa700 1 -- 172.21.15.135:0/982219607 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f7680012420 con 0x7f7688102ab0 2024-05-08T23:14:27.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.497+0000 7f76857fa700 1 --2- 172.21.15.135:0/982219607 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f76700a1120 0x7f76700a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:27.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.498+0000 7f7687fff700 1 --2- 172.21.15.135:0/982219607 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f76700a1120 0x7f76700a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:27.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.498+0000 7f76857fa700 1 -- 172.21.15.135:0/982219607 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f76800cccb0 con 0x7f7688102ab0 2024-05-08T23:14:27.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.498+0000 7f7687fff700 1 --2- 172.21.15.135:0/982219607 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f76700a1120 0x7f76700a35e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7688100c40 tx=0x7f7678008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:27.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.502+0000 7f76857fa700 1 -- 172.21.15.135:0/982219607 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f76800964f0 con 0x7f7688102ab0 2024-05-08T23:14:27.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:27.734+0000 7f768e815700 1 -- 172.21.15.135:0/982219607 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f76880613e0 con 0x7f76700a1120 2024-05-08T23:14:28.203 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:14:27 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:14:27.739+0000 7f6c9f782700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T23:14:28.203 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:14:27 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:14:27.739+0000 7f6c9f782700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T23:14:28.204 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:14:27 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:14:27.739+0000 7f6c9f782700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T23:14:28.204 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:14:27 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:14:27.739+0000 7f6c9f782700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T23:14:28.204 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:14:27 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:14:27.739+0000 7f6c9f782700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T23:14:28.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:27 smithi135 ceph-mon[42440]: pgmap v226: 97 pgs: 97 active+clean; 580 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s wr, 13 op/s 2024-05-08T23:14:28.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:27 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] up:active 2024-05-08T23:14:28.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:27 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2388419871' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-08T23:14:28.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:27 smithi135 ceph-mon[42440]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-08T23:14:28.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:27 smithi135 ceph-mon[42440]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-08T23:14:28.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:27 smithi135 ceph-mon[42440]: Cluster is now healthy 2024-05-08T23:14:28.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:27 smithi135 ceph-mon[42440]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=l=up:active} 3 up:standby-replay 5 up:standby 2024-05-08T23:14:28.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:27 smithi135 ceph-mon[42440]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2024-05-08T23:14:28.205 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:27 smithi135 ceph-mon[42440]: daemon mds.k is now active in filesystem cephfs as rank 4 2024-05-08T23:14:28.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:27 smithi179 ceph-mon[46314]: pgmap v226: 97 pgs: 97 active+clean; 580 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s wr, 13 op/s 2024-05-08T23:14:28.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:27 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] up:active 2024-05-08T23:14:28.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:27 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2388419871' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-08T23:14:28.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:27 smithi179 ceph-mon[46314]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-08T23:14:28.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:27 smithi179 ceph-mon[46314]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-08T23:14:28.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:27 smithi179 ceph-mon[46314]: Cluster is now healthy 2024-05-08T23:14:28.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:27 smithi179 ceph-mon[46314]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=l=up:active} 3 up:standby-replay 5 up:standby 2024-05-08T23:14:28.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:27 smithi179 ceph-mon[46314]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2024-05-08T23:14:28.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:27 smithi179 ceph-mon[46314]: daemon mds.k is now active in filesystem cephfs as rank 4 2024-05-08T23:14:28.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.371+0000 7f76857fa700 1 -- 172.21.15.135:0/982219607 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f76880613e0 con 0x7f76700a1120 2024-05-08T23:14:28.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.374+0000 7f768e815700 1 -- 172.21.15.135:0/982219607 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f76700a1120 msgr2=0x7f76700a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:28.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.374+0000 7f768e815700 1 --2- 172.21.15.135:0/982219607 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f76700a1120 0x7f76700a35e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7688100c40 tx=0x7f7678008040 comp rx=0 tx=0).stop 2024-05-08T23:14:28.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.374+0000 7f768e815700 1 -- 172.21.15.135:0/982219607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7688102ab0 msgr2=0x7f76880738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:28.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.374+0000 7f768e815700 1 --2- 172.21.15.135:0/982219607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7688102ab0 0x7f76880738d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7680007d70 tx=0x7f768000a340 comp rx=0 tx=0).stop 2024-05-08T23:14:28.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.374+0000 7f768e815700 1 -- 172.21.15.135:0/982219607 shutdown_connections 2024-05-08T23:14:28.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.374+0000 7f768e815700 1 --2- 172.21.15.135:0/982219607 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f76700a1120 0x7f76700a35e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.374+0000 7f768e815700 1 --2- 172.21.15.135:0/982219607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7688102ab0 0x7f76880738d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.374+0000 7f768e815700 1 --2- 172.21.15.135:0/982219607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7688100f20 0x7f7688074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.374+0000 7f768e815700 1 --2- 172.21.15.135:0/982219607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76881020f0 0x7f7688073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.374+0000 7f768e815700 1 -- 172.21.15.135:0/982219607 >> 172.21.15.135:0/982219607 conn(0x7f76880fc4e0 msgr2=0x7f76881055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:28.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.374+0000 7f768e815700 1 -- 172.21.15.135:0/982219607 shutdown_connections 2024-05-08T23:14:28.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.374+0000 7f768e815700 1 -- 172.21.15.135:0/982219607 wait complete. 2024-05-08T23:14:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:27 smithi195 ceph-mon[46516]: pgmap v226: 97 pgs: 97 active+clean; 580 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s wr, 13 op/s 2024-05-08T23:14:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:27 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] up:active 2024-05-08T23:14:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:27 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2388419871' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-08T23:14:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:27 smithi195 ceph-mon[46516]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-08T23:14:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:27 smithi195 ceph-mon[46516]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-08T23:14:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:27 smithi195 ceph-mon[46516]: Cluster is now healthy 2024-05-08T23:14:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:27 smithi195 ceph-mon[46516]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=l=up:active} 3 up:standby-replay 5 up:standby 2024-05-08T23:14:28.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:27 smithi195 ceph-mon[46516]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2024-05-08T23:14:28.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:27 smithi195 ceph-mon[46516]: daemon mds.k is now active in filesystem cephfs as rank 4 2024-05-08T23:14:28.389 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-08T23:14:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.522+0000 7f14d1de9700 1 -- 172.21.15.135:0/123519795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc1019e0 msgr2=0x7f14cc103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.522+0000 7f14d1de9700 1 --2- 172.21.15.135:0/123519795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc1019e0 0x7f14cc103dd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009990 tx=0x7f14bc009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.522+0000 7f14d1de9700 1 -- 172.21.15.135:0/123519795 shutdown_connections 2024-05-08T23:14:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.522+0000 7f14d1de9700 1 --2- 172.21.15.135:0/123519795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc106c40 0x7f14cc1090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.522+0000 7f14d1de9700 1 --2- 172.21.15.135:0/123519795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc1019e0 0x7f14cc103dd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.522+0000 7f14d1de9700 1 --2- 172.21.15.135:0/123519795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14cc104310 0x7f14cc106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.522+0000 7f14d1de9700 1 -- 172.21.15.135:0/123519795 >> 172.21.15.135:0/123519795 conn(0x7f14cc0fb3f0 msgr2=0x7f14cc0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.522+0000 7f14d1de9700 1 -- 172.21.15.135:0/123519795 shutdown_connections 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.522+0000 7f14d1de9700 1 -- 172.21.15.135:0/123519795 wait complete. 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.522+0000 7f14d1de9700 1 Processor -- start 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.522+0000 7f14d1de9700 1 -- start start 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14d1de9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14cc1019e0 0x7f14cc196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14d1de9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc104310 0x7f14cc197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14d1de9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc106c40 0x7f14cc19e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14d1de9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc19ea10 con 0x7f14cc104310 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14d1de9700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc19eb50 con 0x7f14cc106c40 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14d1de9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc19ece0 con 0x7f14cc1019e0 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14caffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc104310 0x7f14cc197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14caffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc104310 0x7f14cc197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54808/0 (socket says 172.21.15.135:54808) 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14caffd700 1 -- 172.21.15.135:0/1498925452 learned_addr learned my addr 172.21.15.135:0/1498925452 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14cbfff700 1 --2- 172.21.15.135:0/1498925452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc106c40 0x7f14cc19e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14caffd700 1 -- 172.21.15.135:0/1498925452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14cc1019e0 msgr2=0x7f14cc196ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14caffd700 1 --2- 172.21.15.135:0/1498925452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14cc1019e0 0x7f14cc196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14caffd700 1 -- 172.21.15.135:0/1498925452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc106c40 msgr2=0x7f14cc19e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:28.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14caffd700 1 --2- 172.21.15.135:0/1498925452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc106c40 0x7f14cc19e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14caffd700 1 -- 172.21.15.135:0/1498925452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc0095f0 con 0x7f14cc104310 2024-05-08T23:14:28.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14caffd700 1 --2- 172.21.15.135:0/1498925452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc104310 0x7f14cc197420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f14c000c920 tx=0x7f14c000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:28.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14c8ff9700 1 -- 172.21.15.135:0/1498925452 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0007b00 con 0x7f14cc104310 2024-05-08T23:14:28.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14c8ff9700 1 -- 172.21.15.135:0/1498925452 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14c0004cf0 con 0x7f14cc104310 2024-05-08T23:14:28.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14c8ff9700 1 -- 172.21.15.135:0/1498925452 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0005610 con 0x7f14cc104310 2024-05-08T23:14:28.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14d1de9700 1 -- 172.21.15.135:0/1498925452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14cc19efc0 con 0x7f14cc104310 2024-05-08T23:14:28.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.523+0000 7f14d1de9700 1 -- 172.21.15.135:0/1498925452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14cc19f3f0 con 0x7f14cc104310 2024-05-08T23:14:28.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.524+0000 7f14d1de9700 1 -- 172.21.15.135:0/1498925452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14cc0fcf70 con 0x7f14cc104310 2024-05-08T23:14:28.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.525+0000 7f14c8ff9700 1 -- 172.21.15.135:0/1498925452 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f14c0004750 con 0x7f14cc104310 2024-05-08T23:14:28.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.526+0000 7f14c8ff9700 1 --2- 172.21.15.135:0/1498925452 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f14b40a11a0 0x7f14b40a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:28.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.526+0000 7f14c8ff9700 1 -- 172.21.15.135:0/1498925452 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f14c00cc680 con 0x7f14cc104310 2024-05-08T23:14:28.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.526+0000 7f14cb7fe700 1 --2- 172.21.15.135:0/1498925452 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f14b40a11a0 0x7f14b40a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:28.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.526+0000 7f14cb7fe700 1 --2- 172.21.15.135:0/1498925452 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f14b40a11a0 0x7f14b40a3660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0098e0 tx=0x7f14bc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:28.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.529+0000 7f14c8ff9700 1 -- 172.21.15.135:0/1498925452 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f14c0095fe0 con 0x7f14cc104310 2024-05-08T23:14:28.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.761+0000 7f14d1de9700 1 -- 172.21.15.135:0/1498925452 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f14cc02ceb0 con 0x7f14b40a11a0 2024-05-08T23:14:28.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.783+0000 7f14c8ff9700 1 -- 172.21.15.135:0/1498925452 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f14cc02ceb0 con 0x7f14b40a11a0 2024-05-08T23:14:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.785+0000 7f14d1de9700 1 -- 172.21.15.135:0/1498925452 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f14b40a11a0 msgr2=0x7f14b40a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.785+0000 7f14d1de9700 1 --2- 172.21.15.135:0/1498925452 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f14b40a11a0 0x7f14b40a3660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0098e0 tx=0x7f14bc005fb0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.785+0000 7f14d1de9700 1 -- 172.21.15.135:0/1498925452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc104310 msgr2=0x7f14cc197420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.785+0000 7f14d1de9700 1 --2- 172.21.15.135:0/1498925452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc104310 0x7f14cc197420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f14c000c920 tx=0x7f14c000cce0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.785+0000 7f14d1de9700 1 -- 172.21.15.135:0/1498925452 shutdown_connections 2024-05-08T23:14:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.785+0000 7f14d1de9700 1 --2- 172.21.15.135:0/1498925452 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f14b40a11a0 0x7f14b40a3660 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.785+0000 7f14d1de9700 1 --2- 172.21.15.135:0/1498925452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14cc1019e0 0x7f14cc196ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.785+0000 7f14d1de9700 1 --2- 172.21.15.135:0/1498925452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14cc106c40 0x7f14cc19e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.785+0000 7f14d1de9700 1 --2- 172.21.15.135:0/1498925452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc104310 0x7f14cc197420 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.785+0000 7f14d1de9700 1 -- 172.21.15.135:0/1498925452 >> 172.21.15.135:0/1498925452 conn(0x7f14cc0fb3f0 msgr2=0x7f14cc1024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:28.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.786+0000 7f14d1de9700 1 -- 172.21.15.135:0/1498925452 shutdown_connections 2024-05-08T23:14:28.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.786+0000 7f14d1de9700 1 -- 172.21.15.135:0/1498925452 wait complete. 2024-05-08T23:14:28.797 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-08T23:14:28.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.925+0000 7ff091efd700 1 -- 172.21.15.135:0/1277704091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff08c0ffe80 msgr2=0x7ff08c1002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:28.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.925+0000 7ff091efd700 1 --2- 172.21.15.135:0/1277704091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff08c0ffe80 0x7ff08c1002a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff074009990 tx=0x7ff074009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.925+0000 7ff091efd700 1 -- 172.21.15.135:0/1277704091 shutdown_connections 2024-05-08T23:14:28.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.925+0000 7ff091efd700 1 --2- 172.21.15.135:0/1277704091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff08c101990 0x7ff08c1082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.925+0000 7ff091efd700 1 --2- 172.21.15.135:0/1277704091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff08c0ffe80 0x7ff08c1002a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.925+0000 7ff091efd700 1 --2- 172.21.15.135:0/1277704091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff08c100fd0 0x7ff08c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.925+0000 7ff091efd700 1 -- 172.21.15.135:0/1277704091 >> 172.21.15.135:0/1277704091 conn(0x7ff08c0fb3f0 msgr2=0x7ff08c0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:28.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.925+0000 7ff091efd700 1 -- 172.21.15.135:0/1277704091 shutdown_connections 2024-05-08T23:14:28.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.925+0000 7ff091efd700 1 -- 172.21.15.135:0/1277704091 wait complete. 2024-05-08T23:14:28.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff091efd700 1 Processor -- start 2024-05-08T23:14:28.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff091efd700 1 -- start start 2024-05-08T23:14:28.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff091efd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff08c0ffe80 0x7ff08c103d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:28.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff091efd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff08c100fd0 0x7ff08c102440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:28.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff091efd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff08c101990 0x7ff08c102980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:28.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff091efd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c103080 con 0x7ff08c101990 2024-05-08T23:14:28.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff091efd700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c1031f0 con 0x7ff08c0ffe80 2024-05-08T23:14:28.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff091efd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c1a0fc0 con 0x7ff08c100fd0 2024-05-08T23:14:28.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff08bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff08c101990 0x7ff08c102980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:28.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff08bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff08c101990 0x7ff08c102980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54830/0 (socket says 172.21.15.135:54830) 2024-05-08T23:14:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff08bfff700 1 -- 172.21.15.135:0/1180083409 learned_addr learned my addr 172.21.15.135:0/1180083409 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff08affd700 1 --2- 172.21.15.135:0/1180083409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff08c100fd0 0x7ff08c102440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff08b7fe700 1 --2- 172.21.15.135:0/1180083409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff08c0ffe80 0x7ff08c103d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff08bfff700 1 -- 172.21.15.135:0/1180083409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff08c100fd0 msgr2=0x7ff08c102440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff08bfff700 1 --2- 172.21.15.135:0/1180083409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff08c100fd0 0x7ff08c102440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff08bfff700 1 -- 172.21.15.135:0/1180083409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff08c0ffe80 msgr2=0x7ff08c103d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff08bfff700 1 --2- 172.21.15.135:0/1180083409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff08c0ffe80 0x7ff08c103d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff08bfff700 1 -- 172.21.15.135:0/1180083409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0740095f0 con 0x7ff08c101990 2024-05-08T23:14:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.926+0000 7ff08b7fe700 1 --2- 172.21.15.135:0/1180083409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff08c0ffe80 0x7ff08c103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:14:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.927+0000 7ff08bfff700 1 --2- 172.21.15.135:0/1180083409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff08c101990 0x7ff08c102980 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff084007ee0 tx=0x7ff08400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.927+0000 7ff088ff9700 1 -- 172.21.15.135:0/1180083409 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084017070 con 0x7ff08c101990 2024-05-08T23:14:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.927+0000 7ff091efd700 1 -- 172.21.15.135:0/1180083409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08c1a1220 con 0x7ff08c101990 2024-05-08T23:14:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.927+0000 7ff091efd700 1 -- 172.21.15.135:0/1180083409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08c1a1780 con 0x7ff08c101990 2024-05-08T23:14:28.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.927+0000 7ff088ff9700 1 -- 172.21.15.135:0/1180083409 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff08400f040 con 0x7ff08c101990 2024-05-08T23:14:28.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.927+0000 7ff088ff9700 1 -- 172.21.15.135:0/1180083409 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084005740 con 0x7ff08c101990 2024-05-08T23:14:28.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.928+0000 7ff091efd700 1 -- 172.21.15.135:0/1180083409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06c0052f0 con 0x7ff08c101990 2024-05-08T23:14:28.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.929+0000 7ff088ff9700 1 -- 172.21.15.135:0/1180083409 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7ff0840058a0 con 0x7ff08c101990 2024-05-08T23:14:28.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.930+0000 7ff088ff9700 1 --2- 172.21.15.135:0/1180083409 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff0780a1120 0x7ff0780a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:28.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.930+0000 7ff08b7fe700 1 --2- 172.21.15.135:0/1180083409 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff0780a1120 0x7ff0780a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:28.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.930+0000 7ff088ff9700 1 -- 172.21.15.135:0/1180083409 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff0840cbef0 con 0x7ff08c101990 2024-05-08T23:14:28.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.930+0000 7ff08b7fe700 1 --2- 172.21.15.135:0/1180083409 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff0780a1120 0x7ff0780a35e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff074000c00 tx=0x7ff074005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:28.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:28.934+0000 7ff088ff9700 1 -- 172.21.15.135:0/1180083409 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff084095860 con 0x7ff08c101990 2024-05-08T23:14:29.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.173+0000 7ff091efd700 1 -- 172.21.15.135:0/1180083409 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff06c000bc0 con 0x7ff0780a1120 2024-05-08T23:14:29.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.177+0000 7ff088ff9700 1 -- 172.21.15.135:0/1180083409 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7ff06c000bc0 con 0x7ff0780a1120 2024-05-08T23:14:29.176 INFO:teuthology.orchestra.run.smithi135.stdout:/volumes/qa/sv_0/9f70995b-ff43-49d1-96e9-c9bf30d86013 2024-05-08T23:14:29.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.179+0000 7ff091efd700 1 -- 172.21.15.135:0/1180083409 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff0780a1120 msgr2=0x7ff0780a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:29.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.179+0000 7ff091efd700 1 --2- 172.21.15.135:0/1180083409 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff0780a1120 0x7ff0780a35e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff074000c00 tx=0x7ff074005fb0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.179+0000 7ff091efd700 1 -- 172.21.15.135:0/1180083409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff08c101990 msgr2=0x7ff08c102980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:29.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.179+0000 7ff091efd700 1 --2- 172.21.15.135:0/1180083409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff08c101990 0x7ff08c102980 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff084007ee0 tx=0x7ff08400d3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.179+0000 7ff091efd700 1 -- 172.21.15.135:0/1180083409 shutdown_connections 2024-05-08T23:14:29.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.179+0000 7ff091efd700 1 --2- 172.21.15.135:0/1180083409 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff0780a1120 0x7ff0780a35e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.179+0000 7ff091efd700 1 --2- 172.21.15.135:0/1180083409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff08c101990 0x7ff08c102980 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.179+0000 7ff091efd700 1 --2- 172.21.15.135:0/1180083409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff08c0ffe80 0x7ff08c103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.179+0000 7ff091efd700 1 --2- 172.21.15.135:0/1180083409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff08c100fd0 0x7ff08c102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.179+0000 7ff091efd700 1 -- 172.21.15.135:0/1180083409 >> 172.21.15.135:0/1180083409 conn(0x7ff08c0fb3f0 msgr2=0x7ff08c069240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:29.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.179+0000 7ff091efd700 1 -- 172.21.15.135:0/1180083409 shutdown_connections 2024-05-08T23:14:29.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.179+0000 7ff091efd700 1 -- 172.21.15.135:0/1180083409 wait complete. 2024-05-08T23:14:29.189 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:28 smithi135 ceph-mon[42440]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:14:29.190 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:28 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] up:active 2024-05-08T23:14:29.190 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:28 smithi135 ceph-mon[42440]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2024-05-08T23:14:29.190 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:28 smithi135 ceph-mon[42440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T23:14:29.191 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-08T23:14:29.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.320+0000 7fc31dbcf700 1 -- 172.21.15.135:0/2964221064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3180ffe70 msgr2=0x7fc318100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:29.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.320+0000 7fc31dbcf700 1 --2- 172.21.15.135:0/2964221064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3180ffe70 0x7fc318100290 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc300009990 tx=0x7fc300009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.320+0000 7fc31dbcf700 1 -- 172.21.15.135:0/2964221064 shutdown_connections 2024-05-08T23:14:29.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.320+0000 7fc31dbcf700 1 --2- 172.21.15.135:0/2964221064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc318101980 0x7fc3181082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.320+0000 7fc31dbcf700 1 --2- 172.21.15.135:0/2964221064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3180ffe70 0x7fc318100290 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.320+0000 7fc31dbcf700 1 --2- 172.21.15.135:0/2964221064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc318100fc0 0x7fc318101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.320+0000 7fc31dbcf700 1 -- 172.21.15.135:0/2964221064 >> 172.21.15.135:0/2964221064 conn(0x7fc3180fb400 msgr2=0x7fc3180fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:29.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.320+0000 7fc31dbcf700 1 -- 172.21.15.135:0/2964221064 shutdown_connections 2024-05-08T23:14:29.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.320+0000 7fc31dbcf700 1 -- 172.21.15.135:0/2964221064 wait complete. 2024-05-08T23:14:29.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.320+0000 7fc31dbcf700 1 Processor -- start 2024-05-08T23:14:29.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.320+0000 7fc31dbcf700 1 -- start start 2024-05-08T23:14:29.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc31dbcf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3180ffe70 0x7fc318195cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:29.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc31dbcf700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc318100fc0 0x7fc318196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:29.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc31dbcf700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc318101980 0x7fc31819d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:29.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc31dbcf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31819d810 con 0x7fc3180ffe70 2024-05-08T23:14:29.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc31dbcf700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31819d980 con 0x7fc318100fc0 2024-05-08T23:14:29.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc31dbcf700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31819db40 con 0x7fc318101980 2024-05-08T23:14:29.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc3177fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3180ffe70 0x7fc318195cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:29.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc3177fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3180ffe70 0x7fc318195cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54862/0 (socket says 172.21.15.135:54862) 2024-05-08T23:14:29.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc3177fe700 1 -- 172.21.15.135:0/1834398244 learned_addr learned my addr 172.21.15.135:0/1834398244 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:29.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc316ffd700 1 --2- 172.21.15.135:0/1834398244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc318100fc0 0x7fc318196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:29.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc317fff700 1 --2- 172.21.15.135:0/1834398244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc318101980 0x7fc31819d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:29.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc3177fe700 1 -- 172.21.15.135:0/1834398244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc318101980 msgr2=0x7fc31819d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:29.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc3177fe700 1 --2- 172.21.15.135:0/1834398244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc318101980 0x7fc31819d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc3177fe700 1 -- 172.21.15.135:0/1834398244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc318100fc0 msgr2=0x7fc318196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:29.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc3177fe700 1 --2- 172.21.15.135:0/1834398244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc318100fc0 0x7fc318196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc3177fe700 1 -- 172.21.15.135:0/1834398244 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3000095f0 con 0x7fc3180ffe70 2024-05-08T23:14:29.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc3177fe700 1 --2- 172.21.15.135:0/1834398244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3180ffe70 0x7fc318195cf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc3000059d0 tx=0x7fc300005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:29.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc314ff9700 1 -- 172.21.15.135:0/1834398244 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30001d070 con 0x7fc3180ffe70 2024-05-08T23:14:29.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc314ff9700 1 -- 172.21.15.135:0/1834398244 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc300004060 con 0x7fc3180ffe70 2024-05-08T23:14:29.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc31dbcf700 1 -- 172.21.15.135:0/1834398244 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31819ddc0 con 0x7fc3180ffe70 2024-05-08T23:14:29.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc314ff9700 1 -- 172.21.15.135:0/1834398244 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc300022dc0 con 0x7fc3180ffe70 2024-05-08T23:14:29.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.321+0000 7fc31dbcf700 1 -- 172.21.15.135:0/1834398244 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31819e190 con 0x7fc3180ffe70 2024-05-08T23:14:29.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.322+0000 7fc31dbcf700 1 -- 172.21.15.135:0/1834398244 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3181071b0 con 0x7fc3180ffe70 2024-05-08T23:14:29.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.323+0000 7fc314ff9700 1 -- 172.21.15.135:0/1834398244 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fc300003ba0 con 0x7fc3180ffe70 2024-05-08T23:14:29.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.324+0000 7fc314ff9700 1 --2- 172.21.15.135:0/1834398244 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc3040a1120 0x7fc3040a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:29.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.324+0000 7fc316ffd700 1 --2- 172.21.15.135:0/1834398244 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc3040a1120 0x7fc3040a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:29.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.324+0000 7fc314ff9700 1 -- 172.21.15.135:0/1834398244 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc3000cdd20 con 0x7fc3180ffe70 2024-05-08T23:14:29.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.324+0000 7fc316ffd700 1 --2- 172.21.15.135:0/1834398244 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc3040a1120 0x7fc3040a35e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc3181971a0 tx=0x7fc30800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:29.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.328+0000 7fc314ff9700 1 -- 172.21.15.135:0/1834398244 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc300097690 con 0x7fc3180ffe70 2024-05-08T23:14:29.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:28 smithi179 ceph-mon[46314]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:14:29.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:28 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] up:active 2024-05-08T23:14:29.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:28 smithi179 ceph-mon[46314]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2024-05-08T23:14:29.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:28 smithi179 ceph-mon[46314]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T23:14:29.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.368+0000 7fc314ff9700 1 -- 172.21.15.135:0/1834398244 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fc300097a60 con 0x7fc3180ffe70 2024-05-08T23:14:29.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:28 smithi195 ceph-mon[46516]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:14:29.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:28 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] up:active 2024-05-08T23:14:29.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:28 smithi195 ceph-mon[46516]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2024-05-08T23:14:29.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:28 smithi195 ceph-mon[46516]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T23:14:29.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.573+0000 7fc31dbcf700 1 -- 172.21.15.135:0/1834398244 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fc31802ce60 con 0x7fc3040a1120 2024-05-08T23:14:29.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.597+0000 7fc314ff9700 1 -- 172.21.15.135:0/1834398244 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc31802ce60 con 0x7fc3040a1120 2024-05-08T23:14:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.599+0000 7fc31dbcf700 1 -- 172.21.15.135:0/1834398244 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc3040a1120 msgr2=0x7fc3040a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.599+0000 7fc31dbcf700 1 --2- 172.21.15.135:0/1834398244 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc3040a1120 0x7fc3040a35e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc3181971a0 tx=0x7fc30800a380 comp rx=0 tx=0).stop 2024-05-08T23:14:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.599+0000 7fc31dbcf700 1 -- 172.21.15.135:0/1834398244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3180ffe70 msgr2=0x7fc318195cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.599+0000 7fc31dbcf700 1 --2- 172.21.15.135:0/1834398244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3180ffe70 0x7fc318195cf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc3000059d0 tx=0x7fc300005740 comp rx=0 tx=0).stop 2024-05-08T23:14:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.599+0000 7fc31dbcf700 1 -- 172.21.15.135:0/1834398244 shutdown_connections 2024-05-08T23:14:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.599+0000 7fc31dbcf700 1 --2- 172.21.15.135:0/1834398244 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc3040a1120 0x7fc3040a35e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.599+0000 7fc31dbcf700 1 --2- 172.21.15.135:0/1834398244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc318101980 0x7fc31819d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.599+0000 7fc31dbcf700 1 --2- 172.21.15.135:0/1834398244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3180ffe70 0x7fc318195cf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.599+0000 7fc31dbcf700 1 --2- 172.21.15.135:0/1834398244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc318100fc0 0x7fc318196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.599+0000 7fc31dbcf700 1 -- 172.21.15.135:0/1834398244 >> 172.21.15.135:0/1834398244 conn(0x7fc3180fb400 msgr2=0x7fc3181042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.599+0000 7fc31dbcf700 1 -- 172.21.15.135:0/1834398244 shutdown_connections 2024-05-08T23:14:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.599+0000 7fc31dbcf700 1 -- 172.21.15.135:0/1834398244 wait complete. 2024-05-08T23:14:29.611 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-08T23:14:29.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.739+0000 7fee435ea700 1 -- 172.21.15.135:0/4112839288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee3c102140 msgr2=0x7fee3c1045d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:29.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.739+0000 7fee435ea700 1 --2- 172.21.15.135:0/4112839288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee3c102140 0x7fee3c1045d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fee30009990 tx=0x7fee30009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.739+0000 7fee435ea700 1 -- 172.21.15.135:0/4112839288 shutdown_connections 2024-05-08T23:14:29.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.739+0000 7fee435ea700 1 --2- 172.21.15.135:0/4112839288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee3c0ff7d0 0x7fee3c101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.739+0000 7fee435ea700 1 --2- 172.21.15.135:0/4112839288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee3c104b10 0x7fee3c104f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.739+0000 7fee435ea700 1 --2- 172.21.15.135:0/4112839288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee3c102140 0x7fee3c1045d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.739+0000 7fee435ea700 1 -- 172.21.15.135:0/4112839288 >> 172.21.15.135:0/4112839288 conn(0x7fee3c0fb3f0 msgr2=0x7fee3c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:29.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.739+0000 7fee435ea700 1 -- 172.21.15.135:0/4112839288 shutdown_connections 2024-05-08T23:14:29.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.739+0000 7fee435ea700 1 -- 172.21.15.135:0/4112839288 wait complete. 2024-05-08T23:14:29.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee435ea700 1 Processor -- start 2024-05-08T23:14:29.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee435ea700 1 -- start start 2024-05-08T23:14:29.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee435ea700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee3c0ff7d0 0x7fee3c19d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:29.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee435ea700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee3c102140 0x7fee3c19da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:29.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee435ea700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee3c104b10 0x7fee3c1a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:29.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee435ea700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c1a5000 con 0x7fee3c104b10 2024-05-08T23:14:29.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee435ea700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c1a5140 con 0x7fee3c0ff7d0 2024-05-08T23:14:29.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee435ea700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c1a52d0 con 0x7fee3c102140 2024-05-08T23:14:29.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee41b87700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee3c104b10 0x7fee3c1a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:29.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee41b87700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee3c104b10 0x7fee3c1a4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54880/0 (socket says 172.21.15.135:54880) 2024-05-08T23:14:29.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee41b87700 1 -- 172.21.15.135:0/645938343 learned_addr learned my addr 172.21.15.135:0/645938343 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:29.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee41386700 1 --2- 172.21.15.135:0/645938343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee3c0ff7d0 0x7fee3c19d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:29.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee41b87700 1 -- 172.21.15.135:0/645938343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee3c102140 msgr2=0x7fee3c19da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:29.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee41b87700 1 --2- 172.21.15.135:0/645938343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee3c102140 0x7fee3c19da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee41b87700 1 -- 172.21.15.135:0/645938343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee3c0ff7d0 msgr2=0x7fee3c19d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:29.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee41b87700 1 --2- 172.21.15.135:0/645938343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee3c0ff7d0 0x7fee3c19d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.740+0000 7fee41b87700 1 -- 172.21.15.135:0/645938343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee300095f0 con 0x7fee3c104b10 2024-05-08T23:14:29.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.741+0000 7fee41b87700 1 --2- 172.21.15.135:0/645938343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee3c104b10 0x7fee3c1a4a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fee34007ee0 tx=0x7fee3400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:29.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.741+0000 7fee2e7fc700 1 -- 172.21.15.135:0/645938343 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee34017070 con 0x7fee3c104b10 2024-05-08T23:14:29.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.741+0000 7fee2e7fc700 1 -- 172.21.15.135:0/645938343 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee3400f040 con 0x7fee3c104b10 2024-05-08T23:14:29.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.741+0000 7fee435ea700 1 -- 172.21.15.135:0/645938343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3c1a55b0 con 0x7fee3c104b10 2024-05-08T23:14:29.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.741+0000 7fee2e7fc700 1 -- 172.21.15.135:0/645938343 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee34005740 con 0x7fee3c104b10 2024-05-08T23:14:29.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.741+0000 7fee435ea700 1 -- 172.21.15.135:0/645938343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3c1a5ac0 con 0x7fee3c104b10 2024-05-08T23:14:29.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.742+0000 7fee435ea700 1 -- 172.21.15.135:0/645938343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3c0fcf70 con 0x7fee3c104b10 2024-05-08T23:14:29.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.743+0000 7fee2e7fc700 1 -- 172.21.15.135:0/645938343 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fee3400dc60 con 0x7fee3c104b10 2024-05-08T23:14:29.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.743+0000 7fee2e7fc700 1 --2- 172.21.15.135:0/645938343 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fee280a11b0 0x7fee280a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:29.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.743+0000 7fee41386700 1 --2- 172.21.15.135:0/645938343 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fee280a11b0 0x7fee280a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:29.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.743+0000 7fee2e7fc700 1 -- 172.21.15.135:0/645938343 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fee340cc070 con 0x7fee3c104b10 2024-05-08T23:14:29.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.744+0000 7fee41386700 1 --2- 172.21.15.135:0/645938343 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fee280a11b0 0x7fee280a3670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fee38005950 tx=0x7fee3800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:29.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.748+0000 7fee2e7fc700 1 -- 172.21.15.135:0/645938343 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fee34095850 con 0x7fee3c104b10 2024-05-08T23:14:29.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.986+0000 7fee435ea700 1 -- 172.21.15.135:0/645938343 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fee3c0613e0 con 0x7fee280a11b0 2024-05-08T23:14:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.990+0000 7fee2e7fc700 1 -- 172.21.15.135:0/645938343 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fee3c0613e0 con 0x7fee280a11b0 2024-05-08T23:14:29.989 INFO:teuthology.orchestra.run.smithi135.stdout:/volumes/qa/sv_1/e8d98d61-b0f4-4534-b54f-f33683085264 2024-05-08T23:14:29.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.992+0000 7fee435ea700 1 -- 172.21.15.135:0/645938343 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fee280a11b0 msgr2=0x7fee280a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:29.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.992+0000 7fee435ea700 1 --2- 172.21.15.135:0/645938343 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fee280a11b0 0x7fee280a3670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fee38005950 tx=0x7fee3800a300 comp rx=0 tx=0).stop 2024-05-08T23:14:29.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.992+0000 7fee435ea700 1 -- 172.21.15.135:0/645938343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee3c104b10 msgr2=0x7fee3c1a4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:29.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.992+0000 7fee435ea700 1 --2- 172.21.15.135:0/645938343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee3c104b10 0x7fee3c1a4a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fee34007ee0 tx=0x7fee3400d3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.992+0000 7fee435ea700 1 -- 172.21.15.135:0/645938343 shutdown_connections 2024-05-08T23:14:29.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.992+0000 7fee435ea700 1 --2- 172.21.15.135:0/645938343 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fee280a11b0 0x7fee280a3670 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.992+0000 7fee435ea700 1 --2- 172.21.15.135:0/645938343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee3c104b10 0x7fee3c1a4a30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.992+0000 7fee435ea700 1 --2- 172.21.15.135:0/645938343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee3c0ff7d0 0x7fee3c19d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.992+0000 7fee435ea700 1 --2- 172.21.15.135:0/645938343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee3c102140 0x7fee3c19da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:29.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.992+0000 7fee435ea700 1 -- 172.21.15.135:0/645938343 >> 172.21.15.135:0/645938343 conn(0x7fee3c0fb3f0 msgr2=0x7fee3c1002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:29.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.992+0000 7fee435ea700 1 -- 172.21.15.135:0/645938343 shutdown_connections 2024-05-08T23:14:29.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:29.992+0000 7fee435ea700 1 -- 172.21.15.135:0/645938343 wait complete. 2024-05-08T23:14:30.004 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:14:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.128+0000 7fe41944b700 1 -- 172.21.15.135:0/1117709104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe414100a00 msgr2=0x7fe4141082c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.128+0000 7fe41944b700 1 --2- 172.21.15.135:0/1117709104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe414100a00 0x7fe4141082c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00b0a0 tx=0x7fe40c00b3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.128+0000 7fe41944b700 1 -- 172.21.15.135:0/1117709104 shutdown_connections 2024-05-08T23:14:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.128+0000 7fe41944b700 1 --2- 172.21.15.135:0/1117709104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe414100a00 0x7fe4141082c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.128+0000 7fe41944b700 1 --2- 172.21.15.135:0/1117709104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe414101330 0x7fe414101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.128+0000 7fe41944b700 1 --2- 172.21.15.135:0/1117709104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe414100060 0x7fe4141004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.128+0000 7fe41944b700 1 -- 172.21.15.135:0/1117709104 >> 172.21.15.135:0/1117709104 conn(0x7fe4140faab0 msgr2=0x7fe4140fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.128+0000 7fe41944b700 1 -- 172.21.15.135:0/1117709104 shutdown_connections 2024-05-08T23:14:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.128+0000 7fe41944b700 1 -- 172.21.15.135:0/1117709104 wait complete. 2024-05-08T23:14:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe41944b700 1 Processor -- start 2024-05-08T23:14:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe41944b700 1 -- start start 2024-05-08T23:14:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe41944b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe414100060 0x7fe414194c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe41944b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe414100a00 0x7fe4141951c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe41944b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe414101330 0x7fe41419c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe41944b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41419c770 con 0x7fe414100a00 2024-05-08T23:14:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe41944b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41419c8e0 con 0x7fe414100060 2024-05-08T23:14:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe41944b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41419caa0 con 0x7fe414101330 2024-05-08T23:14:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe4127fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe414100a00 0x7fe4141951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe4127fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe414100a00 0x7fe4141951c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54890/0 (socket says 172.21.15.135:54890) 2024-05-08T23:14:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe4127fc700 1 -- 172.21.15.135:0/2297307981 learned_addr learned my addr 172.21.15.135:0/2297307981 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:30.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe412ffd700 1 --2- 172.21.15.135:0/2297307981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe414100060 0x7fe414194c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:30.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe4137fe700 1 --2- 172.21.15.135:0/2297307981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe414101330 0x7fe41419c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:30.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe4127fc700 1 -- 172.21.15.135:0/2297307981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe414101330 msgr2=0x7fe41419c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:30.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe4127fc700 1 --2- 172.21.15.135:0/2297307981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe414101330 0x7fe41419c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe4127fc700 1 -- 172.21.15.135:0/2297307981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe414100060 msgr2=0x7fe414194c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:30.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe4127fc700 1 --2- 172.21.15.135:0/2297307981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe414100060 0x7fe414194c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe4127fc700 1 -- 172.21.15.135:0/2297307981 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c009d00 con 0x7fe414100a00 2024-05-08T23:14:30.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.129+0000 7fe4137fe700 1 --2- 172.21.15.135:0/2297307981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe414101330 0x7fe41419c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:14:30.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.130+0000 7fe4127fc700 1 --2- 172.21.15.135:0/2297307981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe414100a00 0x7fe4141951c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe404009a80 tx=0x7fe404009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:30.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.130+0000 7fe3fbfff700 1 -- 172.21.15.135:0/2297307981 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40400cb70 con 0x7fe414100a00 2024-05-08T23:14:30.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.130+0000 7fe41944b700 1 -- 172.21.15.135:0/2297307981 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41419cd80 con 0x7fe414100a00 2024-05-08T23:14:30.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.130+0000 7fe3fbfff700 1 -- 172.21.15.135:0/2297307981 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe40400f4d0 con 0x7fe414100a00 2024-05-08T23:14:30.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.130+0000 7fe3fbfff700 1 -- 172.21.15.135:0/2297307981 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4040165c0 con 0x7fe414100a00 2024-05-08T23:14:30.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.130+0000 7fe41944b700 1 -- 172.21.15.135:0/2297307981 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41419d1d0 con 0x7fe414100a00 2024-05-08T23:14:30.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.131+0000 7fe41944b700 1 -- 172.21.15.135:0/2297307981 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe414107230 con 0x7fe414100a00 2024-05-08T23:14:30.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.132+0000 7fe3fbfff700 1 -- 172.21.15.135:0/2297307981 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fe404017400 con 0x7fe414100a00 2024-05-08T23:14:30.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.132+0000 7fe3fbfff700 1 --2- 172.21.15.135:0/2297307981 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe3fc0a11b0 0x7fe3fc0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:30.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.132+0000 7fe412ffd700 1 --2- 172.21.15.135:0/2297307981 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe3fc0a11b0 0x7fe3fc0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:30.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.132+0000 7fe3fbfff700 1 -- 172.21.15.135:0/2297307981 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe4040cc950 con 0x7fe414100a00 2024-05-08T23:14:30.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.133+0000 7fe412ffd700 1 --2- 172.21.15.135:0/2297307981 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe3fc0a11b0 0x7fe3fc0a3670 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe414196100 tx=0x7fe40800d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:30.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.136+0000 7fe3fbfff700 1 -- 172.21.15.135:0/2297307981 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe404099b40 con 0x7fe414100a00 2024-05-08T23:14:30.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:29 smithi179 ceph-mon[46314]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:14:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:29 smithi179 ceph-mon[46314]: pgmap v227: 97 pgs: 97 active+clean; 582 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 6.1 KiB/s wr, 21 op/s 2024-05-08T23:14:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:29 smithi179 ceph-mon[46314]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:14:30.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:29 smithi179 ceph-mon[46314]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-05-08T23:14:30.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.379+0000 7fe41944b700 1 -- 172.21.15.135:0/2297307981 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe414068060 con 0x7fe414100a00 2024-05-08T23:14:30.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.379+0000 7fe3fbfff700 1 -- 172.21.15.135:0/2297307981 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10927 (secure 0 0 0) 0x7fe404026090 con 0x7fe414100a00 2024-05-08T23:14:30.379 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:30.379 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2432614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2432614311},{"type":"v1","addr":"172.21.15.135:6837","nonce":2432614311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T23:14:21.921303+0000","modified":"2024-05-08T23:14:28.351004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24500,"mds_2":24484,"mds_3":24439,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/360966092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":360966092},{"type":"v1","addr":"172.21.15.135:6839","nonce":360966092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6841/1831266531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":1831266531},{"type":"v1","addr":"172.21.15.135:6841","nonce":1831266531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1024532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1024532},{"type":"v1","addr":"172.21.15.179:6835","nonce":1024532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/2957410160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2957410160},{"type":"v1","addr":"172.21.15.179:6837","nonce":2957410160}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/4199708510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":4199708510},{"type":"v1","addr":"172.21.15.195:6835","nonce":4199708510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6837/2390721751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2390721751},{"type":"v1","addr":"172.21.15.195:6837","nonce":2390721751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.179:6839/1135239419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":1135239419},{"type":"v1","addr":"172.21.15.179:6839","nonce":1135239419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6839/1730571841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1730571841},{"type":"v1","addr":"172.21.15.195:6839","nonce":1730571841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T23:14:30.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:29 smithi195 ceph-mon[46516]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:14:30.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:29 smithi195 ceph-mon[46516]: pgmap v227: 97 pgs: 97 active+clean; 582 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 6.1 KiB/s wr, 21 op/s 2024-05-08T23:14:30.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:29 smithi195 ceph-mon[46516]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:14:30.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:29 smithi195 ceph-mon[46516]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-05-08T23:14:30.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.381+0000 7fe41944b700 1 -- 172.21.15.135:0/2297307981 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe3fc0a11b0 msgr2=0x7fe3fc0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:30.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.381+0000 7fe41944b700 1 --2- 172.21.15.135:0/2297307981 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe3fc0a11b0 0x7fe3fc0a3670 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe414196100 tx=0x7fe40800d040 comp rx=0 tx=0).stop 2024-05-08T23:14:30.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.381+0000 7fe41944b700 1 -- 172.21.15.135:0/2297307981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe414100a00 msgr2=0x7fe4141951c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:30.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.381+0000 7fe41944b700 1 --2- 172.21.15.135:0/2297307981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe414100a00 0x7fe4141951c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe404009a80 tx=0x7fe404009d90 comp rx=0 tx=0).stop 2024-05-08T23:14:30.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.382+0000 7fe41944b700 1 -- 172.21.15.135:0/2297307981 shutdown_connections 2024-05-08T23:14:30.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.382+0000 7fe41944b700 1 --2- 172.21.15.135:0/2297307981 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe3fc0a11b0 0x7fe3fc0a3670 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.382+0000 7fe41944b700 1 --2- 172.21.15.135:0/2297307981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe414101330 0x7fe41419c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.382+0000 7fe41944b700 1 --2- 172.21.15.135:0/2297307981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe414100060 0x7fe414194c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.382+0000 7fe41944b700 1 --2- 172.21.15.135:0/2297307981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe414100a00 0x7fe4141951c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.382+0000 7fe41944b700 1 -- 172.21.15.135:0/2297307981 >> 172.21.15.135:0/2297307981 conn(0x7fe4140faab0 msgr2=0x7fe414104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:30.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.382+0000 7fe41944b700 1 -- 172.21.15.135:0/2297307981 shutdown_connections 2024-05-08T23:14:30.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.382+0000 7fe41944b700 1 -- 172.21.15.135:0/2297307981 wait complete. 2024-05-08T23:14:30.382 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 27 2024-05-08T23:14:30.392 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:29 smithi135 ceph-mon[42440]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:14:30.392 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:29 smithi135 ceph-mon[42440]: pgmap v227: 97 pgs: 97 active+clean; 582 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 6.1 KiB/s wr, 21 op/s 2024-05-08T23:14:30.392 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:29 smithi135 ceph-mon[42440]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:14:30.392 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:29 smithi135 ceph-mon[42440]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-05-08T23:14:30.393 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T23:14:30.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.516+0000 7f43005e4700 1 -- 172.21.15.135:0/3423778662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42f8101900 msgr2=0x7f42f81081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:30.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.516+0000 7f43005e4700 1 --2- 172.21.15.135:0/3423778662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42f8101900 0x7f42f81081b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f42f000b0d0 tx=0x7f42f000b3e0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.516+0000 7f43005e4700 1 -- 172.21.15.135:0/3423778662 shutdown_connections 2024-05-08T23:14:30.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.516+0000 7f43005e4700 1 --2- 172.21.15.135:0/3423778662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42f8101900 0x7f42f81081b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.516+0000 7f43005e4700 1 --2- 172.21.15.135:0/3423778662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f80ffd70 0x7f42f8100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.516+0000 7f43005e4700 1 --2- 172.21.15.135:0/3423778662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42f8100f60 0x7f42f81013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.516+0000 7f43005e4700 1 -- 172.21.15.135:0/3423778662 >> 172.21.15.135:0/3423778662 conn(0x7f42f80fb2e0 msgr2=0x7f42f80fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.517+0000 7f43005e4700 1 -- 172.21.15.135:0/3423778662 shutdown_connections 2024-05-08T23:14:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.517+0000 7f43005e4700 1 -- 172.21.15.135:0/3423778662 wait complete. 2024-05-08T23:14:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.517+0000 7f43005e4700 1 Processor -- start 2024-05-08T23:14:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.517+0000 7f43005e4700 1 -- start start 2024-05-08T23:14:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.517+0000 7f43005e4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42f80ffd70 0x7f42f8069f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.517+0000 7f43005e4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42f8100f60 0x7f42f819dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.517+0000 7f43005e4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f8101900 0x7f42f81a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.517+0000 7f43005e4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f81a0b90 con 0x7f42f80ffd70 2024-05-08T23:14:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.517+0000 7f43005e4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f81a0d00 con 0x7f42f8101900 2024-05-08T23:14:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.517+0000 7f43005e4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f81a0ec0 con 0x7f42f8100f60 2024-05-08T23:14:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.517+0000 7f42fe380700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42f80ffd70 0x7f42f8069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.517+0000 7f42fe380700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42f80ffd70 0x7f42f8069f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54908/0 (socket says 172.21.15.135:54908) 2024-05-08T23:14:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.517+0000 7f42fe380700 1 -- 172.21.15.135:0/4252333708 learned_addr learned my addr 172.21.15.135:0/4252333708 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.518+0000 7f42fdb7f700 1 --2- 172.21.15.135:0/4252333708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42f8100f60 0x7f42f819dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.518+0000 7f42fe380700 1 -- 172.21.15.135:0/4252333708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42f8100f60 msgr2=0x7f42f819dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.518+0000 7f42fe380700 1 --2- 172.21.15.135:0/4252333708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42f8100f60 0x7f42f819dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.518+0000 7f42fe380700 1 -- 172.21.15.135:0/4252333708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f8101900 msgr2=0x7f42f81a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.518+0000 7f42fe380700 1 --2- 172.21.15.135:0/4252333708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f8101900 0x7f42f81a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.518+0000 7f42fe380700 1 -- 172.21.15.135:0/4252333708 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f0009d00 con 0x7f42f80ffd70 2024-05-08T23:14:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.518+0000 7f42fdb7f700 1 --2- 172.21.15.135:0/4252333708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42f8100f60 0x7f42f819dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:14:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.518+0000 7f42fe380700 1 --2- 172.21.15.135:0/4252333708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42f80ffd70 0x7f42f8069f70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f42f400c970 tx=0x7f42f400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.518+0000 7f42ef7fe700 1 -- 172.21.15.135:0/4252333708 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4004220 con 0x7f42f80ffd70 2024-05-08T23:14:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.518+0000 7f43005e4700 1 -- 172.21.15.135:0/4252333708 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f81a11a0 con 0x7f42f80ffd70 2024-05-08T23:14:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.518+0000 7f42ef7fe700 1 -- 172.21.15.135:0/4252333708 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42f4007d60 con 0x7f42f80ffd70 2024-05-08T23:14:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.518+0000 7f42ef7fe700 1 -- 172.21.15.135:0/4252333708 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4003d00 con 0x7f42f80ffd70 2024-05-08T23:14:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.518+0000 7f43005e4700 1 -- 172.21.15.135:0/4252333708 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f81a16b0 con 0x7f42f80ffd70 2024-05-08T23:14:30.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.519+0000 7f43005e4700 1 -- 172.21.15.135:0/4252333708 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f81070c0 con 0x7f42f80ffd70 2024-05-08T23:14:30.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.520+0000 7f42ef7fe700 1 -- 172.21.15.135:0/4252333708 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f42f4004380 con 0x7f42f80ffd70 2024-05-08T23:14:30.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.520+0000 7f42ef7fe700 1 --2- 172.21.15.135:0/4252333708 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f42e40a11b0 0x7f42e40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:30.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.520+0000 7f42fdb7f700 1 --2- 172.21.15.135:0/4252333708 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f42e40a11b0 0x7f42e40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:30.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.520+0000 7f42ef7fe700 1 -- 172.21.15.135:0/4252333708 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f42f40cc860 con 0x7f42f80ffd70 2024-05-08T23:14:30.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.521+0000 7f42fdb7f700 1 --2- 172.21.15.135:0/4252333708 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f42e40a11b0 0x7f42e40a3670 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f42e8005fd0 tx=0x7f42e8005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:30.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.525+0000 7f42ef7fe700 1 -- 172.21.15.135:0/4252333708 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f42f4096040 con 0x7f42f80ffd70 2024-05-08T23:14:30.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.726+0000 7f43005e4700 1 -- 172.21.15.135:0/4252333708 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42f810b590 con 0x7f42f80ffd70 2024-05-08T23:14:30.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.727+0000 7f42ef7fe700 1 -- 172.21.15.135:0/4252333708 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22176 (secure 0 0 0) 0x7f42f401d090 con 0x7f42f80ffd70 2024-05-08T23:14:30.727 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:30.727 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":83,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:14:22.924945+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T23:14:19.726838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T23:14:21.097732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:14:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.729+0000 7f43005e4700 1 -- 172.21.15.135:0/4252333708 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f42e40a11b0 msgr2=0x7f42e40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.730+0000 7f43005e4700 1 --2- 172.21.15.135:0/4252333708 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f42e40a11b0 0x7f42e40a3670 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f42e8005fd0 tx=0x7f42e8005e20 comp rx=0 tx=0).stop 2024-05-08T23:14:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.730+0000 7f43005e4700 1 -- 172.21.15.135:0/4252333708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42f80ffd70 msgr2=0x7f42f8069f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.730+0000 7f43005e4700 1 --2- 172.21.15.135:0/4252333708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42f80ffd70 0x7f42f8069f70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f42f400c970 tx=0x7f42f400cd30 comp rx=0 tx=0).stop 2024-05-08T23:14:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.730+0000 7f43005e4700 1 -- 172.21.15.135:0/4252333708 shutdown_connections 2024-05-08T23:14:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.730+0000 7f43005e4700 1 --2- 172.21.15.135:0/4252333708 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f42e40a11b0 0x7f42e40a3670 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.730+0000 7f43005e4700 1 --2- 172.21.15.135:0/4252333708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42f8101900 0x7f42f81a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.730+0000 7f43005e4700 1 --2- 172.21.15.135:0/4252333708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42f80ffd70 0x7f42f8069f70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.730+0000 7f43005e4700 1 --2- 172.21.15.135:0/4252333708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42f8100f60 0x7f42f819dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.730+0000 7f43005e4700 1 -- 172.21.15.135:0/4252333708 >> 172.21.15.135:0/4252333708 conn(0x7f42f80fb2e0 msgr2=0x7f42f8104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.730+0000 7f43005e4700 1 -- 172.21.15.135:0/4252333708 shutdown_connections 2024-05-08T23:14:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.730+0000 7f43005e4700 1 -- 172.21.15.135:0/4252333708 wait complete. 2024-05-08T23:14:30.742 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-08T23:14:30.742 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T23:14:30.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.865+0000 7fc901ad5700 1 -- 172.21.15.135:0/2208586783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8fc100f50 msgr2=0x7fc8fc1013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:30.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.865+0000 7fc901ad5700 1 --2- 172.21.15.135:0/2208586783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8fc100f50 0x7fc8fc1013b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00099c0 tx=0x7fc8f0009cd0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.865+0000 7fc901ad5700 1 -- 172.21.15.135:0/2208586783 shutdown_connections 2024-05-08T23:14:30.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.865+0000 7fc901ad5700 1 --2- 172.21.15.135:0/2208586783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8fc0ffd60 0x7fc8fc100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.865+0000 7fc901ad5700 1 --2- 172.21.15.135:0/2208586783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8fc1018f0 0x7fc8fc1081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.865+0000 7fc901ad5700 1 --2- 172.21.15.135:0/2208586783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8fc100f50 0x7fc8fc1013b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.865+0000 7fc901ad5700 1 -- 172.21.15.135:0/2208586783 >> 172.21.15.135:0/2208586783 conn(0x7fc8fc0fb2f0 msgr2=0x7fc8fc0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:30.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.865+0000 7fc901ad5700 1 -- 172.21.15.135:0/2208586783 shutdown_connections 2024-05-08T23:14:30.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.865+0000 7fc901ad5700 1 -- 172.21.15.135:0/2208586783 wait complete. 2024-05-08T23:14:30.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.866+0000 7fc901ad5700 1 Processor -- start 2024-05-08T23:14:30.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.866+0000 7fc901ad5700 1 -- start start 2024-05-08T23:14:30.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc901ad5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8fc0ffd60 0x7fc8fc195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:30.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc901ad5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8fc100f50 0x7fc8fc196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:30.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc901ad5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8fc1018f0 0x7fc8fc19d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:30.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc901ad5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc19d7c0 con 0x7fc8fc1018f0 2024-05-08T23:14:30.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc901ad5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc19d930 con 0x7fc8fc0ffd60 2024-05-08T23:14:30.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc901ad5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc19daf0 con 0x7fc8fc100f50 2024-05-08T23:14:30.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc8fbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8fc1018f0 0x7fc8fc19d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:30.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc8fbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8fc1018f0 0x7fc8fc19d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54922/0 (socket says 172.21.15.135:54922) 2024-05-08T23:14:30.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc8fbfff700 1 -- 172.21.15.135:0/1929311326 learned_addr learned my addr 172.21.15.135:0/1929311326 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:30.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc8fb7fe700 1 --2- 172.21.15.135:0/1929311326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8fc0ffd60 0x7fc8fc195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:30.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc8faffd700 1 --2- 172.21.15.135:0/1929311326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8fc100f50 0x7fc8fc196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:30.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc8fbfff700 1 -- 172.21.15.135:0/1929311326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8fc100f50 msgr2=0x7fc8fc196210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:30.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc8fbfff700 1 --2- 172.21.15.135:0/1929311326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8fc100f50 0x7fc8fc196210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc8fbfff700 1 -- 172.21.15.135:0/1929311326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8fc0ffd60 msgr2=0x7fc8fc195cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:30.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc8fbfff700 1 --2- 172.21.15.135:0/1929311326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8fc0ffd60 0x7fc8fc195cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:30.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc8fbfff700 1 -- 172.21.15.135:0/1929311326 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f00095f0 con 0x7fc8fc1018f0 2024-05-08T23:14:30.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc8faffd700 1 --2- 172.21.15.135:0/1929311326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8fc100f50 0x7fc8fc196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:14:30.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc8fbfff700 1 --2- 172.21.15.135:0/1929311326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8fc1018f0 0x7fc8fc19d1f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4007ee0 tx=0x7fc8f400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:30.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc8f8ff9700 1 -- 172.21.15.135:0/1929311326 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4017070 con 0x7fc8fc1018f0 2024-05-08T23:14:30.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc8f8ff9700 1 -- 172.21.15.135:0/1929311326 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8f400f040 con 0x7fc8fc1018f0 2024-05-08T23:14:30.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc8f8ff9700 1 -- 172.21.15.135:0/1929311326 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4005740 con 0x7fc8fc1018f0 2024-05-08T23:14:30.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc901ad5700 1 -- 172.21.15.135:0/1929311326 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8fc19ddd0 con 0x7fc8fc1018f0 2024-05-08T23:14:30.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.867+0000 7fc901ad5700 1 -- 172.21.15.135:0/1929311326 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8fc19e1d0 con 0x7fc8fc1018f0 2024-05-08T23:14:30.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.868+0000 7fc901ad5700 1 -- 172.21.15.135:0/1929311326 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8fc107180 con 0x7fc8fc1018f0 2024-05-08T23:14:30.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.869+0000 7fc8f8ff9700 1 -- 172.21.15.135:0/1929311326 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fc8f400dc60 con 0x7fc8fc1018f0 2024-05-08T23:14:30.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.870+0000 7fc8f8ff9700 1 --2- 172.21.15.135:0/1929311326 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc8e40a11b0 0x7fc8e40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:30.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.870+0000 7fc8f8ff9700 1 -- 172.21.15.135:0/1929311326 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc8f40cc0d0 con 0x7fc8fc1018f0 2024-05-08T23:14:30.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.870+0000 7fc8fb7fe700 1 --2- 172.21.15.135:0/1929311326 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc8e40a11b0 0x7fc8e40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:30.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.870+0000 7fc8fb7fe700 1 --2- 172.21.15.135:0/1929311326 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc8e40a11b0 0x7fc8e40a3670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc197150 tx=0x7fc8ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:30.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:30.874+0000 7fc8f8ff9700 1 -- 172.21.15.135:0/1929311326 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc8f40958b0 con 0x7fc8fc1018f0 2024-05-08T23:14:31.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.072+0000 7fc901ad5700 1 -- 172.21.15.135:0/1929311326 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8fc02cf00 con 0x7fc8e40a11b0 2024-05-08T23:14:31.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.082+0000 7fc8f8ff9700 1 -- 172.21.15.135:0/1929311326 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+328482 (secure 0 0 0) 0x7fc8fc02cf00 con 0x7fc8e40a11b0 2024-05-08T23:14:31.087 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:31.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.086+0000 7fc901ad5700 1 -- 172.21.15.135:0/1929311326 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc8e40a11b0 msgr2=0x7fc8e40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:31.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.086+0000 7fc901ad5700 1 --2- 172.21.15.135:0/1929311326 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc8e40a11b0 0x7fc8e40a3670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc197150 tx=0x7fc8ec009260 comp rx=0 tx=0).stop 2024-05-08T23:14:31.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.086+0000 7fc901ad5700 1 -- 172.21.15.135:0/1929311326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8fc1018f0 msgr2=0x7fc8fc19d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:31.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.086+0000 7fc901ad5700 1 --2- 172.21.15.135:0/1929311326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8fc1018f0 0x7fc8fc19d1f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4007ee0 tx=0x7fc8f400d3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.086+0000 7fc901ad5700 1 -- 172.21.15.135:0/1929311326 shutdown_connections 2024-05-08T23:14:31.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.086+0000 7fc901ad5700 1 --2- 172.21.15.135:0/1929311326 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fc8e40a11b0 0x7fc8e40a3670 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.086+0000 7fc901ad5700 1 --2- 172.21.15.135:0/1929311326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8fc1018f0 0x7fc8fc19d1f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.086+0000 7fc901ad5700 1 --2- 172.21.15.135:0/1929311326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8fc0ffd60 0x7fc8fc195cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.086+0000 7fc901ad5700 1 --2- 172.21.15.135:0/1929311326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8fc100f50 0x7fc8fc196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.086+0000 7fc901ad5700 1 -- 172.21.15.135:0/1929311326 >> 172.21.15.135:0/1929311326 conn(0x7fc8fc0fb2f0 msgr2=0x7fc8fc1042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:31.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.086+0000 7fc901ad5700 1 -- 172.21.15.135:0/1929311326 shutdown_connections 2024-05-08T23:14:31.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.086+0000 7fc901ad5700 1 -- 172.21.15.135:0/1929311326 wait complete. 2024-05-08T23:14:31.090 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T23:14:31.096 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:30 smithi135 ceph-mon[42440]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:14:31.097 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:30 smithi135 ceph-mon[42440]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:14:31.097 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:30 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2297307981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:31.097 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:30 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/4252333708' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:31.098 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2024-05-08T23:14:31.032224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596747,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":152,"num_read_kb":128,"num_write":343,"num_write_kb":2989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363732,"kb_used_data":10856,"kb_used_omap":18,"kb_used_meta":352749,"kb_avail":1124578092,"statfs":{"total":1151940427776,"available":1151567966208,"internally_reserved":0,"allocated":11116544,"data_stored":6935373,"data_compressed":107634,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":361215290},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6379,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":162,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.104650"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934695+0000","last_change":"2024-05-08T23:14:21.938982+0000","last_active":"2024-05-08T23:14:22.934695+0000","last_peered":"2024-05-08T23:14:22.934695+0000","last_clean":"2024-05-08T23:14:22.934695+0000","last_became_active":"2024-05-08T23:14:21.938630+0000","last_became_peered":"2024-05-08T23:14:21.938630+0000","last_unstale":"2024-05-08T23:14:22.934695+0000","last_undegraded":"2024-05-08T23:14:22.934695+0000","last_fullsized":"2024-05-08T23:14:22.934695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:33.421139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125505+0000","last_change":"2024-05-08T23:14:21.952126+0000","last_active":"2024-05-08T23:14:24.125505+0000","last_peered":"2024-05-08T23:14:24.125505+0000","last_clean":"2024-05-08T23:14:24.125505+0000","last_became_active":"2024-05-08T23:14:21.951155+0000","last_became_peered":"2024-05-08T23:14:21.951155+0000","last_unstale":"2024-05-08T23:14:24.125505+0000","last_undegraded":"2024-05-08T23:14:24.125505+0000","last_fullsized":"2024-05-08T23:14:24.125505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:24.931166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125409+0000","last_change":"2024-05-08T23:14:21.947520+0000","last_active":"2024-05-08T23:14:24.125409+0000","last_peered":"2024-05-08T23:14:24.125409+0000","last_clean":"2024-05-08T23:14:24.125409+0000","last_became_active":"2024-05-08T23:14:21.947258+0000","last_became_peered":"2024-05-08T23:14:21.947258+0000","last_unstale":"2024-05-08T23:14:24.125409+0000","last_undegraded":"2024-05-08T23:14:24.125409+0000","last_fullsized":"2024-05-08T23:14:24.125409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:37.173840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.850109+0000","last_change":"2024-05-08T23:14:21.951221+0000","last_active":"2024-05-08T23:14:23.850109+0000","last_peered":"2024-05-08T23:14:23.850109+0000","last_clean":"2024-05-08T23:14:23.850109+0000","last_became_active":"2024-05-08T23:14:21.950398+0000","last_became_peered":"2024-05-08T23:14:21.950398+0000","last_unstale":"2024-05-08T23:14:23.850109+0000","last_undegraded":"2024-05-08T23:14:23.850109+0000","last_fullsized":"2024-05-08T23:14:23.850109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:26.360521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169189+0000","last_change":"2024-05-08T23:14:21.947783+0000","last_active":"2024-05-08T23:14:24.169189+0000","last_peered":"2024-05-08T23:14:24.169189+0000","last_clean":"2024-05-08T23:14:24.169189+0000","last_became_active":"2024-05-08T23:14:21.947448+0000","last_became_peered":"2024-05-08T23:14:21.947448+0000","last_unstale":"2024-05-08T23:14:24.169189+0000","last_undegraded":"2024-05-08T23:14:24.169189+0000","last_fullsized":"2024-05-08T23:14:24.169189+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:21.447674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.071003+0000","last_change":"2024-05-08T23:14:21.945541+0000","last_active":"2024-05-08T23:14:22.071003+0000","last_peered":"2024-05-08T23:14:22.071003+0000","last_clean":"2024-05-08T23:14:22.071003+0000","last_became_active":"2024-05-08T23:14:21.945135+0000","last_became_peered":"2024-05-08T23:14:21.945135+0000","last_unstale":"2024-05-08T23:14:22.071003+0000","last_undegraded":"2024-05-08T23:14:22.071003+0000","last_fullsized":"2024-05-08T23:14:22.071003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:44.143289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041794+0000","last_change":"2024-05-08T23:14:21.958827+0000","last_active":"2024-05-08T23:14:22.041794+0000","last_peered":"2024-05-08T23:14:22.041794+0000","last_clean":"2024-05-08T23:14:22.041794+0000","last_became_active":"2024-05-08T23:14:21.958400+0000","last_became_peered":"2024-05-08T23:14:21.958400+0000","last_unstale":"2024-05-08T23:14:22.041794+0000","last_undegraded":"2024-05-08T23:14:22.041794+0000","last_fullsized":"2024-05-08T23:14:22.041794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:39.280896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099219+0000","last_change":"2024-05-08T23:14:21.960924+0000","last_active":"2024-05-08T23:14:23.099219+0000","last_peered":"2024-05-08T23:14:23.099219+0000","last_clean":"2024-05-08T23:14:23.099219+0000","last_became_active":"2024-05-08T23:14:21.960651+0000","last_became_peered":"2024-05-08T23:14:21.960651+0000","last_unstale":"2024-05-08T23:14:23.099219+0000","last_undegraded":"2024-05-08T23:14:23.099219+0000","last_fullsized":"2024-05-08T23:14:23.099219+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:14:22.284354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468928+0000","last_change":"2024-05-08T23:14:21.961059+0000","last_active":"2024-05-08T23:14:22.468928+0000","last_peered":"2024-05-08T23:14:22.468928+0000","last_clean":"2024-05-08T23:14:22.468928+0000","last_became_active":"2024-05-08T23:14:21.960730+0000","last_became_peered":"2024-05-08T23:14:21.960730+0000","last_unstale":"2024-05-08T23:14:22.468928+0000","last_undegraded":"2024-05-08T23:14:22.468928+0000","last_fullsized":"2024-05-08T23:14:22.468928+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:01.448480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.071052+0000","last_change":"2024-05-08T23:14:21.950267+0000","last_active":"2024-05-08T23:14:22.071052+0000","last_peered":"2024-05-08T23:14:22.071052+0000","last_clean":"2024-05-08T23:14:22.071052+0000","last_became_active":"2024-05-08T23:14:21.949477+0000","last_became_peered":"2024-05-08T23:14:21.949477+0000","last_unstale":"2024-05-08T23:14:22.071052+0000","last_undegraded":"2024-05-08T23:14:22.071052+0000","last_fullsized":"2024-05-08T23:14:22.071052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:36.123316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041851+0000","last_change":"2024-05-08T23:14:21.955566+0000","last_active":"2024-05-08T23:14:22.041851+0000","last_peered":"2024-05-08T23:14:22.041851+0000","last_clean":"2024-05-08T23:14:22.041851+0000","last_became_active":"2024-05-08T23:14:21.955208+0000","last_became_peered":"2024-05-08T23:14:21.955208+0000","last_unstale":"2024-05-08T23:14:22.041851+0000","last_undegraded":"2024-05-08T23:14:22.041851+0000","last_fullsized":"2024-05-08T23:14:22.041851+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:29.478197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.850194+0000","last_change":"2024-05-08T23:14:21.939532+0000","last_active":"2024-05-08T23:14:23.850194+0000","last_peered":"2024-05-08T23:14:23.850194+0000","last_clean":"2024-05-08T23:14:23.850194+0000","last_became_active":"2024-05-08T23:14:21.938590+0000","last_became_peered":"2024-05-08T23:14:21.938590+0000","last_unstale":"2024-05-08T23:14:23.850194+0000","last_undegraded":"2024-05-08T23:14:23.850194+0000","last_fullsized":"2024-05-08T23:14:23.850194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:50.525121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067896+0000","last_change":"2024-05-08T23:14:21.942720+0000","last_active":"2024-05-08T23:14:24.067896+0000","last_peered":"2024-05-08T23:14:24.067896+0000","last_clean":"2024-05-08T23:14:24.067896+0000","last_became_active":"2024-05-08T23:14:21.942396+0000","last_became_peered":"2024-05-08T23:14:21.942396+0000","last_unstale":"2024-05-08T23:14:24.067896+0000","last_undegraded":"2024-05-08T23:14:24.067896+0000","last_fullsized":"2024-05-08T23:14:24.067896+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:17.893007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125207+0000","last_change":"2024-05-08T23:14:21.946955+0000","last_active":"2024-05-08T23:14:24.125207+0000","last_peered":"2024-05-08T23:14:24.125207+0000","last_clean":"2024-05-08T23:14:24.125207+0000","last_became_active":"2024-05-08T23:14:21.946733+0000","last_became_peered":"2024-05-08T23:14:21.946733+0000","last_unstale":"2024-05-08T23:14:24.125207+0000","last_undegraded":"2024-05-08T23:14:24.125207+0000","last_fullsized":"2024-05-08T23:14:24.125207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:39.097612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125239+0000","last_change":"2024-05-08T23:14:21.945827+0000","last_active":"2024-05-08T23:14:24.125239+0000","last_peered":"2024-05-08T23:14:24.125239+0000","last_clean":"2024-05-08T23:14:24.125239+0000","last_became_active":"2024-05-08T23:14:21.945606+0000","last_became_peered":"2024-05-08T23:14:21.945606+0000","last_unstale":"2024-05-08T23:14:24.125239+0000","last_undegraded":"2024-05-08T23:14:24.125239+0000","last_fullsized":"2024-05-08T23:14:24.125239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:22.689917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468793+0000","last_change":"2024-05-08T23:14:21.952640+0000","last_active":"2024-05-08T23:14:22.468793+0000","last_peered":"2024-05-08T23:14:22.468793+0000","last_clean":"2024-05-08T23:14:22.468793+0000","last_became_active":"2024-05-08T23:14:21.952283+0000","last_became_peered":"2024-05-08T23:14:21.952283+0000","last_unstale":"2024-05-08T23:14:22.468793+0000","last_undegraded":"2024-05-08T23:14:22.468793+0000","last_fullsized":"2024-05-08T23:14:22.468793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:42.211479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934813+0000","last_change":"2024-05-08T23:14:21.947950+0000","last_active":"2024-05-08T23:14:22.934813+0000","last_peered":"2024-05-08T23:14:22.934813+0000","last_clean":"2024-05-08T23:14:22.934813+0000","last_became_active":"2024-05-08T23:14:21.947621+0000","last_became_peered":"2024-05-08T23:14:21.947621+0000","last_unstale":"2024-05-08T23:14:22.934813+0000","last_undegraded":"2024-05-08T23:14:22.934813+0000","last_fullsized":"2024-05-08T23:14:22.934813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:54:47.736649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.933859+0000","last_change":"2024-05-08T23:14:21.950172+0000","last_active":"2024-05-08T23:14:22.933859+0000","last_peered":"2024-05-08T23:14:22.933859+0000","last_clean":"2024-05-08T23:14:22.933859+0000","last_became_active":"2024-05-08T23:14:21.949844+0000","last_became_peered":"2024-05-08T23:14:21.949844+0000","last_unstale":"2024-05-08T23:14:22.933859+0000","last_undegraded":"2024-05-08T23:14:22.933859+0000","last_fullsized":"2024-05-08T23:14:22.933859+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:18.216174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685351+0000","last_change":"2024-05-08T23:14:21.943336+0000","last_active":"2024-05-08T23:14:23.685351+0000","last_peered":"2024-05-08T23:14:23.685351+0000","last_clean":"2024-05-08T23:14:23.685351+0000","last_became_active":"2024-05-08T23:14:21.942697+0000","last_became_peered":"2024-05-08T23:14:21.942697+0000","last_unstale":"2024-05-08T23:14:23.685351+0000","last_undegraded":"2024-05-08T23:14:23.685351+0000","last_fullsized":"2024-05-08T23:14:23.685351+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:54.332708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.355456+0000","last_change":"2024-05-08T23:14:21.526822+0000","last_active":"2024-05-08T23:14:27.355456+0000","last_peered":"2024-05-08T23:14:27.355456+0000","last_clean":"2024-05-08T23:14:27.355456+0000","last_became_active":"2024-05-08T23:14:21.526561+0000","last_became_peered":"2024-05-08T23:14:21.526561+0000","last_unstale":"2024-05-08T23:14:27.355456+0000","last_undegraded":"2024-05-08T23:14:27.355456+0000","last_fullsized":"2024-05-08T23:14:27.355456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:45.360865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099287+0000","last_change":"2024-05-08T23:14:21.961315+0000","last_active":"2024-05-08T23:14:23.099287+0000","last_peered":"2024-05-08T23:14:23.099287+0000","last_clean":"2024-05-08T23:14:23.099287+0000","last_became_active":"2024-05-08T23:14:21.961039+0000","last_became_peered":"2024-05-08T23:14:21.961039+0000","last_unstale":"2024-05-08T23:14:23.099287+0000","last_undegraded":"2024-05-08T23:14:23.099287+0000","last_fullsized":"2024-05-08T23:14:23.099287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:01.163246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.168432+0000","last_change":"2024-05-08T23:14:21.523353+0000","last_active":"2024-05-08T23:14:24.168432+0000","last_peered":"2024-05-08T23:14:24.168432+0000","last_clean":"2024-05-08T23:14:24.168432+0000","last_became_active":"2024-05-08T23:14:21.523046+0000","last_became_peered":"2024-05-08T23:14:21.523046+0000","last_unstale":"2024-05-08T23:14:24.168432+0000","last_undegraded":"2024-05-08T23:14:24.168432+0000","last_fullsized":"2024-05-08T23:14:24.168432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:04:54.448457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125580+0000","last_change":"2024-05-08T23:14:21.948093+0000","last_active":"2024-05-08T23:14:24.125580+0000","last_peered":"2024-05-08T23:14:24.125580+0000","last_clean":"2024-05-08T23:14:24.125580+0000","last_became_active":"2024-05-08T23:14:21.947812+0000","last_became_peered":"2024-05-08T23:14:21.947812+0000","last_unstale":"2024-05-08T23:14:24.125580+0000","last_undegraded":"2024-05-08T23:14:24.125580+0000","last_fullsized":"2024-05-08T23:14:24.125580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:47.804387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.961273+0000","last_change":"2024-05-08T23:14:21.527205+0000","last_active":"2024-05-08T23:14:25.961273+0000","last_peered":"2024-05-08T23:14:25.961273+0000","last_clean":"2024-05-08T23:14:25.961273+0000","last_became_active":"2024-05-08T23:14:21.526699+0000","last_became_peered":"2024-05-08T23:14:21.526699+0000","last_unstale":"2024-05-08T23:14:25.961273+0000","last_undegraded":"2024-05-08T23:14:25.961273+0000","last_fullsized":"2024-05-08T23:14:25.961273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:04.818255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468855+0000","last_change":"2024-05-08T23:14:21.946804+0000","last_active":"2024-05-08T23:14:22.468855+0000","last_peered":"2024-05-08T23:14:22.468855+0000","last_clean":"2024-05-08T23:14:22.468855+0000","last_became_active":"2024-05-08T23:14:21.946448+0000","last_became_peered":"2024-05-08T23:14:21.946448+0000","last_unstale":"2024-05-08T23:14:22.468855+0000","last_undegraded":"2024-05-08T23:14:22.468855+0000","last_fullsized":"2024-05-08T23:14:22.468855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:40.495644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:21.964658+0000","last_change":"2024-05-08T23:14:21.521146+0000","last_active":"2024-05-08T23:14:21.964658+0000","last_peered":"2024-05-08T23:14:21.964658+0000","last_clean":"2024-05-08T23:14:21.964658+0000","last_became_active":"2024-05-08T23:14:21.520936+0000","last_became_peered":"2024-05-08T23:14:21.520936+0000","last_unstale":"2024-05-08T23:14:21.964658+0000","last_undegraded":"2024-05-08T23:14:21.964658+0000","last_fullsized":"2024-05-08T23:14:21.964658+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:30.725824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.102003+0000","last_change":"2024-05-08T23:14:21.961059+0000","last_active":"2024-05-08T23:14:22.102003+0000","last_peered":"2024-05-08T23:14:22.102003+0000","last_clean":"2024-05-08T23:14:22.102003+0000","last_became_active":"2024-05-08T23:14:21.960719+0000","last_became_peered":"2024-05-08T23:14:21.960719+0000","last_unstale":"2024-05-08T23:14:22.102003+0000","last_undegraded":"2024-05-08T23:14:22.102003+0000","last_fullsized":"2024-05-08T23:14:22.102003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:13.004002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.337738+0000","last_change":"2024-05-08T23:14:21.527091+0000","last_active":"2024-05-08T23:14:26.337738+0000","last_peered":"2024-05-08T23:14:26.337738+0000","last_clean":"2024-05-08T23:14:26.337738+0000","last_became_active":"2024-05-08T23:14:21.526750+0000","last_became_peered":"2024-05-08T23:14:21.526750+0000","last_unstale":"2024-05-08T23:14:26.337738+0000","last_undegraded":"2024-05-08T23:14:26.337738+0000","last_fullsized":"2024-05-08T23:14:26.337738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:35.059241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169216+0000","last_change":"2024-05-08T23:14:21.942050+0000","last_active":"2024-05-08T23:14:24.169216+0000","last_peered":"2024-05-08T23:14:24.169216+0000","last_clean":"2024-05-08T23:14:24.169216+0000","last_became_active":"2024-05-08T23:14:21.941719+0000","last_became_peered":"2024-05-08T23:14:21.941719+0000","last_unstale":"2024-05-08T23:14:24.169216+0000","last_undegraded":"2024-05-08T23:14:24.169216+0000","last_fullsized":"2024-05-08T23:14:24.169216+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:03.821820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.344926+0000","last_change":"2024-05-08T23:14:21.523760+0000","last_active":"2024-05-08T23:14:26.344926+0000","last_peered":"2024-05-08T23:14:26.344926+0000","last_clean":"2024-05-08T23:14:26.344926+0000","last_became_active":"2024-05-08T23:14:21.523213+0000","last_became_peered":"2024-05-08T23:14:21.523213+0000","last_unstale":"2024-05-08T23:14:26.344926+0000","last_undegraded":"2024-05-08T23:14:26.344926+0000","last_fullsized":"2024-05-08T23:14:26.344926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:12.225427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101977+0000","last_change":"2024-05-08T23:14:21.959473+0000","last_active":"2024-05-08T23:14:22.101977+0000","last_peered":"2024-05-08T23:14:22.101977+0000","last_clean":"2024-05-08T23:14:22.101977+0000","last_became_active":"2024-05-08T23:14:21.959127+0000","last_became_peered":"2024-05-08T23:14:21.959127+0000","last_unstale":"2024-05-08T23:14:22.101977+0000","last_undegraded":"2024-05-08T23:14:22.101977+0000","last_fullsized":"2024-05-08T23:14:22.101977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:50.181028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.959885+0000","last_change":"2024-05-08T23:14:21.520072+0000","last_active":"2024-05-08T23:14:25.959885+0000","last_peered":"2024-05-08T23:14:25.959885+0000","last_clean":"2024-05-08T23:14:25.959885+0000","last_became_active":"2024-05-08T23:14:21.519753+0000","last_became_peered":"2024-05-08T23:14:21.519753+0000","last_unstale":"2024-05-08T23:14:25.959885+0000","last_undegraded":"2024-05-08T23:14:25.959885+0000","last_fullsized":"2024-05-08T23:14:25.959885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:35.966643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099236+0000","last_change":"2024-05-08T23:14:21.946034+0000","last_active":"2024-05-08T23:14:23.099236+0000","last_peered":"2024-05-08T23:14:23.099236+0000","last_clean":"2024-05-08T23:14:23.099236+0000","last_became_active":"2024-05-08T23:14:21.945652+0000","last_became_peered":"2024-05-08T23:14:21.945652+0000","last_unstale":"2024-05-08T23:14:23.099236+0000","last_undegraded":"2024-05-08T23:14:23.099236+0000","last_fullsized":"2024-05-08T23:14:23.099236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:13.527673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.955716+0000","last_change":"2024-05-08T23:14:21.522394+0000","last_active":"2024-05-08T23:14:24.955716+0000","last_peered":"2024-05-08T23:14:24.955716+0000","last_clean":"2024-05-08T23:14:24.955716+0000","last_became_active":"2024-05-08T23:14:21.522038+0000","last_became_peered":"2024-05-08T23:14:21.522038+0000","last_unstale":"2024-05-08T23:14:24.955716+0000","last_undegraded":"2024-05-08T23:14:24.955716+0000","last_fullsized":"2024-05-08T23:14:24.955716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:18.958647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.933815+0000","last_change":"2024-05-08T23:14:21.946005+0000","last_active":"2024-05-08T23:14:22.933815+0000","last_peered":"2024-05-08T23:14:22.933815+0000","last_clean":"2024-05-08T23:14:22.933815+0000","last_became_active":"2024-05-08T23:14:21.945681+0000","last_became_peered":"2024-05-08T23:14:21.945681+0000","last_unstale":"2024-05-08T23:14:22.933815+0000","last_undegraded":"2024-05-08T23:14:22.933815+0000","last_fullsized":"2024-05-08T23:14:22.933815+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:17.511869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.337197+0000","last_change":"2024-05-08T23:14:21.521775+0000","last_active":"2024-05-08T23:14:26.337197+0000","last_peered":"2024-05-08T23:14:26.337197+0000","last_clean":"2024-05-08T23:14:26.337197+0000","last_became_active":"2024-05-08T23:14:21.521428+0000","last_became_peered":"2024-05-08T23:14:21.521428+0000","last_unstale":"2024-05-08T23:14:26.337197+0000","last_undegraded":"2024-05-08T23:14:26.337197+0000","last_fullsized":"2024-05-08T23:14:26.337197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:13.379322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468911+0000","last_change":"2024-05-08T23:14:21.944886+0000","last_active":"2024-05-08T23:14:22.468911+0000","last_peered":"2024-05-08T23:14:22.468911+0000","last_clean":"2024-05-08T23:14:22.468911+0000","last_became_active":"2024-05-08T23:14:21.944585+0000","last_became_peered":"2024-05-08T23:14:21.944585+0000","last_unstale":"2024-05-08T23:14:22.468911+0000","last_undegraded":"2024-05-08T23:14:22.468911+0000","last_fullsized":"2024-05-08T23:14:22.468911+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:00.519286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.953232+0000","last_change":"2024-05-08T23:14:21.527500+0000","last_active":"2024-05-08T23:14:24.953232+0000","last_peered":"2024-05-08T23:14:24.953232+0000","last_clean":"2024-05-08T23:14:24.953232+0000","last_became_active":"2024-05-08T23:14:21.526709+0000","last_became_peered":"2024-05-08T23:14:21.526709+0000","last_unstale":"2024-05-08T23:14:24.953232+0000","last_undegraded":"2024-05-08T23:14:24.953232+0000","last_fullsized":"2024-05-08T23:14:24.953232+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:49.584194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125526+0000","last_change":"2024-05-08T23:14:21.952026+0000","last_active":"2024-05-08T23:14:24.125526+0000","last_peered":"2024-05-08T23:14:24.125526+0000","last_clean":"2024-05-08T23:14:24.125526+0000","last_became_active":"2024-05-08T23:14:21.951817+0000","last_became_peered":"2024-05-08T23:14:21.951817+0000","last_unstale":"2024-05-08T23:14:24.125526+0000","last_undegraded":"2024-05-08T23:14:24.125526+0000","last_fullsized":"2024-05-08T23:14:24.125526+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:45.239470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.338428+0000","last_change":"2024-05-08T23:14:21.519296+0000","last_active":"2024-05-08T23:14:26.338428+0000","last_peered":"2024-05-08T23:14:26.338428+0000","last_clean":"2024-05-08T23:14:26.338428+0000","last_became_active":"2024-05-08T23:14:21.518975+0000","last_became_peered":"2024-05-08T23:14:21.518975+0000","last_unstale":"2024-05-08T23:14:26.338428+0000","last_undegraded":"2024-05-08T23:14:26.338428+0000","last_fullsized":"2024-05-08T23:14:26.338428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:12.663513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468873+0000","last_change":"2024-05-08T23:14:21.947768+0000","last_active":"2024-05-08T23:14:22.468873+0000","last_peered":"2024-05-08T23:14:22.468873+0000","last_clean":"2024-05-08T23:14:22.468873+0000","last_became_active":"2024-05-08T23:14:21.947247+0000","last_became_peered":"2024-05-08T23:14:21.947247+0000","last_unstale":"2024-05-08T23:14:22.468873+0000","last_undegraded":"2024-05-08T23:14:22.468873+0000","last_fullsized":"2024-05-08T23:14:22.468873+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:16:58.283218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'8","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.342043+0000","last_change":"2024-05-08T23:14:21.519630+0000","last_active":"2024-05-08T23:14:26.342043+0000","last_peered":"2024-05-08T23:14:26.342043+0000","last_clean":"2024-05-08T23:14:26.342043+0000","last_became_active":"2024-05-08T23:14:21.519151+0000","last_became_peered":"2024-05-08T23:14:21.519151+0000","last_unstale":"2024-05-08T23:14:26.342043+0000","last_undegraded":"2024-05-08T23:14:26.342043+0000","last_fullsized":"2024-05-08T23:14:26.342043+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169605+0000","last_change":"2024-05-08T23:14:21.950966+0000","last_active":"2024-05-08T23:14:24.169605+0000","last_peered":"2024-05-08T23:14:24.169605+0000","last_clean":"2024-05-08T23:14:24.169605+0000","last_became_active":"2024-05-08T23:14:21.950694+0000","last_became_peered":"2024-05-08T23:14:21.950694+0000","last_unstale":"2024-05-08T23:14:24.169605+0000","last_undegraded":"2024-05-08T23:14:24.169605+0000","last_fullsized":"2024-05-08T23:14:24.169605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:41.599529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.960793+0000","last_change":"2024-05-08T23:14:21.519509+0000","last_active":"2024-05-08T23:14:25.960793+0000","last_peered":"2024-05-08T23:14:25.960793+0000","last_clean":"2024-05-08T23:14:25.960793+0000","last_became_active":"2024-05-08T23:14:21.519237+0000","last_became_peered":"2024-05-08T23:14:21.519237+0000","last_unstale":"2024-05-08T23:14:25.960793+0000","last_undegraded":"2024-05-08T23:14:25.960793+0000","last_fullsized":"2024-05-08T23:14:25.960793+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:52.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067695+0000","last_change":"2024-05-08T23:14:21.944225+0000","last_active":"2024-05-08T23:14:24.067695+0000","last_peered":"2024-05-08T23:14:24.067695+0000","last_clean":"2024-05-08T23:14:24.067695+0000","last_became_active":"2024-05-08T23:14:21.943909+0000","last_became_peered":"2024-05-08T23:14:21.943909+0000","last_unstale":"2024-05-08T23:14:24.067695+0000","last_undegraded":"2024-05-08T23:14:24.067695+0000","last_fullsized":"2024-05-08T23:14:24.067695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:52.003909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.956230+0000","last_change":"2024-05-08T23:14:21.522565+0000","last_active":"2024-05-08T23:14:24.956230+0000","last_peered":"2024-05-08T23:14:24.956230+0000","last_clean":"2024-05-08T23:14:24.956230+0000","last_became_active":"2024-05-08T23:14:21.522224+0000","last_became_peered":"2024-05-08T23:14:21.522224+0000","last_unstale":"2024-05-08T23:14:24.956230+0000","last_undegraded":"2024-05-08T23:14:24.956230+0000","last_fullsized":"2024-05-08T23:14:24.956230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.768309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041830+0000","last_change":"2024-05-08T23:14:21.953759+0000","last_active":"2024-05-08T23:14:22.041830+0000","last_peered":"2024-05-08T23:14:22.041830+0000","last_clean":"2024-05-08T23:14:22.041830+0000","last_became_active":"2024-05-08T23:14:21.953425+0000","last_became_peered":"2024-05-08T23:14:21.953425+0000","last_unstale":"2024-05-08T23:14:22.041830+0000","last_undegraded":"2024-05-08T23:14:22.041830+0000","last_fullsized":"2024-05-08T23:14:22.041830+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:36.189067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:29.344086+0000","last_change":"2024-05-08T23:14:21.525305+0000","last_active":"2024-05-08T23:14:29.344086+0000","last_peered":"2024-05-08T23:14:29.344086+0000","last_clean":"2024-05-08T23:14:29.344086+0000","last_became_active":"2024-05-08T23:14:21.524985+0000","last_became_peered":"2024-05-08T23:14:21.524985+0000","last_unstale":"2024-05-08T23:14:29.344086+0000","last_undegraded":"2024-05-08T23:14:29.344086+0000","last_fullsized":"2024-05-08T23:14:29.344086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:20:23.814736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041755+0000","last_change":"2024-05-08T23:14:21.958958+0000","last_active":"2024-05-08T23:14:22.041755+0000","last_peered":"2024-05-08T23:14:22.041755+0000","last_clean":"2024-05-08T23:14:22.041755+0000","last_became_active":"2024-05-08T23:14:21.958613+0000","last_became_peered":"2024-05-08T23:14:21.958613+0000","last_unstale":"2024-05-08T23:14:22.041755+0000","last_undegraded":"2024-05-08T23:14:22.041755+0000","last_fullsized":"2024-05-08T23:14:22.041755+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:07.245634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.963236+0000","last_change":"2024-05-08T23:14:21.525484+0000","last_active":"2024-05-08T23:14:25.963236+0000","last_peered":"2024-05-08T23:14:25.963236+0000","last_clean":"2024-05-08T23:14:25.963236+0000","last_became_active":"2024-05-08T23:14:21.525142+0000","last_became_peered":"2024-05-08T23:14:21.525142+0000","last_unstale":"2024-05-08T23:14:25.963236+0000","last_undegraded":"2024-05-08T23:14:25.963236+0000","last_fullsized":"2024-05-08T23:14:25.963236+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:43.273230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101938+0000","last_change":"2024-05-08T23:14:21.962233+0000","last_active":"2024-05-08T23:14:22.101938+0000","last_peered":"2024-05-08T23:14:22.101938+0000","last_clean":"2024-05-08T23:14:22.101938+0000","last_became_active":"2024-05-08T23:14:21.961720+0000","last_became_peered":"2024-05-08T23:14:21.961720+0000","last_unstale":"2024-05-08T23:14:22.101938+0000","last_undegraded":"2024-05-08T23:14:22.101938+0000","last_fullsized":"2024-05-08T23:14:22.101938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:49:29.797724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:21.964303+0000","last_change":"2024-05-08T23:14:21.525125+0000","last_active":"2024-05-08T23:14:21.964303+0000","last_peered":"2024-05-08T23:14:21.964303+0000","last_clean":"2024-05-08T23:14:21.964303+0000","last_became_active":"2024-05-08T23:14:21.524759+0000","last_became_peered":"2024-05-08T23:14:21.524759+0000","last_unstale":"2024-05-08T23:14:21.964303+0000","last_undegraded":"2024-05-08T23:14:21.964303+0000","last_fullsized":"2024-05-08T23:14:21.964303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:45.267925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934649+0000","last_change":"2024-05-08T23:14:21.949084+0000","last_active":"2024-05-08T23:14:22.934649+0000","last_peered":"2024-05-08T23:14:22.934649+0000","last_clean":"2024-05-08T23:14:22.934649+0000","last_became_active":"2024-05-08T23:14:21.948567+0000","last_became_peered":"2024-05-08T23:14:21.948567+0000","last_unstale":"2024-05-08T23:14:22.934649+0000","last_undegraded":"2024-05-08T23:14:22.934649+0000","last_fullsized":"2024-05-08T23:14:22.934649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:50:33.466144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.814965+0000","last_change":"2024-05-08T23:14:21.519758+0000","last_active":"2024-05-08T23:14:23.814965+0000","last_peered":"2024-05-08T23:14:23.814965+0000","last_clean":"2024-05-08T23:14:23.814965+0000","last_became_active":"2024-05-08T23:14:21.519403+0000","last_became_peered":"2024-05-08T23:14:21.519403+0000","last_unstale":"2024-05-08T23:14:23.814965+0000","last_undegraded":"2024-05-08T23:14:23.814965+0000","last_fullsized":"2024-05-08T23:14:23.814965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:49.080141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.071039+0000","last_change":"2024-05-08T23:14:21.944315+0000","last_active":"2024-05-08T23:14:22.071039+0000","last_peered":"2024-05-08T23:14:22.071039+0000","last_clean":"2024-05-08T23:14:22.071039+0000","last_became_active":"2024-05-08T23:14:21.943542+0000","last_became_peered":"2024-05-08T23:14:21.943542+0000","last_unstale":"2024-05-08T23:14:22.071039+0000","last_undegraded":"2024-05-08T23:14:22.071039+0000","last_fullsized":"2024-05-08T23:14:22.071039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:10.667516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169231+0000","last_change":"2024-05-08T23:14:21.526576+0000","last_active":"2024-05-08T23:14:24.169231+0000","last_peered":"2024-05-08T23:14:24.169231+0000","last_clean":"2024-05-08T23:14:24.169231+0000","last_became_active":"2024-05-08T23:14:21.524611+0000","last_became_peered":"2024-05-08T23:14:21.524611+0000","last_unstale":"2024-05-08T23:14:24.169231+0000","last_undegraded":"2024-05-08T23:14:24.169231+0000","last_fullsized":"2024-05-08T23:14:24.169231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:52.929531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.071016+0000","last_change":"2024-05-08T23:14:21.951870+0000","last_active":"2024-05-08T23:14:22.071016+0000","last_peered":"2024-05-08T23:14:22.071016+0000","last_clean":"2024-05-08T23:14:22.071016+0000","last_became_active":"2024-05-08T23:14:21.949810+0000","last_became_peered":"2024-05-08T23:14:21.949810+0000","last_unstale":"2024-05-08T23:14:22.071016+0000","last_undegraded":"2024-05-08T23:14:22.071016+0000","last_fullsized":"2024-05-08T23:14:22.071016+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:01.727234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101925+0000","last_change":"2024-05-08T23:14:21.958705+0000","last_active":"2024-05-08T23:14:22.101925+0000","last_peered":"2024-05-08T23:14:22.101925+0000","last_clean":"2024-05-08T23:14:22.101925+0000","last_became_active":"2024-05-08T23:14:21.958392+0000","last_became_peered":"2024-05-08T23:14:21.958392+0000","last_unstale":"2024-05-08T23:14:22.101925+0000","last_undegraded":"2024-05-08T23:14:22.101925+0000","last_fullsized":"2024-05-08T23:14:22.101925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:34.417439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.962885+0000","last_change":"2024-05-08T23:14:21.520978+0000","last_active":"2024-05-08T23:14:25.962885+0000","last_peered":"2024-05-08T23:14:25.962885+0000","last_clean":"2024-05-08T23:14:25.962885+0000","last_became_active":"2024-05-08T23:14:21.520688+0000","last_became_peered":"2024-05-08T23:14:21.520688+0000","last_unstale":"2024-05-08T23:14:25.962885+0000","last_undegraded":"2024-05-08T23:14:25.962885+0000","last_fullsized":"2024-05-08T23:14:25.962885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:59:43.000719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099268+0000","last_change":"2024-05-08T23:14:21.946315+0000","last_active":"2024-05-08T23:14:23.099268+0000","last_peered":"2024-05-08T23:14:23.099268+0000","last_clean":"2024-05-08T23:14:23.099268+0000","last_became_active":"2024-05-08T23:14:21.945542+0000","last_became_peered":"2024-05-08T23:14:21.945542+0000","last_unstale":"2024-05-08T23:14:23.099268+0000","last_undegraded":"2024-05-08T23:14:23.099268+0000","last_fullsized":"2024-05-08T23:14:23.099268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:35.027035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.354653+0000","last_change":"2024-05-08T23:14:21.521066+0000","last_active":"2024-05-08T23:14:27.354653+0000","last_peered":"2024-05-08T23:14:27.354653+0000","last_clean":"2024-05-08T23:14:27.354653+0000","last_became_active":"2024-05-08T23:14:21.520730+0000","last_became_peered":"2024-05-08T23:14:21.520730+0000","last_unstale":"2024-05-08T23:14:27.354653+0000","last_undegraded":"2024-05-08T23:14:27.354653+0000","last_fullsized":"2024-05-08T23:14:27.354653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:11.033062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":323,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:21.936605+0000","last_change":"2024-05-08T23:13:34.449454+0000","last_active":"2024-05-08T23:14:21.936605+0000","last_peered":"2024-05-08T23:14:21.936605+0000","last_clean":"2024-05-08T23:14:21.936605+0000","last_became_active":"2024-05-08T23:13:34.448953+0000","last_became_peered":"2024-05-08T23:13:34.448953+0000","last_unstale":"2024-05-08T23:14:21.936605+0000","last_undegraded":"2024-05-08T23:14:21.936605+0000","last_fullsized":"2024-05-08T23:14:21.936605+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:11:11.941444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:11:11.941444+0000","last_clean_scrub_stamp":"2024-05-08T23:11:11.941444+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:49.039661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067594+0000","last_change":"2024-05-08T23:14:21.947145+0000","last_active":"2024-05-08T23:14:24.067594+0000","last_peered":"2024-05-08T23:14:24.067594+0000","last_clean":"2024-05-08T23:14:24.067594+0000","last_became_active":"2024-05-08T23:14:21.946842+0000","last_became_peered":"2024-05-08T23:14:21.946842+0000","last_unstale":"2024-05-08T23:14:24.067594+0000","last_undegraded":"2024-05-08T23:14:24.067594+0000","last_fullsized":"2024-05-08T23:14:24.067594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:27.070888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.959869+0000","last_change":"2024-05-08T23:14:21.525571+0000","last_active":"2024-05-08T23:14:25.959869+0000","last_peered":"2024-05-08T23:14:25.959869+0000","last_clean":"2024-05-08T23:14:25.959869+0000","last_became_active":"2024-05-08T23:14:21.524486+0000","last_became_peered":"2024-05-08T23:14:21.524486+0000","last_unstale":"2024-05-08T23:14:25.959869+0000","last_undegraded":"2024-05-08T23:14:25.959869+0000","last_fullsized":"2024-05-08T23:14:25.959869+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:07.575183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169691+0000","last_change":"2024-05-08T23:14:21.527012+0000","last_active":"2024-05-08T23:14:24.169691+0000","last_peered":"2024-05-08T23:14:24.169691+0000","last_clean":"2024-05-08T23:14:24.169691+0000","last_became_active":"2024-05-08T23:14:21.526263+0000","last_became_peered":"2024-05-08T23:14:21.526263+0000","last_unstale":"2024-05-08T23:14:24.169691+0000","last_undegraded":"2024-05-08T23:14:24.169691+0000","last_fullsized":"2024-05-08T23:14:24.169691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:42.930529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067797+0000","last_change":"2024-05-08T23:14:21.948803+0000","last_active":"2024-05-08T23:14:24.067797+0000","last_peered":"2024-05-08T23:14:24.067797+0000","last_clean":"2024-05-08T23:14:24.067797+0000","last_became_active":"2024-05-08T23:14:21.947787+0000","last_became_peered":"2024-05-08T23:14:21.947787+0000","last_unstale":"2024-05-08T23:14:24.067797+0000","last_undegraded":"2024-05-08T23:14:24.067797+0000","last_fullsized":"2024-05-08T23:14:24.067797+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:25.521045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'7","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.344849+0000","last_change":"2024-05-08T23:14:21.522944+0000","last_active":"2024-05-08T23:14:26.344849+0000","last_peered":"2024-05-08T23:14:26.344849+0000","last_clean":"2024-05-08T23:14:26.344849+0000","last_became_active":"2024-05-08T23:14:21.522644+0000","last_became_peered":"2024-05-08T23:14:21.522644+0000","last_unstale":"2024-05-08T23:14:26.344849+0000","last_undegraded":"2024-05-08T23:14:26.344849+0000","last_fullsized":"2024-05-08T23:14:26.344849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:17.008946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099353+0000","last_change":"2024-05-08T23:14:21.947133+0000","last_active":"2024-05-08T23:14:23.099353+0000","last_peered":"2024-05-08T23:14:23.099353+0000","last_clean":"2024-05-08T23:14:23.099353+0000","last_became_active":"2024-05-08T23:14:21.946373+0000","last_became_peered":"2024-05-08T23:14:21.946373+0000","last_unstale":"2024-05-08T23:14:23.099353+0000","last_undegraded":"2024-05-08T23:14:23.099353+0000","last_fullsized":"2024-05-08T23:14:23.099353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:08.784990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.355529+0000","last_change":"2024-05-08T23:14:21.525172+0000","last_active":"2024-05-08T23:14:27.355529+0000","last_peered":"2024-05-08T23:14:27.355529+0000","last_clean":"2024-05-08T23:14:27.355529+0000","last_became_active":"2024-05-08T23:14:21.524721+0000","last_became_peered":"2024-05-08T23:14:21.524721+0000","last_unstale":"2024-05-08T23:14:27.355529+0000","last_undegraded":"2024-05-08T23:14:27.355529+0000","last_fullsized":"2024-05-08T23:14:27.355529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:21.051347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125579+0000","last_change":"2024-05-08T23:14:21.951912+0000","last_active":"2024-05-08T23:14:24.125579+0000","last_peered":"2024-05-08T23:14:24.125579+0000","last_clean":"2024-05-08T23:14:24.125579+0000","last_became_active":"2024-05-08T23:14:21.951620+0000","last_became_peered":"2024-05-08T23:14:21.951620+0000","last_unstale":"2024-05-08T23:14:24.125579+0000","last_undegraded":"2024-05-08T23:14:24.125579+0000","last_fullsized":"2024-05-08T23:14:24.125579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:28.218680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.955304+0000","last_change":"2024-05-08T23:14:21.521707+0000","last_active":"2024-05-08T23:14:24.955304+0000","last_peered":"2024-05-08T23:14:24.955304+0000","last_clean":"2024-05-08T23:14:24.955304+0000","last_became_active":"2024-05-08T23:14:21.521376+0000","last_became_peered":"2024-05-08T23:14:21.521376+0000","last_unstale":"2024-05-08T23:14:24.955304+0000","last_undegraded":"2024-05-08T23:14:24.955304+0000","last_fullsized":"2024-05-08T23:14:24.955304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:39.192259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.168939+0000","last_change":"2024-05-08T23:14:21.952825+0000","last_active":"2024-05-08T23:14:24.168939+0000","last_peered":"2024-05-08T23:14:24.168939+0000","last_clean":"2024-05-08T23:14:24.168939+0000","last_became_active":"2024-05-08T23:14:21.952494+0000","last_became_peered":"2024-05-08T23:14:21.952494+0000","last_unstale":"2024-05-08T23:14:24.168939+0000","last_undegraded":"2024-05-08T23:14:24.168939+0000","last_fullsized":"2024-05-08T23:14:24.168939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:31:29.439165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.354216+0000","last_change":"2024-05-08T23:14:21.516550+0000","last_active":"2024-05-08T23:14:27.354216+0000","last_peered":"2024-05-08T23:14:27.354216+0000","last_clean":"2024-05-08T23:14:27.354216+0000","last_became_active":"2024-05-08T23:14:21.516211+0000","last_became_peered":"2024-05-08T23:14:21.516211+0000","last_unstale":"2024-05-08T23:14:27.354216+0000","last_undegraded":"2024-05-08T23:14:27.354216+0000","last_fullsized":"2024-05-08T23:14:27.354216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:37.112939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934466+0000","last_change":"2024-05-08T23:14:21.945018+0000","last_active":"2024-05-08T23:14:22.934466+0000","last_peered":"2024-05-08T23:14:22.934466+0000","last_clean":"2024-05-08T23:14:22.934466+0000","last_became_active":"2024-05-08T23:14:21.944691+0000","last_became_peered":"2024-05-08T23:14:21.944691+0000","last_unstale":"2024-05-08T23:14:22.934466+0000","last_undegraded":"2024-05-08T23:14:22.934466+0000","last_fullsized":"2024-05-08T23:14:22.934466+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:36.323757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:21.936156+0000","last_change":"2024-05-08T23:14:21.518130+0000","last_active":"2024-05-08T23:14:21.936156+0000","last_peered":"2024-05-08T23:14:21.936156+0000","last_clean":"2024-05-08T23:14:21.936156+0000","last_became_active":"2024-05-08T23:14:21.517828+0000","last_became_peered":"2024-05-08T23:14:21.517828+0000","last_unstale":"2024-05-08T23:14:21.936156+0000","last_undegraded":"2024-05-08T23:14:21.936156+0000","last_fullsized":"2024-05-08T23:14:21.936156+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:47.201096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099277+0000","last_change":"2024-05-08T23:14:21.952081+0000","last_active":"2024-05-08T23:14:23.099277+0000","last_peered":"2024-05-08T23:14:23.099277+0000","last_clean":"2024-05-08T23:14:23.099277+0000","last_became_active":"2024-05-08T23:14:21.951794+0000","last_became_peered":"2024-05-08T23:14:21.951794+0000","last_unstale":"2024-05-08T23:14:23.099277+0000","last_undegraded":"2024-05-08T23:14:23.099277+0000","last_fullsized":"2024-05-08T23:14:23.099277+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:41.957442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.953462+0000","last_change":"2024-05-08T23:14:21.525362+0000","last_active":"2024-05-08T23:14:24.953462+0000","last_peered":"2024-05-08T23:14:24.953462+0000","last_clean":"2024-05-08T23:14:24.953462+0000","last_became_active":"2024-05-08T23:14:21.525033+0000","last_became_peered":"2024-05-08T23:14:21.525033+0000","last_unstale":"2024-05-08T23:14:24.953462+0000","last_undegraded":"2024-05-08T23:14:24.953462+0000","last_fullsized":"2024-05-08T23:14:24.953462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:41.610041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041817+0000","last_change":"2024-05-08T23:14:21.950784+0000","last_active":"2024-05-08T23:14:22.041817+0000","last_peered":"2024-05-08T23:14:22.041817+0000","last_clean":"2024-05-08T23:14:22.041817+0000","last_became_active":"2024-05-08T23:14:21.950504+0000","last_became_peered":"2024-05-08T23:14:21.950504+0000","last_unstale":"2024-05-08T23:14:22.041817+0000","last_undegraded":"2024-05-08T23:14:22.041817+0000","last_fullsized":"2024-05-08T23:14:22.041817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.096546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.963174+0000","last_change":"2024-05-08T23:14:21.524636+0000","last_active":"2024-05-08T23:14:25.963174+0000","last_peered":"2024-05-08T23:14:25.963174+0000","last_clean":"2024-05-08T23:14:25.963174+0000","last_became_active":"2024-05-08T23:14:21.524323+0000","last_became_peered":"2024-05-08T23:14:21.524323+0000","last_unstale":"2024-05-08T23:14:25.963174+0000","last_undegraded":"2024-05-08T23:14:25.963174+0000","last_fullsized":"2024-05-08T23:14:25.963174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:59.714443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041863+0000","last_change":"2024-05-08T23:14:21.950109+0000","last_active":"2024-05-08T23:14:22.041863+0000","last_peered":"2024-05-08T23:14:22.041863+0000","last_clean":"2024-05-08T23:14:22.041863+0000","last_became_active":"2024-05-08T23:14:21.949803+0000","last_became_peered":"2024-05-08T23:14:21.949803+0000","last_unstale":"2024-05-08T23:14:22.041863+0000","last_undegraded":"2024-05-08T23:14:22.041863+0000","last_fullsized":"2024-05-08T23:14:22.041863+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:00.025947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.335410+0000","last_change":"2024-05-08T23:14:21.517997+0000","last_active":"2024-05-08T23:14:26.335410+0000","last_peered":"2024-05-08T23:14:26.335410+0000","last_clean":"2024-05-08T23:14:26.335410+0000","last_became_active":"2024-05-08T23:14:21.517635+0000","last_became_peered":"2024-05-08T23:14:21.517635+0000","last_unstale":"2024-05-08T23:14:26.335410+0000","last_undegraded":"2024-05-08T23:14:26.335410+0000","last_fullsized":"2024-05-08T23:14:26.335410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:55.088301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041842+0000","last_change":"2024-05-08T23:14:21.958863+0000","last_active":"2024-05-08T23:14:22.041842+0000","last_peered":"2024-05-08T23:14:22.041842+0000","last_clean":"2024-05-08T23:14:22.041842+0000","last_became_active":"2024-05-08T23:14:21.958462+0000","last_became_peered":"2024-05-08T23:14:21.958462+0000","last_unstale":"2024-05-08T23:14:22.041842+0000","last_undegraded":"2024-05-08T23:14:22.041842+0000","last_fullsized":"2024-05-08T23:14:22.041842+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:41:42.202867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:21.951361+0000","last_change":"2024-05-08T23:14:21.522669+0000","last_active":"2024-05-08T23:14:21.951361+0000","last_peered":"2024-05-08T23:14:21.951361+0000","last_clean":"2024-05-08T23:14:21.951361+0000","last_became_active":"2024-05-08T23:14:21.522348+0000","last_became_peered":"2024-05-08T23:14:21.522348+0000","last_unstale":"2024-05-08T23:14:21.951361+0000","last_undegraded":"2024-05-08T23:14:21.951361+0000","last_fullsized":"2024-05-08T23:14:21.951361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:37.824190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041886+0000","last_change":"2024-05-08T23:14:21.960656+0000","last_active":"2024-05-08T23:14:22.041886+0000","last_peered":"2024-05-08T23:14:22.041886+0000","last_clean":"2024-05-08T23:14:22.041886+0000","last_became_active":"2024-05-08T23:14:21.960336+0000","last_became_peered":"2024-05-08T23:14:21.960336+0000","last_unstale":"2024-05-08T23:14:22.041886+0000","last_undegraded":"2024-05-08T23:14:22.041886+0000","last_fullsized":"2024-05-08T23:14:22.041886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:55.101942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934706+0000","last_change":"2024-05-08T23:14:21.965928+0000","last_active":"2024-05-08T23:14:22.934706+0000","last_peered":"2024-05-08T23:14:22.934706+0000","last_clean":"2024-05-08T23:14:22.934706+0000","last_became_active":"2024-05-08T23:14:21.965570+0000","last_became_peered":"2024-05-08T23:14:21.965570+0000","last_unstale":"2024-05-08T23:14:22.934706+0000","last_undegraded":"2024-05-08T23:14:22.934706+0000","last_fullsized":"2024-05-08T23:14:22.934706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:01.963727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685021+0000","last_change":"2024-05-08T23:14:21.948795+0000","last_active":"2024-05-08T23:14:23.685021+0000","last_peered":"2024-05-08T23:14:23.685021+0000","last_clean":"2024-05-08T23:14:23.685021+0000","last_became_active":"2024-05-08T23:14:21.948275+0000","last_became_peered":"2024-05-08T23:14:21.948275+0000","last_unstale":"2024-05-08T23:14:23.685021+0000","last_undegraded":"2024-05-08T23:14:23.685021+0000","last_fullsized":"2024-05-08T23:14:23.685021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:27.812089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685000+0000","last_change":"2024-05-08T23:14:21.942911+0000","last_active":"2024-05-08T23:14:23.685000+0000","last_peered":"2024-05-08T23:14:23.685000+0000","last_clean":"2024-05-08T23:14:23.685000+0000","last_became_active":"2024-05-08T23:14:21.942050+0000","last_became_peered":"2024-05-08T23:14:21.942050+0000","last_unstale":"2024-05-08T23:14:23.685000+0000","last_undegraded":"2024-05-08T23:14:23.685000+0000","last_fullsized":"2024-05-08T23:14:23.685000+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:05.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125373+0000","last_change":"2024-05-08T23:14:21.952424+0000","last_active":"2024-05-08T23:14:24.125373+0000","last_peered":"2024-05-08T23:14:24.125373+0000","last_clean":"2024-05-08T23:14:24.125373+0000","last_became_active":"2024-05-08T23:14:21.952132+0000","last_became_peered":"2024-05-08T23:14:21.952132+0000","last_unstale":"2024-05-08T23:14:24.125373+0000","last_undegraded":"2024-05-08T23:14:24.125373+0000","last_fullsized":"2024-05-08T23:14:24.125373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:55.035476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067879+0000","last_change":"2024-05-08T23:14:21.933701+0000","last_active":"2024-05-08T23:14:24.067879+0000","last_peered":"2024-05-08T23:14:24.067879+0000","last_clean":"2024-05-08T23:14:24.067879+0000","last_became_active":"2024-05-08T23:14:21.933275+0000","last_became_peered":"2024-05-08T23:14:21.933275+0000","last_unstale":"2024-05-08T23:14:24.067879+0000","last_undegraded":"2024-05-08T23:14:24.067879+0000","last_fullsized":"2024-05-08T23:14:24.067879+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:47.660620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934618+0000","last_change":"2024-05-08T23:14:21.958705+0000","last_active":"2024-05-08T23:14:22.934618+0000","last_peered":"2024-05-08T23:14:22.934618+0000","last_clean":"2024-05-08T23:14:22.934618+0000","last_became_active":"2024-05-08T23:14:21.958410+0000","last_became_peered":"2024-05-08T23:14:21.958410+0000","last_unstale":"2024-05-08T23:14:22.934618+0000","last_undegraded":"2024-05-08T23:14:22.934618+0000","last_fullsized":"2024-05-08T23:14:22.934618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:42:31.167722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685346+0000","last_change":"2024-05-08T23:14:21.963814+0000","last_active":"2024-05-08T23:14:23.685346+0000","last_peered":"2024-05-08T23:14:23.685346+0000","last_clean":"2024-05-08T23:14:23.685346+0000","last_became_active":"2024-05-08T23:14:21.963485+0000","last_became_peered":"2024-05-08T23:14:21.963485+0000","last_unstale":"2024-05-08T23:14:23.685346+0000","last_undegraded":"2024-05-08T23:14:23.685346+0000","last_fullsized":"2024-05-08T23:14:23.685346+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:22.782637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099336+0000","last_change":"2024-05-08T23:14:21.947887+0000","last_active":"2024-05-08T23:14:23.099336+0000","last_peered":"2024-05-08T23:14:23.099336+0000","last_clean":"2024-05-08T23:14:23.099336+0000","last_became_active":"2024-05-08T23:14:21.947577+0000","last_became_peered":"2024-05-08T23:14:21.947577+0000","last_unstale":"2024-05-08T23:14:23.099336+0000","last_undegraded":"2024-05-08T23:14:23.099336+0000","last_fullsized":"2024-05-08T23:14:23.099336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:33.022146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101912+0000","last_change":"2024-05-08T23:14:21.963857+0000","last_active":"2024-05-08T23:14:22.101912+0000","last_peered":"2024-05-08T23:14:22.101912+0000","last_clean":"2024-05-08T23:14:22.101912+0000","last_became_active":"2024-05-08T23:14:21.963366+0000","last_became_peered":"2024-05-08T23:14:21.963366+0000","last_unstale":"2024-05-08T23:14:22.101912+0000","last_undegraded":"2024-05-08T23:14:22.101912+0000","last_fullsized":"2024-05-08T23:14:22.101912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:34.402188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099246+0000","last_change":"2024-05-08T23:14:21.946956+0000","last_active":"2024-05-08T23:14:23.099246+0000","last_peered":"2024-05-08T23:14:23.099246+0000","last_clean":"2024-05-08T23:14:23.099246+0000","last_became_active":"2024-05-08T23:14:21.946669+0000","last_became_peered":"2024-05-08T23:14:21.946669+0000","last_unstale":"2024-05-08T23:14:23.099246+0000","last_undegraded":"2024-05-08T23:14:23.099246+0000","last_fullsized":"2024-05-08T23:14:23.099246+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:29.826418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468837+0000","last_change":"2024-05-08T23:14:21.952852+0000","last_active":"2024-05-08T23:14:22.468837+0000","last_peered":"2024-05-08T23:14:22.468837+0000","last_clean":"2024-05-08T23:14:22.468837+0000","last_became_active":"2024-05-08T23:14:21.952515+0000","last_became_peered":"2024-05-08T23:14:21.952515+0000","last_unstale":"2024-05-08T23:14:22.468837+0000","last_undegraded":"2024-05-08T23:14:22.468837+0000","last_fullsized":"2024-05-08T23:14:22.468837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:15.611960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067841+0000","last_change":"2024-05-08T23:14:21.944967+0000","last_active":"2024-05-08T23:14:24.067841+0000","last_peered":"2024-05-08T23:14:24.067841+0000","last_clean":"2024-05-08T23:14:24.067841+0000","last_became_active":"2024-05-08T23:14:21.944588+0000","last_became_peered":"2024-05-08T23:14:21.944588+0000","last_unstale":"2024-05-08T23:14:24.067841+0000","last_undegraded":"2024-05-08T23:14:24.067841+0000","last_fullsized":"2024-05-08T23:14:24.067841+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:40:12.545764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934362+0000","last_change":"2024-05-08T23:14:21.948689+0000","last_active":"2024-05-08T23:14:22.934362+0000","last_peered":"2024-05-08T23:14:22.934362+0000","last_clean":"2024-05-08T23:14:22.934362+0000","last_became_active":"2024-05-08T23:14:21.948335+0000","last_became_peered":"2024-05-08T23:14:21.948335+0000","last_unstale":"2024-05-08T23:14:22.934362+0000","last_undegraded":"2024-05-08T23:14:22.934362+0000","last_fullsized":"2024-05-08T23:14:22.934362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:41.767077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282110,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6379,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":162,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":21395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449099,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36088,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709064,"statfs":{"total":95995035648,"available":95958081536,"internally_reserved":0,"allocated":901120,"data_stored":430329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36043205},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":10,"up_from":70,"seq":300647710733,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":987136,"data_stored":1022097,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31848896},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":9,"up_from":65,"seq":279172874258,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":925696,"data_stored":429914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31848896},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.40799999999999997}]},{"osd":1,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.57199999999999995}]},{"osd":2,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.441},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.505}]},{"osd":3,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54300000000000004}]},{"osd":4,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55500000000000005}]},{"osd":5,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.626}]},{"osd":7,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.68500000000000005}]},{"osd":8,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.72999999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":8,"up_from":57,"seq":244813135893,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":901120,"data_stored":429418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.82199999999999995}]},{"osd":2,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.499},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.56399999999999995}]},{"osd":3,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.624}]},{"osd":4,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.79300000000000004}]},{"osd":5,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.72499999999999998}]},{"osd":6,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.752}]},{"osd":7,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.83299999999999996}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.81000000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":7,"up_from":50,"seq":214748364824,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":1021528,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.442},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.46300000000000002}]},{"osd":2,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.496},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.63700000000000001}]},{"osd":3,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.56100000000000005}]},{"osd":4,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.71199999999999997}]},{"osd":6,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.53400000000000003}]},{"osd":8,"last update":"Wed May 8 23:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.624}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.70199999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":6,"up_from":45,"seq":193273528348,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31984,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713168,"statfs":{"total":95995035648,"available":95962284032,"internally_reserved":0,"allocated":888832,"data_stored":428792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.27900000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61299999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42099999999999999,"15min":0.42299999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65900000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.37}]},{"osd":1,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.502,"15min":0.495},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53600000000000003}]},{"osd":2,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72499999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46500000000000002}]},{"osd":3,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68600000000000005,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.498,"15min":0.501},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78700000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.374,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77100000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.66300000000000003}]},{"osd":5,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.748,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.629,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.49299999999999999}]},{"osd":7,"last update":"Wed May 8 23:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.73499999999999999}]},{"osd":8,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.57699999999999996}]},{"osd":9,"last update":"Wed May 8 23:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59799999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":430938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.50900000000000001,"15min":0.503},"min":{"1min":0.436,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.749,"15min":0.749},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.41399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.72199999999999998}]},{"osd":2,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.41699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.46700000000000003}]},{"osd":3,"last update":"Wed May 8 23:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51700000000000002,"15min":0.51300000000000001},"min":{"1min":0.35999999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.496},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.38,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.67800000000000005}]},{"osd":4,"last update":"Wed May 8 23:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40100000000000002,"15min":0.38900000000000001},"min":{"1min":0.30399999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.42099999999999999,"15min":0.41299999999999998},"min":{"1min":0.32600000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":5,"last update":"Wed May 8 23:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.46400000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.59799999999999998,"15min":0.58199999999999996},"min":{"1min":0.51600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.77300000000000002}]},{"osd":6,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.59599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.79100000000000004}]},{"osd":7,"last update":"Wed May 8 23:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.93700000000000006}]},{"osd":8,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.747}]},{"osd":9,"last update":"Wed May 8 23:14:14 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":1.0189999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738418,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":431315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 23:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.499,"15min":0.5},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72999999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.501,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Wed May 8 23:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68700000000000006,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.499},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.495}]},{"osd":3,"last update":"Wed May 8 23:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.41099999999999998},"min":{"1min":0.28000000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58799999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.40899999999999997},"min":{"1min":0.27600000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Wed May 8 23:13:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.69599999999999995}]},{"osd":5,"last update":"Wed May 8 23:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.40300000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69399999999999995,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.80900000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.45900000000000002}]},{"osd":7,"last update":"Wed May 8 23:13:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64300000000000002}]},{"osd":8,"last update":"Wed May 8 23:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60099999999999998}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63600000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411369,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":430964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.44500000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.626}]},{"osd":1,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.496,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52100000000000002,"15min":0.504},"min":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.67800000000000005,"5min":0.751,"15min":0.751},"last":0.76800000000000002}]},{"osd":3,"last update":"Wed May 8 23:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.505,"15min":0.503},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47499999999999998,"15min":0.46999999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.51200000000000001}]},{"osd":4,"last update":"Wed May 8 23:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.746,"5min":0.747,"15min":0.747},"last":0.67400000000000004}]},{"osd":5,"last update":"Wed May 8 23:14:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.435,"15min":0.438},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58699999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61699999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57699999999999996}]},{"osd":6,"last update":"Wed May 8 23:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65300000000000002}]},{"osd":7,"last update":"Wed May 8 23:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51100000000000001}]},{"osd":8,"last update":"Wed May 8 23:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.83899999999999997}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.86599999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]},{"osd":3,"up_from":26,"seq":111669149735,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":913408,"data_stored":428891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.32700000000000001,"15min":0.32100000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.34399999999999997,"15min":0.33800000000000002},"min":{"1min":0.24199999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.30499999999999999}]},{"osd":1,"last update":"Wed May 8 23:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48699999999999999,"15min":0.47799999999999998},"min":{"1min":0.43099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.505},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.36799999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68300000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.42399999999999999}]},{"osd":2,"last update":"Wed May 8 23:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.53200000000000003},"min":{"1min":0.371,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.376}]},{"osd":4,"last update":"Wed May 8 23:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.54200000000000004},"min":{"1min":0.441,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.54000000000000004}]},{"osd":5,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.56399999999999995,"15min":0.55100000000000005},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed May 8 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42999999999999999}]},{"osd":7,"last update":"Wed May 8 23:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56399999999999995}]},{"osd":8,"last update":"Wed May 8 23:13:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.53400000000000003}]},{"osd":9,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.55200000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":4,"up_from":33,"seq":141733920804,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":909312,"data_stored":429837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:13:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48499999999999999,"15min":0.47999999999999998},"min":{"1min":0.33100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.36099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.60699999999999998}]},{"osd":1,"last update":"Wed May 8 23:13:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33400000000000002},"min":{"1min":0.28399999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.36099999999999999},"min":{"1min":0.25600000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.47899999999999998}]},{"osd":2,"last update":"Wed May 8 23:13:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed May 8 23:13:46 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.50800000000000001,"15min":0.503},"min":{"1min":0.36899999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.50900000000000001}]},{"osd":5,"last update":"Wed May 8 23:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69099999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.754},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.71599999999999997}]},{"osd":6,"last update":"Wed May 8 23:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Wed May 8 23:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.69799999999999995}]},{"osd":8,"last update":"Wed May 8 23:13:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.90400000000000003}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.407,"5min":2.407,"15min":2.407},"last":0.61799999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":5,"up_from":38,"seq":163208757278,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":1021350,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.624},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.47799999999999998}]},{"osd":1,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.66000000000000003}]},{"osd":2,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40000000000000002,"15min":0.39200000000000002},"min":{"1min":0.27700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.29499999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.497}]},{"osd":3,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.318,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59699999999999998}]},{"osd":4,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.498,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77200000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74199999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.63900000000000001}]},{"osd":6,"last update":"Wed May 8 23:14:25 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.48599999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.77200000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.752}]},{"osd":7,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.68600000000000005}]},{"osd":8,"last update":"Wed May 8 23:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.73999999999999999}]},{"osd":9,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.81999999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34240,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34240,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34240,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T23:14:31.104 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T23:14:31.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.261+0000 7f00a1777700 1 -- 172.21.15.135:0/2348068826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f009c100f50 msgr2=0x7f009c1013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:31.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.261+0000 7f00a1777700 1 --2- 172.21.15.135:0/2348068826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f009c100f50 0x7f009c1013b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f00900099c0 tx=0x7f0090009cd0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.261+0000 7f00a1777700 1 -- 172.21.15.135:0/2348068826 shutdown_connections 2024-05-08T23:14:31.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.261+0000 7f00a1777700 1 --2- 172.21.15.135:0/2348068826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f009c1018f0 0x7f009c1081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.261+0000 7f00a1777700 1 --2- 172.21.15.135:0/2348068826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f009c0ffd60 0x7f009c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.261+0000 7f00a1777700 1 --2- 172.21.15.135:0/2348068826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f009c100f50 0x7f009c1013b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.261+0000 7f00a1777700 1 -- 172.21.15.135:0/2348068826 >> 172.21.15.135:0/2348068826 conn(0x7f009c0fb2f0 msgr2=0x7f009c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:31.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.261+0000 7f00a1777700 1 -- 172.21.15.135:0/2348068826 shutdown_connections 2024-05-08T23:14:31.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.261+0000 7f00a1777700 1 -- 172.21.15.135:0/2348068826 wait complete. 2024-05-08T23:14:31.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.262+0000 7f00a1777700 1 Processor -- start 2024-05-08T23:14:31.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.262+0000 7f00a1777700 1 -- start start 2024-05-08T23:14:31.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.262+0000 7f00a1777700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f009c0ffd60 0x7f009c103ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:31.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.262+0000 7f00a1777700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f009c100f50 0x7f009c102330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:31.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.262+0000 7f00a1777700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f009c1018f0 0x7f009c102870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:31.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.262+0000 7f00a1777700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c103010 con 0x7f009c100f50 2024-05-08T23:14:31.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.262+0000 7f00a1777700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c103180 con 0x7f009c0ffd60 2024-05-08T23:14:31.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.262+0000 7f00a1777700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c1a0ea0 con 0x7f009c1018f0 2024-05-08T23:14:31.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.262+0000 7f009a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f009c100f50 0x7f009c102330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:31.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.262+0000 7f009a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f009c100f50 0x7f009c102330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54938/0 (socket says 172.21.15.135:54938) 2024-05-08T23:14:31.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.262+0000 7f009a7fc700 1 -- 172.21.15.135:0/2635754648 learned_addr learned my addr 172.21.15.135:0/2635754648 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:31.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.262+0000 7f009b7fe700 1 --2- 172.21.15.135:0/2635754648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f009c1018f0 0x7f009c102870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:31.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.262+0000 7f009affd700 1 --2- 172.21.15.135:0/2635754648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f009c0ffd60 0x7f009c103ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:31.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.263+0000 7f009a7fc700 1 -- 172.21.15.135:0/2635754648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f009c1018f0 msgr2=0x7f009c102870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:31.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.263+0000 7f009a7fc700 1 --2- 172.21.15.135:0/2635754648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f009c1018f0 0x7f009c102870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.263+0000 7f009a7fc700 1 -- 172.21.15.135:0/2635754648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f009c0ffd60 msgr2=0x7f009c103ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:31.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.263+0000 7f009a7fc700 1 --2- 172.21.15.135:0/2635754648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f009c0ffd60 0x7f009c103ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.263+0000 7f009a7fc700 1 -- 172.21.15.135:0/2635754648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00900095f0 con 0x7f009c100f50 2024-05-08T23:14:31.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.263+0000 7f009affd700 1 --2- 172.21.15.135:0/2635754648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f009c0ffd60 0x7f009c103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:14:31.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.263+0000 7f009a7fc700 1 --2- 172.21.15.135:0/2635754648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f009c100f50 0x7f009c102330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f00900036f0 tx=0x7f0090003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:31.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.263+0000 7f0083fff700 1 -- 172.21.15.135:0/2635754648 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009001d070 con 0x7f009c100f50 2024-05-08T23:14:31.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.263+0000 7f00a1777700 1 -- 172.21.15.135:0/2635754648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009c1a10d0 con 0x7f009c100f50 2024-05-08T23:14:31.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.263+0000 7f0083fff700 1 -- 172.21.15.135:0/2635754648 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0090022470 con 0x7f009c100f50 2024-05-08T23:14:31.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.263+0000 7f0083fff700 1 -- 172.21.15.135:0/2635754648 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009000f6e0 con 0x7f009c100f50 2024-05-08T23:14:31.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.263+0000 7f00a1777700 1 -- 172.21.15.135:0/2635754648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009c1a1520 con 0x7f009c100f50 2024-05-08T23:14:31.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.264+0000 7f00a1777700 1 -- 172.21.15.135:0/2635754648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f009c068060 con 0x7f009c100f50 2024-05-08T23:14:31.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.265+0000 7f0083fff700 1 -- 172.21.15.135:0/2635754648 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f0090022890 con 0x7f009c100f50 2024-05-08T23:14:31.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.265+0000 7f0083fff700 1 --2- 172.21.15.135:0/2635754648 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f00840a11b0 0x7f00840a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:31.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.266+0000 7f009affd700 1 --2- 172.21.15.135:0/2635754648 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f00840a11b0 0x7f00840a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:31.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.266+0000 7f0083fff700 1 -- 172.21.15.135:0/2635754648 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f00900ce0f0 con 0x7f009c100f50 2024-05-08T23:14:31.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.266+0000 7f009affd700 1 --2- 172.21.15.135:0/2635754648 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f00840a11b0 0x7f00840a3670 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f008c005fd0 tx=0x7f008c005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:31.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.269+0000 7f0083fff700 1 -- 172.21.15.135:0/2635754648 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0090097980 con 0x7f009c100f50 2024-05-08T23:14:31.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:30 smithi179 ceph-mon[46314]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:14:31.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:30 smithi179 ceph-mon[46314]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:14:31.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:30 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2297307981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:31.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:30 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/4252333708' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:31.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:30 smithi195 ceph-mon[46516]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:14:31.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:30 smithi195 ceph-mon[46516]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:14:31.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:30 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2297307981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:14:31.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:30 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/4252333708' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:31.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.465+0000 7f00a1777700 1 -- 172.21.15.135:0/2635754648 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f009c0fd500 con 0x7f00840a11b0 2024-05-08T23:14:31.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.475+0000 7f0083fff700 1 -- 172.21.15.135:0/2635754648 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+328482 (secure 0 0 0) 0x7f009c0fd500 con 0x7f00840a11b0 2024-05-08T23:14:31.479 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:31.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.479+0000 7f00a1777700 1 -- 172.21.15.135:0/2635754648 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f00840a11b0 msgr2=0x7f00840a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:31.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.479+0000 7f00a1777700 1 --2- 172.21.15.135:0/2635754648 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f00840a11b0 0x7f00840a3670 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f008c005fd0 tx=0x7f008c005dc0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.479+0000 7f00a1777700 1 -- 172.21.15.135:0/2635754648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f009c100f50 msgr2=0x7f009c102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:31.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.479+0000 7f00a1777700 1 --2- 172.21.15.135:0/2635754648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f009c100f50 0x7f009c102330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f00900036f0 tx=0x7f0090003970 comp rx=0 tx=0).stop 2024-05-08T23:14:31.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.479+0000 7f00a1777700 1 -- 172.21.15.135:0/2635754648 shutdown_connections 2024-05-08T23:14:31.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.479+0000 7f00a1777700 1 --2- 172.21.15.135:0/2635754648 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f00840a11b0 0x7f00840a3670 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.479+0000 7f00a1777700 1 --2- 172.21.15.135:0/2635754648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f009c1018f0 0x7f009c102870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.479+0000 7f00a1777700 1 --2- 172.21.15.135:0/2635754648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f009c0ffd60 0x7f009c103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.479+0000 7f00a1777700 1 --2- 172.21.15.135:0/2635754648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f009c100f50 0x7f009c102330 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:31.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.479+0000 7f00a1777700 1 -- 172.21.15.135:0/2635754648 >> 172.21.15.135:0/2635754648 conn(0x7f009c0fb2f0 msgr2=0x7f009c0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:31.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.479+0000 7f00a1777700 1 -- 172.21.15.135:0/2635754648 shutdown_connections 2024-05-08T23:14:31.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:31.479+0000 7f00a1777700 1 -- 172.21.15.135:0/2635754648 wait complete. 2024-05-08T23:14:31.484 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T23:14:31.490 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2024-05-08T23:14:31.032224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596747,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":152,"num_read_kb":128,"num_write":343,"num_write_kb":2989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363732,"kb_used_data":10856,"kb_used_omap":18,"kb_used_meta":352749,"kb_avail":1124578092,"statfs":{"total":1151940427776,"available":1151567966208,"internally_reserved":0,"allocated":11116544,"data_stored":6935373,"data_compressed":107634,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":361215290},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6379,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":162,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.104650"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934695+0000","last_change":"2024-05-08T23:14:21.938982+0000","last_active":"2024-05-08T23:14:22.934695+0000","last_peered":"2024-05-08T23:14:22.934695+0000","last_clean":"2024-05-08T23:14:22.934695+0000","last_became_active":"2024-05-08T23:14:21.938630+0000","last_became_peered":"2024-05-08T23:14:21.938630+0000","last_unstale":"2024-05-08T23:14:22.934695+0000","last_undegraded":"2024-05-08T23:14:22.934695+0000","last_fullsized":"2024-05-08T23:14:22.934695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:33.421139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125505+0000","last_change":"2024-05-08T23:14:21.952126+0000","last_active":"2024-05-08T23:14:24.125505+0000","last_peered":"2024-05-08T23:14:24.125505+0000","last_clean":"2024-05-08T23:14:24.125505+0000","last_became_active":"2024-05-08T23:14:21.951155+0000","last_became_peered":"2024-05-08T23:14:21.951155+0000","last_unstale":"2024-05-08T23:14:24.125505+0000","last_undegraded":"2024-05-08T23:14:24.125505+0000","last_fullsized":"2024-05-08T23:14:24.125505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:24.931166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125409+0000","last_change":"2024-05-08T23:14:21.947520+0000","last_active":"2024-05-08T23:14:24.125409+0000","last_peered":"2024-05-08T23:14:24.125409+0000","last_clean":"2024-05-08T23:14:24.125409+0000","last_became_active":"2024-05-08T23:14:21.947258+0000","last_became_peered":"2024-05-08T23:14:21.947258+0000","last_unstale":"2024-05-08T23:14:24.125409+0000","last_undegraded":"2024-05-08T23:14:24.125409+0000","last_fullsized":"2024-05-08T23:14:24.125409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:37.173840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.850109+0000","last_change":"2024-05-08T23:14:21.951221+0000","last_active":"2024-05-08T23:14:23.850109+0000","last_peered":"2024-05-08T23:14:23.850109+0000","last_clean":"2024-05-08T23:14:23.850109+0000","last_became_active":"2024-05-08T23:14:21.950398+0000","last_became_peered":"2024-05-08T23:14:21.950398+0000","last_unstale":"2024-05-08T23:14:23.850109+0000","last_undegraded":"2024-05-08T23:14:23.850109+0000","last_fullsized":"2024-05-08T23:14:23.850109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:26.360521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169189+0000","last_change":"2024-05-08T23:14:21.947783+0000","last_active":"2024-05-08T23:14:24.169189+0000","last_peered":"2024-05-08T23:14:24.169189+0000","last_clean":"2024-05-08T23:14:24.169189+0000","last_became_active":"2024-05-08T23:14:21.947448+0000","last_became_peered":"2024-05-08T23:14:21.947448+0000","last_unstale":"2024-05-08T23:14:24.169189+0000","last_undegraded":"2024-05-08T23:14:24.169189+0000","last_fullsized":"2024-05-08T23:14:24.169189+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:21.447674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.071003+0000","last_change":"2024-05-08T23:14:21.945541+0000","last_active":"2024-05-08T23:14:22.071003+0000","last_peered":"2024-05-08T23:14:22.071003+0000","last_clean":"2024-05-08T23:14:22.071003+0000","last_became_active":"2024-05-08T23:14:21.945135+0000","last_became_peered":"2024-05-08T23:14:21.945135+0000","last_unstale":"2024-05-08T23:14:22.071003+0000","last_undegraded":"2024-05-08T23:14:22.071003+0000","last_fullsized":"2024-05-08T23:14:22.071003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:44.143289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041794+0000","last_change":"2024-05-08T23:14:21.958827+0000","last_active":"2024-05-08T23:14:22.041794+0000","last_peered":"2024-05-08T23:14:22.041794+0000","last_clean":"2024-05-08T23:14:22.041794+0000","last_became_active":"2024-05-08T23:14:21.958400+0000","last_became_peered":"2024-05-08T23:14:21.958400+0000","last_unstale":"2024-05-08T23:14:22.041794+0000","last_undegraded":"2024-05-08T23:14:22.041794+0000","last_fullsized":"2024-05-08T23:14:22.041794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:39.280896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099219+0000","last_change":"2024-05-08T23:14:21.960924+0000","last_active":"2024-05-08T23:14:23.099219+0000","last_peered":"2024-05-08T23:14:23.099219+0000","last_clean":"2024-05-08T23:14:23.099219+0000","last_became_active":"2024-05-08T23:14:21.960651+0000","last_became_peered":"2024-05-08T23:14:21.960651+0000","last_unstale":"2024-05-08T23:14:23.099219+0000","last_undegraded":"2024-05-08T23:14:23.099219+0000","last_fullsized":"2024-05-08T23:14:23.099219+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:14:22.284354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468928+0000","last_change":"2024-05-08T23:14:21.961059+0000","last_active":"2024-05-08T23:14:22.468928+0000","last_peered":"2024-05-08T23:14:22.468928+0000","last_clean":"2024-05-08T23:14:22.468928+0000","last_became_active":"2024-05-08T23:14:21.960730+0000","last_became_peered":"2024-05-08T23:14:21.960730+0000","last_unstale":"2024-05-08T23:14:22.468928+0000","last_undegraded":"2024-05-08T23:14:22.468928+0000","last_fullsized":"2024-05-08T23:14:22.468928+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:01.448480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.071052+0000","last_change":"2024-05-08T23:14:21.950267+0000","last_active":"2024-05-08T23:14:22.071052+0000","last_peered":"2024-05-08T23:14:22.071052+0000","last_clean":"2024-05-08T23:14:22.071052+0000","last_became_active":"2024-05-08T23:14:21.949477+0000","last_became_peered":"2024-05-08T23:14:21.949477+0000","last_unstale":"2024-05-08T23:14:22.071052+0000","last_undegraded":"2024-05-08T23:14:22.071052+0000","last_fullsized":"2024-05-08T23:14:22.071052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:36.123316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041851+0000","last_change":"2024-05-08T23:14:21.955566+0000","last_active":"2024-05-08T23:14:22.041851+0000","last_peered":"2024-05-08T23:14:22.041851+0000","last_clean":"2024-05-08T23:14:22.041851+0000","last_became_active":"2024-05-08T23:14:21.955208+0000","last_became_peered":"2024-05-08T23:14:21.955208+0000","last_unstale":"2024-05-08T23:14:22.041851+0000","last_undegraded":"2024-05-08T23:14:22.041851+0000","last_fullsized":"2024-05-08T23:14:22.041851+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:29.478197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.850194+0000","last_change":"2024-05-08T23:14:21.939532+0000","last_active":"2024-05-08T23:14:23.850194+0000","last_peered":"2024-05-08T23:14:23.850194+0000","last_clean":"2024-05-08T23:14:23.850194+0000","last_became_active":"2024-05-08T23:14:21.938590+0000","last_became_peered":"2024-05-08T23:14:21.938590+0000","last_unstale":"2024-05-08T23:14:23.850194+0000","last_undegraded":"2024-05-08T23:14:23.850194+0000","last_fullsized":"2024-05-08T23:14:23.850194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:50.525121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067896+0000","last_change":"2024-05-08T23:14:21.942720+0000","last_active":"2024-05-08T23:14:24.067896+0000","last_peered":"2024-05-08T23:14:24.067896+0000","last_clean":"2024-05-08T23:14:24.067896+0000","last_became_active":"2024-05-08T23:14:21.942396+0000","last_became_peered":"2024-05-08T23:14:21.942396+0000","last_unstale":"2024-05-08T23:14:24.067896+0000","last_undegraded":"2024-05-08T23:14:24.067896+0000","last_fullsized":"2024-05-08T23:14:24.067896+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:17.893007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125207+0000","last_change":"2024-05-08T23:14:21.946955+0000","last_active":"2024-05-08T23:14:24.125207+0000","last_peered":"2024-05-08T23:14:24.125207+0000","last_clean":"2024-05-08T23:14:24.125207+0000","last_became_active":"2024-05-08T23:14:21.946733+0000","last_became_peered":"2024-05-08T23:14:21.946733+0000","last_unstale":"2024-05-08T23:14:24.125207+0000","last_undegraded":"2024-05-08T23:14:24.125207+0000","last_fullsized":"2024-05-08T23:14:24.125207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:39.097612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125239+0000","last_change":"2024-05-08T23:14:21.945827+0000","last_active":"2024-05-08T23:14:24.125239+0000","last_peered":"2024-05-08T23:14:24.125239+0000","last_clean":"2024-05-08T23:14:24.125239+0000","last_became_active":"2024-05-08T23:14:21.945606+0000","last_became_peered":"2024-05-08T23:14:21.945606+0000","last_unstale":"2024-05-08T23:14:24.125239+0000","last_undegraded":"2024-05-08T23:14:24.125239+0000","last_fullsized":"2024-05-08T23:14:24.125239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:22.689917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468793+0000","last_change":"2024-05-08T23:14:21.952640+0000","last_active":"2024-05-08T23:14:22.468793+0000","last_peered":"2024-05-08T23:14:22.468793+0000","last_clean":"2024-05-08T23:14:22.468793+0000","last_became_active":"2024-05-08T23:14:21.952283+0000","last_became_peered":"2024-05-08T23:14:21.952283+0000","last_unstale":"2024-05-08T23:14:22.468793+0000","last_undegraded":"2024-05-08T23:14:22.468793+0000","last_fullsized":"2024-05-08T23:14:22.468793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:42.211479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934813+0000","last_change":"2024-05-08T23:14:21.947950+0000","last_active":"2024-05-08T23:14:22.934813+0000","last_peered":"2024-05-08T23:14:22.934813+0000","last_clean":"2024-05-08T23:14:22.934813+0000","last_became_active":"2024-05-08T23:14:21.947621+0000","last_became_peered":"2024-05-08T23:14:21.947621+0000","last_unstale":"2024-05-08T23:14:22.934813+0000","last_undegraded":"2024-05-08T23:14:22.934813+0000","last_fullsized":"2024-05-08T23:14:22.934813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:54:47.736649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.933859+0000","last_change":"2024-05-08T23:14:21.950172+0000","last_active":"2024-05-08T23:14:22.933859+0000","last_peered":"2024-05-08T23:14:22.933859+0000","last_clean":"2024-05-08T23:14:22.933859+0000","last_became_active":"2024-05-08T23:14:21.949844+0000","last_became_peered":"2024-05-08T23:14:21.949844+0000","last_unstale":"2024-05-08T23:14:22.933859+0000","last_undegraded":"2024-05-08T23:14:22.933859+0000","last_fullsized":"2024-05-08T23:14:22.933859+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:18.216174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685351+0000","last_change":"2024-05-08T23:14:21.943336+0000","last_active":"2024-05-08T23:14:23.685351+0000","last_peered":"2024-05-08T23:14:23.685351+0000","last_clean":"2024-05-08T23:14:23.685351+0000","last_became_active":"2024-05-08T23:14:21.942697+0000","last_became_peered":"2024-05-08T23:14:21.942697+0000","last_unstale":"2024-05-08T23:14:23.685351+0000","last_undegraded":"2024-05-08T23:14:23.685351+0000","last_fullsized":"2024-05-08T23:14:23.685351+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:54.332708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.355456+0000","last_change":"2024-05-08T23:14:21.526822+0000","last_active":"2024-05-08T23:14:27.355456+0000","last_peered":"2024-05-08T23:14:27.355456+0000","last_clean":"2024-05-08T23:14:27.355456+0000","last_became_active":"2024-05-08T23:14:21.526561+0000","last_became_peered":"2024-05-08T23:14:21.526561+0000","last_unstale":"2024-05-08T23:14:27.355456+0000","last_undegraded":"2024-05-08T23:14:27.355456+0000","last_fullsized":"2024-05-08T23:14:27.355456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:45.360865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099287+0000","last_change":"2024-05-08T23:14:21.961315+0000","last_active":"2024-05-08T23:14:23.099287+0000","last_peered":"2024-05-08T23:14:23.099287+0000","last_clean":"2024-05-08T23:14:23.099287+0000","last_became_active":"2024-05-08T23:14:21.961039+0000","last_became_peered":"2024-05-08T23:14:21.961039+0000","last_unstale":"2024-05-08T23:14:23.099287+0000","last_undegraded":"2024-05-08T23:14:23.099287+0000","last_fullsized":"2024-05-08T23:14:23.099287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:01.163246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.168432+0000","last_change":"2024-05-08T23:14:21.523353+0000","last_active":"2024-05-08T23:14:24.168432+0000","last_peered":"2024-05-08T23:14:24.168432+0000","last_clean":"2024-05-08T23:14:24.168432+0000","last_became_active":"2024-05-08T23:14:21.523046+0000","last_became_peered":"2024-05-08T23:14:21.523046+0000","last_unstale":"2024-05-08T23:14:24.168432+0000","last_undegraded":"2024-05-08T23:14:24.168432+0000","last_fullsized":"2024-05-08T23:14:24.168432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:04:54.448457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125580+0000","last_change":"2024-05-08T23:14:21.948093+0000","last_active":"2024-05-08T23:14:24.125580+0000","last_peered":"2024-05-08T23:14:24.125580+0000","last_clean":"2024-05-08T23:14:24.125580+0000","last_became_active":"2024-05-08T23:14:21.947812+0000","last_became_peered":"2024-05-08T23:14:21.947812+0000","last_unstale":"2024-05-08T23:14:24.125580+0000","last_undegraded":"2024-05-08T23:14:24.125580+0000","last_fullsized":"2024-05-08T23:14:24.125580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:47.804387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.961273+0000","last_change":"2024-05-08T23:14:21.527205+0000","last_active":"2024-05-08T23:14:25.961273+0000","last_peered":"2024-05-08T23:14:25.961273+0000","last_clean":"2024-05-08T23:14:25.961273+0000","last_became_active":"2024-05-08T23:14:21.526699+0000","last_became_peered":"2024-05-08T23:14:21.526699+0000","last_unstale":"2024-05-08T23:14:25.961273+0000","last_undegraded":"2024-05-08T23:14:25.961273+0000","last_fullsized":"2024-05-08T23:14:25.961273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:04.818255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468855+0000","last_change":"2024-05-08T23:14:21.946804+0000","last_active":"2024-05-08T23:14:22.468855+0000","last_peered":"2024-05-08T23:14:22.468855+0000","last_clean":"2024-05-08T23:14:22.468855+0000","last_became_active":"2024-05-08T23:14:21.946448+0000","last_became_peered":"2024-05-08T23:14:21.946448+0000","last_unstale":"2024-05-08T23:14:22.468855+0000","last_undegraded":"2024-05-08T23:14:22.468855+0000","last_fullsized":"2024-05-08T23:14:22.468855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:40.495644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:21.964658+0000","last_change":"2024-05-08T23:14:21.521146+0000","last_active":"2024-05-08T23:14:21.964658+0000","last_peered":"2024-05-08T23:14:21.964658+0000","last_clean":"2024-05-08T23:14:21.964658+0000","last_became_active":"2024-05-08T23:14:21.520936+0000","last_became_peered":"2024-05-08T23:14:21.520936+0000","last_unstale":"2024-05-08T23:14:21.964658+0000","last_undegraded":"2024-05-08T23:14:21.964658+0000","last_fullsized":"2024-05-08T23:14:21.964658+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:30.725824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.102003+0000","last_change":"2024-05-08T23:14:21.961059+0000","last_active":"2024-05-08T23:14:22.102003+0000","last_peered":"2024-05-08T23:14:22.102003+0000","last_clean":"2024-05-08T23:14:22.102003+0000","last_became_active":"2024-05-08T23:14:21.960719+0000","last_became_peered":"2024-05-08T23:14:21.960719+0000","last_unstale":"2024-05-08T23:14:22.102003+0000","last_undegraded":"2024-05-08T23:14:22.102003+0000","last_fullsized":"2024-05-08T23:14:22.102003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:13.004002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.337738+0000","last_change":"2024-05-08T23:14:21.527091+0000","last_active":"2024-05-08T23:14:26.337738+0000","last_peered":"2024-05-08T23:14:26.337738+0000","last_clean":"2024-05-08T23:14:26.337738+0000","last_became_active":"2024-05-08T23:14:21.526750+0000","last_became_peered":"2024-05-08T23:14:21.526750+0000","last_unstale":"2024-05-08T23:14:26.337738+0000","last_undegraded":"2024-05-08T23:14:26.337738+0000","last_fullsized":"2024-05-08T23:14:26.337738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:35.059241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169216+0000","last_change":"2024-05-08T23:14:21.942050+0000","last_active":"2024-05-08T23:14:24.169216+0000","last_peered":"2024-05-08T23:14:24.169216+0000","last_clean":"2024-05-08T23:14:24.169216+0000","last_became_active":"2024-05-08T23:14:21.941719+0000","last_became_peered":"2024-05-08T23:14:21.941719+0000","last_unstale":"2024-05-08T23:14:24.169216+0000","last_undegraded":"2024-05-08T23:14:24.169216+0000","last_fullsized":"2024-05-08T23:14:24.169216+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:03.821820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.344926+0000","last_change":"2024-05-08T23:14:21.523760+0000","last_active":"2024-05-08T23:14:26.344926+0000","last_peered":"2024-05-08T23:14:26.344926+0000","last_clean":"2024-05-08T23:14:26.344926+0000","last_became_active":"2024-05-08T23:14:21.523213+0000","last_became_peered":"2024-05-08T23:14:21.523213+0000","last_unstale":"2024-05-08T23:14:26.344926+0000","last_undegraded":"2024-05-08T23:14:26.344926+0000","last_fullsized":"2024-05-08T23:14:26.344926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:12.225427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101977+0000","last_change":"2024-05-08T23:14:21.959473+0000","last_active":"2024-05-08T23:14:22.101977+0000","last_peered":"2024-05-08T23:14:22.101977+0000","last_clean":"2024-05-08T23:14:22.101977+0000","last_became_active":"2024-05-08T23:14:21.959127+0000","last_became_peered":"2024-05-08T23:14:21.959127+0000","last_unstale":"2024-05-08T23:14:22.101977+0000","last_undegraded":"2024-05-08T23:14:22.101977+0000","last_fullsized":"2024-05-08T23:14:22.101977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:50.181028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.959885+0000","last_change":"2024-05-08T23:14:21.520072+0000","last_active":"2024-05-08T23:14:25.959885+0000","last_peered":"2024-05-08T23:14:25.959885+0000","last_clean":"2024-05-08T23:14:25.959885+0000","last_became_active":"2024-05-08T23:14:21.519753+0000","last_became_peered":"2024-05-08T23:14:21.519753+0000","last_unstale":"2024-05-08T23:14:25.959885+0000","last_undegraded":"2024-05-08T23:14:25.959885+0000","last_fullsized":"2024-05-08T23:14:25.959885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:35.966643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099236+0000","last_change":"2024-05-08T23:14:21.946034+0000","last_active":"2024-05-08T23:14:23.099236+0000","last_peered":"2024-05-08T23:14:23.099236+0000","last_clean":"2024-05-08T23:14:23.099236+0000","last_became_active":"2024-05-08T23:14:21.945652+0000","last_became_peered":"2024-05-08T23:14:21.945652+0000","last_unstale":"2024-05-08T23:14:23.099236+0000","last_undegraded":"2024-05-08T23:14:23.099236+0000","last_fullsized":"2024-05-08T23:14:23.099236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:13.527673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.955716+0000","last_change":"2024-05-08T23:14:21.522394+0000","last_active":"2024-05-08T23:14:24.955716+0000","last_peered":"2024-05-08T23:14:24.955716+0000","last_clean":"2024-05-08T23:14:24.955716+0000","last_became_active":"2024-05-08T23:14:21.522038+0000","last_became_peered":"2024-05-08T23:14:21.522038+0000","last_unstale":"2024-05-08T23:14:24.955716+0000","last_undegraded":"2024-05-08T23:14:24.955716+0000","last_fullsized":"2024-05-08T23:14:24.955716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:18.958647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.933815+0000","last_change":"2024-05-08T23:14:21.946005+0000","last_active":"2024-05-08T23:14:22.933815+0000","last_peered":"2024-05-08T23:14:22.933815+0000","last_clean":"2024-05-08T23:14:22.933815+0000","last_became_active":"2024-05-08T23:14:21.945681+0000","last_became_peered":"2024-05-08T23:14:21.945681+0000","last_unstale":"2024-05-08T23:14:22.933815+0000","last_undegraded":"2024-05-08T23:14:22.933815+0000","last_fullsized":"2024-05-08T23:14:22.933815+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:17.511869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.337197+0000","last_change":"2024-05-08T23:14:21.521775+0000","last_active":"2024-05-08T23:14:26.337197+0000","last_peered":"2024-05-08T23:14:26.337197+0000","last_clean":"2024-05-08T23:14:26.337197+0000","last_became_active":"2024-05-08T23:14:21.521428+0000","last_became_peered":"2024-05-08T23:14:21.521428+0000","last_unstale":"2024-05-08T23:14:26.337197+0000","last_undegraded":"2024-05-08T23:14:26.337197+0000","last_fullsized":"2024-05-08T23:14:26.337197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:13.379322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468911+0000","last_change":"2024-05-08T23:14:21.944886+0000","last_active":"2024-05-08T23:14:22.468911+0000","last_peered":"2024-05-08T23:14:22.468911+0000","last_clean":"2024-05-08T23:14:22.468911+0000","last_became_active":"2024-05-08T23:14:21.944585+0000","last_became_peered":"2024-05-08T23:14:21.944585+0000","last_unstale":"2024-05-08T23:14:22.468911+0000","last_undegraded":"2024-05-08T23:14:22.468911+0000","last_fullsized":"2024-05-08T23:14:22.468911+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:00.519286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.953232+0000","last_change":"2024-05-08T23:14:21.527500+0000","last_active":"2024-05-08T23:14:24.953232+0000","last_peered":"2024-05-08T23:14:24.953232+0000","last_clean":"2024-05-08T23:14:24.953232+0000","last_became_active":"2024-05-08T23:14:21.526709+0000","last_became_peered":"2024-05-08T23:14:21.526709+0000","last_unstale":"2024-05-08T23:14:24.953232+0000","last_undegraded":"2024-05-08T23:14:24.953232+0000","last_fullsized":"2024-05-08T23:14:24.953232+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:49.584194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125526+0000","last_change":"2024-05-08T23:14:21.952026+0000","last_active":"2024-05-08T23:14:24.125526+0000","last_peered":"2024-05-08T23:14:24.125526+0000","last_clean":"2024-05-08T23:14:24.125526+0000","last_became_active":"2024-05-08T23:14:21.951817+0000","last_became_peered":"2024-05-08T23:14:21.951817+0000","last_unstale":"2024-05-08T23:14:24.125526+0000","last_undegraded":"2024-05-08T23:14:24.125526+0000","last_fullsized":"2024-05-08T23:14:24.125526+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:45.239470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.338428+0000","last_change":"2024-05-08T23:14:21.519296+0000","last_active":"2024-05-08T23:14:26.338428+0000","last_peered":"2024-05-08T23:14:26.338428+0000","last_clean":"2024-05-08T23:14:26.338428+0000","last_became_active":"2024-05-08T23:14:21.518975+0000","last_became_peered":"2024-05-08T23:14:21.518975+0000","last_unstale":"2024-05-08T23:14:26.338428+0000","last_undegraded":"2024-05-08T23:14:26.338428+0000","last_fullsized":"2024-05-08T23:14:26.338428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:12.663513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468873+0000","last_change":"2024-05-08T23:14:21.947768+0000","last_active":"2024-05-08T23:14:22.468873+0000","last_peered":"2024-05-08T23:14:22.468873+0000","last_clean":"2024-05-08T23:14:22.468873+0000","last_became_active":"2024-05-08T23:14:21.947247+0000","last_became_peered":"2024-05-08T23:14:21.947247+0000","last_unstale":"2024-05-08T23:14:22.468873+0000","last_undegraded":"2024-05-08T23:14:22.468873+0000","last_fullsized":"2024-05-08T23:14:22.468873+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:16:58.283218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'8","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.342043+0000","last_change":"2024-05-08T23:14:21.519630+0000","last_active":"2024-05-08T23:14:26.342043+0000","last_peered":"2024-05-08T23:14:26.342043+0000","last_clean":"2024-05-08T23:14:26.342043+0000","last_became_active":"2024-05-08T23:14:21.519151+0000","last_became_peered":"2024-05-08T23:14:21.519151+0000","last_unstale":"2024-05-08T23:14:26.342043+0000","last_undegraded":"2024-05-08T23:14:26.342043+0000","last_fullsized":"2024-05-08T23:14:26.342043+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169605+0000","last_change":"2024-05-08T23:14:21.950966+0000","last_active":"2024-05-08T23:14:24.169605+0000","last_peered":"2024-05-08T23:14:24.169605+0000","last_clean":"2024-05-08T23:14:24.169605+0000","last_became_active":"2024-05-08T23:14:21.950694+0000","last_became_peered":"2024-05-08T23:14:21.950694+0000","last_unstale":"2024-05-08T23:14:24.169605+0000","last_undegraded":"2024-05-08T23:14:24.169605+0000","last_fullsized":"2024-05-08T23:14:24.169605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:41.599529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.960793+0000","last_change":"2024-05-08T23:14:21.519509+0000","last_active":"2024-05-08T23:14:25.960793+0000","last_peered":"2024-05-08T23:14:25.960793+0000","last_clean":"2024-05-08T23:14:25.960793+0000","last_became_active":"2024-05-08T23:14:21.519237+0000","last_became_peered":"2024-05-08T23:14:21.519237+0000","last_unstale":"2024-05-08T23:14:25.960793+0000","last_undegraded":"2024-05-08T23:14:25.960793+0000","last_fullsized":"2024-05-08T23:14:25.960793+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:52.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067695+0000","last_change":"2024-05-08T23:14:21.944225+0000","last_active":"2024-05-08T23:14:24.067695+0000","last_peered":"2024-05-08T23:14:24.067695+0000","last_clean":"2024-05-08T23:14:24.067695+0000","last_became_active":"2024-05-08T23:14:21.943909+0000","last_became_peered":"2024-05-08T23:14:21.943909+0000","last_unstale":"2024-05-08T23:14:24.067695+0000","last_undegraded":"2024-05-08T23:14:24.067695+0000","last_fullsized":"2024-05-08T23:14:24.067695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:52.003909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.956230+0000","last_change":"2024-05-08T23:14:21.522565+0000","last_active":"2024-05-08T23:14:24.956230+0000","last_peered":"2024-05-08T23:14:24.956230+0000","last_clean":"2024-05-08T23:14:24.956230+0000","last_became_active":"2024-05-08T23:14:21.522224+0000","last_became_peered":"2024-05-08T23:14:21.522224+0000","last_unstale":"2024-05-08T23:14:24.956230+0000","last_undegraded":"2024-05-08T23:14:24.956230+0000","last_fullsized":"2024-05-08T23:14:24.956230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.768309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041830+0000","last_change":"2024-05-08T23:14:21.953759+0000","last_active":"2024-05-08T23:14:22.041830+0000","last_peered":"2024-05-08T23:14:22.041830+0000","last_clean":"2024-05-08T23:14:22.041830+0000","last_became_active":"2024-05-08T23:14:21.953425+0000","last_became_peered":"2024-05-08T23:14:21.953425+0000","last_unstale":"2024-05-08T23:14:22.041830+0000","last_undegraded":"2024-05-08T23:14:22.041830+0000","last_fullsized":"2024-05-08T23:14:22.041830+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:36.189067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:29.344086+0000","last_change":"2024-05-08T23:14:21.525305+0000","last_active":"2024-05-08T23:14:29.344086+0000","last_peered":"2024-05-08T23:14:29.344086+0000","last_clean":"2024-05-08T23:14:29.344086+0000","last_became_active":"2024-05-08T23:14:21.524985+0000","last_became_peered":"2024-05-08T23:14:21.524985+0000","last_unstale":"2024-05-08T23:14:29.344086+0000","last_undegraded":"2024-05-08T23:14:29.344086+0000","last_fullsized":"2024-05-08T23:14:29.344086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:20:23.814736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041755+0000","last_change":"2024-05-08T23:14:21.958958+0000","last_active":"2024-05-08T23:14:22.041755+0000","last_peered":"2024-05-08T23:14:22.041755+0000","last_clean":"2024-05-08T23:14:22.041755+0000","last_became_active":"2024-05-08T23:14:21.958613+0000","last_became_peered":"2024-05-08T23:14:21.958613+0000","last_unstale":"2024-05-08T23:14:22.041755+0000","last_undegraded":"2024-05-08T23:14:22.041755+0000","last_fullsized":"2024-05-08T23:14:22.041755+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:07.245634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.963236+0000","last_change":"2024-05-08T23:14:21.525484+0000","last_active":"2024-05-08T23:14:25.963236+0000","last_peered":"2024-05-08T23:14:25.963236+0000","last_clean":"2024-05-08T23:14:25.963236+0000","last_became_active":"2024-05-08T23:14:21.525142+0000","last_became_peered":"2024-05-08T23:14:21.525142+0000","last_unstale":"2024-05-08T23:14:25.963236+0000","last_undegraded":"2024-05-08T23:14:25.963236+0000","last_fullsized":"2024-05-08T23:14:25.963236+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:43.273230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101938+0000","last_change":"2024-05-08T23:14:21.962233+0000","last_active":"2024-05-08T23:14:22.101938+0000","last_peered":"2024-05-08T23:14:22.101938+0000","last_clean":"2024-05-08T23:14:22.101938+0000","last_became_active":"2024-05-08T23:14:21.961720+0000","last_became_peered":"2024-05-08T23:14:21.961720+0000","last_unstale":"2024-05-08T23:14:22.101938+0000","last_undegraded":"2024-05-08T23:14:22.101938+0000","last_fullsized":"2024-05-08T23:14:22.101938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:49:29.797724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:21.964303+0000","last_change":"2024-05-08T23:14:21.525125+0000","last_active":"2024-05-08T23:14:21.964303+0000","last_peered":"2024-05-08T23:14:21.964303+0000","last_clean":"2024-05-08T23:14:21.964303+0000","last_became_active":"2024-05-08T23:14:21.524759+0000","last_became_peered":"2024-05-08T23:14:21.524759+0000","last_unstale":"2024-05-08T23:14:21.964303+0000","last_undegraded":"2024-05-08T23:14:21.964303+0000","last_fullsized":"2024-05-08T23:14:21.964303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:45.267925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934649+0000","last_change":"2024-05-08T23:14:21.949084+0000","last_active":"2024-05-08T23:14:22.934649+0000","last_peered":"2024-05-08T23:14:22.934649+0000","last_clean":"2024-05-08T23:14:22.934649+0000","last_became_active":"2024-05-08T23:14:21.948567+0000","last_became_peered":"2024-05-08T23:14:21.948567+0000","last_unstale":"2024-05-08T23:14:22.934649+0000","last_undegraded":"2024-05-08T23:14:22.934649+0000","last_fullsized":"2024-05-08T23:14:22.934649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:50:33.466144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.814965+0000","last_change":"2024-05-08T23:14:21.519758+0000","last_active":"2024-05-08T23:14:23.814965+0000","last_peered":"2024-05-08T23:14:23.814965+0000","last_clean":"2024-05-08T23:14:23.814965+0000","last_became_active":"2024-05-08T23:14:21.519403+0000","last_became_peered":"2024-05-08T23:14:21.519403+0000","last_unstale":"2024-05-08T23:14:23.814965+0000","last_undegraded":"2024-05-08T23:14:23.814965+0000","last_fullsized":"2024-05-08T23:14:23.814965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:49.080141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.071039+0000","last_change":"2024-05-08T23:14:21.944315+0000","last_active":"2024-05-08T23:14:22.071039+0000","last_peered":"2024-05-08T23:14:22.071039+0000","last_clean":"2024-05-08T23:14:22.071039+0000","last_became_active":"2024-05-08T23:14:21.943542+0000","last_became_peered":"2024-05-08T23:14:21.943542+0000","last_unstale":"2024-05-08T23:14:22.071039+0000","last_undegraded":"2024-05-08T23:14:22.071039+0000","last_fullsized":"2024-05-08T23:14:22.071039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:10.667516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169231+0000","last_change":"2024-05-08T23:14:21.526576+0000","last_active":"2024-05-08T23:14:24.169231+0000","last_peered":"2024-05-08T23:14:24.169231+0000","last_clean":"2024-05-08T23:14:24.169231+0000","last_became_active":"2024-05-08T23:14:21.524611+0000","last_became_peered":"2024-05-08T23:14:21.524611+0000","last_unstale":"2024-05-08T23:14:24.169231+0000","last_undegraded":"2024-05-08T23:14:24.169231+0000","last_fullsized":"2024-05-08T23:14:24.169231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:52.929531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.071016+0000","last_change":"2024-05-08T23:14:21.951870+0000","last_active":"2024-05-08T23:14:22.071016+0000","last_peered":"2024-05-08T23:14:22.071016+0000","last_clean":"2024-05-08T23:14:22.071016+0000","last_became_active":"2024-05-08T23:14:21.949810+0000","last_became_peered":"2024-05-08T23:14:21.949810+0000","last_unstale":"2024-05-08T23:14:22.071016+0000","last_undegraded":"2024-05-08T23:14:22.071016+0000","last_fullsized":"2024-05-08T23:14:22.071016+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:01.727234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101925+0000","last_change":"2024-05-08T23:14:21.958705+0000","last_active":"2024-05-08T23:14:22.101925+0000","last_peered":"2024-05-08T23:14:22.101925+0000","last_clean":"2024-05-08T23:14:22.101925+0000","last_became_active":"2024-05-08T23:14:21.958392+0000","last_became_peered":"2024-05-08T23:14:21.958392+0000","last_unstale":"2024-05-08T23:14:22.101925+0000","last_undegraded":"2024-05-08T23:14:22.101925+0000","last_fullsized":"2024-05-08T23:14:22.101925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:34.417439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.962885+0000","last_change":"2024-05-08T23:14:21.520978+0000","last_active":"2024-05-08T23:14:25.962885+0000","last_peered":"2024-05-08T23:14:25.962885+0000","last_clean":"2024-05-08T23:14:25.962885+0000","last_became_active":"2024-05-08T23:14:21.520688+0000","last_became_peered":"2024-05-08T23:14:21.520688+0000","last_unstale":"2024-05-08T23:14:25.962885+0000","last_undegraded":"2024-05-08T23:14:25.962885+0000","last_fullsized":"2024-05-08T23:14:25.962885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:59:43.000719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099268+0000","last_change":"2024-05-08T23:14:21.946315+0000","last_active":"2024-05-08T23:14:23.099268+0000","last_peered":"2024-05-08T23:14:23.099268+0000","last_clean":"2024-05-08T23:14:23.099268+0000","last_became_active":"2024-05-08T23:14:21.945542+0000","last_became_peered":"2024-05-08T23:14:21.945542+0000","last_unstale":"2024-05-08T23:14:23.099268+0000","last_undegraded":"2024-05-08T23:14:23.099268+0000","last_fullsized":"2024-05-08T23:14:23.099268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:35.027035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.354653+0000","last_change":"2024-05-08T23:14:21.521066+0000","last_active":"2024-05-08T23:14:27.354653+0000","last_peered":"2024-05-08T23:14:27.354653+0000","last_clean":"2024-05-08T23:14:27.354653+0000","last_became_active":"2024-05-08T23:14:21.520730+0000","last_became_peered":"2024-05-08T23:14:21.520730+0000","last_unstale":"2024-05-08T23:14:27.354653+0000","last_undegraded":"2024-05-08T23:14:27.354653+0000","last_fullsized":"2024-05-08T23:14:27.354653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:11.033062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":323,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:21.936605+0000","last_change":"2024-05-08T23:13:34.449454+0000","last_active":"2024-05-08T23:14:21.936605+0000","last_peered":"2024-05-08T23:14:21.936605+0000","last_clean":"2024-05-08T23:14:21.936605+0000","last_became_active":"2024-05-08T23:13:34.448953+0000","last_became_peered":"2024-05-08T23:13:34.448953+0000","last_unstale":"2024-05-08T23:14:21.936605+0000","last_undegraded":"2024-05-08T23:14:21.936605+0000","last_fullsized":"2024-05-08T23:14:21.936605+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:11:11.941444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:11:11.941444+0000","last_clean_scrub_stamp":"2024-05-08T23:11:11.941444+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:49.039661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067594+0000","last_change":"2024-05-08T23:14:21.947145+0000","last_active":"2024-05-08T23:14:24.067594+0000","last_peered":"2024-05-08T23:14:24.067594+0000","last_clean":"2024-05-08T23:14:24.067594+0000","last_became_active":"2024-05-08T23:14:21.946842+0000","last_became_peered":"2024-05-08T23:14:21.946842+0000","last_unstale":"2024-05-08T23:14:24.067594+0000","last_undegraded":"2024-05-08T23:14:24.067594+0000","last_fullsized":"2024-05-08T23:14:24.067594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:27.070888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.959869+0000","last_change":"2024-05-08T23:14:21.525571+0000","last_active":"2024-05-08T23:14:25.959869+0000","last_peered":"2024-05-08T23:14:25.959869+0000","last_clean":"2024-05-08T23:14:25.959869+0000","last_became_active":"2024-05-08T23:14:21.524486+0000","last_became_peered":"2024-05-08T23:14:21.524486+0000","last_unstale":"2024-05-08T23:14:25.959869+0000","last_undegraded":"2024-05-08T23:14:25.959869+0000","last_fullsized":"2024-05-08T23:14:25.959869+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:07.575183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169691+0000","last_change":"2024-05-08T23:14:21.527012+0000","last_active":"2024-05-08T23:14:24.169691+0000","last_peered":"2024-05-08T23:14:24.169691+0000","last_clean":"2024-05-08T23:14:24.169691+0000","last_became_active":"2024-05-08T23:14:21.526263+0000","last_became_peered":"2024-05-08T23:14:21.526263+0000","last_unstale":"2024-05-08T23:14:24.169691+0000","last_undegraded":"2024-05-08T23:14:24.169691+0000","last_fullsized":"2024-05-08T23:14:24.169691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:42.930529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067797+0000","last_change":"2024-05-08T23:14:21.948803+0000","last_active":"2024-05-08T23:14:24.067797+0000","last_peered":"2024-05-08T23:14:24.067797+0000","last_clean":"2024-05-08T23:14:24.067797+0000","last_became_active":"2024-05-08T23:14:21.947787+0000","last_became_peered":"2024-05-08T23:14:21.947787+0000","last_unstale":"2024-05-08T23:14:24.067797+0000","last_undegraded":"2024-05-08T23:14:24.067797+0000","last_fullsized":"2024-05-08T23:14:24.067797+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:25.521045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'7","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.344849+0000","last_change":"2024-05-08T23:14:21.522944+0000","last_active":"2024-05-08T23:14:26.344849+0000","last_peered":"2024-05-08T23:14:26.344849+0000","last_clean":"2024-05-08T23:14:26.344849+0000","last_became_active":"2024-05-08T23:14:21.522644+0000","last_became_peered":"2024-05-08T23:14:21.522644+0000","last_unstale":"2024-05-08T23:14:26.344849+0000","last_undegraded":"2024-05-08T23:14:26.344849+0000","last_fullsized":"2024-05-08T23:14:26.344849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:17.008946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099353+0000","last_change":"2024-05-08T23:14:21.947133+0000","last_active":"2024-05-08T23:14:23.099353+0000","last_peered":"2024-05-08T23:14:23.099353+0000","last_clean":"2024-05-08T23:14:23.099353+0000","last_became_active":"2024-05-08T23:14:21.946373+0000","last_became_peered":"2024-05-08T23:14:21.946373+0000","last_unstale":"2024-05-08T23:14:23.099353+0000","last_undegraded":"2024-05-08T23:14:23.099353+0000","last_fullsized":"2024-05-08T23:14:23.099353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:08.784990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.355529+0000","last_change":"2024-05-08T23:14:21.525172+0000","last_active":"2024-05-08T23:14:27.355529+0000","last_peered":"2024-05-08T23:14:27.355529+0000","last_clean":"2024-05-08T23:14:27.355529+0000","last_became_active":"2024-05-08T23:14:21.524721+0000","last_became_peered":"2024-05-08T23:14:21.524721+0000","last_unstale":"2024-05-08T23:14:27.355529+0000","last_undegraded":"2024-05-08T23:14:27.355529+0000","last_fullsized":"2024-05-08T23:14:27.355529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:21.051347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125579+0000","last_change":"2024-05-08T23:14:21.951912+0000","last_active":"2024-05-08T23:14:24.125579+0000","last_peered":"2024-05-08T23:14:24.125579+0000","last_clean":"2024-05-08T23:14:24.125579+0000","last_became_active":"2024-05-08T23:14:21.951620+0000","last_became_peered":"2024-05-08T23:14:21.951620+0000","last_unstale":"2024-05-08T23:14:24.125579+0000","last_undegraded":"2024-05-08T23:14:24.125579+0000","last_fullsized":"2024-05-08T23:14:24.125579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:28.218680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.955304+0000","last_change":"2024-05-08T23:14:21.521707+0000","last_active":"2024-05-08T23:14:24.955304+0000","last_peered":"2024-05-08T23:14:24.955304+0000","last_clean":"2024-05-08T23:14:24.955304+0000","last_became_active":"2024-05-08T23:14:21.521376+0000","last_became_peered":"2024-05-08T23:14:21.521376+0000","last_unstale":"2024-05-08T23:14:24.955304+0000","last_undegraded":"2024-05-08T23:14:24.955304+0000","last_fullsized":"2024-05-08T23:14:24.955304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:39.192259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.168939+0000","last_change":"2024-05-08T23:14:21.952825+0000","last_active":"2024-05-08T23:14:24.168939+0000","last_peered":"2024-05-08T23:14:24.168939+0000","last_clean":"2024-05-08T23:14:24.168939+0000","last_became_active":"2024-05-08T23:14:21.952494+0000","last_became_peered":"2024-05-08T23:14:21.952494+0000","last_unstale":"2024-05-08T23:14:24.168939+0000","last_undegraded":"2024-05-08T23:14:24.168939+0000","last_fullsized":"2024-05-08T23:14:24.168939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:31:29.439165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.354216+0000","last_change":"2024-05-08T23:14:21.516550+0000","last_active":"2024-05-08T23:14:27.354216+0000","last_peered":"2024-05-08T23:14:27.354216+0000","last_clean":"2024-05-08T23:14:27.354216+0000","last_became_active":"2024-05-08T23:14:21.516211+0000","last_became_peered":"2024-05-08T23:14:21.516211+0000","last_unstale":"2024-05-08T23:14:27.354216+0000","last_undegraded":"2024-05-08T23:14:27.354216+0000","last_fullsized":"2024-05-08T23:14:27.354216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:37.112939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934466+0000","last_change":"2024-05-08T23:14:21.945018+0000","last_active":"2024-05-08T23:14:22.934466+0000","last_peered":"2024-05-08T23:14:22.934466+0000","last_clean":"2024-05-08T23:14:22.934466+0000","last_became_active":"2024-05-08T23:14:21.944691+0000","last_became_peered":"2024-05-08T23:14:21.944691+0000","last_unstale":"2024-05-08T23:14:22.934466+0000","last_undegraded":"2024-05-08T23:14:22.934466+0000","last_fullsized":"2024-05-08T23:14:22.934466+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:36.323757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:21.936156+0000","last_change":"2024-05-08T23:14:21.518130+0000","last_active":"2024-05-08T23:14:21.936156+0000","last_peered":"2024-05-08T23:14:21.936156+0000","last_clean":"2024-05-08T23:14:21.936156+0000","last_became_active":"2024-05-08T23:14:21.517828+0000","last_became_peered":"2024-05-08T23:14:21.517828+0000","last_unstale":"2024-05-08T23:14:21.936156+0000","last_undegraded":"2024-05-08T23:14:21.936156+0000","last_fullsized":"2024-05-08T23:14:21.936156+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:47.201096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099277+0000","last_change":"2024-05-08T23:14:21.952081+0000","last_active":"2024-05-08T23:14:23.099277+0000","last_peered":"2024-05-08T23:14:23.099277+0000","last_clean":"2024-05-08T23:14:23.099277+0000","last_became_active":"2024-05-08T23:14:21.951794+0000","last_became_peered":"2024-05-08T23:14:21.951794+0000","last_unstale":"2024-05-08T23:14:23.099277+0000","last_undegraded":"2024-05-08T23:14:23.099277+0000","last_fullsized":"2024-05-08T23:14:23.099277+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:41.957442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.953462+0000","last_change":"2024-05-08T23:14:21.525362+0000","last_active":"2024-05-08T23:14:24.953462+0000","last_peered":"2024-05-08T23:14:24.953462+0000","last_clean":"2024-05-08T23:14:24.953462+0000","last_became_active":"2024-05-08T23:14:21.525033+0000","last_became_peered":"2024-05-08T23:14:21.525033+0000","last_unstale":"2024-05-08T23:14:24.953462+0000","last_undegraded":"2024-05-08T23:14:24.953462+0000","last_fullsized":"2024-05-08T23:14:24.953462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:41.610041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041817+0000","last_change":"2024-05-08T23:14:21.950784+0000","last_active":"2024-05-08T23:14:22.041817+0000","last_peered":"2024-05-08T23:14:22.041817+0000","last_clean":"2024-05-08T23:14:22.041817+0000","last_became_active":"2024-05-08T23:14:21.950504+0000","last_became_peered":"2024-05-08T23:14:21.950504+0000","last_unstale":"2024-05-08T23:14:22.041817+0000","last_undegraded":"2024-05-08T23:14:22.041817+0000","last_fullsized":"2024-05-08T23:14:22.041817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.096546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.963174+0000","last_change":"2024-05-08T23:14:21.524636+0000","last_active":"2024-05-08T23:14:25.963174+0000","last_peered":"2024-05-08T23:14:25.963174+0000","last_clean":"2024-05-08T23:14:25.963174+0000","last_became_active":"2024-05-08T23:14:21.524323+0000","last_became_peered":"2024-05-08T23:14:21.524323+0000","last_unstale":"2024-05-08T23:14:25.963174+0000","last_undegraded":"2024-05-08T23:14:25.963174+0000","last_fullsized":"2024-05-08T23:14:25.963174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:59.714443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041863+0000","last_change":"2024-05-08T23:14:21.950109+0000","last_active":"2024-05-08T23:14:22.041863+0000","last_peered":"2024-05-08T23:14:22.041863+0000","last_clean":"2024-05-08T23:14:22.041863+0000","last_became_active":"2024-05-08T23:14:21.949803+0000","last_became_peered":"2024-05-08T23:14:21.949803+0000","last_unstale":"2024-05-08T23:14:22.041863+0000","last_undegraded":"2024-05-08T23:14:22.041863+0000","last_fullsized":"2024-05-08T23:14:22.041863+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:00.025947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.335410+0000","last_change":"2024-05-08T23:14:21.517997+0000","last_active":"2024-05-08T23:14:26.335410+0000","last_peered":"2024-05-08T23:14:26.335410+0000","last_clean":"2024-05-08T23:14:26.335410+0000","last_became_active":"2024-05-08T23:14:21.517635+0000","last_became_peered":"2024-05-08T23:14:21.517635+0000","last_unstale":"2024-05-08T23:14:26.335410+0000","last_undegraded":"2024-05-08T23:14:26.335410+0000","last_fullsized":"2024-05-08T23:14:26.335410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:55.088301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041842+0000","last_change":"2024-05-08T23:14:21.958863+0000","last_active":"2024-05-08T23:14:22.041842+0000","last_peered":"2024-05-08T23:14:22.041842+0000","last_clean":"2024-05-08T23:14:22.041842+0000","last_became_active":"2024-05-08T23:14:21.958462+0000","last_became_peered":"2024-05-08T23:14:21.958462+0000","last_unstale":"2024-05-08T23:14:22.041842+0000","last_undegraded":"2024-05-08T23:14:22.041842+0000","last_fullsized":"2024-05-08T23:14:22.041842+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:41:42.202867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:21.951361+0000","last_change":"2024-05-08T23:14:21.522669+0000","last_active":"2024-05-08T23:14:21.951361+0000","last_peered":"2024-05-08T23:14:21.951361+0000","last_clean":"2024-05-08T23:14:21.951361+0000","last_became_active":"2024-05-08T23:14:21.522348+0000","last_became_peered":"2024-05-08T23:14:21.522348+0000","last_unstale":"2024-05-08T23:14:21.951361+0000","last_undegraded":"2024-05-08T23:14:21.951361+0000","last_fullsized":"2024-05-08T23:14:21.951361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:37.824190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041886+0000","last_change":"2024-05-08T23:14:21.960656+0000","last_active":"2024-05-08T23:14:22.041886+0000","last_peered":"2024-05-08T23:14:22.041886+0000","last_clean":"2024-05-08T23:14:22.041886+0000","last_became_active":"2024-05-08T23:14:21.960336+0000","last_became_peered":"2024-05-08T23:14:21.960336+0000","last_unstale":"2024-05-08T23:14:22.041886+0000","last_undegraded":"2024-05-08T23:14:22.041886+0000","last_fullsized":"2024-05-08T23:14:22.041886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:55.101942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934706+0000","last_change":"2024-05-08T23:14:21.965928+0000","last_active":"2024-05-08T23:14:22.934706+0000","last_peered":"2024-05-08T23:14:22.934706+0000","last_clean":"2024-05-08T23:14:22.934706+0000","last_became_active":"2024-05-08T23:14:21.965570+0000","last_became_peered":"2024-05-08T23:14:21.965570+0000","last_unstale":"2024-05-08T23:14:22.934706+0000","last_undegraded":"2024-05-08T23:14:22.934706+0000","last_fullsized":"2024-05-08T23:14:22.934706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:01.963727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685021+0000","last_change":"2024-05-08T23:14:21.948795+0000","last_active":"2024-05-08T23:14:23.685021+0000","last_peered":"2024-05-08T23:14:23.685021+0000","last_clean":"2024-05-08T23:14:23.685021+0000","last_became_active":"2024-05-08T23:14:21.948275+0000","last_became_peered":"2024-05-08T23:14:21.948275+0000","last_unstale":"2024-05-08T23:14:23.685021+0000","last_undegraded":"2024-05-08T23:14:23.685021+0000","last_fullsized":"2024-05-08T23:14:23.685021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:27.812089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685000+0000","last_change":"2024-05-08T23:14:21.942911+0000","last_active":"2024-05-08T23:14:23.685000+0000","last_peered":"2024-05-08T23:14:23.685000+0000","last_clean":"2024-05-08T23:14:23.685000+0000","last_became_active":"2024-05-08T23:14:21.942050+0000","last_became_peered":"2024-05-08T23:14:21.942050+0000","last_unstale":"2024-05-08T23:14:23.685000+0000","last_undegraded":"2024-05-08T23:14:23.685000+0000","last_fullsized":"2024-05-08T23:14:23.685000+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:05.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125373+0000","last_change":"2024-05-08T23:14:21.952424+0000","last_active":"2024-05-08T23:14:24.125373+0000","last_peered":"2024-05-08T23:14:24.125373+0000","last_clean":"2024-05-08T23:14:24.125373+0000","last_became_active":"2024-05-08T23:14:21.952132+0000","last_became_peered":"2024-05-08T23:14:21.952132+0000","last_unstale":"2024-05-08T23:14:24.125373+0000","last_undegraded":"2024-05-08T23:14:24.125373+0000","last_fullsized":"2024-05-08T23:14:24.125373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:55.035476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067879+0000","last_change":"2024-05-08T23:14:21.933701+0000","last_active":"2024-05-08T23:14:24.067879+0000","last_peered":"2024-05-08T23:14:24.067879+0000","last_clean":"2024-05-08T23:14:24.067879+0000","last_became_active":"2024-05-08T23:14:21.933275+0000","last_became_peered":"2024-05-08T23:14:21.933275+0000","last_unstale":"2024-05-08T23:14:24.067879+0000","last_undegraded":"2024-05-08T23:14:24.067879+0000","last_fullsized":"2024-05-08T23:14:24.067879+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:47.660620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934618+0000","last_change":"2024-05-08T23:14:21.958705+0000","last_active":"2024-05-08T23:14:22.934618+0000","last_peered":"2024-05-08T23:14:22.934618+0000","last_clean":"2024-05-08T23:14:22.934618+0000","last_became_active":"2024-05-08T23:14:21.958410+0000","last_became_peered":"2024-05-08T23:14:21.958410+0000","last_unstale":"2024-05-08T23:14:22.934618+0000","last_undegraded":"2024-05-08T23:14:22.934618+0000","last_fullsized":"2024-05-08T23:14:22.934618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:42:31.167722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685346+0000","last_change":"2024-05-08T23:14:21.963814+0000","last_active":"2024-05-08T23:14:23.685346+0000","last_peered":"2024-05-08T23:14:23.685346+0000","last_clean":"2024-05-08T23:14:23.685346+0000","last_became_active":"2024-05-08T23:14:21.963485+0000","last_became_peered":"2024-05-08T23:14:21.963485+0000","last_unstale":"2024-05-08T23:14:23.685346+0000","last_undegraded":"2024-05-08T23:14:23.685346+0000","last_fullsized":"2024-05-08T23:14:23.685346+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:22.782637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099336+0000","last_change":"2024-05-08T23:14:21.947887+0000","last_active":"2024-05-08T23:14:23.099336+0000","last_peered":"2024-05-08T23:14:23.099336+0000","last_clean":"2024-05-08T23:14:23.099336+0000","last_became_active":"2024-05-08T23:14:21.947577+0000","last_became_peered":"2024-05-08T23:14:21.947577+0000","last_unstale":"2024-05-08T23:14:23.099336+0000","last_undegraded":"2024-05-08T23:14:23.099336+0000","last_fullsized":"2024-05-08T23:14:23.099336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:33.022146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101912+0000","last_change":"2024-05-08T23:14:21.963857+0000","last_active":"2024-05-08T23:14:22.101912+0000","last_peered":"2024-05-08T23:14:22.101912+0000","last_clean":"2024-05-08T23:14:22.101912+0000","last_became_active":"2024-05-08T23:14:21.963366+0000","last_became_peered":"2024-05-08T23:14:21.963366+0000","last_unstale":"2024-05-08T23:14:22.101912+0000","last_undegraded":"2024-05-08T23:14:22.101912+0000","last_fullsized":"2024-05-08T23:14:22.101912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:34.402188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099246+0000","last_change":"2024-05-08T23:14:21.946956+0000","last_active":"2024-05-08T23:14:23.099246+0000","last_peered":"2024-05-08T23:14:23.099246+0000","last_clean":"2024-05-08T23:14:23.099246+0000","last_became_active":"2024-05-08T23:14:21.946669+0000","last_became_peered":"2024-05-08T23:14:21.946669+0000","last_unstale":"2024-05-08T23:14:23.099246+0000","last_undegraded":"2024-05-08T23:14:23.099246+0000","last_fullsized":"2024-05-08T23:14:23.099246+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:29.826418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468837+0000","last_change":"2024-05-08T23:14:21.952852+0000","last_active":"2024-05-08T23:14:22.468837+0000","last_peered":"2024-05-08T23:14:22.468837+0000","last_clean":"2024-05-08T23:14:22.468837+0000","last_became_active":"2024-05-08T23:14:21.952515+0000","last_became_peered":"2024-05-08T23:14:21.952515+0000","last_unstale":"2024-05-08T23:14:22.468837+0000","last_undegraded":"2024-05-08T23:14:22.468837+0000","last_fullsized":"2024-05-08T23:14:22.468837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:15.611960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067841+0000","last_change":"2024-05-08T23:14:21.944967+0000","last_active":"2024-05-08T23:14:24.067841+0000","last_peered":"2024-05-08T23:14:24.067841+0000","last_clean":"2024-05-08T23:14:24.067841+0000","last_became_active":"2024-05-08T23:14:21.944588+0000","last_became_peered":"2024-05-08T23:14:21.944588+0000","last_unstale":"2024-05-08T23:14:24.067841+0000","last_undegraded":"2024-05-08T23:14:24.067841+0000","last_fullsized":"2024-05-08T23:14:24.067841+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:40:12.545764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934362+0000","last_change":"2024-05-08T23:14:21.948689+0000","last_active":"2024-05-08T23:14:22.934362+0000","last_peered":"2024-05-08T23:14:22.934362+0000","last_clean":"2024-05-08T23:14:22.934362+0000","last_became_active":"2024-05-08T23:14:21.948335+0000","last_became_peered":"2024-05-08T23:14:21.948335+0000","last_unstale":"2024-05-08T23:14:22.934362+0000","last_undegraded":"2024-05-08T23:14:22.934362+0000","last_fullsized":"2024-05-08T23:14:22.934362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:41.767077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282110,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6379,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":162,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":21395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449099,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36088,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709064,"statfs":{"total":95995035648,"available":95958081536,"internally_reserved":0,"allocated":901120,"data_stored":430329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36043205},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":10,"up_from":70,"seq":300647710733,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":987136,"data_stored":1022097,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31848896},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":9,"up_from":65,"seq":279172874258,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":925696,"data_stored":429914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31848896},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.40799999999999997}]},{"osd":1,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.57199999999999995}]},{"osd":2,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.441},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.505}]},{"osd":3,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54300000000000004}]},{"osd":4,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55500000000000005}]},{"osd":5,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.626}]},{"osd":7,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.68500000000000005}]},{"osd":8,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.72999999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":8,"up_from":57,"seq":244813135893,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":901120,"data_stored":429418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.82199999999999995}]},{"osd":2,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.499},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.56399999999999995}]},{"osd":3,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.624}]},{"osd":4,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.79300000000000004}]},{"osd":5,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.72499999999999998}]},{"osd":6,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.752}]},{"osd":7,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.83299999999999996}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.81000000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":7,"up_from":50,"seq":214748364824,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":1021528,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.442},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.46300000000000002}]},{"osd":2,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.496},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.63700000000000001}]},{"osd":3,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.56100000000000005}]},{"osd":4,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.71199999999999997}]},{"osd":6,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.53400000000000003}]},{"osd":8,"last update":"Wed May 8 23:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.624}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.70199999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":6,"up_from":45,"seq":193273528348,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31984,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713168,"statfs":{"total":95995035648,"available":95962284032,"internally_reserved":0,"allocated":888832,"data_stored":428792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.27900000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61299999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42099999999999999,"15min":0.42299999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65900000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.37}]},{"osd":1,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.502,"15min":0.495},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53600000000000003}]},{"osd":2,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72499999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46500000000000002}]},{"osd":3,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68600000000000005,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.498,"15min":0.501},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78700000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.374,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77100000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.66300000000000003}]},{"osd":5,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.748,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.629,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.49299999999999999}]},{"osd":7,"last update":"Wed May 8 23:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.73499999999999999}]},{"osd":8,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.57699999999999996}]},{"osd":9,"last update":"Wed May 8 23:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59799999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":430938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.50900000000000001,"15min":0.503},"min":{"1min":0.436,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.749,"15min":0.749},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.41399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.72199999999999998}]},{"osd":2,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.41699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.46700000000000003}]},{"osd":3,"last update":"Wed May 8 23:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51700000000000002,"15min":0.51300000000000001},"min":{"1min":0.35999999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.496},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.38,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.67800000000000005}]},{"osd":4,"last update":"Wed May 8 23:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40100000000000002,"15min":0.38900000000000001},"min":{"1min":0.30399999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.42099999999999999,"15min":0.41299999999999998},"min":{"1min":0.32600000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":5,"last update":"Wed May 8 23:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.46400000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.59799999999999998,"15min":0.58199999999999996},"min":{"1min":0.51600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.77300000000000002}]},{"osd":6,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.59599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.79100000000000004}]},{"osd":7,"last update":"Wed May 8 23:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.93700000000000006}]},{"osd":8,"last update":"Wed May 8 23:13:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.747}]},{"osd":9,"last update":"Wed May 8 23:14:14 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":1.0189999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738418,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":431315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 23:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.499,"15min":0.5},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72999999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.501,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Wed May 8 23:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68700000000000006,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.499},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.495}]},{"osd":3,"last update":"Wed May 8 23:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.41099999999999998},"min":{"1min":0.28000000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58799999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.40899999999999997},"min":{"1min":0.27600000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Wed May 8 23:13:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.69599999999999995}]},{"osd":5,"last update":"Wed May 8 23:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.40300000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69399999999999995,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.80900000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.45900000000000002}]},{"osd":7,"last update":"Wed May 8 23:13:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64300000000000002}]},{"osd":8,"last update":"Wed May 8 23:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60099999999999998}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63600000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411369,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":430964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.44500000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.626}]},{"osd":1,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.496,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52100000000000002,"15min":0.504},"min":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.67800000000000005,"5min":0.751,"15min":0.751},"last":0.76800000000000002}]},{"osd":3,"last update":"Wed May 8 23:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.505,"15min":0.503},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47499999999999998,"15min":0.46999999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.51200000000000001}]},{"osd":4,"last update":"Wed May 8 23:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.746,"5min":0.747,"15min":0.747},"last":0.67400000000000004}]},{"osd":5,"last update":"Wed May 8 23:14:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.435,"15min":0.438},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58699999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61699999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57699999999999996}]},{"osd":6,"last update":"Wed May 8 23:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65300000000000002}]},{"osd":7,"last update":"Wed May 8 23:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51100000000000001}]},{"osd":8,"last update":"Wed May 8 23:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.83899999999999997}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.86599999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]},{"osd":3,"up_from":26,"seq":111669149735,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":913408,"data_stored":428891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.32700000000000001,"15min":0.32100000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.34399999999999997,"15min":0.33800000000000002},"min":{"1min":0.24199999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.30499999999999999}]},{"osd":1,"last update":"Wed May 8 23:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48699999999999999,"15min":0.47799999999999998},"min":{"1min":0.43099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.505},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.36799999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68300000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.42399999999999999}]},{"osd":2,"last update":"Wed May 8 23:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.53200000000000003},"min":{"1min":0.371,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.376}]},{"osd":4,"last update":"Wed May 8 23:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.54200000000000004},"min":{"1min":0.441,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.54000000000000004}]},{"osd":5,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.56399999999999995,"15min":0.55100000000000005},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed May 8 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42999999999999999}]},{"osd":7,"last update":"Wed May 8 23:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56399999999999995}]},{"osd":8,"last update":"Wed May 8 23:13:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.53400000000000003}]},{"osd":9,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.55200000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":4,"up_from":33,"seq":141733920804,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":909312,"data_stored":429837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:13:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48499999999999999,"15min":0.47999999999999998},"min":{"1min":0.33100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.36099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.60699999999999998}]},{"osd":1,"last update":"Wed May 8 23:13:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33400000000000002},"min":{"1min":0.28399999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.36099999999999999},"min":{"1min":0.25600000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.47899999999999998}]},{"osd":2,"last update":"Wed May 8 23:13:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed May 8 23:13:46 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.50800000000000001,"15min":0.503},"min":{"1min":0.36899999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.50900000000000001}]},{"osd":5,"last update":"Wed May 8 23:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69099999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.754},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.71599999999999997}]},{"osd":6,"last update":"Wed May 8 23:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Wed May 8 23:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.69799999999999995}]},{"osd":8,"last update":"Wed May 8 23:13:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.90400000000000003}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.407,"5min":2.407,"15min":2.407},"last":0.61799999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":5,"up_from":38,"seq":163208757278,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":1021350,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.624},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.47799999999999998}]},{"osd":1,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.66000000000000003}]},{"osd":2,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40000000000000002,"15min":0.39200000000000002},"min":{"1min":0.27700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.29499999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.497}]},{"osd":3,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.318,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59699999999999998}]},{"osd":4,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.498,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77200000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74199999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.63900000000000001}]},{"osd":6,"last update":"Wed May 8 23:14:25 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.48599999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.77200000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.752}]},{"osd":7,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.68600000000000005}]},{"osd":8,"last update":"Wed May 8 23:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.73999999999999999}]},{"osd":9,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.81999999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34240,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34240,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34240,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T23:14:31.498 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-08T23:14:31.499 INFO:tasks.cephadm:Setting up client nodes... 2024-05-08T23:14:31.499 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-08T23:14:31.751 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:32.177 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:31 smithi135 ceph-mon[42440]: pgmap v228: 97 pgs: 97 active+clean; 583 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5.6 KiB/s wr, 20 op/s 2024-05-08T23:14:32.178 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:31 smithi135 ceph-mon[42440]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:14:32.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:31 smithi179 ceph-mon[46314]: pgmap v228: 97 pgs: 97 active+clean; 583 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5.6 KiB/s wr, 20 op/s 2024-05-08T23:14:32.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:31 smithi179 ceph-mon[46314]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:14:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:31 smithi195 ceph-mon[46516]: pgmap v228: 97 pgs: 97 active+clean; 583 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5.6 KiB/s wr, 20 op/s 2024-05-08T23:14:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:31 smithi195 ceph-mon[46516]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:14:32.380 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:14:32 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-i[84605]: 2024-05-08T23:14:32.061+0000 7fecfd07f700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-05-08T23:14:32.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.729+0000 7faa3917c700 1 -- 172.21.15.135:0/2508810534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa34101170 msgr2=0x7faa341015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:32.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.729+0000 7faa3917c700 1 --2- 172.21.15.135:0/2508810534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa34101170 0x7faa341015d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faa240099c0 tx=0x7faa24009cd0 comp rx=0 tx=0).stop 2024-05-08T23:14:32.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.729+0000 7faa3917c700 1 -- 172.21.15.135:0/2508810534 shutdown_connections 2024-05-08T23:14:32.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.729+0000 7faa3917c700 1 --2- 172.21.15.135:0/2508810534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa340fff70 0x7faa34100390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:32.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.729+0000 7faa3917c700 1 --2- 172.21.15.135:0/2508810534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa34101b10 0x7faa341083c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:32.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.729+0000 7faa3917c700 1 --2- 172.21.15.135:0/2508810534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa34101170 0x7faa341015d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:32.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.729+0000 7faa3917c700 1 -- 172.21.15.135:0/2508810534 >> 172.21.15.135:0/2508810534 conn(0x7faa340fb530 msgr2=0x7faa340fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:32.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.729+0000 7faa3917c700 1 -- 172.21.15.135:0/2508810534 shutdown_connections 2024-05-08T23:14:32.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.729+0000 7faa3917c700 1 -- 172.21.15.135:0/2508810534 wait complete. 2024-05-08T23:14:32.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.730+0000 7faa3917c700 1 Processor -- start 2024-05-08T23:14:32.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.730+0000 7faa3917c700 1 -- start start 2024-05-08T23:14:32.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.730+0000 7faa3917c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa340fff70 0x7faa34196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:32.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.730+0000 7faa3917c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa34101170 0x7faa341974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:32.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.730+0000 7faa3917c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa34101b10 0x7faa3419e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:32.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.730+0000 7faa3917c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3419ea60 con 0x7faa34101170 2024-05-08T23:14:32.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.730+0000 7faa3917c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3419eba0 con 0x7faa34101b10 2024-05-08T23:14:32.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.730+0000 7faa3917c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3419ed30 con 0x7faa340fff70 2024-05-08T23:14:32.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.730+0000 7faa3259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa34101170 0x7faa341974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:32.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.730+0000 7faa3259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa34101170 0x7faa341974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54948/0 (socket says 172.21.15.135:54948) 2024-05-08T23:14:32.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.730+0000 7faa3259c700 1 -- 172.21.15.135:0/3393294980 learned_addr learned my addr 172.21.15.135:0/3393294980 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:32.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.731+0000 7faa3359e700 1 --2- 172.21.15.135:0/3393294980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa34101b10 0x7faa3419e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:32.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.731+0000 7faa32d9d700 1 --2- 172.21.15.135:0/3393294980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa340fff70 0x7faa34196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:32.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.731+0000 7faa3259c700 1 -- 172.21.15.135:0/3393294980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa340fff70 msgr2=0x7faa34196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:32.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.731+0000 7faa3259c700 1 --2- 172.21.15.135:0/3393294980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa340fff70 0x7faa34196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:32.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.731+0000 7faa3259c700 1 -- 172.21.15.135:0/3393294980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa34101b10 msgr2=0x7faa3419e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:32.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.731+0000 7faa3259c700 1 --2- 172.21.15.135:0/3393294980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa34101b10 0x7faa3419e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:32.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.731+0000 7faa3259c700 1 -- 172.21.15.135:0/3393294980 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa240095f0 con 0x7faa34101170 2024-05-08T23:14:32.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.731+0000 7faa3259c700 1 --2- 172.21.15.135:0/3393294980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa34101170 0x7faa341974b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faa24005910 tx=0x7faa240047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:32.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.731+0000 7faa1bfff700 1 -- 172.21.15.135:0/3393294980 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2401d070 con 0x7faa34101170 2024-05-08T23:14:32.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.731+0000 7faa3917c700 1 -- 172.21.15.135:0/3393294980 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa3419efb0 con 0x7faa34101170 2024-05-08T23:14:32.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.731+0000 7faa1bfff700 1 -- 172.21.15.135:0/3393294980 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa240041c0 con 0x7faa34101170 2024-05-08T23:14:32.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.731+0000 7faa3917c700 1 -- 172.21.15.135:0/3393294980 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3419f3d0 con 0x7faa34101170 2024-05-08T23:14:32.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.731+0000 7faa1bfff700 1 -- 172.21.15.135:0/3393294980 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2400f460 con 0x7faa34101170 2024-05-08T23:14:32.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.732+0000 7faa3917c700 1 -- 172.21.15.135:0/3393294980 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa3404ec60 con 0x7faa34101170 2024-05-08T23:14:32.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.733+0000 7faa1bfff700 1 -- 172.21.15.135:0/3393294980 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7faa240225e0 con 0x7faa34101170 2024-05-08T23:14:32.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.734+0000 7faa1bfff700 1 --2- 172.21.15.135:0/3393294980 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7faa1c0a11b0 0x7faa1c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:32.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.734+0000 7faa32d9d700 1 --2- 172.21.15.135:0/3393294980 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7faa1c0a11b0 0x7faa1c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:32.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.734+0000 7faa1bfff700 1 -- 172.21.15.135:0/3393294980 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7faa240ce020 con 0x7faa34101170 2024-05-08T23:14:32.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.734+0000 7faa32d9d700 1 --2- 172.21.15.135:0/3393294980 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7faa1c0a11b0 0x7faa1c0a3670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faa28005fd0 tx=0x7faa28005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:32.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:32.738+0000 7faa1bfff700 1 -- 172.21.15.135:0/3393294980 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7faa24097810 con 0x7faa34101170 2024-05-08T23:14:33.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:33.013+0000 7faa3917c700 1 -- 172.21.15.135:0/3393294980 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7faa3410b820 con 0x7faa34101170 2024-05-08T23:14:33.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:33.017+0000 7faa1bfff700 1 -- 172.21.15.135:0/3393294980 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7faa24031050 con 0x7faa34101170 2024-05-08T23:14:33.017 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2024-05-08T23:14:33.017 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBZBzxmsxrcABAASIW3pJRHGKHH0LoHImZfnw== 2024-05-08T23:14:33.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:33.019+0000 7faa3917c700 1 -- 172.21.15.135:0/3393294980 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7faa1c0a11b0 msgr2=0x7faa1c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:33.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:33.019+0000 7faa3917c700 1 --2- 172.21.15.135:0/3393294980 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7faa1c0a11b0 0x7faa1c0a3670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faa28005fd0 tx=0x7faa28005dd0 comp rx=0 tx=0).stop 2024-05-08T23:14:33.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:33.019+0000 7faa3917c700 1 -- 172.21.15.135:0/3393294980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa34101170 msgr2=0x7faa341974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:33.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:33.019+0000 7faa3917c700 1 --2- 172.21.15.135:0/3393294980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa34101170 0x7faa341974b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faa24005910 tx=0x7faa240047b0 comp rx=0 tx=0).stop 2024-05-08T23:14:33.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:33.020+0000 7faa3917c700 1 -- 172.21.15.135:0/3393294980 shutdown_connections 2024-05-08T23:14:33.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:33.020+0000 7faa3917c700 1 --2- 172.21.15.135:0/3393294980 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7faa1c0a11b0 0x7faa1c0a3670 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:33.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:33.020+0000 7faa3917c700 1 --2- 172.21.15.135:0/3393294980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa340fff70 0x7faa34196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:33.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:33.020+0000 7faa3917c700 1 --2- 172.21.15.135:0/3393294980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa34101b10 0x7faa3419e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:33.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:33.020+0000 7faa3917c700 1 --2- 172.21.15.135:0/3393294980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa34101170 0x7faa341974b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:33.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:33.020+0000 7faa3917c700 1 -- 172.21.15.135:0/3393294980 >> 172.21.15.135:0/3393294980 conn(0x7faa340fb530 msgr2=0x7faa340fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:33.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:33.020+0000 7faa3917c700 1 -- 172.21.15.135:0/3393294980 shutdown_connections 2024-05-08T23:14:33.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:33.020+0000 7faa3917c700 1 -- 172.21.15.135:0/3393294980 wait complete. 2024-05-08T23:14:33.269 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:32 smithi135 ceph-mon[42440]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:14:33.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:32 smithi179 ceph-mon[46314]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:14:33.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:32 smithi195 ceph-mon[46516]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:14:33.492 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:14:33.492 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-08T23:14:33.492 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T23:14:33.532 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T23:14:33.532 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-08T23:14:33.532 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-08T23:14:33.794 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:34.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:33 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3393294980' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T23:14:34.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:33 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3393294980' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-08T23:14:34.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:33 smithi135 ceph-mon[42440]: pgmap v229: 97 pgs: 97 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 10 KiB/s wr, 28 op/s 2024-05-08T23:14:34.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:33 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3393294980' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T23:14:34.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:33 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3393294980' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-08T23:14:34.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:33 smithi179 ceph-mon[46314]: pgmap v229: 97 pgs: 97 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 10 KiB/s wr, 28 op/s 2024-05-08T23:14:34.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:33 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3393294980' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T23:14:34.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:33 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3393294980' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-08T23:14:34.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:33 smithi195 ceph-mon[46516]: pgmap v229: 97 pgs: 97 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 10 KiB/s wr, 28 op/s 2024-05-08T23:14:34.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.805+0000 7fe89c483700 1 -- 172.21.15.135:0/3964931735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe894101990 msgr2=0x7fe89410de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:34.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.805+0000 7fe89c483700 1 --2- 172.21.15.135:0/3964931735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe894101990 0x7fe89410de70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00b0a0 tx=0x7fe88c00b3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:34.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.805+0000 7fe89c483700 1 -- 172.21.15.135:0/3964931735 shutdown_connections 2024-05-08T23:14:34.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.805+0000 7fe89c483700 1 --2- 172.21.15.135:0/3964931735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe894101990 0x7fe89410de70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:34.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.805+0000 7fe89c483700 1 --2- 172.21.15.135:0/3964931735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe894107030 0x7fe894107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:34.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.805+0000 7fe89c483700 1 --2- 172.21.15.135:0/3964931735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe894100ff0 0x7fe894101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:34.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.805+0000 7fe89c483700 1 -- 172.21.15.135:0/3964931735 >> 172.21.15.135:0/3964931735 conn(0x7fe894078190 msgr2=0x7fe8940785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:34.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.805+0000 7fe89c483700 1 -- 172.21.15.135:0/3964931735 shutdown_connections 2024-05-08T23:14:34.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.805+0000 7fe89c483700 1 -- 172.21.15.135:0/3964931735 wait complete. 2024-05-08T23:14:34.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.805+0000 7fe89c483700 1 Processor -- start 2024-05-08T23:14:34.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.805+0000 7fe89c483700 1 -- start start 2024-05-08T23:14:34.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe89c483700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe894100ff0 0x7fe8941974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:34.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe89c483700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe894101990 0x7fe894197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:34.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe89c483700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe894107030 0x7fe89419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:34.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe89c483700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89419c3d0 con 0x7fe894101990 2024-05-08T23:14:34.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe89c483700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89419c540 con 0x7fe894100ff0 2024-05-08T23:14:34.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe89c483700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89419c700 con 0x7fe894107030 2024-05-08T23:14:34.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe899a1e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe894101990 0x7fe894197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:34.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe899a1e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe894101990 0x7fe894197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54970/0 (socket says 172.21.15.135:54970) 2024-05-08T23:14:34.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe899a1e700 1 -- 172.21.15.135:0/3949589945 learned_addr learned my addr 172.21.15.135:0/3949589945 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:34.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe89a21f700 1 --2- 172.21.15.135:0/3949589945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe894100ff0 0x7fe8941974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:34.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe89aa20700 1 --2- 172.21.15.135:0/3949589945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe894107030 0x7fe89419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:34.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe899a1e700 1 -- 172.21.15.135:0/3949589945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe894107030 msgr2=0x7fe89419bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:34.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe899a1e700 1 --2- 172.21.15.135:0/3949589945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe894107030 0x7fe89419bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:34.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe899a1e700 1 -- 172.21.15.135:0/3949589945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe894100ff0 msgr2=0x7fe8941974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:34.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe899a1e700 1 --2- 172.21.15.135:0/3949589945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe894100ff0 0x7fe8941974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:34.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe899a1e700 1 -- 172.21.15.135:0/3949589945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c009d00 con 0x7fe894101990 2024-05-08T23:14:34.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe899a1e700 1 --2- 172.21.15.135:0/3949589945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe894101990 0x7fe894197a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe88400c920 tx=0x7fe88400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:34.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe88b7fe700 1 -- 172.21.15.135:0/3949589945 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884004a30 con 0x7fe894101990 2024-05-08T23:14:34.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe88b7fe700 1 -- 172.21.15.135:0/3949589945 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe8840054e0 con 0x7fe894101990 2024-05-08T23:14:34.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe88b7fe700 1 -- 172.21.15.135:0/3949589945 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884007bd0 con 0x7fe894101990 2024-05-08T23:14:34.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.806+0000 7fe89c483700 1 -- 172.21.15.135:0/3949589945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89419c9e0 con 0x7fe894101990 2024-05-08T23:14:34.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.807+0000 7fe89c483700 1 -- 172.21.15.135:0/3949589945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8941a4240 con 0x7fe894101990 2024-05-08T23:14:34.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.807+0000 7fe89c483700 1 -- 172.21.15.135:0/3949589945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe894109550 con 0x7fe894101990 2024-05-08T23:14:34.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.808+0000 7fe88b7fe700 1 -- 172.21.15.135:0/3949589945 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fe884005000 con 0x7fe894101990 2024-05-08T23:14:34.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.809+0000 7fe88b7fe700 1 --2- 172.21.15.135:0/3949589945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe8800a1230 0x7fe8800a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:34.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.809+0000 7fe88b7fe700 1 -- 172.21.15.135:0/3949589945 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe8840cc390 con 0x7fe894101990 2024-05-08T23:14:34.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.809+0000 7fe89a21f700 1 --2- 172.21.15.135:0/3949589945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe8800a1230 0x7fe8800a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:34.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.809+0000 7fe89a21f700 1 --2- 172.21.15.135:0/3949589945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe8800a1230 0x7fe8800a36f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe890005950 tx=0x7fe89000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:34.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:34.814+0000 7fe88b7fe700 1 -- 172.21.15.135:0/3949589945 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe884095b70 con 0x7fe894101990 2024-05-08T23:14:35.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:35.061+0000 7fe89c483700 1 -- 172.21.15.135:0/3949589945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe8941987e0 con 0x7fe894101990 2024-05-08T23:14:35.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:35.065+0000 7fe88b7fe700 1 -- 172.21.15.135:0/3949589945 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260292 (secure 0 0 0) 0x7fe884099190 con 0x7fe894101990 2024-05-08T23:14:35.068 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:35.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:35.068+0000 7fe89c483700 1 -- 172.21.15.135:0/3949589945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe8800a1230 msgr2=0x7fe8800a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:35.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:35.068+0000 7fe89c483700 1 --2- 172.21.15.135:0/3949589945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe8800a1230 0x7fe8800a36f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe890005950 tx=0x7fe89000b410 comp rx=0 tx=0).stop 2024-05-08T23:14:35.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:35.068+0000 7fe89c483700 1 -- 172.21.15.135:0/3949589945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe894101990 msgr2=0x7fe894197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:35.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:35.068+0000 7fe89c483700 1 --2- 172.21.15.135:0/3949589945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe894101990 0x7fe894197a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe88400c920 tx=0x7fe88400cc30 comp rx=0 tx=0).stop 2024-05-08T23:14:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:35.068+0000 7fe89c483700 1 -- 172.21.15.135:0/3949589945 shutdown_connections 2024-05-08T23:14:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:35.069+0000 7fe89c483700 1 --2- 172.21.15.135:0/3949589945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe8800a1230 0x7fe8800a36f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:35.069+0000 7fe89c483700 1 --2- 172.21.15.135:0/3949589945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe894107030 0x7fe89419bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:35.069+0000 7fe89c483700 1 --2- 172.21.15.135:0/3949589945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe894100ff0 0x7fe8941974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:35.069+0000 7fe89c483700 1 --2- 172.21.15.135:0/3949589945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe894101990 0x7fe894197a10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:35.069+0000 7fe89c483700 1 -- 172.21.15.135:0/3949589945 >> 172.21.15.135:0/3949589945 conn(0x7fe894078190 msgr2=0x7fe8940ffe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:35.069+0000 7fe89c483700 1 -- 172.21.15.135:0/3949589945 shutdown_connections 2024-05-08T23:14:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:35.069+0000 7fe89c483700 1 -- 172.21.15.135:0/3949589945 wait complete. 2024-05-08T23:14:35.347 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:35 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3949589945' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-08T23:14:35.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:35 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3949589945' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-08T23:14:35.449 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1743116941},{"type":"v1","addr":"172.21.15.135:6801","nonce":1743116941}]},"active_addr":"172.21.15.135:6801/1743116941","active_change":"2024-05-08T23:09:20.971654+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.135:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2724343877}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":1864621858}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":653989776}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":268551726}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":505429755}]}]} 2024-05-08T23:14:35.453 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-08T23:14:35.454 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-08T23:14:35.454 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T23:14:35.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:35 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3949589945' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-08T23:14:35.678 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:36 smithi195 ceph-mon[46516]: pgmap v230: 97 pgs: 97 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.9 KiB/s wr, 24 op/s 2024-05-08T23:14:36.419 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:36 smithi135 ceph-mon[42440]: pgmap v230: 97 pgs: 97 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.9 KiB/s wr, 24 op/s 2024-05-08T23:14:36.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:36 smithi179 ceph-mon[46314]: pgmap v230: 97 pgs: 97 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.9 KiB/s wr, 24 op/s 2024-05-08T23:14:36.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.613+0000 7f7334807700 1 -- 172.21.15.135:0/2001454896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7330101990 msgr2=0x7f733010de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:36.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.613+0000 7f7334807700 1 --2- 172.21.15.135:0/2001454896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7330101990 0x7f733010de70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7328009990 tx=0x7f7328009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:36.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.613+0000 7f7334807700 1 -- 172.21.15.135:0/2001454896 shutdown_connections 2024-05-08T23:14:36.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.613+0000 7f7334807700 1 --2- 172.21.15.135:0/2001454896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7330107030 0x7f7330107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:36.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.613+0000 7f7334807700 1 --2- 172.21.15.135:0/2001454896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7330101990 0x7f733010de70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:36.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.613+0000 7f7334807700 1 --2- 172.21.15.135:0/2001454896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7330100ff0 0x7f7330101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:36.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.613+0000 7f7334807700 1 -- 172.21.15.135:0/2001454896 >> 172.21.15.135:0/2001454896 conn(0x7f7330078190 msgr2=0x7f73300785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:36.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.613+0000 7f7334807700 1 -- 172.21.15.135:0/2001454896 shutdown_connections 2024-05-08T23:14:36.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.613+0000 7f7334807700 1 -- 172.21.15.135:0/2001454896 wait complete. 2024-05-08T23:14:36.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.614+0000 7f7334807700 1 Processor -- start 2024-05-08T23:14:36.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.614+0000 7f7334807700 1 -- start start 2024-05-08T23:14:36.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f7334807700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7330100ff0 0x7f73301973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:36.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f7334807700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7330101990 0x7f7330197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:36.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f7334807700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7330107030 0x7f733019bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:36.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f7334807700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733019c2f0 con 0x7f7330100ff0 2024-05-08T23:14:36.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f7334807700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733019c460 con 0x7f7330101990 2024-05-08T23:14:36.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f7334807700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733019c620 con 0x7f7330107030 2024-05-08T23:14:36.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f732e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7330100ff0 0x7f73301973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:36.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f732e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7330100ff0 0x7f73301973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54980/0 (socket says 172.21.15.135:54980) 2024-05-08T23:14:36.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f732e59c700 1 -- 172.21.15.135:0/37816747 learned_addr learned my addr 172.21.15.135:0/37816747 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:36.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f732ed9d700 1 --2- 172.21.15.135:0/37816747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7330107030 0x7f733019bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:36.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f732e59c700 1 -- 172.21.15.135:0/37816747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7330107030 msgr2=0x7f733019bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:36.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f732e59c700 1 --2- 172.21.15.135:0/37816747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7330107030 0x7f733019bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:36.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f732dd9b700 1 --2- 172.21.15.135:0/37816747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7330101990 0x7f7330197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:36.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f732e59c700 1 -- 172.21.15.135:0/37816747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7330101990 msgr2=0x7f7330197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:36.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f732e59c700 1 --2- 172.21.15.135:0/37816747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7330101990 0x7f7330197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:36.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f732e59c700 1 -- 172.21.15.135:0/37816747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73280095f0 con 0x7f7330100ff0 2024-05-08T23:14:36.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f732e59c700 1 --2- 172.21.15.135:0/37816747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7330100ff0 0x7f73301973f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f73200060b0 tx=0x7f7320007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:36.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f731f7fe700 1 -- 172.21.15.135:0/37816747 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732000de20 con 0x7f7330100ff0 2024-05-08T23:14:36.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f731f7fe700 1 -- 172.21.15.135:0/37816747 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f732000f040 con 0x7f7330100ff0 2024-05-08T23:14:36.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f7334807700 1 -- 172.21.15.135:0/37816747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733019c900 con 0x7f7330100ff0 2024-05-08T23:14:36.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.615+0000 7f731f7fe700 1 -- 172.21.15.135:0/37816747 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73200146e0 con 0x7f7330100ff0 2024-05-08T23:14:36.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.616+0000 7f7334807700 1 -- 172.21.15.135:0/37816747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73301a4160 con 0x7f7330100ff0 2024-05-08T23:14:36.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.616+0000 7f7334807700 1 -- 172.21.15.135:0/37816747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7330109550 con 0x7f7330100ff0 2024-05-08T23:14:36.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.618+0000 7f731f7fe700 1 -- 172.21.15.135:0/37816747 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f7320015a30 con 0x7f7330100ff0 2024-05-08T23:14:36.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.618+0000 7f731f7fe700 1 --2- 172.21.15.135:0/37816747 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73180a11b0 0x7f73180a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:36.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.618+0000 7f732dd9b700 1 --2- 172.21.15.135:0/37816747 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73180a11b0 0x7f73180a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:36.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.618+0000 7f731f7fe700 1 -- 172.21.15.135:0/37816747 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f73200cc750 con 0x7f7330100ff0 2024-05-08T23:14:36.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.619+0000 7f732dd9b700 1 --2- 172.21.15.135:0/37816747 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73180a11b0 0x7f73180a3670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7324005950 tx=0x7f73240058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:36.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.622+0000 7f731f7fe700 1 -- 172.21.15.135:0/37816747 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7320095f30 con 0x7f7330100ff0 2024-05-08T23:14:36.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.815+0000 7f7334807700 1 -- 172.21.15.135:0/37816747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7330198700 con 0x7f7330100ff0 2024-05-08T23:14:36.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.816+0000 7f731f7fe700 1 -- 172.21.15.135:0/37816747 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22176 (secure 0 0 0) 0x7f7320024090 con 0x7f7330100ff0 2024-05-08T23:14:36.816 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:36.816 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":83,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:14:22.924945+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T23:14:19.726838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T23:14:21.097732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:14:36.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.819+0000 7f7334807700 1 -- 172.21.15.135:0/37816747 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73180a11b0 msgr2=0x7f73180a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:36.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.819+0000 7f7334807700 1 --2- 172.21.15.135:0/37816747 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73180a11b0 0x7f73180a3670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7324005950 tx=0x7f73240058e0 comp rx=0 tx=0).stop 2024-05-08T23:14:36.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.819+0000 7f7334807700 1 -- 172.21.15.135:0/37816747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7330100ff0 msgr2=0x7f73301973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:36.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.819+0000 7f7334807700 1 --2- 172.21.15.135:0/37816747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7330100ff0 0x7f73301973f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f73200060b0 tx=0x7f7320007f90 comp rx=0 tx=0).stop 2024-05-08T23:14:36.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.819+0000 7f7334807700 1 -- 172.21.15.135:0/37816747 shutdown_connections 2024-05-08T23:14:36.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.819+0000 7f7334807700 1 --2- 172.21.15.135:0/37816747 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73180a11b0 0x7f73180a3670 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:36.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.819+0000 7f7334807700 1 --2- 172.21.15.135:0/37816747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7330107030 0x7f733019bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:36.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.819+0000 7f7334807700 1 --2- 172.21.15.135:0/37816747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7330100ff0 0x7f73301973f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:36.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.819+0000 7f7334807700 1 --2- 172.21.15.135:0/37816747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7330101990 0x7f7330197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:36.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.819+0000 7f7334807700 1 -- 172.21.15.135:0/37816747 >> 172.21.15.135:0/37816747 conn(0x7f7330078190 msgr2=0x7f73300ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:36.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.819+0000 7f7334807700 1 -- 172.21.15.135:0/37816747 shutdown_connections 2024-05-08T23:14:36.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:36.819+0000 7f7334807700 1 -- 172.21.15.135:0/37816747 wait complete. 2024-05-08T23:14:37.182 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-08T23:14:37.182 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T23:14:37.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:37 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/37816747' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:37.408 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:37.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:37 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/37816747' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:37.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:37 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/37816747' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:38.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:38 smithi195 ceph-mon[46516]: pgmap v231: 97 pgs: 97 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.8 KiB/s wr, 25 op/s 2024-05-08T23:14:38.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.404+0000 7ff7004cc700 1 -- 172.21.15.135:0/198434585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f81001c0 msgr2=0x7ff6f8100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:38.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.404+0000 7ff7004cc700 1 --2- 172.21.15.135:0/198434585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f81001c0 0x7ff6f8100640 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40099c0 tx=0x7ff6f4009cd0 comp rx=0 tx=0).stop 2024-05-08T23:14:38.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.404+0000 7ff7004cc700 1 -- 172.21.15.135:0/198434585 shutdown_connections 2024-05-08T23:14:38.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.404+0000 7ff7004cc700 1 --2- 172.21.15.135:0/198434585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f8106040 0x7ff6f8106420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:38.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.404+0000 7ff7004cc700 1 --2- 172.21.15.135:0/198434585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6f8100b80 0x7ff6f810cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:38.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.404+0000 7ff7004cc700 1 --2- 172.21.15.135:0/198434585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f81001c0 0x7ff6f8100640 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:38.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.404+0000 7ff7004cc700 1 -- 172.21.15.135:0/198434585 >> 172.21.15.135:0/198434585 conn(0x7ff6f8076c40 msgr2=0x7ff6f8077050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:38.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.404+0000 7ff7004cc700 1 -- 172.21.15.135:0/198434585 shutdown_connections 2024-05-08T23:14:38.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.404+0000 7ff7004cc700 1 -- 172.21.15.135:0/198434585 wait complete. 2024-05-08T23:14:38.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff7004cc700 1 Processor -- start 2024-05-08T23:14:38.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff7004cc700 1 -- start start 2024-05-08T23:14:38.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff7004cc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6f81001c0 0x7ff6f81973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:38.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff7004cc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f8100b80 0x7ff6f81978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:38.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff7004cc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f8106040 0x7ff6f819bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:38.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff7004cc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f819c2a0 con 0x7ff6f8100b80 2024-05-08T23:14:38.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff7004cc700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f819c410 con 0x7ff6f81001c0 2024-05-08T23:14:38.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff7004cc700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f819c5d0 con 0x7ff6f8106040 2024-05-08T23:14:38.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff6fda67700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f8100b80 0x7ff6f81978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:38.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff6fda67700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f8100b80 0x7ff6f81978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60742/0 (socket says 172.21.15.135:60742) 2024-05-08T23:14:38.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff6fda67700 1 -- 172.21.15.135:0/2855740719 learned_addr learned my addr 172.21.15.135:0/2855740719 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:38.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff6fe268700 1 --2- 172.21.15.135:0/2855740719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6f81001c0 0x7ff6f81973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:38.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff6fea69700 1 --2- 172.21.15.135:0/2855740719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f8106040 0x7ff6f819bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:38.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff6fda67700 1 -- 172.21.15.135:0/2855740719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f8106040 msgr2=0x7ff6f819bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:38.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff6fda67700 1 --2- 172.21.15.135:0/2855740719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f8106040 0x7ff6f819bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:38.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff6fda67700 1 -- 172.21.15.135:0/2855740719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6f81001c0 msgr2=0x7ff6f81973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:38.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff6fda67700 1 --2- 172.21.15.135:0/2855740719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6f81001c0 0x7ff6f81973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:38.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff6fda67700 1 -- 172.21.15.135:0/2855740719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f40095f0 con 0x7ff6f8100b80 2024-05-08T23:14:38.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.405+0000 7ff6fe268700 1 --2- 172.21.15.135:0/2855740719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6f81001c0 0x7ff6f81973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:14:38.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.406+0000 7ff6fda67700 1 --2- 172.21.15.135:0/2855740719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f8100b80 0x7ff6f81978e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4005910 tx=0x7ff6f400f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:38.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.406+0000 7ff6ef7fe700 1 -- 172.21.15.135:0/2855740719 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f401d070 con 0x7ff6f8100b80 2024-05-08T23:14:38.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.406+0000 7ff6ef7fe700 1 -- 172.21.15.135:0/2855740719 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6f400fe80 con 0x7ff6f8100b80 2024-05-08T23:14:38.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.406+0000 7ff6ef7fe700 1 -- 172.21.15.135:0/2855740719 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f40037c0 con 0x7ff6f8100b80 2024-05-08T23:14:38.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.406+0000 7ff7004cc700 1 -- 172.21.15.135:0/2855740719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f819c850 con 0x7ff6f8100b80 2024-05-08T23:14:38.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.406+0000 7ff7004cc700 1 -- 172.21.15.135:0/2855740719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f81a4110 con 0x7ff6f8100b80 2024-05-08T23:14:38.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.407+0000 7ff7004cc700 1 -- 172.21.15.135:0/2855740719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f81093f0 con 0x7ff6f8100b80 2024-05-08T23:14:38.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.408+0000 7ff6ef7fe700 1 -- 172.21.15.135:0/2855740719 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7ff6f4022650 con 0x7ff6f8100b80 2024-05-08T23:14:38.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.408+0000 7ff6ef7fe700 1 --2- 172.21.15.135:0/2855740719 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff6e40a1230 0x7ff6e40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:38.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.408+0000 7ff6fe268700 1 --2- 172.21.15.135:0/2855740719 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff6e40a1230 0x7ff6e40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:38.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.408+0000 7ff6ef7fe700 1 -- 172.21.15.135:0/2855740719 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff6f40ce010 con 0x7ff6f8100b80 2024-05-08T23:14:38.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.409+0000 7ff6fe268700 1 --2- 172.21.15.135:0/2855740719 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff6e40a1230 0x7ff6e40a36f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8005950 tx=0x7ff6e8005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:38.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.412+0000 7ff6ef7fe700 1 -- 172.21.15.135:0/2855740719 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff6f4097880 con 0x7ff6f8100b80 2024-05-08T23:14:38.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:38 smithi135 ceph-mon[42440]: pgmap v231: 97 pgs: 97 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.8 KiB/s wr, 25 op/s 2024-05-08T23:14:38.602 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:38 smithi179 ceph-mon[46314]: pgmap v231: 97 pgs: 97 active+clean; 626 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.8 KiB/s wr, 25 op/s 2024-05-08T23:14:38.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.609+0000 7ff7004cc700 1 -- 172.21.15.135:0/2855740719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6f81986b0 con 0x7ff6f8100b80 2024-05-08T23:14:38.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.610+0000 7ff6ef7fe700 1 -- 172.21.15.135:0/2855740719 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22176 (secure 0 0 0) 0x7ff6f409aea0 con 0x7ff6f8100b80 2024-05-08T23:14:38.610 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:14:38.610 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":83,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:14:22.924945+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T23:14:19.726838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T23:14:21.097732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:14:38.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.612+0000 7ff7004cc700 1 -- 172.21.15.135:0/2855740719 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff6e40a1230 msgr2=0x7ff6e40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:38.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.612+0000 7ff7004cc700 1 --2- 172.21.15.135:0/2855740719 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff6e40a1230 0x7ff6e40a36f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8005950 tx=0x7ff6e8005f50 comp rx=0 tx=0).stop 2024-05-08T23:14:38.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.612+0000 7ff7004cc700 1 -- 172.21.15.135:0/2855740719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f8100b80 msgr2=0x7ff6f81978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:38.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.612+0000 7ff7004cc700 1 --2- 172.21.15.135:0/2855740719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f8100b80 0x7ff6f81978e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4005910 tx=0x7ff6f400f510 comp rx=0 tx=0).stop 2024-05-08T23:14:38.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.612+0000 7ff7004cc700 1 -- 172.21.15.135:0/2855740719 shutdown_connections 2024-05-08T23:14:38.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.612+0000 7ff7004cc700 1 --2- 172.21.15.135:0/2855740719 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff6e40a1230 0x7ff6e40a36f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:38.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.612+0000 7ff7004cc700 1 --2- 172.21.15.135:0/2855740719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f8106040 0x7ff6f819bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:38.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.612+0000 7ff7004cc700 1 --2- 172.21.15.135:0/2855740719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6f81001c0 0x7ff6f81973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:38.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.612+0000 7ff7004cc700 1 --2- 172.21.15.135:0/2855740719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f8100b80 0x7ff6f81978e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:38.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.612+0000 7ff7004cc700 1 -- 172.21.15.135:0/2855740719 >> 172.21.15.135:0/2855740719 conn(0x7ff6f8076c40 msgr2=0x7ff6f80698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:38.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.612+0000 7ff7004cc700 1 -- 172.21.15.135:0/2855740719 shutdown_connections 2024-05-08T23:14:38.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:38.612+0000 7ff7004cc700 1 -- 172.21.15.135:0/2855740719 wait complete. 2024-05-08T23:14:39.007 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-08T23:14:39.008 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-08T23:14:39.009 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-08T23:14:39.009 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-08T23:14:39.010 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-08T23:14:39.014 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-08T23:14:39.015 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-08T23:14:39.016 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-08T23:14:39.016 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-08T23:14:39.017 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-08T23:14:39.018 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-08T23:14:39.018 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-08T23:14:39.221 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:39 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2855740719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:39.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:39 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2855740719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:39.621 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:39.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:39 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2855740719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:14:39.941 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:40.368 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:40 smithi135 ceph-mon[42440]: pgmap v232: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 KiB/s wr, 23 op/s 2024-05-08T23:14:40.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:40 smithi179 ceph-mon[46314]: pgmap v232: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 KiB/s wr, 23 op/s 2024-05-08T23:14:40.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:40 smithi195 ceph-mon[46516]: pgmap v232: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 KiB/s wr, 23 op/s 2024-05-08T23:14:40.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.906+0000 7f76ca3da700 1 -- 172.21.15.135:0/722836322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76c40ffed0 msgr2=0x7f76c4100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:40.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.906+0000 7f76ca3da700 1 --2- 172.21.15.135:0/722836322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76c40ffed0 0x7f76c4100350 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009990 tx=0x7f76b8009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:40.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.906+0000 7f76ca3da700 1 -- 172.21.15.135:0/722836322 shutdown_connections 2024-05-08T23:14:40.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.906+0000 7f76ca3da700 1 --2- 172.21.15.135:0/722836322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76c4105f00 0x7f76c41062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:40.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.906+0000 7f76ca3da700 1 --2- 172.21.15.135:0/722836322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76c4100890 0x7f76c410cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:40.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.906+0000 7f76ca3da700 1 --2- 172.21.15.135:0/722836322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76c40ffed0 0x7f76c4100350 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:40.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.906+0000 7f76ca3da700 1 -- 172.21.15.135:0/722836322 >> 172.21.15.135:0/722836322 conn(0x7f76c4075f80 msgr2=0x7f76c4076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:40.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.906+0000 7f76ca3da700 1 -- 172.21.15.135:0/722836322 shutdown_connections 2024-05-08T23:14:40.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.906+0000 7f76ca3da700 1 -- 172.21.15.135:0/722836322 wait complete. 2024-05-08T23:14:40.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.906+0000 7f76ca3da700 1 Processor -- start 2024-05-08T23:14:40.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.906+0000 7f76ca3da700 1 -- start start 2024-05-08T23:14:40.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76ca3da700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76c40ffed0 0x7f76c4197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:40.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76ca3da700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76c4100890 0x7f76c4197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:40.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76ca3da700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76c4105f00 0x7f76c419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:40.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76ca3da700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c419c2c0 con 0x7f76c4100890 2024-05-08T23:14:40.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76ca3da700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c419c430 con 0x7f76c4105f00 2024-05-08T23:14:40.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76ca3da700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c419c5f0 con 0x7f76c40ffed0 2024-05-08T23:14:40.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76c3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76c40ffed0 0x7f76c4197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:40.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76c37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76c4100890 0x7f76c4197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:40.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76c3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76c40ffed0 0x7f76c4197410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.135:57222/0 (socket says 172.21.15.135:57222) 2024-05-08T23:14:40.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76c37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76c4100890 0x7f76c4197950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60754/0 (socket says 172.21.15.135:60754) 2024-05-08T23:14:40.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76c3fff700 1 -- 172.21.15.135:0/479914202 learned_addr learned my addr 172.21.15.135:0/479914202 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:40.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76c8977700 1 --2- 172.21.15.135:0/479914202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76c4105f00 0x7f76c419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:40.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76c37fe700 1 -- 172.21.15.135:0/479914202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76c40ffed0 msgr2=0x7f76c4197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:40.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76c37fe700 1 --2- 172.21.15.135:0/479914202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76c40ffed0 0x7f76c4197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:40.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76c37fe700 1 -- 172.21.15.135:0/479914202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76c4105f00 msgr2=0x7f76c419bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:40.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76c37fe700 1 --2- 172.21.15.135:0/479914202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76c4105f00 0x7f76c419bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:40.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76c37fe700 1 -- 172.21.15.135:0/479914202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b80095f0 con 0x7f76c4100890 2024-05-08T23:14:40.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76c8977700 1 --2- 172.21.15.135:0/479914202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76c4105f00 0x7f76c419bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:14:40.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.907+0000 7f76c37fe700 1 --2- 172.21.15.135:0/479914202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76c4100890 0x7f76c4197950 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f76b80059d0 tx=0x7f76b800f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:40.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.908+0000 7f76c17fa700 1 -- 172.21.15.135:0/479914202 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b801d070 con 0x7f76c4100890 2024-05-08T23:14:40.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.908+0000 7f76ca3da700 1 -- 172.21.15.135:0/479914202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c419c870 con 0x7f76c4100890 2024-05-08T23:14:40.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.908+0000 7f76c17fa700 1 -- 172.21.15.135:0/479914202 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76b800fbb0 con 0x7f76c4100890 2024-05-08T23:14:40.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.908+0000 7f76c17fa700 1 -- 172.21.15.135:0/479914202 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b8017650 con 0x7f76c4100890 2024-05-08T23:14:40.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.908+0000 7f76ca3da700 1 -- 172.21.15.135:0/479914202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c41a4130 con 0x7f76c4100890 2024-05-08T23:14:40.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.909+0000 7f76ca3da700 1 -- 172.21.15.135:0/479914202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76c41111c0 con 0x7f76c4100890 2024-05-08T23:14:40.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.910+0000 7f76c17fa700 1 -- 172.21.15.135:0/479914202 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f76b800fd20 con 0x7f76c4100890 2024-05-08T23:14:40.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.910+0000 7f76c17fa700 1 --2- 172.21.15.135:0/479914202 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f76ac0a11b0 0x7f76ac0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:40.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.911+0000 7f76c3fff700 1 --2- 172.21.15.135:0/479914202 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f76ac0a11b0 0x7f76ac0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:40.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.911+0000 7f76c17fa700 1 -- 172.21.15.135:0/479914202 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f76b80ce720 con 0x7f76c4100890 2024-05-08T23:14:40.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.911+0000 7f76c17fa700 1 --2- 172.21.15.135:0/479914202 >> [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232] conn(0x7f76ac0aa990 0x7f76ac0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:40.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.911+0000 7f76c17fa700 1 -- 172.21.15.135:0/479914202 --> [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76ac0ad460 con 0x7f76ac0aa990 2024-05-08T23:14:40.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.911+0000 7f76c17fa700 1 -- 172.21.15.135:0/479914202 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76b80cebc0 con 0x7f76c4100890 2024-05-08T23:14:40.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.911+0000 7f76c3fff700 1 --2- 172.21.15.135:0/479914202 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f76ac0a11b0 0x7f76ac0a3670 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f76b400aca0 tx=0x7f76b4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:40.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.911+0000 7f76c8977700 1 --2- 172.21.15.135:0/479914202 >> [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232] conn(0x7f76ac0aa990 0x7f76ac0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:40.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.912+0000 7f76c8977700 1 --2- 172.21.15.135:0/479914202 >> [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232] conn(0x7f76ac0aa990 0x7f76ac0acdb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:40.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.912+0000 7f76c17fa700 1 -- 172.21.15.135:0/479914202 <== osd.2 v2:172.21.15.195:6800/1615315232 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f76ac0ad460 con 0x7f76ac0aa990 2024-05-08T23:14:40.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.929+0000 7f76ca3da700 1 -- 172.21.15.135:0/479914202 --> [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76c4061620 con 0x7f76ac0aa990 2024-05-08T23:14:40.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.929+0000 7f76c17fa700 1 -- 172.21.15.135:0/479914202 <== osd.2 v2:172.21.15.195:6800/1615315232 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f76c4061620 con 0x7f76ac0aa990 2024-05-08T23:14:40.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.930+0000 7f76ca3da700 1 -- 172.21.15.135:0/479914202 >> [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232] conn(0x7f76ac0aa990 msgr2=0x7f76ac0acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:40.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.930+0000 7f76ca3da700 1 --2- 172.21.15.135:0/479914202 >> [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232] conn(0x7f76ac0aa990 0x7f76ac0acdb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:40.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.930+0000 7f76ca3da700 1 -- 172.21.15.135:0/479914202 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f76ac0a11b0 msgr2=0x7f76ac0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:40.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.930+0000 7f76ca3da700 1 --2- 172.21.15.135:0/479914202 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f76ac0a11b0 0x7f76ac0a3670 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f76b400aca0 tx=0x7f76b4005f90 comp rx=0 tx=0).stop 2024-05-08T23:14:40.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.930+0000 7f76ca3da700 1 -- 172.21.15.135:0/479914202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76c4100890 msgr2=0x7f76c4197950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:40.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.930+0000 7f76ca3da700 1 --2- 172.21.15.135:0/479914202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76c4100890 0x7f76c4197950 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f76b80059d0 tx=0x7f76b800f700 comp rx=0 tx=0).stop 2024-05-08T23:14:40.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.930+0000 7f76c8977700 1 -- 172.21.15.135:0/479914202 reap_dead start 2024-05-08T23:14:40.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.930+0000 7f76ca3da700 1 -- 172.21.15.135:0/479914202 shutdown_connections 2024-05-08T23:14:40.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.930+0000 7f76ca3da700 1 -- 172.21.15.135:0/479914202 >> 172.21.15.135:0/479914202 conn(0x7f76c4075f80 msgr2=0x7f76c40fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:40.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.930+0000 7f76ca3da700 1 -- 172.21.15.135:0/479914202 shutdown_connections 2024-05-08T23:14:40.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:40.930+0000 7f76ca3da700 1 -- 172.21.15.135:0/479914202 wait complete. 2024-05-08T23:14:40.982 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:41.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.355+0000 7f9a064cc700 1 -- 172.21.15.135:0/1913941908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a00101990 msgr2=0x7f9a0010de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:41.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.355+0000 7f9a064cc700 1 --2- 172.21.15.135:0/1913941908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a00101990 0x7f9a0010de70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f99f800b0a0 tx=0x7f99f800b3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:41.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.355+0000 7f9a064cc700 1 -- 172.21.15.135:0/1913941908 shutdown_connections 2024-05-08T23:14:41.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.355+0000 7f9a064cc700 1 --2- 172.21.15.135:0/1913941908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a00107030 0x7f9a00107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:41.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.355+0000 7f9a064cc700 1 --2- 172.21.15.135:0/1913941908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a00101990 0x7f9a0010de70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:41.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.355+0000 7f9a064cc700 1 --2- 172.21.15.135:0/1913941908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a00100ff0 0x7f9a00101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:41.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.355+0000 7f9a064cc700 1 -- 172.21.15.135:0/1913941908 >> 172.21.15.135:0/1913941908 conn(0x7f9a00078190 msgr2=0x7f9a000785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:41.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.355+0000 7f9a064cc700 1 -- 172.21.15.135:0/1913941908 shutdown_connections 2024-05-08T23:14:41.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.355+0000 7f9a064cc700 1 -- 172.21.15.135:0/1913941908 wait complete. 2024-05-08T23:14:41.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.355+0000 7f9a064cc700 1 Processor -- start 2024-05-08T23:14:41.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.355+0000 7f9a064cc700 1 -- start start 2024-05-08T23:14:41.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a064cc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a00100ff0 0x7f9a000732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:41.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a064cc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a00101990 0x7f9a000737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:41.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a064cc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a00107030 0x7f9a00073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:41.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a064cc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a001a5830 con 0x7f9a00107030 2024-05-08T23:14:41.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a064cc700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a001a59a0 con 0x7f9a00100ff0 2024-05-08T23:14:41.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a064cc700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a001a5b60 con 0x7f9a00101990 2024-05-08T23:14:41.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a04a69700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a00107030 0x7f9a00073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:41.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a04a69700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a00107030 0x7f9a00073d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60784/0 (socket says 172.21.15.135:60784) 2024-05-08T23:14:41.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a04a69700 1 -- 172.21.15.135:0/3174930308 learned_addr learned my addr 172.21.15.135:0/3174930308 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:41.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f99ff7fe700 1 --2- 172.21.15.135:0/3174930308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a00101990 0x7f9a000737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:41.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f99fffff700 1 --2- 172.21.15.135:0/3174930308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a00100ff0 0x7f9a000732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:41.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a04a69700 1 -- 172.21.15.135:0/3174930308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a00101990 msgr2=0x7f9a000737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:41.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a04a69700 1 --2- 172.21.15.135:0/3174930308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a00101990 0x7f9a000737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:41.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a04a69700 1 -- 172.21.15.135:0/3174930308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a00100ff0 msgr2=0x7f9a000732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:41.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a04a69700 1 --2- 172.21.15.135:0/3174930308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a00100ff0 0x7f9a000732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:41.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a04a69700 1 -- 172.21.15.135:0/3174930308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f8009d00 con 0x7f9a00107030 2024-05-08T23:14:41.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a04a69700 1 --2- 172.21.15.135:0/3174930308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a00107030 0x7f9a00073d20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f99f800b830 tx=0x7f99f8007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:41.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f99fd7fa700 1 -- 172.21.15.135:0/3174930308 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f800e040 con 0x7f9a00107030 2024-05-08T23:14:41.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f99fd7fa700 1 -- 172.21.15.135:0/3174930308 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99f8004c60 con 0x7f9a00107030 2024-05-08T23:14:41.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f99fd7fa700 1 -- 172.21.15.135:0/3174930308 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f80052a0 con 0x7f9a00107030 2024-05-08T23:14:41.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.356+0000 7f9a064cc700 1 -- 172.21.15.135:0/3174930308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a001a5de0 con 0x7f9a00107030 2024-05-08T23:14:41.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.357+0000 7f9a064cc700 1 -- 172.21.15.135:0/3174930308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a001a6200 con 0x7f9a00107030 2024-05-08T23:14:41.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.357+0000 7f9a064cc700 1 -- 172.21.15.135:0/3174930308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a001026e0 con 0x7f9a00107030 2024-05-08T23:14:41.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.359+0000 7f99fd7fa700 1 -- 172.21.15.135:0/3174930308 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f99f801b450 con 0x7f9a00107030 2024-05-08T23:14:41.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.359+0000 7f99fd7fa700 1 --2- 172.21.15.135:0/3174930308 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f99e80a11b0 0x7f99e80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:41.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.359+0000 7f99fffff700 1 --2- 172.21.15.135:0/3174930308 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f99e80a11b0 0x7f99e80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:41.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.359+0000 7f99fd7fa700 1 -- 172.21.15.135:0/3174930308 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f99f80ce350 con 0x7f9a00107030 2024-05-08T23:14:41.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.359+0000 7f99fd7fa700 1 --2- 172.21.15.135:0/3174930308 >> [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982] conn(0x7f99e80aa990 0x7f99e80acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:41.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.359+0000 7f99fd7fa700 1 -- 172.21.15.135:0/3174930308 --> [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99e80ad460 con 0x7f99e80aa990 2024-05-08T23:14:41.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.359+0000 7f99fd7fa700 1 -- 172.21.15.135:0/3174930308 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99f80ce7f0 con 0x7f9a00107030 2024-05-08T23:14:41.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.360+0000 7f99ff7fe700 1 --2- 172.21.15.135:0/3174930308 >> [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982] conn(0x7f99e80aa990 0x7f99e80acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:41.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.360+0000 7f99fffff700 1 --2- 172.21.15.135:0/3174930308 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f99e80a11b0 0x7f99e80a3670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f99f0005950 tx=0x7f99f000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:41.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.360+0000 7f99ff7fe700 1 --2- 172.21.15.135:0/3174930308 >> [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982] conn(0x7f99e80aa990 0x7f99e80acdb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:41.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.361+0000 7f99fd7fa700 1 -- 172.21.15.135:0/3174930308 <== osd.0 v2:172.21.15.135:6802/2658342982 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f99e80ad460 con 0x7f99e80aa990 2024-05-08T23:14:41.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.377+0000 7f9a064cc700 1 -- 172.21.15.135:0/3174930308 --> [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a001111a0 con 0x7f99e80aa990 2024-05-08T23:14:41.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.378+0000 7f99fd7fa700 1 -- 172.21.15.135:0/3174930308 <== osd.0 v2:172.21.15.135:6802/2658342982 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9a001111a0 con 0x7f99e80aa990 2024-05-08T23:14:41.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.378+0000 7f9a064cc700 1 -- 172.21.15.135:0/3174930308 >> [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982] conn(0x7f99e80aa990 msgr2=0x7f99e80acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:41.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.378+0000 7f9a064cc700 1 --2- 172.21.15.135:0/3174930308 >> [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982] conn(0x7f99e80aa990 0x7f99e80acdb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:41.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.378+0000 7f9a064cc700 1 -- 172.21.15.135:0/3174930308 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f99e80a11b0 msgr2=0x7f99e80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:41.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.378+0000 7f9a064cc700 1 --2- 172.21.15.135:0/3174930308 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f99e80a11b0 0x7f99e80a3670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f99f0005950 tx=0x7f99f000a300 comp rx=0 tx=0).stop 2024-05-08T23:14:41.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.378+0000 7f9a064cc700 1 -- 172.21.15.135:0/3174930308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a00107030 msgr2=0x7f9a00073d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:41.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.378+0000 7f9a064cc700 1 --2- 172.21.15.135:0/3174930308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a00107030 0x7f9a00073d20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f99f800b830 tx=0x7f99f8007870 comp rx=0 tx=0).stop 2024-05-08T23:14:41.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.378+0000 7f9a04a69700 1 -- 172.21.15.135:0/3174930308 reap_dead start 2024-05-08T23:14:41.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.378+0000 7f9a064cc700 1 -- 172.21.15.135:0/3174930308 shutdown_connections 2024-05-08T23:14:41.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.378+0000 7f9a064cc700 1 -- 172.21.15.135:0/3174930308 >> 172.21.15.135:0/3174930308 conn(0x7f9a00078190 msgr2=0x7f9a000ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:41.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.378+0000 7f9a064cc700 1 -- 172.21.15.135:0/3174930308 shutdown_connections 2024-05-08T23:14:41.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:41.378+0000 7f9a064cc700 1 -- 172.21.15.135:0/3174930308 wait complete. 2024-05-08T23:14:41.788 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:41.811 INFO:teuthology.orchestra.run.smithi135.stdout:34359738421 2024-05-08T23:14:41.812 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-08T23:14:42.014 INFO:teuthology.orchestra.run.smithi135.stdout:77309411372 2024-05-08T23:14:42.015 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-08T23:14:42.142 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:42.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:42 smithi135 ceph-mon[42440]: pgmap v233: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 18 op/s 2024-05-08T23:14:42.545 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:42.545 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:42.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:42 smithi179 ceph-mon[46314]: pgmap v233: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 18 op/s 2024-05-08T23:14:42.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:42 smithi195 ceph-mon[46516]: pgmap v233: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 18 op/s 2024-05-08T23:14:42.998 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:43.149 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:43.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.469+0000 7f7dbd537700 1 -- 172.21.15.135:0/2064489052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7db8100570 msgr2=0x7f7db8105cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:43.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.469+0000 7f7dbd537700 1 --2- 172.21.15.135:0/2064489052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7db8100570 0x7f7db8105cb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009990 tx=0x7f7dac009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:43.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.469+0000 7f7dbd537700 1 -- 172.21.15.135:0/2064489052 shutdown_connections 2024-05-08T23:14:43.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.469+0000 7f7dbd537700 1 --2- 172.21.15.135:0/2064489052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7db80ffbc0 0x7f7db80fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:43.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.469+0000 7f7dbd537700 1 --2- 172.21.15.135:0/2064489052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db81063e0 0x7f7db810dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:43.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.469+0000 7f7dbd537700 1 --2- 172.21.15.135:0/2064489052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7db8100570 0x7f7db8105cb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:43.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.469+0000 7f7dbd537700 1 -- 172.21.15.135:0/2064489052 >> 172.21.15.135:0/2064489052 conn(0x7f7db8075190 msgr2=0x7f7db80755a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:43.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.469+0000 7f7dbd537700 1 -- 172.21.15.135:0/2064489052 shutdown_connections 2024-05-08T23:14:43.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.469+0000 7f7dbd537700 1 -- 172.21.15.135:0/2064489052 wait complete. 2024-05-08T23:14:43.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7dbd537700 1 Processor -- start 2024-05-08T23:14:43.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7dbd537700 1 -- start start 2024-05-08T23:14:43.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7dbd537700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7db80ffbc0 0x7f7db8100b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:43.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7dbd537700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7db8100570 0x7f7db8101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:43.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7dbd537700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db81063e0 0x7f7db81015c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:43.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7dbd537700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db81a57b0 con 0x7f7db8100570 2024-05-08T23:14:43.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7dbd537700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db81a5920 con 0x7f7db81063e0 2024-05-08T23:14:43.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7dbd537700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db81a5ae0 con 0x7f7db80ffbc0 2024-05-08T23:14:43.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7db67fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7db8100570 0x7f7db8101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:43.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7db67fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7db8100570 0x7f7db8101080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60792/0 (socket says 172.21.15.135:60792) 2024-05-08T23:14:43.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7db67fc700 1 -- 172.21.15.135:0/4231614111 learned_addr learned my addr 172.21.15.135:0/4231614111 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:43.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7db77fe700 1 --2- 172.21.15.135:0/4231614111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db81063e0 0x7f7db81015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:43.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7db6ffd700 1 --2- 172.21.15.135:0/4231614111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7db80ffbc0 0x7f7db8100b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:43.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7db67fc700 1 -- 172.21.15.135:0/4231614111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7db80ffbc0 msgr2=0x7f7db8100b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:43.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7db67fc700 1 --2- 172.21.15.135:0/4231614111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7db80ffbc0 0x7f7db8100b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:43.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7db67fc700 1 -- 172.21.15.135:0/4231614111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db81063e0 msgr2=0x7f7db81015c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:43.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7db67fc700 1 --2- 172.21.15.135:0/4231614111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db81063e0 0x7f7db81015c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:43.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7db67fc700 1 -- 172.21.15.135:0/4231614111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0095f0 con 0x7f7db8100570 2024-05-08T23:14:43.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.470+0000 7f7db6ffd700 1 --2- 172.21.15.135:0/4231614111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7db80ffbc0 0x7f7db8100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:14:43.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.471+0000 7f7db67fc700 1 --2- 172.21.15.135:0/4231614111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7db8100570 0x7f7db8101080 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7dac005910 tx=0x7f7dac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:43.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.471+0000 7f7d9ffff700 1 -- 172.21.15.135:0/4231614111 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac01d070 con 0x7f7db8100570 2024-05-08T23:14:43.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.471+0000 7f7dbd537700 1 -- 172.21.15.135:0/4231614111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db81a5d60 con 0x7f7db8100570 2024-05-08T23:14:43.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.471+0000 7f7d9ffff700 1 -- 172.21.15.135:0/4231614111 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7dac005a00 con 0x7f7db8100570 2024-05-08T23:14:43.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.471+0000 7f7d9ffff700 1 -- 172.21.15.135:0/4231614111 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac022c20 con 0x7f7db8100570 2024-05-08T23:14:43.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.471+0000 7f7dbd537700 1 -- 172.21.15.135:0/4231614111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db81a6180 con 0x7f7db8100570 2024-05-08T23:14:43.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.471+0000 7f7dbd537700 1 -- 172.21.15.135:0/4231614111 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7db80690f0 con 0x7f7db8100570 2024-05-08T23:14:43.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.473+0000 7f7d9ffff700 1 -- 172.21.15.135:0/4231614111 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f7dac00f670 con 0x7f7db8100570 2024-05-08T23:14:43.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.474+0000 7f7d9ffff700 1 --2- 172.21.15.135:0/4231614111 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7da00a11b0 0x7f7da00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:43.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.474+0000 7f7db6ffd700 1 --2- 172.21.15.135:0/4231614111 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7da00a11b0 0x7f7da00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:43.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.474+0000 7f7d9ffff700 1 -- 172.21.15.135:0/4231614111 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7dac0ce7c0 con 0x7f7db8100570 2024-05-08T23:14:43.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.474+0000 7f7d9ffff700 1 --2- 172.21.15.135:0/4231614111 >> [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152] conn(0x7f7da00aa990 0x7f7da00acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:43.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.474+0000 7f7d9ffff700 1 -- 172.21.15.135:0/4231614111 --> [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7da00ad460 con 0x7f7da00aa990 2024-05-08T23:14:43.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.474+0000 7f7d9ffff700 1 -- 172.21.15.135:0/4231614111 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7dac0cec60 con 0x7f7db8100570 2024-05-08T23:14:43.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.474+0000 7f7db6ffd700 1 --2- 172.21.15.135:0/4231614111 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7da00a11b0 0x7f7da00a3670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7da8007900 tx=0x7f7da8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:43.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.474+0000 7f7db77fe700 1 --2- 172.21.15.135:0/4231614111 >> [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152] conn(0x7f7da00aa990 0x7f7da00acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:43.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.475+0000 7f7db77fe700 1 --2- 172.21.15.135:0/4231614111 >> [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152] conn(0x7f7da00aa990 0x7f7da00acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:43.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.475+0000 7f7d9ffff700 1 -- 172.21.15.135:0/4231614111 <== osd.1 v2:172.21.15.179:6800/3883295152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7da00ad460 con 0x7f7da00aa990 2024-05-08T23:14:43.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.491+0000 7f7dbd537700 1 -- 172.21.15.135:0/4231614111 --> [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7db80616e0 con 0x7f7da00aa990 2024-05-08T23:14:43.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.492+0000 7f7d9ffff700 1 -- 172.21.15.135:0/4231614111 <== osd.1 v2:172.21.15.179:6800/3883295152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7db80616e0 con 0x7f7da00aa990 2024-05-08T23:14:43.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.492+0000 7f7dbd537700 1 -- 172.21.15.135:0/4231614111 >> [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152] conn(0x7f7da00aa990 msgr2=0x7f7da00acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:43.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.492+0000 7f7dbd537700 1 --2- 172.21.15.135:0/4231614111 >> [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152] conn(0x7f7da00aa990 0x7f7da00acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:43.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.493+0000 7f7dbd537700 1 -- 172.21.15.135:0/4231614111 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7da00a11b0 msgr2=0x7f7da00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:43.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.493+0000 7f7dbd537700 1 --2- 172.21.15.135:0/4231614111 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7da00a11b0 0x7f7da00a3670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7da8007900 tx=0x7f7da8008040 comp rx=0 tx=0).stop 2024-05-08T23:14:43.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.493+0000 7f7dbd537700 1 -- 172.21.15.135:0/4231614111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7db8100570 msgr2=0x7f7db8101080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:43.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.493+0000 7f7dbd537700 1 --2- 172.21.15.135:0/4231614111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7db8100570 0x7f7db8101080 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7dac005910 tx=0x7f7dac004730 comp rx=0 tx=0).stop 2024-05-08T23:14:43.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.493+0000 7f7db77fe700 1 -- 172.21.15.135:0/4231614111 reap_dead start 2024-05-08T23:14:43.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.493+0000 7f7dbd537700 1 -- 172.21.15.135:0/4231614111 shutdown_connections 2024-05-08T23:14:43.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.493+0000 7f7dbd537700 1 -- 172.21.15.135:0/4231614111 >> 172.21.15.135:0/4231614111 conn(0x7f7db8075190 msgr2=0x7f7db80ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:43.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.493+0000 7f7dbd537700 1 -- 172.21.15.135:0/4231614111 shutdown_connections 2024-05-08T23:14:43.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:43.493+0000 7f7dbd537700 1 -- 172.21.15.135:0/4231614111 wait complete. 2024-05-08T23:14:43.704 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:43.905 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:44.156 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:44.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:44 smithi135 ceph-mon[42440]: pgmap v234: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 KiB/s wr, 18 op/s 2024-05-08T23:14:44.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:44 smithi179 ceph-mon[46314]: pgmap v234: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 KiB/s wr, 18 op/s 2024-05-08T23:14:44.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:44 smithi195 ceph-mon[46516]: pgmap v234: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 KiB/s wr, 18 op/s 2024-05-08T23:14:45.019 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:45.193 INFO:teuthology.orchestra.run.smithi135.stdout:55834574898 2024-05-08T23:14:45.194 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-08T23:14:46.434 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:46 smithi135 ceph-mon[42440]: pgmap v235: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-05-08T23:14:46.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:46 smithi179 ceph-mon[46314]: pgmap v235: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-05-08T23:14:46.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:46 smithi195 ceph-mon[46516]: pgmap v235: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-05-08T23:14:47.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.654+0000 7f8c006f5700 1 -- 172.21.15.135:0/1734792978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf81063c0 msgr2=0x7f8bf810dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:47.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.654+0000 7f8c006f5700 1 --2- 172.21.15.135:0/1734792978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf81063c0 0x7f8bf810dee0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000b0d0 tx=0x7f8bf000b3e0 comp rx=0 tx=0).stop 2024-05-08T23:14:47.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.655+0000 7f8c006f5700 1 -- 172.21.15.135:0/1734792978 shutdown_connections 2024-05-08T23:14:47.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.655+0000 7f8c006f5700 1 --2- 172.21.15.135:0/1734792978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf81063c0 0x7f8bf810dee0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:47.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.655+0000 7f8c006f5700 1 --2- 172.21.15.135:0/1734792978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bf80ffba0 0x7f8bf80fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:47.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.655+0000 7f8c006f5700 1 --2- 172.21.15.135:0/1734792978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bf8100550 0x7f8bf8105c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:47.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.655+0000 7f8c006f5700 1 -- 172.21.15.135:0/1734792978 >> 172.21.15.135:0/1734792978 conn(0x7f8bf8075260 msgr2=0x7f8bf8075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:47.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.655+0000 7f8c006f5700 1 -- 172.21.15.135:0/1734792978 shutdown_connections 2024-05-08T23:14:47.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.655+0000 7f8c006f5700 1 -- 172.21.15.135:0/1734792978 wait complete. 2024-05-08T23:14:47.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.655+0000 7f8c006f5700 1 Processor -- start 2024-05-08T23:14:47.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.655+0000 7f8c006f5700 1 -- start start 2024-05-08T23:14:47.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8c006f5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bf80ffba0 0x7f8bf8197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:47.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8c006f5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf8100550 0x7f8bf8197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:47.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8c006f5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bf81063c0 0x7f8bf819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:47.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8c006f5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf819c350 con 0x7f8bf8100550 2024-05-08T23:14:47.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8c006f5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf819c4c0 con 0x7f8bf81063c0 2024-05-08T23:14:47.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8c006f5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf819c680 con 0x7f8bf80ffba0 2024-05-08T23:14:47.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8bfdc90700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf8100550 0x7f8bf8197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:47.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8bfdc90700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf8100550 0x7f8bf8197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60810/0 (socket says 172.21.15.135:60810) 2024-05-08T23:14:47.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8bfdc90700 1 -- 172.21.15.135:0/3756574589 learned_addr learned my addr 172.21.15.135:0/3756574589 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:47.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8bfe491700 1 --2- 172.21.15.135:0/3756574589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bf80ffba0 0x7f8bf8197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:47.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8bfdc90700 1 -- 172.21.15.135:0/3756574589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bf80ffba0 msgr2=0x7f8bf8197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:47.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8bfdc90700 1 --2- 172.21.15.135:0/3756574589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bf80ffba0 0x7f8bf8197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:47.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8bfdc90700 1 -- 172.21.15.135:0/3756574589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bf81063c0 msgr2=0x7f8bf819bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:47.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8bfdc90700 1 --2- 172.21.15.135:0/3756574589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bf81063c0 0x7f8bf819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:47.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8bfdc90700 1 -- 172.21.15.135:0/3756574589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf0009d00 con 0x7f8bf8100550 2024-05-08T23:14:47.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8bfe491700 1 --2- 172.21.15.135:0/3756574589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bf80ffba0 0x7f8bf8197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:14:47.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8bfdc90700 1 --2- 172.21.15.135:0/3756574589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf8100550 0x7f8bf8197990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400d950 tx=0x7f8bf400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:47.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8bef7fe700 1 -- 172.21.15.135:0/3756574589 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4009b40 con 0x7f8bf8100550 2024-05-08T23:14:47.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8bef7fe700 1 -- 172.21.15.135:0/3756574589 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bf4009ca0 con 0x7f8bf8100550 2024-05-08T23:14:47.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.656+0000 7f8c006f5700 1 -- 172.21.15.135:0/3756574589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf819c960 con 0x7f8bf8100550 2024-05-08T23:14:47.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.657+0000 7f8bef7fe700 1 -- 172.21.15.135:0/3756574589 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf400f620 con 0x7f8bf8100550 2024-05-08T23:14:47.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.657+0000 7f8c006f5700 1 -- 172.21.15.135:0/3756574589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf81a41c0 con 0x7f8bf8100550 2024-05-08T23:14:47.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.657+0000 7f8c006f5700 1 -- 172.21.15.135:0/3756574589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8bf81111c0 con 0x7f8bf8100550 2024-05-08T23:14:47.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.659+0000 7f8bef7fe700 1 -- 172.21.15.135:0/3756574589 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f8bf4010460 con 0x7f8bf8100550 2024-05-08T23:14:47.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.659+0000 7f8bef7fe700 1 --2- 172.21.15.135:0/3756574589 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8be40a1230 0x7f8be40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:47.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.659+0000 7f8bfe491700 1 --2- 172.21.15.135:0/3756574589 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8be40a1230 0x7f8be40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:47.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.659+0000 7f8bef7fe700 1 -- 172.21.15.135:0/3756574589 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8bf40ccd10 con 0x7f8bf8100550 2024-05-08T23:14:47.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.659+0000 7f8bef7fe700 1 --2- 172.21.15.135:0/3756574589 >> [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951] conn(0x7f8be40aaa10 0x7f8be40ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:47.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.659+0000 7f8bef7fe700 1 -- 172.21.15.135:0/3756574589 --> [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8be40ad4e0 con 0x7f8be40aaa10 2024-05-08T23:14:47.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.659+0000 7f8bef7fe700 1 -- 172.21.15.135:0/3756574589 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bf40cd1b0 con 0x7f8bf8100550 2024-05-08T23:14:47.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.660+0000 7f8bfec92700 1 --2- 172.21.15.135:0/3756574589 >> [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951] conn(0x7f8be40aaa10 0x7f8be40ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:47.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.660+0000 7f8bfe491700 1 --2- 172.21.15.135:0/3756574589 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8be40a1230 0x7f8be40a36f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8be8005950 tx=0x7f8be80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:47.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.660+0000 7f8bfec92700 1 --2- 172.21.15.135:0/3756574589 >> [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951] conn(0x7f8be40aaa10 0x7f8be40ace30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:47.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.660+0000 7f8bef7fe700 1 -- 172.21.15.135:0/3756574589 <== osd.9 v2:172.21.15.135:6826/2141009951 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8be40ad4e0 con 0x7f8be40aaa10 2024-05-08T23:14:47.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.676+0000 7f8c006f5700 1 -- 172.21.15.135:0/3756574589 --> [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8bf8061620 con 0x7f8be40aaa10 2024-05-08T23:14:47.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.677+0000 7f8bef7fe700 1 -- 172.21.15.135:0/3756574589 <== osd.9 v2:172.21.15.135:6826/2141009951 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8bf8061620 con 0x7f8be40aaa10 2024-05-08T23:14:47.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.677+0000 7f8c006f5700 1 -- 172.21.15.135:0/3756574589 >> [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951] conn(0x7f8be40aaa10 msgr2=0x7f8be40ace30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:47.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.677+0000 7f8c006f5700 1 --2- 172.21.15.135:0/3756574589 >> [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951] conn(0x7f8be40aaa10 0x7f8be40ace30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:47.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.677+0000 7f8c006f5700 1 -- 172.21.15.135:0/3756574589 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8be40a1230 msgr2=0x7f8be40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:47.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.677+0000 7f8c006f5700 1 --2- 172.21.15.135:0/3756574589 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8be40a1230 0x7f8be40a36f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8be8005950 tx=0x7f8be80058e0 comp rx=0 tx=0).stop 2024-05-08T23:14:47.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.677+0000 7f8c006f5700 1 -- 172.21.15.135:0/3756574589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf8100550 msgr2=0x7f8bf8197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:47.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.677+0000 7f8c006f5700 1 --2- 172.21.15.135:0/3756574589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf8100550 0x7f8bf8197990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400d950 tx=0x7f8bf400dd10 comp rx=0 tx=0).stop 2024-05-08T23:14:47.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.677+0000 7f8bfec92700 1 -- 172.21.15.135:0/3756574589 reap_dead start 2024-05-08T23:14:47.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.677+0000 7f8c006f5700 1 -- 172.21.15.135:0/3756574589 shutdown_connections 2024-05-08T23:14:47.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.677+0000 7f8c006f5700 1 -- 172.21.15.135:0/3756574589 >> 172.21.15.135:0/3756574589 conn(0x7f8bf8075260 msgr2=0x7f8bf80fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:47.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.677+0000 7f8c006f5700 1 -- 172.21.15.135:0/3756574589 shutdown_connections 2024-05-08T23:14:47.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:47.677+0000 7f8c006f5700 1 -- 172.21.15.135:0/3756574589 wait complete. 2024-05-08T23:14:48.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.052+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/582052287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9df81019e0 msgr2=0x7f9df810ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:48.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.052+0000 7f9dfe7d3700 1 --2- 172.21.15.135:0/582052287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9df81019e0 0x7f9df810ddf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9df000b0a0 tx=0x7f9df000b3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:48.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.052+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/582052287 shutdown_connections 2024-05-08T23:14:48.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.052+0000 7f9dfe7d3700 1 --2- 172.21.15.135:0/582052287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9df81019e0 0x7f9df810ddf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:48.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.052+0000 7f9dfe7d3700 1 --2- 172.21.15.135:0/582052287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9df8107040 0x7f9df8107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:48.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.052+0000 7f9dfe7d3700 1 --2- 172.21.15.135:0/582052287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9df8101020 0x7f9df81014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:48.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.052+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/582052287 >> 172.21.15.135:0/582052287 conn(0x7f9df8078100 msgr2=0x7f9df8078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:48.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.052+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/582052287 shutdown_connections 2024-05-08T23:14:48.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.052+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/582052287 wait complete. 2024-05-08T23:14:48.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.052+0000 7f9dfe7d3700 1 Processor -- start 2024-05-08T23:14:48.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9dfe7d3700 1 -- start start 2024-05-08T23:14:48.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9dfe7d3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9df8101020 0x7f9df81974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:48.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9dfe7d3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9df81019e0 0x7f9df8197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:48.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9dfe7d3700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9df8107040 0x7f9df819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:48.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9dfe7d3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df819c3c0 con 0x7f9df8101020 2024-05-08T23:14:48.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9dfe7d3700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df819c530 con 0x7f9df8107040 2024-05-08T23:14:48.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9dfe7d3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df819c6f0 con 0x7f9df81019e0 2024-05-08T23:14:48.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9df7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9df8101020 0x7f9df81974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:48.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9df7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9df8101020 0x7f9df81974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60820/0 (socket says 172.21.15.135:60820) 2024-05-08T23:14:48.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9df7fff700 1 -- 172.21.15.135:0/2212169648 learned_addr learned my addr 172.21.15.135:0/2212169648 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:48.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9df77fe700 1 --2- 172.21.15.135:0/2212169648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9df81019e0 0x7f9df8197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:48.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9dfcd70700 1 --2- 172.21.15.135:0/2212169648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9df8107040 0x7f9df819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:48.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9df7fff700 1 -- 172.21.15.135:0/2212169648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9df81019e0 msgr2=0x7f9df8197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:48.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9df7fff700 1 --2- 172.21.15.135:0/2212169648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9df81019e0 0x7f9df8197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:48.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9df7fff700 1 -- 172.21.15.135:0/2212169648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9df8107040 msgr2=0x7f9df819bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:48.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9df7fff700 1 --2- 172.21.15.135:0/2212169648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9df8107040 0x7f9df819bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:48.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9df7fff700 1 -- 172.21.15.135:0/2212169648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df0009d00 con 0x7f9df8101020 2024-05-08T23:14:48.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.053+0000 7f9df77fe700 1 --2- 172.21.15.135:0/2212169648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9df81019e0 0x7f9df8197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:14:48.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.054+0000 7f9df7fff700 1 --2- 172.21.15.135:0/2212169648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9df8101020 0x7f9df81974c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00d950 tx=0x7f9dec00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:48.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.054+0000 7f9df57fa700 1 -- 172.21.15.135:0/2212169648 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec009b40 con 0x7f9df8101020 2024-05-08T23:14:48.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.054+0000 7f9df57fa700 1 -- 172.21.15.135:0/2212169648 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9dec009ca0 con 0x7f9df8101020 2024-05-08T23:14:48.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.054+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/2212169648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df819c9d0 con 0x7f9df8101020 2024-05-08T23:14:48.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.054+0000 7f9df57fa700 1 -- 172.21.15.135:0/2212169648 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00f620 con 0x7f9df8101020 2024-05-08T23:14:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.054+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/2212169648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df81a4230 con 0x7f9df8101020 2024-05-08T23:14:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.054+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/2212169648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9df8111150 con 0x7f9df8101020 2024-05-08T23:14:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.056+0000 7f9df57fa700 1 -- 172.21.15.135:0/2212169648 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f9dec010460 con 0x7f9df8101020 2024-05-08T23:14:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.056+0000 7f9df57fa700 1 --2- 172.21.15.135:0/2212169648 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9de00a11b0 0x7f9de00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.056+0000 7f9df77fe700 1 --2- 172.21.15.135:0/2212169648 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9de00a11b0 0x7f9de00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.056+0000 7f9df57fa700 1 -- 172.21.15.135:0/2212169648 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9dec0ccd40 con 0x7f9df8101020 2024-05-08T23:14:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.057+0000 7f9df57fa700 1 --2- 172.21.15.135:0/2212169648 >> [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817] conn(0x7f9de00aa990 0x7f9de00acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.057+0000 7f9df57fa700 1 -- 172.21.15.135:0/2212169648 --> [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9de00ad460 con 0x7f9de00aa990 2024-05-08T23:14:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.057+0000 7f9df57fa700 1 -- 172.21.15.135:0/2212169648 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dec0cd1e0 con 0x7f9df8101020 2024-05-08T23:14:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.057+0000 7f9dfcd70700 1 --2- 172.21.15.135:0/2212169648 >> [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817] conn(0x7f9de00aa990 0x7f9de00acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.057+0000 7f9df77fe700 1 --2- 172.21.15.135:0/2212169648 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9de00a11b0 0x7f9de00a3670 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9de8005950 tx=0x7f9de80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.057+0000 7f9dfcd70700 1 --2- 172.21.15.135:0/2212169648 >> [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817] conn(0x7f9de00aa990 0x7f9de00acdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.058+0000 7f9df57fa700 1 -- 172.21.15.135:0/2212169648 <== osd.3 v2:172.21.15.135:6810/1328709817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9de00ad460 con 0x7f9de00aa990 2024-05-08T23:14:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.074+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/2212169648 --> [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9df8102680 con 0x7f9de00aa990 2024-05-08T23:14:48.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.074+0000 7f9df57fa700 1 -- 172.21.15.135:0/2212169648 <== osd.3 v2:172.21.15.135:6810/1328709817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9df8102680 con 0x7f9de00aa990 2024-05-08T23:14:48.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.074+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/2212169648 >> [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817] conn(0x7f9de00aa990 msgr2=0x7f9de00acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:48.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.074+0000 7f9dfe7d3700 1 --2- 172.21.15.135:0/2212169648 >> [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817] conn(0x7f9de00aa990 0x7f9de00acdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:48.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.074+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/2212169648 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9de00a11b0 msgr2=0x7f9de00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:48.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.074+0000 7f9dfe7d3700 1 --2- 172.21.15.135:0/2212169648 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9de00a11b0 0x7f9de00a3670 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9de8005950 tx=0x7f9de80058e0 comp rx=0 tx=0).stop 2024-05-08T23:14:48.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.074+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/2212169648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9df8101020 msgr2=0x7f9df81974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:48.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.074+0000 7f9dfe7d3700 1 --2- 172.21.15.135:0/2212169648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9df8101020 0x7f9df81974c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00d950 tx=0x7f9dec00dd10 comp rx=0 tx=0).stop 2024-05-08T23:14:48.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.074+0000 7f9dfcd70700 1 -- 172.21.15.135:0/2212169648 reap_dead start 2024-05-08T23:14:48.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.074+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/2212169648 shutdown_connections 2024-05-08T23:14:48.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.074+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/2212169648 >> 172.21.15.135:0/2212169648 conn(0x7f9df8078100 msgr2=0x7f9df80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:48.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.074+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/2212169648 shutdown_connections 2024-05-08T23:14:48.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.074+0000 7f9dfe7d3700 1 -- 172.21.15.135:0/2212169648 wait complete. 2024-05-08T23:14:48.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:48 smithi135 ceph-mon[42440]: pgmap v236: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-08T23:14:48.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:48 smithi179 ceph-mon[46314]: pgmap v236: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-08T23:14:48.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:48 smithi195 ceph-mon[46516]: pgmap v236: 97 pgs: 97 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-08T23:14:48.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.770+0000 7fda7cade700 1 -- 172.21.15.135:0/3442500070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda781001f0 msgr2=0x7fda78100670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:48.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.770+0000 7fda7cade700 1 --2- 172.21.15.135:0/3442500070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda781001f0 0x7fda78100670 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009990 tx=0x7fda6c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:48.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.770+0000 7fda7cade700 1 -- 172.21.15.135:0/3442500070 shutdown_connections 2024-05-08T23:14:48.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.770+0000 7fda7cade700 1 --2- 172.21.15.135:0/3442500070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda78105ff0 0x7fda781063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:48.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.770+0000 7fda7cade700 1 --2- 172.21.15.135:0/3442500070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda78100bb0 0x7fda7810ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:48.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.770+0000 7fda7cade700 1 --2- 172.21.15.135:0/3442500070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda781001f0 0x7fda78100670 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:48.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.770+0000 7fda7cade700 1 -- 172.21.15.135:0/3442500070 >> 172.21.15.135:0/3442500070 conn(0x7fda78075d10 msgr2=0x7fda78076120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:48.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.770+0000 7fda7cade700 1 -- 172.21.15.135:0/3442500070 shutdown_connections 2024-05-08T23:14:48.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.770+0000 7fda7cade700 1 -- 172.21.15.135:0/3442500070 wait complete. 2024-05-08T23:14:48.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.771+0000 7fda7cade700 1 Processor -- start 2024-05-08T23:14:48.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.771+0000 7fda7cade700 1 -- start start 2024-05-08T23:14:48.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.771+0000 7fda7cade700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda781001f0 0x7fda78197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:48.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.771+0000 7fda7cade700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda78100bb0 0x7fda781978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:48.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.771+0000 7fda7cade700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda78105ff0 0x7fda7819bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:48.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.771+0000 7fda7cade700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7819c240 con 0x7fda78100bb0 2024-05-08T23:14:48.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.771+0000 7fda7cade700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7819c3b0 con 0x7fda781001f0 2024-05-08T23:14:48.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.771+0000 7fda7cade700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7819c570 con 0x7fda78105ff0 2024-05-08T23:14:48.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda75d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda78100bb0 0x7fda781978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:48.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda75d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda78100bb0 0x7fda781978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54488/0 (socket says 172.21.15.135:54488) 2024-05-08T23:14:48.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda7659c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda781001f0 0x7fda78197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:48.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda75d9b700 1 -- 172.21.15.135:0/557351867 learned_addr learned my addr 172.21.15.135:0/557351867 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:48.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda76d9d700 1 --2- 172.21.15.135:0/557351867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda78105ff0 0x7fda7819bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:48.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda75d9b700 1 -- 172.21.15.135:0/557351867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda78105ff0 msgr2=0x7fda7819bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:48.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda75d9b700 1 --2- 172.21.15.135:0/557351867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda78105ff0 0x7fda7819bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:48.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda75d9b700 1 -- 172.21.15.135:0/557351867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda781001f0 msgr2=0x7fda78197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:48.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda75d9b700 1 --2- 172.21.15.135:0/557351867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda781001f0 0x7fda78197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:48.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda75d9b700 1 -- 172.21.15.135:0/557351867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c0095f0 con 0x7fda78100bb0 2024-05-08T23:14:48.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda75d9b700 1 --2- 172.21.15.135:0/557351867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda78100bb0 0x7fda781978d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0098e0 tx=0x7fda6c00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:48.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda677fe700 1 -- 172.21.15.135:0/557351867 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c01d070 con 0x7fda78100bb0 2024-05-08T23:14:48.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda7cade700 1 -- 172.21.15.135:0/557351867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7819c7f0 con 0x7fda78100bb0 2024-05-08T23:14:48.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda677fe700 1 -- 172.21.15.135:0/557351867 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda6c022470 con 0x7fda78100bb0 2024-05-08T23:14:48.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda677fe700 1 -- 172.21.15.135:0/557351867 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c017650 con 0x7fda78100bb0 2024-05-08T23:14:48.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.772+0000 7fda7cade700 1 -- 172.21.15.135:0/557351867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7810d7c0 con 0x7fda78100bb0 2024-05-08T23:14:48.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.773+0000 7fda7cade700 1 -- 172.21.15.135:0/557351867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda78111240 con 0x7fda78100bb0 2024-05-08T23:14:48.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.774+0000 7fda677fe700 1 -- 172.21.15.135:0/557351867 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fda6c00fa30 con 0x7fda78100bb0 2024-05-08T23:14:48.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.775+0000 7fda677fe700 1 --2- 172.21.15.135:0/557351867 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fda600a1230 0x7fda600a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:48.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.775+0000 7fda7659c700 1 --2- 172.21.15.135:0/557351867 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fda600a1230 0x7fda600a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:48.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.775+0000 7fda677fe700 1 -- 172.21.15.135:0/557351867 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fda6c0ce270 con 0x7fda78100bb0 2024-05-08T23:14:48.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.776+0000 7fda677fe700 1 --2- 172.21.15.135:0/557351867 >> [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864] conn(0x7fda600aaa10 0x7fda600ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:48.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.776+0000 7fda677fe700 1 -- 172.21.15.135:0/557351867 --> [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda600ad4e0 con 0x7fda600aaa10 2024-05-08T23:14:48.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.776+0000 7fda677fe700 1 -- 172.21.15.135:0/557351867 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda6c0ce620 con 0x7fda78100bb0 2024-05-08T23:14:48.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.776+0000 7fda7659c700 1 --2- 172.21.15.135:0/557351867 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fda600a1230 0x7fda600a36f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fda68005950 tx=0x7fda6800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:48.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.776+0000 7fda76d9d700 1 --2- 172.21.15.135:0/557351867 >> [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864] conn(0x7fda600aaa10 0x7fda600ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:48.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.776+0000 7fda76d9d700 1 --2- 172.21.15.135:0/557351867 >> [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864] conn(0x7fda600aaa10 0x7fda600ace30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:48.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.777+0000 7fda677fe700 1 -- 172.21.15.135:0/557351867 <== osd.10 v2:172.21.15.179:6824/1119841864 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fda600ad4e0 con 0x7fda600aaa10 2024-05-08T23:14:48.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.806+0000 7fda7cade700 1 -- 172.21.15.135:0/557351867 --> [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fda78061620 con 0x7fda600aaa10 2024-05-08T23:14:48.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.806+0000 7fda677fe700 1 -- 172.21.15.135:0/557351867 <== osd.10 v2:172.21.15.179:6824/1119841864 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fda78061620 con 0x7fda600aaa10 2024-05-08T23:14:48.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.807+0000 7fda7cade700 1 -- 172.21.15.135:0/557351867 >> [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864] conn(0x7fda600aaa10 msgr2=0x7fda600ace30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:48.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.807+0000 7fda7cade700 1 --2- 172.21.15.135:0/557351867 >> [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864] conn(0x7fda600aaa10 0x7fda600ace30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:48.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.807+0000 7fda7cade700 1 -- 172.21.15.135:0/557351867 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fda600a1230 msgr2=0x7fda600a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:48.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.807+0000 7fda7cade700 1 --2- 172.21.15.135:0/557351867 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fda600a1230 0x7fda600a36f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fda68005950 tx=0x7fda6800a300 comp rx=0 tx=0).stop 2024-05-08T23:14:48.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.807+0000 7fda7cade700 1 -- 172.21.15.135:0/557351867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda78100bb0 msgr2=0x7fda781978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:48.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.807+0000 7fda7cade700 1 --2- 172.21.15.135:0/557351867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda78100bb0 0x7fda781978d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0098e0 tx=0x7fda6c00f670 comp rx=0 tx=0).stop 2024-05-08T23:14:48.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.807+0000 7fda76d9d700 1 -- 172.21.15.135:0/557351867 reap_dead start 2024-05-08T23:14:48.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.807+0000 7fda7cade700 1 -- 172.21.15.135:0/557351867 shutdown_connections 2024-05-08T23:14:48.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.807+0000 7fda7cade700 1 -- 172.21.15.135:0/557351867 >> 172.21.15.135:0/557351867 conn(0x7fda78075d10 msgr2=0x7fda780feef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:48.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.807+0000 7fda7cade700 1 -- 172.21.15.135:0/557351867 shutdown_connections 2024-05-08T23:14:48.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.807+0000 7fda7cade700 1 -- 172.21.15.135:0/557351867 wait complete. 2024-05-08T23:14:49.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.847+0000 7f5122aed700 1 -- 172.21.15.135:0/1660244857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f511c069bd0 msgr2=0x7f511c10de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.847+0000 7f5122aed700 1 --2- 172.21.15.135:0/1660244857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f511c069bd0 0x7f511c10de00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f511400b0d0 tx=0x7f511400b3e0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.847+0000 7f5122aed700 1 -- 172.21.15.135:0/1660244857 shutdown_connections 2024-05-08T23:14:49.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.847+0000 7f5122aed700 1 --2- 172.21.15.135:0/1660244857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f511c106fe0 0x7f511c1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.847+0000 7f5122aed700 1 --2- 172.21.15.135:0/1660244857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f511c069bd0 0x7f511c10de00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.847+0000 7f5122aed700 1 --2- 172.21.15.135:0/1660244857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f511c069210 0x7f511c069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.847+0000 7f5122aed700 1 -- 172.21.15.135:0/1660244857 >> 172.21.15.135:0/1660244857 conn(0x7f511c076e70 msgr2=0x7f511c077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.847+0000 7f5122aed700 1 -- 172.21.15.135:0/1660244857 shutdown_connections 2024-05-08T23:14:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.847+0000 7f5122aed700 1 -- 172.21.15.135:0/1660244857 wait complete. 2024-05-08T23:14:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f5122aed700 1 Processor -- start 2024-05-08T23:14:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f5122aed700 1 -- start start 2024-05-08T23:14:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f5122aed700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f511c069210 0x7f511c197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f5122aed700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f511c069bd0 0x7f511c1979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f5122aed700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f511c106fe0 0x7f511c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f5122aed700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c19c370 con 0x7f511c106fe0 2024-05-08T23:14:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f5122aed700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c19c4e0 con 0x7f511c069210 2024-05-08T23:14:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f5122aed700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c19c6a0 con 0x7f511c069bd0 2024-05-08T23:14:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f512108a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f511c106fe0 0x7f511c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f512108a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f511c106fe0 0x7f511c19bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54496/0 (socket says 172.21.15.135:54496) 2024-05-08T23:14:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f512108a700 1 -- 172.21.15.135:0/3259144369 learned_addr learned my addr 172.21.15.135:0/3259144369 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f5120889700 1 --2- 172.21.15.135:0/3259144369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f511c069210 0x7f511c197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f511bfff700 1 --2- 172.21.15.135:0/3259144369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f511c069bd0 0x7f511c1979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f512108a700 1 -- 172.21.15.135:0/3259144369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f511c069bd0 msgr2=0x7f511c1979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f512108a700 1 --2- 172.21.15.135:0/3259144369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f511c069bd0 0x7f511c1979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f512108a700 1 -- 172.21.15.135:0/3259144369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f511c069210 msgr2=0x7f511c197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f512108a700 1 --2- 172.21.15.135:0/3259144369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f511c069210 0x7f511c197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.848+0000 7f512108a700 1 -- 172.21.15.135:0/3259144369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5114009d00 con 0x7f511c106fe0 2024-05-08T23:14:49.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.849+0000 7f512108a700 1 --2- 172.21.15.135:0/3259144369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f511c106fe0 0x7f511c19bd60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f51140094c0 tx=0x7f51140095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:49.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.849+0000 7f5119ffb700 1 -- 172.21.15.135:0/3259144369 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511400e040 con 0x7f511c106fe0 2024-05-08T23:14:49.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.849+0000 7f5119ffb700 1 -- 172.21.15.135:0/3259144369 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f511401db40 con 0x7f511c106fe0 2024-05-08T23:14:49.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.849+0000 7f5119ffb700 1 -- 172.21.15.135:0/3259144369 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511401baf0 con 0x7f511c106fe0 2024-05-08T23:14:49.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.849+0000 7f5122aed700 1 -- 172.21.15.135:0/3259144369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511c19c920 con 0x7f511c106fe0 2024-05-08T23:14:49.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.849+0000 7f5122aed700 1 -- 172.21.15.135:0/3259144369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511c1a41e0 con 0x7f511c106fe0 2024-05-08T23:14:49.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.850+0000 7f5122aed700 1 -- 172.21.15.135:0/3259144369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511c1094e0 con 0x7f511c106fe0 2024-05-08T23:14:49.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.851+0000 7f5119ffb700 1 -- 172.21.15.135:0/3259144369 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f511401dcb0 con 0x7f511c106fe0 2024-05-08T23:14:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.851+0000 7f5119ffb700 1 --2- 172.21.15.135:0/3259144369 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f510c0a11b0 0x7f510c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.852+0000 7f5119ffb700 1 -- 172.21.15.135:0/3259144369 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f51140ce670 con 0x7f511c106fe0 2024-05-08T23:14:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.852+0000 7f5120889700 1 --2- 172.21.15.135:0/3259144369 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f510c0a11b0 0x7f510c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.852+0000 7f5120889700 1 --2- 172.21.15.135:0/3259144369 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f510c0a11b0 0x7f510c0a3670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5110005fd0 tx=0x7f5110005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.855+0000 7f5119ffb700 1 -- 172.21.15.135:0/3259144369 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5114097de0 con 0x7f511c106fe0 2024-05-08T23:14:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.062+0000 7f5122aed700 1 -- 172.21.15.135:0/3259144369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f511c102690 con 0x7f511c106fe0 2024-05-08T23:14:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.062+0000 7f5119ffb700 1 -- 172.21.15.135:0/3259144369 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f511409b400 con 0x7f511c106fe0 2024-05-08T23:14:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.064+0000 7f5122aed700 1 -- 172.21.15.135:0/3259144369 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f510c0a11b0 msgr2=0x7f510c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.064+0000 7f5122aed700 1 --2- 172.21.15.135:0/3259144369 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f510c0a11b0 0x7f510c0a3670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5110005fd0 tx=0x7f5110005db0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.064+0000 7f5122aed700 1 -- 172.21.15.135:0/3259144369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f511c106fe0 msgr2=0x7f511c19bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.064+0000 7f5122aed700 1 --2- 172.21.15.135:0/3259144369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f511c106fe0 0x7f511c19bd60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f51140094c0 tx=0x7f51140095a0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.065+0000 7f5122aed700 1 -- 172.21.15.135:0/3259144369 shutdown_connections 2024-05-08T23:14:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.065+0000 7f5122aed700 1 --2- 172.21.15.135:0/3259144369 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f510c0a11b0 0x7f510c0a3670 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.065+0000 7f5122aed700 1 --2- 172.21.15.135:0/3259144369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f511c106fe0 0x7f511c19bd60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.065+0000 7f5122aed700 1 --2- 172.21.15.135:0/3259144369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f511c069210 0x7f511c197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.065+0000 7f5122aed700 1 --2- 172.21.15.135:0/3259144369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f511c069bd0 0x7f511c1979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.065+0000 7f5122aed700 1 -- 172.21.15.135:0/3259144369 >> 172.21.15.135:0/3259144369 conn(0x7f511c076e70 msgr2=0x7f511c0fea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:49.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.065+0000 7f5122aed700 1 -- 172.21.15.135:0/3259144369 shutdown_connections 2024-05-08T23:14:49.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.065+0000 7f5122aed700 1 -- 172.21.15.135:0/3259144369 wait complete. 2024-05-08T23:14:49.136 INFO:teuthology.orchestra.run.smithi135.stdout:34359738422 2024-05-08T23:14:49.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.741+0000 7fb233be5700 1 -- 172.21.15.135:0/2479901206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb22c104ed0 msgr2=0x7fb22c1052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.741+0000 7fb233be5700 1 --2- 172.21.15.135:0/2479901206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb22c104ed0 0x7fb22c1052b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb2280099c0 tx=0x7fb228009cd0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.742+0000 7fb233be5700 1 -- 172.21.15.135:0/2479901206 shutdown_connections 2024-05-08T23:14:49.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.742+0000 7fb233be5700 1 --2- 172.21.15.135:0/2479901206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb22c101410 0x7fb22c10cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.742+0000 7fb233be5700 1 --2- 172.21.15.135:0/2479901206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb22c104ed0 0x7fb22c1052b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.742+0000 7fb233be5700 1 --2- 172.21.15.135:0/2479901206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb22c100a50 0x7fb22c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.742+0000 7fb233be5700 1 -- 172.21.15.135:0/2479901206 >> 172.21.15.135:0/2479901206 conn(0x7fb22c075260 msgr2=0x7fb22c075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:49.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.742+0000 7fb233be5700 1 -- 172.21.15.135:0/2479901206 shutdown_connections 2024-05-08T23:14:49.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.742+0000 7fb233be5700 1 -- 172.21.15.135:0/2479901206 wait complete. 2024-05-08T23:14:49.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.742+0000 7fb233be5700 1 Processor -- start 2024-05-08T23:14:49.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.742+0000 7fb233be5700 1 -- start start 2024-05-08T23:14:49.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.742+0000 7fb233be5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb22c100a50 0x7fb22c196200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.742+0000 7fb233be5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb22c101410 0x7fb22c196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.742+0000 7fb233be5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb22c104ed0 0x7fb22c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb233be5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c19b100 con 0x7fb22c104ed0 2024-05-08T23:14:49.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb233be5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c19b270 con 0x7fb22c101410 2024-05-08T23:14:49.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb233be5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c19b430 con 0x7fb22c100a50 2024-05-08T23:14:49.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb232182700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb22c104ed0 0x7fb22c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb232182700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb22c104ed0 0x7fb22c19aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54470/0 (socket says 172.21.15.135:54470) 2024-05-08T23:14:49.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb232182700 1 -- 172.21.15.135:0/1608594498 learned_addr learned my addr 172.21.15.135:0/1608594498 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:49.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb231981700 1 --2- 172.21.15.135:0/1608594498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb22c100a50 0x7fb22c196200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb231180700 1 --2- 172.21.15.135:0/1608594498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb22c101410 0x7fb22c196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb232182700 1 -- 172.21.15.135:0/1608594498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb22c100a50 msgr2=0x7fb22c196200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb232182700 1 --2- 172.21.15.135:0/1608594498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb22c100a50 0x7fb22c196200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb232182700 1 -- 172.21.15.135:0/1608594498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb22c101410 msgr2=0x7fb22c196740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb232182700 1 --2- 172.21.15.135:0/1608594498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb22c101410 0x7fb22c196740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb232182700 1 -- 172.21.15.135:0/1608594498 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2280095f0 con 0x7fb22c104ed0 2024-05-08T23:14:49.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb232182700 1 --2- 172.21.15.135:0/1608594498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb22c104ed0 0x7fb22c19aaf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb224007ee0 tx=0x7fb22400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:49.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb222ffd700 1 -- 172.21.15.135:0/1608594498 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224017070 con 0x7fb22c104ed0 2024-05-08T23:14:49.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb233be5700 1 -- 172.21.15.135:0/1608594498 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22c19b710 con 0x7fb22c104ed0 2024-05-08T23:14:49.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb222ffd700 1 -- 172.21.15.135:0/1608594498 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb22400f040 con 0x7fb22c104ed0 2024-05-08T23:14:49.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb222ffd700 1 -- 172.21.15.135:0/1608594498 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224005740 con 0x7fb22c104ed0 2024-05-08T23:14:49.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.743+0000 7fb233be5700 1 -- 172.21.15.135:0/1608594498 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22c0ffb10 con 0x7fb22c104ed0 2024-05-08T23:14:49.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.744+0000 7fb233be5700 1 -- 172.21.15.135:0/1608594498 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb22c110050 con 0x7fb22c104ed0 2024-05-08T23:14:49.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.746+0000 7fb222ffd700 1 -- 172.21.15.135:0/1608594498 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fb22400dc60 con 0x7fb22c104ed0 2024-05-08T23:14:49.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.747+0000 7fb222ffd700 1 --2- 172.21.15.135:0/1608594498 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb2180a11b0 0x7fb2180a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.747+0000 7fb222ffd700 1 -- 172.21.15.135:0/1608594498 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb2240cc880 con 0x7fb22c104ed0 2024-05-08T23:14:49.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.747+0000 7fb231981700 1 --2- 172.21.15.135:0/1608594498 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb2180a11b0 0x7fb2180a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.747+0000 7fb222ffd700 1 --2- 172.21.15.135:0/1608594498 >> [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626] conn(0x7fb2180aa990 0x7fb2180acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.747+0000 7fb222ffd700 1 -- 172.21.15.135:0/1608594498 --> [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2180ad460 con 0x7fb2180aa990 2024-05-08T23:14:49.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.747+0000 7fb222ffd700 1 -- 172.21.15.135:0/1608594498 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2240ccbf0 con 0x7fb22c104ed0 2024-05-08T23:14:49.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.747+0000 7fb231180700 1 --2- 172.21.15.135:0/1608594498 >> [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626] conn(0x7fb2180aa990 0x7fb2180acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.747+0000 7fb231981700 1 --2- 172.21.15.135:0/1608594498 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb2180a11b0 0x7fb2180a3670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb228009f50 tx=0x7fb228005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:49.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.748+0000 7fb231180700 1 --2- 172.21.15.135:0/1608594498 >> [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626] conn(0x7fb2180aa990 0x7fb2180acdb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:49.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.749+0000 7fb222ffd700 1 -- 172.21.15.135:0/1608594498 <== osd.5 v2:172.21.15.195:6808/1466056626 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb2180ad460 con 0x7fb2180aa990 2024-05-08T23:14:49.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.765+0000 7fb233be5700 1 -- 172.21.15.135:0/1608594498 --> [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb22c0684d0 con 0x7fb2180aa990 2024-05-08T23:14:49.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.766+0000 7fb222ffd700 1 -- 172.21.15.135:0/1608594498 <== osd.5 v2:172.21.15.195:6808/1466056626 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb22c0684d0 con 0x7fb2180aa990 2024-05-08T23:14:49.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.766+0000 7fb233be5700 1 -- 172.21.15.135:0/1608594498 >> [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626] conn(0x7fb2180aa990 msgr2=0x7fb2180acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.766+0000 7fb233be5700 1 --2- 172.21.15.135:0/1608594498 >> [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626] conn(0x7fb2180aa990 0x7fb2180acdb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.766+0000 7fb233be5700 1 -- 172.21.15.135:0/1608594498 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb2180a11b0 msgr2=0x7fb2180a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.766+0000 7fb233be5700 1 --2- 172.21.15.135:0/1608594498 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb2180a11b0 0x7fb2180a3670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb228009f50 tx=0x7fb228005fb0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.766+0000 7fb233be5700 1 -- 172.21.15.135:0/1608594498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb22c104ed0 msgr2=0x7fb22c19aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.766+0000 7fb233be5700 1 --2- 172.21.15.135:0/1608594498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb22c104ed0 0x7fb22c19aaf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb224007ee0 tx=0x7fb22400d3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.766+0000 7fb232182700 1 -- 172.21.15.135:0/1608594498 reap_dead start 2024-05-08T23:14:49.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.766+0000 7fb233be5700 1 -- 172.21.15.135:0/1608594498 shutdown_connections 2024-05-08T23:14:49.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.766+0000 7fb233be5700 1 -- 172.21.15.135:0/1608594498 >> 172.21.15.135:0/1608594498 conn(0x7fb22c075260 msgr2=0x7fb22c0fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:49.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.766+0000 7fb233be5700 1 -- 172.21.15.135:0/1608594498 shutdown_connections 2024-05-08T23:14:49.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.766+0000 7fb233be5700 1 -- 172.21.15.135:0/1608594498 wait complete. 2024-05-08T23:14:49.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:49 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3259144369' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-08T23:14:49.507 INFO:teuthology.orchestra.run.smithi135.stdout:300647710738 2024-05-08T23:14:49.507 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-08T23:14:49.542 INFO:teuthology.orchestra.run.smithi135.stdout:279172874262 2024-05-08T23:14:49.542 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-08T23:14:49.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:49 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3259144369' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-08T23:14:49.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:49 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3259144369' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-08T23:14:49.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.849+0000 7fd2109bd700 1 -- 172.21.15.135:0/100027684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd20c0692f0 msgr2=0x7fd20c10de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.849+0000 7fd2109bd700 1 --2- 172.21.15.135:0/100027684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd20c0692f0 0x7fd20c10de60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd20400b0a0 tx=0x7fd20400b3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.849+0000 7fd2109bd700 1 -- 172.21.15.135:0/100027684 shutdown_connections 2024-05-08T23:14:49.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.849+0000 7fd2109bd700 1 --2- 172.21.15.135:0/100027684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd20c107020 0x7fd20c107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.849+0000 7fd2109bd700 1 --2- 172.21.15.135:0/100027684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd20c0692f0 0x7fd20c10de60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.849+0000 7fd2109bd700 1 --2- 172.21.15.135:0/100027684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd20c068950 0x7fd20c068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.849+0000 7fd2109bd700 1 -- 172.21.15.135:0/100027684 >> 172.21.15.135:0/100027684 conn(0x7fd20c075f80 msgr2=0x7fd20c076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:49.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.849+0000 7fd2109bd700 1 -- 172.21.15.135:0/100027684 shutdown_connections 2024-05-08T23:14:49.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.849+0000 7fd2109bd700 1 -- 172.21.15.135:0/100027684 wait complete. 2024-05-08T23:14:49.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.850+0000 7fd2109bd700 1 Processor -- start 2024-05-08T23:14:49.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.850+0000 7fd2109bd700 1 -- start start 2024-05-08T23:14:49.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd2109bd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd20c068950 0x7fd20c0fffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd2109bd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd20c0692f0 0x7fd20c100500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd2109bd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd20c107020 0x7fd20c100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd2109bd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c1a5820 con 0x7fd20c107020 2024-05-08T23:14:49.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd2109bd700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c1a5990 con 0x7fd20c068950 2024-05-08T23:14:49.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd2109bd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c1a5b50 con 0x7fd20c0692f0 2024-05-08T23:14:49.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd20ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd20c107020 0x7fd20c100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd20ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd20c107020 0x7fd20c100a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54514/0 (socket says 172.21.15.135:54514) 2024-05-08T23:14:49.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd20ad9d700 1 -- 172.21.15.135:0/3525390006 learned_addr learned my addr 172.21.15.135:0/3525390006 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:49.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd20a59c700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd20c068950 0x7fd20c0fffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd209d9b700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd20c0692f0 0x7fd20c100500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd20ad9d700 1 -- 172.21.15.135:0/3525390006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd20c0692f0 msgr2=0x7fd20c100500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd20ad9d700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd20c0692f0 0x7fd20c100500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd20ad9d700 1 -- 172.21.15.135:0/3525390006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd20c068950 msgr2=0x7fd20c0fffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd20ad9d700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd20c068950 0x7fd20c0fffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd20ad9d700 1 -- 172.21.15.135:0/3525390006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd204009d00 con 0x7fd20c107020 2024-05-08T23:14:49.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd20a59c700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd20c068950 0x7fd20c0fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:14:49.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd209d9b700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd20c0692f0 0x7fd20c100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:14:49.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd20ad9d700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd20c107020 0x7fd20c100a40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd20400b830 tx=0x7fd2040078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:49.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd1fb7fe700 1 -- 172.21.15.135:0/3525390006 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400e040 con 0x7fd20c107020 2024-05-08T23:14:49.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd2109bd700 1 -- 172.21.15.135:0/3525390006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c1a5dd0 con 0x7fd20c107020 2024-05-08T23:14:49.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd1fb7fe700 1 -- 172.21.15.135:0/3525390006 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd204004e60 con 0x7fd20c107020 2024-05-08T23:14:49.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.851+0000 7fd1fb7fe700 1 -- 172.21.15.135:0/3525390006 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204005420 con 0x7fd20c107020 2024-05-08T23:14:49.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.852+0000 7fd2109bd700 1 -- 172.21.15.135:0/3525390006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c1a61e0 con 0x7fd20c107020 2024-05-08T23:14:49.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.852+0000 7fd2109bd700 1 -- 172.21.15.135:0/3525390006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd20c111150 con 0x7fd20c107020 2024-05-08T23:14:49.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.854+0000 7fd1fb7fe700 1 -- 172.21.15.135:0/3525390006 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fd20401bb30 con 0x7fd20c107020 2024-05-08T23:14:49.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.855+0000 7fd1fb7fe700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd1f40a11b0 0x7fd1f40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.855+0000 7fd20a59c700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd1f40a11b0 0x7fd1f40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.855+0000 7fd1fb7fe700 1 -- 172.21.15.135:0/3525390006 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd2040ce4a0 con 0x7fd20c107020 2024-05-08T23:14:49.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.855+0000 7fd1fb7fe700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376] conn(0x7fd1f40aa860 0x7fd1f40acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.855+0000 7fd1fb7fe700 1 -- 172.21.15.135:0/3525390006 --> [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1f40ad330 con 0x7fd1f40aa860 2024-05-08T23:14:49.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.855+0000 7fd1fb7fe700 1 -- 172.21.15.135:0/3525390006 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2040ce940 con 0x7fd20c107020 2024-05-08T23:14:49.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.855+0000 7fd20a59c700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd1f40a11b0 0x7fd1f40a3670 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00baa0 tx=0x7fd1fc005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:49.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.855+0000 7fd209d9b700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376] conn(0x7fd1f40aa860 0x7fd1f40acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.856+0000 7fd209d9b700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376] conn(0x7fd1f40aa860 0x7fd1f40acc80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:49.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.857+0000 7fd1fb7fe700 1 -- 172.21.15.135:0/3525390006 <== osd.8 v2:172.21.15.195:6816/431240376 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd1f40ad330 con 0x7fd1f40aa860 2024-05-08T23:14:49.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.873+0000 7fd2109bd700 1 -- 172.21.15.135:0/3525390006 --> [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd20c0616a0 con 0x7fd1f40aa860 2024-05-08T23:14:49.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.873+0000 7fd1fb7fe700 1 -- 172.21.15.135:0/3525390006 <== osd.8 v2:172.21.15.195:6816/431240376 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd20c0616a0 con 0x7fd1f40aa860 2024-05-08T23:14:49.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.874+0000 7fd2109bd700 1 -- 172.21.15.135:0/3525390006 >> [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376] conn(0x7fd1f40aa860 msgr2=0x7fd1f40acc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.874+0000 7fd2109bd700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376] conn(0x7fd1f40aa860 0x7fd1f40acc80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.874+0000 7fd2109bd700 1 -- 172.21.15.135:0/3525390006 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd1f40a11b0 msgr2=0x7fd1f40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.874+0000 7fd2109bd700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd1f40a11b0 0x7fd1f40a3670 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00baa0 tx=0x7fd1fc005db0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.874+0000 7fd2109bd700 1 -- 172.21.15.135:0/3525390006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd20c107020 msgr2=0x7fd20c100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.874+0000 7fd2109bd700 1 --2- 172.21.15.135:0/3525390006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd20c107020 0x7fd20c100a40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd20400b830 tx=0x7fd2040078a0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.874+0000 7fd20ad9d700 1 -- 172.21.15.135:0/3525390006 reap_dead start 2024-05-08T23:14:49.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.874+0000 7fd2109bd700 1 -- 172.21.15.135:0/3525390006 shutdown_connections 2024-05-08T23:14:49.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.874+0000 7fd2109bd700 1 -- 172.21.15.135:0/3525390006 >> 172.21.15.135:0/3525390006 conn(0x7fd20c075f80 msgr2=0x7fd20c0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:49.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.874+0000 7fd2109bd700 1 -- 172.21.15.135:0/3525390006 shutdown_connections 2024-05-08T23:14:49.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.874+0000 7fd2109bd700 1 -- 172.21.15.135:0/3525390006 wait complete. 2024-05-08T23:14:49.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.908+0000 7fb392bac700 1 -- 172.21.15.135:0/3415471152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb38c106fe0 msgr2=0x7fb38c1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.908+0000 7fb392bac700 1 --2- 172.21.15.135:0/3415471152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb38c106fe0 0x7fb38c1073c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb3800099c0 tx=0x7fb380009cd0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.908+0000 7fb392bac700 1 -- 172.21.15.135:0/3415471152 shutdown_connections 2024-05-08T23:14:49.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.908+0000 7fb392bac700 1 --2- 172.21.15.135:0/3415471152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb38c069c10 0x7fb38c10de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.908+0000 7fb392bac700 1 --2- 172.21.15.135:0/3415471152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb38c106fe0 0x7fb38c1073c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.908+0000 7fb392bac700 1 --2- 172.21.15.135:0/3415471152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb38c069250 0x7fb38c0696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.908+0000 7fb392bac700 1 -- 172.21.15.135:0/3415471152 >> 172.21.15.135:0/3415471152 conn(0x7fb38c076e70 msgr2=0x7fb38c077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:49.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.908+0000 7fb392bac700 1 -- 172.21.15.135:0/3415471152 shutdown_connections 2024-05-08T23:14:49.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.908+0000 7fb392bac700 1 -- 172.21.15.135:0/3415471152 wait complete. 2024-05-08T23:14:49.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.908+0000 7fb392bac700 1 Processor -- start 2024-05-08T23:14:49.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.908+0000 7fb392bac700 1 -- start start 2024-05-08T23:14:49.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb392bac700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb38c069250 0x7fb38c197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb392bac700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb38c069c10 0x7fb38c197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb392bac700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb38c106fe0 0x7fb38c19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb392bac700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c19c210 con 0x7fb38c069250 2024-05-08T23:14:49.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb392bac700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c19c380 con 0x7fb38c106fe0 2024-05-08T23:14:49.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb392bac700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c19c540 con 0x7fb38c069c10 2024-05-08T23:14:49.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb390948700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb38c069250 0x7fb38c197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb390948700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb38c069250 0x7fb38c197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54538/0 (socket says 172.21.15.135:54538) 2024-05-08T23:14:49.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb390948700 1 -- 172.21.15.135:0/3744332442 learned_addr learned my addr 172.21.15.135:0/3744332442 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:49.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb391149700 1 --2- 172.21.15.135:0/3744332442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb38c106fe0 0x7fb38c19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb390948700 1 -- 172.21.15.135:0/3744332442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb38c069c10 msgr2=0x7fb38c197850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T23:14:49.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb390948700 1 --2- 172.21.15.135:0/3744332442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb38c069c10 0x7fb38c197850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb390948700 1 -- 172.21.15.135:0/3744332442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb38c106fe0 msgr2=0x7fb38c19bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb390948700 1 --2- 172.21.15.135:0/3744332442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb38c106fe0 0x7fb38c19bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb390948700 1 -- 172.21.15.135:0/3744332442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3800095f0 con 0x7fb38c069250 2024-05-08T23:14:49.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb391149700 1 --2- 172.21.15.135:0/3744332442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb38c106fe0 0x7fb38c19bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:14:49.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb390948700 1 --2- 172.21.15.135:0/3744332442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb38c069250 0x7fb38c197310 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb38000b580 tx=0x7fb380003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:49.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb389ffb700 1 -- 172.21.15.135:0/3744332442 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38001d070 con 0x7fb38c069250 2024-05-08T23:14:49.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb392bac700 1 -- 172.21.15.135:0/3744332442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38c19c7c0 con 0x7fb38c069250 2024-05-08T23:14:49.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb389ffb700 1 -- 172.21.15.135:0/3744332442 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb38000fda0 con 0x7fb38c069250 2024-05-08T23:14:49.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.909+0000 7fb389ffb700 1 -- 172.21.15.135:0/3744332442 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3800037c0 con 0x7fb38c069250 2024-05-08T23:14:49.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.910+0000 7fb392bac700 1 -- 172.21.15.135:0/3744332442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38c1a4080 con 0x7fb38c069250 2024-05-08T23:14:49.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.910+0000 7fb392bac700 1 -- 172.21.15.135:0/3744332442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb38c111160 con 0x7fb38c069250 2024-05-08T23:14:49.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.912+0000 7fb389ffb700 1 -- 172.21.15.135:0/3744332442 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fb380022700 con 0x7fb38c069250 2024-05-08T23:14:49.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.913+0000 7fb389ffb700 1 --2- 172.21.15.135:0/3744332442 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb37c0a11b0 0x7fb37c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.913+0000 7fb389ffb700 1 -- 172.21.15.135:0/3744332442 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb3800ce100 con 0x7fb38c069250 2024-05-08T23:14:49.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.913+0000 7fb38bfff700 1 --2- 172.21.15.135:0/3744332442 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb37c0a11b0 0x7fb37c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.913+0000 7fb389ffb700 1 --2- 172.21.15.135:0/3744332442 >> [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625] conn(0x7fb37c0aa990 0x7fb37c0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:49.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.913+0000 7fb389ffb700 1 -- 172.21.15.135:0/3744332442 --> [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb37c0ad460 con 0x7fb37c0aa990 2024-05-08T23:14:49.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.913+0000 7fb389ffb700 1 -- 172.21.15.135:0/3744332442 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3800ce470 con 0x7fb38c069250 2024-05-08T23:14:49.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.913+0000 7fb38bfff700 1 --2- 172.21.15.135:0/3744332442 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb37c0a11b0 0x7fb37c0a3670 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb38c198870 tx=0x7fb378005c10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:49.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.913+0000 7fb391149700 1 --2- 172.21.15.135:0/3744332442 >> [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625] conn(0x7fb37c0aa990 0x7fb37c0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:49.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.914+0000 7fb391149700 1 --2- 172.21.15.135:0/3744332442 >> [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625] conn(0x7fb37c0aa990 0x7fb37c0acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:49.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.915+0000 7fb389ffb700 1 -- 172.21.15.135:0/3744332442 <== osd.7 v2:172.21.15.179:6816/43006625 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb37c0ad460 con 0x7fb37c0aa990 2024-05-08T23:14:49.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.930+0000 7fb392bac700 1 -- 172.21.15.135:0/3744332442 --> [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb38c061620 con 0x7fb37c0aa990 2024-05-08T23:14:49.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.931+0000 7fb389ffb700 1 -- 172.21.15.135:0/3744332442 <== osd.7 v2:172.21.15.179:6816/43006625 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb38c061620 con 0x7fb37c0aa990 2024-05-08T23:14:49.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.931+0000 7fb392bac700 1 -- 172.21.15.135:0/3744332442 >> [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625] conn(0x7fb37c0aa990 msgr2=0x7fb37c0acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.931+0000 7fb392bac700 1 --2- 172.21.15.135:0/3744332442 >> [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625] conn(0x7fb37c0aa990 0x7fb37c0acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:49.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.931+0000 7fb392bac700 1 -- 172.21.15.135:0/3744332442 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb37c0a11b0 msgr2=0x7fb37c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.931+0000 7fb392bac700 1 --2- 172.21.15.135:0/3744332442 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb37c0a11b0 0x7fb37c0a3670 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb38c198870 tx=0x7fb378005c10 comp rx=0 tx=0).stop 2024-05-08T23:14:49.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.931+0000 7fb392bac700 1 -- 172.21.15.135:0/3744332442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb38c069250 msgr2=0x7fb38c197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:49.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.931+0000 7fb392bac700 1 --2- 172.21.15.135:0/3744332442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb38c069250 0x7fb38c197310 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb38000b580 tx=0x7fb380003710 comp rx=0 tx=0).stop 2024-05-08T23:14:49.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.931+0000 7fb391149700 1 -- 172.21.15.135:0/3744332442 reap_dead start 2024-05-08T23:14:49.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.932+0000 7fb392bac700 1 -- 172.21.15.135:0/3744332442 shutdown_connections 2024-05-08T23:14:49.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.932+0000 7fb392bac700 1 -- 172.21.15.135:0/3744332442 >> 172.21.15.135:0/3744332442 conn(0x7fb38c076e70 msgr2=0x7fb38c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:49.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.932+0000 7fb392bac700 1 -- 172.21.15.135:0/3744332442 shutdown_connections 2024-05-08T23:14:49.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:49.932+0000 7fb392bac700 1 -- 172.21.15.135:0/3744332442 wait complete. 2024-05-08T23:14:50.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.111+0000 7f3c92317700 1 -- 172.21.15.135:0/1152451343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c8c06a230 msgr2=0x7f3c8c105c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:50.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.111+0000 7f3c92317700 1 --2- 172.21.15.135:0/1152451343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c8c06a230 0x7f3c8c105c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009990 tx=0x7f3c7c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:50.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.111+0000 7f3c92317700 1 -- 172.21.15.135:0/1152451343 shutdown_connections 2024-05-08T23:14:50.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.111+0000 7f3c92317700 1 --2- 172.21.15.135:0/1152451343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c8c1062f0 0x7f3c8c10dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:50.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.111+0000 7f3c92317700 1 --2- 172.21.15.135:0/1152451343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c8c069880 0x7f3c8c069c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:50.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.111+0000 7f3c92317700 1 --2- 172.21.15.135:0/1152451343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c8c06a230 0x7f3c8c105c10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:50.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.111+0000 7f3c92317700 1 -- 172.21.15.135:0/1152451343 >> 172.21.15.135:0/1152451343 conn(0x7f3c8c076e50 msgr2=0x7f3c8c077260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:50.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.111+0000 7f3c92317700 1 -- 172.21.15.135:0/1152451343 shutdown_connections 2024-05-08T23:14:50.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.111+0000 7f3c92317700 1 -- 172.21.15.135:0/1152451343 wait complete. 2024-05-08T23:14:50.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.111+0000 7f3c92317700 1 Processor -- start 2024-05-08T23:14:50.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.111+0000 7f3c92317700 1 -- start start 2024-05-08T23:14:50.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c92317700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c8c069880 0x7f3c8c197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:50.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c92317700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c8c06a230 0x7f3c8c1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:50.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c92317700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c8c1062f0 0x7f3c8c19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:50.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c92317700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c19c260 con 0x7f3c8c06a230 2024-05-08T23:14:50.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c92317700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c19c3d0 con 0x7f3c8c069880 2024-05-08T23:14:50.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c92317700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c19c590 con 0x7f3c8c1062f0 2024-05-08T23:14:50.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c8b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c8c06a230 0x7f3c8c1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:50.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c8b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c8c06a230 0x7f3c8c1978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54558/0 (socket says 172.21.15.135:54558) 2024-05-08T23:14:50.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c8b7fe700 1 -- 172.21.15.135:0/1783277098 learned_addr learned my addr 172.21.15.135:0/1783277098 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:50.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c8bfff700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c8c069880 0x7f3c8c197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:50.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c8b7fe700 1 -- 172.21.15.135:0/1783277098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c8c1062f0 msgr2=0x7f3c8c19bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:50.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c908b4700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c8c1062f0 0x7f3c8c19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:50.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c8b7fe700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c8c1062f0 0x7f3c8c19bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:50.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c8b7fe700 1 -- 172.21.15.135:0/1783277098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c8c069880 msgr2=0x7f3c8c197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:50.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c8b7fe700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c8c069880 0x7f3c8c197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:50.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c8b7fe700 1 -- 172.21.15.135:0/1783277098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c0095f0 con 0x7f3c8c06a230 2024-05-08T23:14:50.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c8bfff700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c8c069880 0x7f3c8c197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:14:50.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c908b4700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c8c1062f0 0x7f3c8c19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:14:50.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c8b7fe700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c8c06a230 0x7f3c8c1978a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c000c00 tx=0x7f3c7c00f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:50.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c897fa700 1 -- 172.21.15.135:0/1783277098 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c01d070 con 0x7f3c8c06a230 2024-05-08T23:14:50.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c92317700 1 -- 172.21.15.135:0/1783277098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8c19c810 con 0x7f3c8c06a230 2024-05-08T23:14:50.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c897fa700 1 -- 172.21.15.135:0/1783277098 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c7c00fdb0 con 0x7f3c8c06a230 2024-05-08T23:14:50.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c897fa700 1 -- 172.21.15.135:0/1783277098 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c0177b0 con 0x7f3c8c06a230 2024-05-08T23:14:50.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.112+0000 7f3c92317700 1 -- 172.21.15.135:0/1783277098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8c1a40d0 con 0x7f3c8c06a230 2024-05-08T23:14:50.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.113+0000 7f3c92317700 1 -- 172.21.15.135:0/1783277098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c8c111190 con 0x7f3c8c06a230 2024-05-08T23:14:50.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.114+0000 7f3c897fa700 1 -- 172.21.15.135:0/1783277098 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f3c7c022a30 con 0x7f3c8c06a230 2024-05-08T23:14:50.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.115+0000 7f3c897fa700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c740a11b0 0x7f3c740a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:50.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.115+0000 7f3c8bfff700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c740a11b0 0x7f3c740a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:50.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.115+0000 7f3c897fa700 1 -- 172.21.15.135:0/1783277098 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3c7c0ce190 con 0x7f3c8c06a230 2024-05-08T23:14:50.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.115+0000 7f3c897fa700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342] conn(0x7f3c740aa990 0x7f3c740acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:50.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.115+0000 7f3c897fa700 1 -- 172.21.15.135:0/1783277098 --> [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c740ad460 con 0x7f3c740aa990 2024-05-08T23:14:50.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.115+0000 7f3c897fa700 1 -- 172.21.15.135:0/1783277098 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c7c0ce630 con 0x7f3c8c06a230 2024-05-08T23:14:50.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.115+0000 7f3c8bfff700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c740a11b0 0x7f3c740a3670 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3c80005fd0 tx=0x7f3c80005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:50.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.116+0000 7f3c908b4700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342] conn(0x7f3c740aa990 0x7f3c740acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:50.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.116+0000 7f3c908b4700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342] conn(0x7f3c740aa990 0x7f3c740acdb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:50.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.117+0000 7f3c897fa700 1 -- 172.21.15.135:0/1783277098 <== osd.4 v2:172.21.15.179:6808/1955171342 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3c740ad460 con 0x7f3c740aa990 2024-05-08T23:14:50.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.133+0000 7f3c92317700 1 -- 172.21.15.135:0/1783277098 --> [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3c8c061620 con 0x7f3c740aa990 2024-05-08T23:14:50.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.133+0000 7f3c897fa700 1 -- 172.21.15.135:0/1783277098 <== osd.4 v2:172.21.15.179:6808/1955171342 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3c8c061620 con 0x7f3c740aa990 2024-05-08T23:14:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.134+0000 7f3c92317700 1 -- 172.21.15.135:0/1783277098 >> [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342] conn(0x7f3c740aa990 msgr2=0x7f3c740acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.134+0000 7f3c92317700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342] conn(0x7f3c740aa990 0x7f3c740acdb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.134+0000 7f3c92317700 1 -- 172.21.15.135:0/1783277098 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c740a11b0 msgr2=0x7f3c740a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.134+0000 7f3c92317700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c740a11b0 0x7f3c740a3670 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3c80005fd0 tx=0x7f3c80005dc0 comp rx=0 tx=0).stop 2024-05-08T23:14:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.134+0000 7f3c92317700 1 -- 172.21.15.135:0/1783277098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c8c06a230 msgr2=0x7f3c8c1978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.134+0000 7f3c92317700 1 --2- 172.21.15.135:0/1783277098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c8c06a230 0x7f3c8c1978a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c000c00 tx=0x7f3c7c00f880 comp rx=0 tx=0).stop 2024-05-08T23:14:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.134+0000 7f3c908b4700 1 -- 172.21.15.135:0/1783277098 reap_dead start 2024-05-08T23:14:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.134+0000 7f3c92317700 1 -- 172.21.15.135:0/1783277098 shutdown_connections 2024-05-08T23:14:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.134+0000 7f3c92317700 1 -- 172.21.15.135:0/1783277098 >> 172.21.15.135:0/1783277098 conn(0x7f3c8c076e50 msgr2=0x7f3c8c0ff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.134+0000 7f3c92317700 1 -- 172.21.15.135:0/1783277098 shutdown_connections 2024-05-08T23:14:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:50.134+0000 7f3c92317700 1 -- 172.21.15.135:0/1783277098 wait complete. 2024-05-08T23:14:50.315 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738421 got 34359738422 for osd.0 2024-05-08T23:14:50.315 DEBUG:teuthology.parallel:result is None 2024-05-08T23:14:50.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.541+0000 7fd23d76d700 1 -- 172.21.15.135:0/3692320823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd238103220 msgr2=0x7fd238103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:50.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.541+0000 7fd23d76d700 1 --2- 172.21.15.135:0/3692320823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd238103220 0x7fd238103600 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd228009990 tx=0x7fd228009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:50.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.541+0000 7fd23d76d700 1 -- 172.21.15.135:0/3692320823 shutdown_connections 2024-05-08T23:14:50.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.541+0000 7fd23d76d700 1 --2- 172.21.15.135:0/3692320823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd238108300 0x7fd23810fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:50.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.541+0000 7fd23d76d700 1 --2- 172.21.15.135:0/3692320823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd238103220 0x7fd238103600 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:50.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.541+0000 7fd23d76d700 1 --2- 172.21.15.135:0/3692320823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd238103bd0 0x7fd238107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:50.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.541+0000 7fd23d76d700 1 -- 172.21.15.135:0/3692320823 >> 172.21.15.135:0/3692320823 conn(0x7fd2380fea70 msgr2=0x7fd238100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:50.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.541+0000 7fd23d76d700 1 -- 172.21.15.135:0/3692320823 shutdown_connections 2024-05-08T23:14:50.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.541+0000 7fd23d76d700 1 -- 172.21.15.135:0/3692320823 wait complete. 2024-05-08T23:14:50.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd23d76d700 1 Processor -- start 2024-05-08T23:14:50.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd23d76d700 1 -- start start 2024-05-08T23:14:50.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd23d76d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd238103220 0x7fd2380754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:50.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd23d76d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd238103bd0 0x7fd2380759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:50.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd23d76d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd238108300 0x7fd238075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:50.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd23d76d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2381a9a20 con 0x7fd238103220 2024-05-08T23:14:50.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd23d76d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2381991c0 con 0x7fd238108300 2024-05-08T23:14:50.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd23d76d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd238199380 con 0x7fd238103bd0 2024-05-08T23:14:50.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd237fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd238103220 0x7fd2380754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:50.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd237fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd238103220 0x7fd2380754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54454/0 (socket says 172.21.15.135:54454) 2024-05-08T23:14:50.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd237fff700 1 -- 172.21.15.135:0/3814500948 learned_addr learned my addr 172.21.15.135:0/3814500948 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:50.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd2377fe700 1 --2- 172.21.15.135:0/3814500948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd238103bd0 0x7fd2380759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:50.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd23cf6c700 1 --2- 172.21.15.135:0/3814500948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd238108300 0x7fd238075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:50.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd237fff700 1 -- 172.21.15.135:0/3814500948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd238103bd0 msgr2=0x7fd2380759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:50.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd237fff700 1 --2- 172.21.15.135:0/3814500948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd238103bd0 0x7fd2380759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:50.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd237fff700 1 -- 172.21.15.135:0/3814500948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd238108300 msgr2=0x7fd238075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:50.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd237fff700 1 --2- 172.21.15.135:0/3814500948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd238108300 0x7fd238075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:50.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.542+0000 7fd237fff700 1 -- 172.21.15.135:0/3814500948 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2280095f0 con 0x7fd238103220 2024-05-08T23:14:50.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.543+0000 7fd237fff700 1 --2- 172.21.15.135:0/3814500948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd238103220 0x7fd2380754b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd2280098e0 tx=0x7fd22800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:50.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.543+0000 7fd2357fa700 1 -- 172.21.15.135:0/3814500948 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22801d070 con 0x7fd238103220 2024-05-08T23:14:50.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.543+0000 7fd2357fa700 1 -- 172.21.15.135:0/3814500948 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd228022470 con 0x7fd238103220 2024-05-08T23:14:50.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.543+0000 7fd2357fa700 1 -- 172.21.15.135:0/3814500948 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd228017650 con 0x7fd238103220 2024-05-08T23:14:50.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.543+0000 7fd23d76d700 1 -- 172.21.15.135:0/3814500948 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd238199600 con 0x7fd238103220 2024-05-08T23:14:50.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.543+0000 7fd23d76d700 1 -- 172.21.15.135:0/3814500948 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd238199a50 con 0x7fd238103220 2024-05-08T23:14:50.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.543+0000 7fd23d76d700 1 -- 172.21.15.135:0/3814500948 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd2381131d0 con 0x7fd238103220 2024-05-08T23:14:50.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.545+0000 7fd2357fa700 1 -- 172.21.15.135:0/3814500948 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fd2280225e0 con 0x7fd238103220 2024-05-08T23:14:50.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.545+0000 7fd2357fa700 1 --2- 172.21.15.135:0/3814500948 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd2200a11b0 0x7fd2200a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:50.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.545+0000 7fd2377fe700 1 --2- 172.21.15.135:0/3814500948 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd2200a11b0 0x7fd2200a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:50.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.545+0000 7fd2357fa700 1 -- 172.21.15.135:0/3814500948 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd2280cdf70 con 0x7fd238103220 2024-05-08T23:14:50.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.546+0000 7fd2357fa700 1 --2- 172.21.15.135:0/3814500948 >> [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578] conn(0x7fd2200aa990 0x7fd2200acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:50.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.546+0000 7fd2357fa700 1 -- 172.21.15.135:0/3814500948 --> [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2200ad460 con 0x7fd2200aa990 2024-05-08T23:14:50.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.546+0000 7fd2357fa700 1 -- 172.21.15.135:0/3814500948 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2280ce410 con 0x7fd238103220 2024-05-08T23:14:50.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.546+0000 7fd2377fe700 1 --2- 172.21.15.135:0/3814500948 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd2200a11b0 0x7fd2200a3670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd238076b90 tx=0x7fd22c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:50.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.546+0000 7fd23cf6c700 1 --2- 172.21.15.135:0/3814500948 >> [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578] conn(0x7fd2200aa990 0x7fd2200acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:50.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.546+0000 7fd23cf6c700 1 --2- 172.21.15.135:0/3814500948 >> [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578] conn(0x7fd2200aa990 0x7fd2200acdb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:50.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.547+0000 7fd2357fa700 1 -- 172.21.15.135:0/3814500948 <== osd.6 v2:172.21.15.135:6818/2493102578 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd2200ad460 con 0x7fd2200aa990 2024-05-08T23:14:50.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.564+0000 7fd23d76d700 1 -- 172.21.15.135:0/3814500948 --> [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd238104700 con 0x7fd2200aa990 2024-05-08T23:14:50.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.564+0000 7fd2357fa700 1 -- 172.21.15.135:0/3814500948 <== osd.6 v2:172.21.15.135:6818/2493102578 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd238104700 con 0x7fd2200aa990 2024-05-08T23:14:50.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.564+0000 7fd23d76d700 1 -- 172.21.15.135:0/3814500948 >> [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578] conn(0x7fd2200aa990 msgr2=0x7fd2200acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:50.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.564+0000 7fd23d76d700 1 --2- 172.21.15.135:0/3814500948 >> [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578] conn(0x7fd2200aa990 0x7fd2200acdb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:50.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.564+0000 7fd23d76d700 1 -- 172.21.15.135:0/3814500948 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd2200a11b0 msgr2=0x7fd2200a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:50.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.564+0000 7fd23d76d700 1 --2- 172.21.15.135:0/3814500948 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd2200a11b0 0x7fd2200a3670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd238076b90 tx=0x7fd22c00b410 comp rx=0 tx=0).stop 2024-05-08T23:14:50.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.564+0000 7fd23d76d700 1 -- 172.21.15.135:0/3814500948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd238103220 msgr2=0x7fd2380754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:50.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.564+0000 7fd23d76d700 1 --2- 172.21.15.135:0/3814500948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd238103220 0x7fd2380754b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd2280098e0 tx=0x7fd22800f670 comp rx=0 tx=0).stop 2024-05-08T23:14:50.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.564+0000 7fd23cf6c700 1 -- 172.21.15.135:0/3814500948 reap_dead start 2024-05-08T23:14:50.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.564+0000 7fd23d76d700 1 -- 172.21.15.135:0/3814500948 shutdown_connections 2024-05-08T23:14:50.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.564+0000 7fd23d76d700 1 -- 172.21.15.135:0/3814500948 >> 172.21.15.135:0/3814500948 conn(0x7fd2380fea70 msgr2=0x7fd2380ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:50.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.564+0000 7fd23d76d700 1 -- 172.21.15.135:0/3814500948 shutdown_connections 2024-05-08T23:14:50.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:48.565+0000 7fd23d76d700 1 -- 172.21.15.135:0/3814500948 wait complete. 2024-05-08T23:14:50.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:50 smithi135 ceph-mon[42440]: pgmap v237: 97 pgs: 97 active+clean; 642 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-08T23:14:50.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:50 smithi179 ceph-mon[46314]: pgmap v237: 97 pgs: 97 active+clean; 642 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-08T23:14:50.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:50 smithi195 ceph-mon[46516]: pgmap v237: 97 pgs: 97 active+clean; 642 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-08T23:14:50.863 INFO:teuthology.orchestra.run.smithi135.stdout:214748364829 2024-05-08T23:14:50.864 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-08T23:14:51.142 INFO:teuthology.orchestra.run.smithi135.stdout:141733920808 2024-05-08T23:14:51.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-08T23:14:51.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.107+0000 7f0b94dbf700 1 -- 172.21.15.135:0/2792348353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b901063e0 msgr2=0x7f0b9010dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:51.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.107+0000 7f0b94dbf700 1 --2- 172.21.15.135:0/2792348353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b901063e0 0x7f0b9010dee0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800b0a0 tx=0x7f0b8800b3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:51.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.107+0000 7f0b94dbf700 1 -- 172.21.15.135:0/2792348353 shutdown_connections 2024-05-08T23:14:51.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.107+0000 7f0b94dbf700 1 --2- 172.21.15.135:0/2792348353 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b900ffbc0 0x7f0b900fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:51.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.107+0000 7f0b94dbf700 1 --2- 172.21.15.135:0/2792348353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b901063e0 0x7f0b9010dee0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:51.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.107+0000 7f0b94dbf700 1 --2- 172.21.15.135:0/2792348353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b90100570 0x7f0b90105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:51.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.107+0000 7f0b94dbf700 1 -- 172.21.15.135:0/2792348353 >> 172.21.15.135:0/2792348353 conn(0x7f0b90075190 msgr2=0x7f0b900755a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:51.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.107+0000 7f0b94dbf700 1 -- 172.21.15.135:0/2792348353 shutdown_connections 2024-05-08T23:14:51.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.107+0000 7f0b94dbf700 1 -- 172.21.15.135:0/2792348353 wait complete. 2024-05-08T23:14:51.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.108+0000 7f0b94dbf700 1 Processor -- start 2024-05-08T23:14:51.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.108+0000 7f0b94dbf700 1 -- start start 2024-05-08T23:14:51.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.108+0000 7f0b94dbf700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b900ffbc0 0x7f0b90197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:51.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.108+0000 7f0b94dbf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b90100570 0x7f0b90197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:51.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.108+0000 7f0b94dbf700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b901063e0 0x7f0b9019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:51.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.108+0000 7f0b94dbf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9019c340 con 0x7f0b90100570 2024-05-08T23:14:51.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.108+0000 7f0b94dbf700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9019c4b0 con 0x7f0b901063e0 2024-05-08T23:14:51.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.108+0000 7f0b94dbf700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9019c670 con 0x7f0b900ffbc0 2024-05-08T23:14:51.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.108+0000 7f0b8dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b90100570 0x7f0b90197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:51.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.108+0000 7f0b8dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b90100570 0x7f0b90197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54576/0 (socket says 172.21.15.135:54576) 2024-05-08T23:14:51.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.108+0000 7f0b8dd9b700 1 -- 172.21.15.135:0/3138524549 learned_addr learned my addr 172.21.15.135:0/3138524549 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:51.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.108+0000 7f0b8e59c700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b900ffbc0 0x7f0b90197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:51.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.108+0000 7f0b8ed9d700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b901063e0 0x7f0b9019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:51.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.109+0000 7f0b8dd9b700 1 -- 172.21.15.135:0/3138524549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b900ffbc0 msgr2=0x7f0b90197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:51.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.109+0000 7f0b8dd9b700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b900ffbc0 0x7f0b90197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:51.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.109+0000 7f0b8dd9b700 1 -- 172.21.15.135:0/3138524549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b901063e0 msgr2=0x7f0b9019bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:51.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.109+0000 7f0b8dd9b700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b901063e0 0x7f0b9019bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:51.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.109+0000 7f0b8dd9b700 1 -- 172.21.15.135:0/3138524549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b88009d00 con 0x7f0b90100570 2024-05-08T23:14:51.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.109+0000 7f0b8e59c700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b900ffbc0 0x7f0b90197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:14:51.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.109+0000 7f0b8ed9d700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b901063e0 0x7f0b9019bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:14:51.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.109+0000 7f0b8dd9b700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b90100570 0x7f0b90197980 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400d980 tx=0x7f0b8400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:51.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.109+0000 7f0b7f7fe700 1 -- 172.21.15.135:0/3138524549 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8400bb60 con 0x7f0b90100570 2024-05-08T23:14:51.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.109+0000 7f0b7f7fe700 1 -- 172.21.15.135:0/3138524549 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b84007640 con 0x7f0b90100570 2024-05-08T23:14:51.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.109+0000 7f0b94dbf700 1 -- 172.21.15.135:0/3138524549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9019c950 con 0x7f0b90100570 2024-05-08T23:14:51.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.109+0000 7f0b7f7fe700 1 -- 172.21.15.135:0/3138524549 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84004e90 con 0x7f0b90100570 2024-05-08T23:14:51.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.109+0000 7f0b94dbf700 1 -- 172.21.15.135:0/3138524549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b901a41b0 con 0x7f0b90100570 2024-05-08T23:14:51.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.110+0000 7f0b94dbf700 1 -- 172.21.15.135:0/3138524549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0b90111190 con 0x7f0b90100570 2024-05-08T23:14:51.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.111+0000 7f0b7f7fe700 1 -- 172.21.15.135:0/3138524549 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f0b8400bcc0 con 0x7f0b90100570 2024-05-08T23:14:51.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.111+0000 7f0b7f7fe700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0b780a1230 0x7f0b780a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:51.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.112+0000 7f0b8e59c700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0b780a1230 0x7f0b780a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:51.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.112+0000 7f0b7f7fe700 1 -- 172.21.15.135:0/3138524549 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0b840ccf50 con 0x7f0b90100570 2024-05-08T23:14:51.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.112+0000 7f0b7f7fe700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459] conn(0x7f0b780aa8a0 0x7f0b780accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:51.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.112+0000 7f0b7f7fe700 1 -- 172.21.15.135:0/3138524549 --> [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0b780ad370 con 0x7f0b780aa8a0 2024-05-08T23:14:51.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.112+0000 7f0b7f7fe700 1 -- 172.21.15.135:0/3138524549 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b840cd300 con 0x7f0b90100570 2024-05-08T23:14:51.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.112+0000 7f0b8e59c700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0b780a1230 0x7f0b780a36f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009be0 tx=0x7f0b80009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:51.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.112+0000 7f0b8ed9d700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459] conn(0x7f0b780aa8a0 0x7f0b780accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:51.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.113+0000 7f0b8ed9d700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459] conn(0x7f0b780aa8a0 0x7f0b780accc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:51.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.113+0000 7f0b7f7fe700 1 -- 172.21.15.135:0/3138524549 <== osd.11 v2:172.21.15.195:6824/3939527459 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0b780ad370 con 0x7f0b780aa8a0 2024-05-08T23:14:51.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.130+0000 7f0b94dbf700 1 -- 172.21.15.135:0/3138524549 --> [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0b900616a0 con 0x7f0b780aa8a0 2024-05-08T23:14:51.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.131+0000 7f0b7f7fe700 1 -- 172.21.15.135:0/3138524549 <== osd.11 v2:172.21.15.195:6824/3939527459 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0b900616a0 con 0x7f0b780aa8a0 2024-05-08T23:14:51.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.131+0000 7f0b94dbf700 1 -- 172.21.15.135:0/3138524549 >> [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459] conn(0x7f0b780aa8a0 msgr2=0x7f0b780accc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:51.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.131+0000 7f0b94dbf700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459] conn(0x7f0b780aa8a0 0x7f0b780accc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:51.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.131+0000 7f0b94dbf700 1 -- 172.21.15.135:0/3138524549 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0b780a1230 msgr2=0x7f0b780a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:51.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.131+0000 7f0b94dbf700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0b780a1230 0x7f0b780a36f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009be0 tx=0x7f0b80009260 comp rx=0 tx=0).stop 2024-05-08T23:14:51.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.131+0000 7f0b94dbf700 1 -- 172.21.15.135:0/3138524549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b90100570 msgr2=0x7f0b90197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:51.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.131+0000 7f0b94dbf700 1 --2- 172.21.15.135:0/3138524549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b90100570 0x7f0b90197980 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400d980 tx=0x7f0b8400dd40 comp rx=0 tx=0).stop 2024-05-08T23:14:51.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.131+0000 7f0b8ed9d700 1 -- 172.21.15.135:0/3138524549 reap_dead start 2024-05-08T23:14:51.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.131+0000 7f0b94dbf700 1 -- 172.21.15.135:0/3138524549 shutdown_connections 2024-05-08T23:14:51.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.131+0000 7f0b94dbf700 1 -- 172.21.15.135:0/3138524549 >> 172.21.15.135:0/3138524549 conn(0x7f0b90075190 msgr2=0x7f0b900fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:51.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.131+0000 7f0b94dbf700 1 -- 172.21.15.135:0/3138524549 shutdown_connections 2024-05-08T23:14:51.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:51.131+0000 7f0b94dbf700 1 -- 172.21.15.135:0/3138524549 wait complete. 2024-05-08T23:14:51.608 INFO:teuthology.orchestra.run.smithi135.stdout:163208757283 2024-05-08T23:14:51.609 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-08T23:14:51.613 INFO:teuthology.orchestra.run.smithi135.stdout:193273528353 2024-05-08T23:14:51.613 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-08T23:14:51.651 INFO:teuthology.orchestra.run.smithi135.stdout:111669149739 2024-05-08T23:14:51.651 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-08T23:14:51.824 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:51.839 INFO:teuthology.orchestra.run.smithi135.stdout:244813135898 2024-05-08T23:14:51.839 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-08T23:14:52.219 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:52.341 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:52 smithi135 ceph-mon[42440]: pgmap v238: 97 pgs: 97 active+clean; 642 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T23:14:52.427 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:52.478 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:52.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:52 smithi179 ceph-mon[46314]: pgmap v238: 97 pgs: 97 active+clean; 642 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T23:14:52.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:52 smithi195 ceph-mon[46516]: pgmap v238: 97 pgs: 97 active+clean; 642 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T23:14:52.862 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:53.855 INFO:teuthology.orchestra.run.smithi135.stdout:335007449104 2024-05-08T23:14:53.855 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-08T23:14:53.903 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:54.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.153+0000 7fa8defc7700 1 -- 172.21.15.135:0/2519266895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d8100850 msgr2=0x7fa8d810ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:54.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.153+0000 7fa8defc7700 1 --2- 172.21.15.135:0/2519266895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d8100850 0x7fa8d810ccf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000b0a0 tx=0x7fa8d000b3b0 comp rx=0 tx=0).stop 2024-05-08T23:14:54.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.153+0000 7fa8defc7700 1 -- 172.21.15.135:0/2519266895 shutdown_connections 2024-05-08T23:14:54.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.153+0000 7fa8defc7700 1 --2- 172.21.15.135:0/2519266895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8d8105f40 0x7fa8d8106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:54.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.153+0000 7fa8defc7700 1 --2- 172.21.15.135:0/2519266895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d8100850 0x7fa8d810ccf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:54.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.153+0000 7fa8defc7700 1 --2- 172.21.15.135:0/2519266895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d80ffe90 0x7fa8d8100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:54.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.153+0000 7fa8defc7700 1 -- 172.21.15.135:0/2519266895 >> 172.21.15.135:0/2519266895 conn(0x7fa8d8076e70 msgr2=0x7fa8d8077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:54.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.153+0000 7fa8defc7700 1 -- 172.21.15.135:0/2519266895 shutdown_connections 2024-05-08T23:14:54.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.153+0000 7fa8defc7700 1 -- 172.21.15.135:0/2519266895 wait complete. 2024-05-08T23:14:54.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8defc7700 1 Processor -- start 2024-05-08T23:14:54.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8defc7700 1 -- start start 2024-05-08T23:14:54.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8defc7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8d80ffe90 0x7fa8d8197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:54.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8defc7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d8100850 0x7fa8d8197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:54.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8defc7700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d8105f40 0x7fa8d819bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:54.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8defc7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d819c3d0 con 0x7fa8d8100850 2024-05-08T23:14:54.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8defc7700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d819c540 con 0x7fa8d8105f40 2024-05-08T23:14:54.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8defc7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d819c700 con 0x7fa8d80ffe90 2024-05-08T23:14:54.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d8100850 0x7fa8d8197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:54.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d8100850 0x7fa8d8197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54590/0 (socket says 172.21.15.135:54590) 2024-05-08T23:14:54.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8d7fff700 1 -- 172.21.15.135:0/2964698464 learned_addr learned my addr 172.21.15.135:0/2964698464 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:54.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8dd564700 1 --2- 172.21.15.135:0/2964698464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d8105f40 0x7fa8d819bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:54.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8dcd63700 1 --2- 172.21.15.135:0/2964698464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8d80ffe90 0x7fa8d8197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:54.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8d7fff700 1 -- 172.21.15.135:0/2964698464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8d80ffe90 msgr2=0x7fa8d8197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:54.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8d7fff700 1 --2- 172.21.15.135:0/2964698464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8d80ffe90 0x7fa8d8197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:54.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8d7fff700 1 -- 172.21.15.135:0/2964698464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d8105f40 msgr2=0x7fa8d819bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:54.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8d7fff700 1 --2- 172.21.15.135:0/2964698464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d8105f40 0x7fa8d819bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:54.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8d7fff700 1 -- 172.21.15.135:0/2964698464 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d0009d00 con 0x7fa8d8100850 2024-05-08T23:14:54.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.154+0000 7fa8d7fff700 1 --2- 172.21.15.135:0/2964698464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d8100850 0x7fa8d8197a60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400d950 tx=0x7fa8c400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:54.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.155+0000 7fa8d5ffb700 1 -- 172.21.15.135:0/2964698464 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c400f890 con 0x7fa8d8100850 2024-05-08T23:14:54.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.155+0000 7fa8d5ffb700 1 -- 172.21.15.135:0/2964698464 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8c4010460 con 0x7fa8d8100850 2024-05-08T23:14:54.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.155+0000 7fa8defc7700 1 -- 172.21.15.135:0/2964698464 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d819c9e0 con 0x7fa8d8100850 2024-05-08T23:14:54.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.155+0000 7fa8d5ffb700 1 -- 172.21.15.135:0/2964698464 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c400e610 con 0x7fa8d8100850 2024-05-08T23:14:54.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.155+0000 7fa8defc7700 1 -- 172.21.15.135:0/2964698464 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d81a4240 con 0x7fa8d8100850 2024-05-08T23:14:54.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.156+0000 7fa8defc7700 1 -- 172.21.15.135:0/2964698464 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d8101580 con 0x7fa8d8100850 2024-05-08T23:14:54.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.157+0000 7fa8d5ffb700 1 -- 172.21.15.135:0/2964698464 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fa8c40108d0 con 0x7fa8d8100850 2024-05-08T23:14:54.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.157+0000 7fa8d5ffb700 1 --2- 172.21.15.135:0/2964698464 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa8c80a1230 0x7fa8c80a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:54.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.158+0000 7fa8dcd63700 1 --2- 172.21.15.135:0/2964698464 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa8c80a1230 0x7fa8c80a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:54.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.158+0000 7fa8d5ffb700 1 -- 172.21.15.135:0/2964698464 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa8c40cc640 con 0x7fa8d8100850 2024-05-08T23:14:54.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.158+0000 7fa8dcd63700 1 --2- 172.21.15.135:0/2964698464 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa8c80a1230 0x7fa8c80a36f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009a10 tx=0x7fa8cc009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:54.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.163+0000 7fa8d5ffb700 1 -- 172.21.15.135:0/2964698464 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa8c4095e20 con 0x7fa8d8100850 2024-05-08T23:14:54.339 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:54.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.379+0000 7fa8defc7700 1 -- 172.21.15.135:0/2964698464 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa8d810fe10 con 0x7fa8d8100850 2024-05-08T23:14:54.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.380+0000 7fa8d5ffb700 1 -- 172.21.15.135:0/2964698464 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa8c4099440 con 0x7fa8d8100850 2024-05-08T23:14:54.381 INFO:teuthology.orchestra.run.smithi135.stdout:77309411375 2024-05-08T23:14:54.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.382+0000 7fa8defc7700 1 -- 172.21.15.135:0/2964698464 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa8c80a1230 msgr2=0x7fa8c80a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:54.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.382+0000 7fa8defc7700 1 --2- 172.21.15.135:0/2964698464 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa8c80a1230 0x7fa8c80a36f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009a10 tx=0x7fa8cc009190 comp rx=0 tx=0).stop 2024-05-08T23:14:54.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.382+0000 7fa8defc7700 1 -- 172.21.15.135:0/2964698464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d8100850 msgr2=0x7fa8d8197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:54.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.382+0000 7fa8defc7700 1 --2- 172.21.15.135:0/2964698464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d8100850 0x7fa8d8197a60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400d950 tx=0x7fa8c400dc60 comp rx=0 tx=0).stop 2024-05-08T23:14:54.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.382+0000 7fa8defc7700 1 -- 172.21.15.135:0/2964698464 shutdown_connections 2024-05-08T23:14:54.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.382+0000 7fa8defc7700 1 --2- 172.21.15.135:0/2964698464 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa8c80a1230 0x7fa8c80a36f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:54.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.382+0000 7fa8defc7700 1 --2- 172.21.15.135:0/2964698464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8d80ffe90 0x7fa8d8197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:54.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.382+0000 7fa8defc7700 1 --2- 172.21.15.135:0/2964698464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d8105f40 0x7fa8d819bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:54.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.382+0000 7fa8defc7700 1 --2- 172.21.15.135:0/2964698464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d8100850 0x7fa8d8197a60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:54.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.382+0000 7fa8defc7700 1 -- 172.21.15.135:0/2964698464 >> 172.21.15.135:0/2964698464 conn(0x7fa8d8076e70 msgr2=0x7fa8d80ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:54.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.383+0000 7fa8defc7700 1 -- 172.21.15.135:0/2964698464 shutdown_connections 2024-05-08T23:14:54.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.383+0000 7fa8defc7700 1 -- 172.21.15.135:0/2964698464 wait complete. 2024-05-08T23:14:54.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:54 smithi135 ceph-mon[42440]: pgmap v239: 97 pgs: 97 active+clean; 642 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-08T23:14:54.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:54 smithi179 ceph-mon[46314]: pgmap v239: 97 pgs: 97 active+clean; 642 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-08T23:14:54.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:54 smithi195 ceph-mon[46516]: pgmap v239: 97 pgs: 97 active+clean; 642 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-08T23:14:54.842 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:55.119 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:55.567 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:55 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2964698464' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-08T23:14:55.567 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:55 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3559690932' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-08T23:14:55.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:55 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2964698464' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-08T23:14:55.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:55 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3559690932' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-08T23:14:55.616 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411372 got 77309411375 for osd.2 2024-05-08T23:14:55.616 DEBUG:teuthology.parallel:result is None 2024-05-08T23:14:55.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:55 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2964698464' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-08T23:14:55.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:55 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3559690932' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-08T23:14:55.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.495+0000 7fe50972c700 1 -- 172.21.15.135:0/3969443462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5040ffed0 msgr2=0x7fe504100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:55.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.495+0000 7fe50972c700 1 --2- 172.21.15.135:0/3969443462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5040ffed0 0x7fe504100350 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009990 tx=0x7fe4f8009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.495+0000 7fe50972c700 1 -- 172.21.15.135:0/3969443462 shutdown_connections 2024-05-08T23:14:55.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.495+0000 7fe50972c700 1 --2- 172.21.15.135:0/3969443462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe504100890 0x7fe50410cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.495+0000 7fe50972c700 1 --2- 172.21.15.135:0/3969443462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe504105f00 0x7fe5041062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.495+0000 7fe50972c700 1 --2- 172.21.15.135:0/3969443462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5040ffed0 0x7fe504100350 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.495+0000 7fe50972c700 1 -- 172.21.15.135:0/3969443462 >> 172.21.15.135:0/3969443462 conn(0x7fe504075f80 msgr2=0x7fe504076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:55.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.495+0000 7fe50972c700 1 -- 172.21.15.135:0/3969443462 shutdown_connections 2024-05-08T23:14:55.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.495+0000 7fe50972c700 1 -- 172.21.15.135:0/3969443462 wait complete. 2024-05-08T23:14:55.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.496+0000 7fe50972c700 1 Processor -- start 2024-05-08T23:14:55.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.496+0000 7fe50972c700 1 -- start start 2024-05-08T23:14:55.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.496+0000 7fe50972c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5040ffed0 0x7fe504101b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:55.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.496+0000 7fe50972c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe504100890 0x7fe5041020b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:55.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.496+0000 7fe50972c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe504105f00 0x7fe5041025f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:55.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.496+0000 7fe50972c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5041a57d0 con 0x7fe504100890 2024-05-08T23:14:55.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.496+0000 7fe50972c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5041a5940 con 0x7fe5040ffed0 2024-05-08T23:14:55.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.496+0000 7fe50972c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5041a5b00 con 0x7fe504105f00 2024-05-08T23:14:55.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.496+0000 7fe5027fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe504100890 0x7fe5041020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:55.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.497+0000 7fe5027fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe504100890 0x7fe5041020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54618/0 (socket says 172.21.15.135:54618) 2024-05-08T23:14:55.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.497+0000 7fe5027fc700 1 -- 172.21.15.135:0/1611130022 learned_addr learned my addr 172.21.15.135:0/1611130022 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:55.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.497+0000 7fe5037fe700 1 --2- 172.21.15.135:0/1611130022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe504105f00 0x7fe5041025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:55.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.497+0000 7fe502ffd700 1 --2- 172.21.15.135:0/1611130022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5040ffed0 0x7fe504101b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:55.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.497+0000 7fe5027fc700 1 -- 172.21.15.135:0/1611130022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe504105f00 msgr2=0x7fe5041025f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:55.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.497+0000 7fe5027fc700 1 --2- 172.21.15.135:0/1611130022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe504105f00 0x7fe5041025f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.497+0000 7fe5027fc700 1 -- 172.21.15.135:0/1611130022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5040ffed0 msgr2=0x7fe504101b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:55.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.497+0000 7fe5027fc700 1 --2- 172.21.15.135:0/1611130022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5040ffed0 0x7fe504101b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.497+0000 7fe5027fc700 1 -- 172.21.15.135:0/1611130022 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80095f0 con 0x7fe504100890 2024-05-08T23:14:55.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.497+0000 7fe5027fc700 1 --2- 172.21.15.135:0/1611130022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe504100890 0x7fe5041020b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80098e0 tx=0x7fe4f800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:55.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.497+0000 7fe4ebfff700 1 -- 172.21.15.135:0/1611130022 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f801d070 con 0x7fe504100890 2024-05-08T23:14:55.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.497+0000 7fe4ebfff700 1 -- 172.21.15.135:0/1611130022 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4f8022470 con 0x7fe504100890 2024-05-08T23:14:55.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.497+0000 7fe4ebfff700 1 -- 172.21.15.135:0/1611130022 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8017650 con 0x7fe504100890 2024-05-08T23:14:55.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.497+0000 7fe50972c700 1 -- 172.21.15.135:0/1611130022 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5041a5d80 con 0x7fe504100890 2024-05-08T23:14:55.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.497+0000 7fe50972c700 1 -- 172.21.15.135:0/1611130022 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5041a6140 con 0x7fe504100890 2024-05-08T23:14:55.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.498+0000 7fe50972c700 1 -- 172.21.15.135:0/1611130022 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5041015b0 con 0x7fe504100890 2024-05-08T23:14:55.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.499+0000 7fe4ebfff700 1 -- 172.21.15.135:0/1611130022 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fe4f80225e0 con 0x7fe504100890 2024-05-08T23:14:55.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.500+0000 7fe4ebfff700 1 --2- 172.21.15.135:0/1611130022 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe4ec0a11b0 0x7fe4ec0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:55.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.500+0000 7fe502ffd700 1 --2- 172.21.15.135:0/1611130022 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe4ec0a11b0 0x7fe4ec0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:55.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.500+0000 7fe4ebfff700 1 -- 172.21.15.135:0/1611130022 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe4f80cdbc0 con 0x7fe504100890 2024-05-08T23:14:55.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.500+0000 7fe502ffd700 1 --2- 172.21.15.135:0/1611130022 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe4ec0a11b0 0x7fe4ec0a3670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4005950 tx=0x7fe4f400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:55.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.503+0000 7fe4ebfff700 1 -- 172.21.15.135:0/1611130022 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe4f8097430 con 0x7fe504100890 2024-05-08T23:14:55.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.983+0000 7f57b3627700 1 -- 172.21.15.135:0/3145722919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57ac107020 msgr2=0x7f57ac107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:55.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.983+0000 7f57b3627700 1 --2- 172.21.15.135:0/3145722919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57ac107020 0x7f57ac107400 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f579c009990 tx=0x7f579c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.983+0000 7f57b3627700 1 -- 172.21.15.135:0/3145722919 shutdown_connections 2024-05-08T23:14:55.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.983+0000 7f57b3627700 1 --2- 172.21.15.135:0/3145722919 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57ac069fa0 0x7f57ac10de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.983+0000 7f57b3627700 1 --2- 172.21.15.135:0/3145722919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57ac107020 0x7f57ac107400 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.983+0000 7f57b3627700 1 --2- 172.21.15.135:0/3145722919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57ac0695e0 0x7f57ac069a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.983+0000 7f57b3627700 1 -- 172.21.15.135:0/3145722919 >> 172.21.15.135:0/3145722919 conn(0x7f57ac076c40 msgr2=0x7f57ac077050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:55.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.983+0000 7f57b3627700 1 -- 172.21.15.135:0/3145722919 shutdown_connections 2024-05-08T23:14:55.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.984+0000 7f57b3627700 1 -- 172.21.15.135:0/3145722919 wait complete. 2024-05-08T23:14:55.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.984+0000 7f57b3627700 1 Processor -- start 2024-05-08T23:14:55.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b3627700 1 -- start start 2024-05-08T23:14:55.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b3627700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57ac0695e0 0x7f57ac197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:55.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b3627700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57ac069fa0 0x7f57ac1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:55.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b3627700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57ac107020 0x7f57ac19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:55.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b3627700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac19c260 con 0x7f57ac069fa0 2024-05-08T23:14:55.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b3627700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac19c3d0 con 0x7f57ac107020 2024-05-08T23:14:55.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b3627700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac19c590 con 0x7f57ac0695e0 2024-05-08T23:14:55.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b0bc2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57ac069fa0 0x7f57ac1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:55.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b0bc2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57ac069fa0 0x7f57ac1978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54598/0 (socket says 172.21.15.135:54598) 2024-05-08T23:14:55.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b0bc2700 1 -- 172.21.15.135:0/3559690932 learned_addr learned my addr 172.21.15.135:0/3559690932 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:55.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b13c3700 1 --2- 172.21.15.135:0/3559690932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57ac0695e0 0x7f57ac197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:55.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b1bc4700 1 --2- 172.21.15.135:0/3559690932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57ac107020 0x7f57ac19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:55.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b0bc2700 1 -- 172.21.15.135:0/3559690932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57ac0695e0 msgr2=0x7f57ac197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:55.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b0bc2700 1 --2- 172.21.15.135:0/3559690932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57ac0695e0 0x7f57ac197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b0bc2700 1 -- 172.21.15.135:0/3559690932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57ac107020 msgr2=0x7f57ac19bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:55.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b0bc2700 1 --2- 172.21.15.135:0/3559690932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57ac107020 0x7f57ac19bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b0bc2700 1 -- 172.21.15.135:0/3559690932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c0095f0 con 0x7f57ac069fa0 2024-05-08T23:14:55.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.985+0000 7f57b0bc2700 1 --2- 172.21.15.135:0/3559690932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57ac069fa0 0x7f57ac1978a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f57a800c920 tx=0x7f57a800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:55.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.986+0000 7f57a27fc700 1 -- 172.21.15.135:0/3559690932 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a8007b00 con 0x7f57ac069fa0 2024-05-08T23:14:55.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.986+0000 7f57a27fc700 1 -- 172.21.15.135:0/3559690932 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57a8004cf0 con 0x7f57ac069fa0 2024-05-08T23:14:55.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.986+0000 7f57a27fc700 1 -- 172.21.15.135:0/3559690932 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a8005520 con 0x7f57ac069fa0 2024-05-08T23:14:55.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.986+0000 7f57b3627700 1 -- 172.21.15.135:0/3559690932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac19c870 con 0x7f57ac069fa0 2024-05-08T23:14:55.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.986+0000 7f57b3627700 1 -- 172.21.15.135:0/3559690932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ac1a40d0 con 0x7f57ac069fa0 2024-05-08T23:14:55.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.987+0000 7f57b3627700 1 -- 172.21.15.135:0/3559690932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ac109540 con 0x7f57ac069fa0 2024-05-08T23:14:55.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.988+0000 7f57a27fc700 1 -- 172.21.15.135:0/3559690932 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f57a8004750 con 0x7f57ac069fa0 2024-05-08T23:14:55.667 INFO:teuthology.orchestra.run.smithi135.stdout:279172874263 2024-05-08T23:14:55.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.988+0000 7f57a27fc700 1 --2- 172.21.15.135:0/3559690932 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f57980a1230 0x7f57980a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:55.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.988+0000 7f57b13c3700 1 --2- 172.21.15.135:0/3559690932 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f57980a1230 0x7f57980a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:55.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.989+0000 7f57a27fc700 1 -- 172.21.15.135:0/3559690932 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f57a80cca60 con 0x7f57ac069fa0 2024-05-08T23:14:55.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.989+0000 7f57b13c3700 1 --2- 172.21.15.135:0/3559690932 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f57980a1230 0x7f57980a36f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f579c005850 tx=0x7f579c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:55.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:54.992+0000 7f57a27fc700 1 -- 172.21.15.135:0/3559690932 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f57a8096140 con 0x7f57ac069fa0 2024-05-08T23:14:55.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.202+0000 7f57b3627700 1 -- 172.21.15.135:0/3559690932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f57ac1026d0 con 0x7f57ac069fa0 2024-05-08T23:14:55.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.202+0000 7f57a27fc700 1 -- 172.21.15.135:0/3559690932 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57a801d020 con 0x7f57ac069fa0 2024-05-08T23:14:55.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.205+0000 7f57b3627700 1 -- 172.21.15.135:0/3559690932 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f57980a1230 msgr2=0x7f57980a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:55.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.205+0000 7f57b3627700 1 --2- 172.21.15.135:0/3559690932 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f57980a1230 0x7f57980a36f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f579c005850 tx=0x7f579c01a040 comp rx=0 tx=0).stop 2024-05-08T23:14:55.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.205+0000 7f57b3627700 1 -- 172.21.15.135:0/3559690932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57ac069fa0 msgr2=0x7f57ac1978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:55.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.205+0000 7f57b3627700 1 --2- 172.21.15.135:0/3559690932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57ac069fa0 0x7f57ac1978a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f57a800c920 tx=0x7f57a800cce0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.205+0000 7f57b3627700 1 -- 172.21.15.135:0/3559690932 shutdown_connections 2024-05-08T23:14:55.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.205+0000 7f57b3627700 1 --2- 172.21.15.135:0/3559690932 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f57980a1230 0x7f57980a36f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.205+0000 7f57b3627700 1 --2- 172.21.15.135:0/3559690932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57ac0695e0 0x7f57ac197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.205+0000 7f57b3627700 1 --2- 172.21.15.135:0/3559690932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57ac107020 0x7f57ac19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.205+0000 7f57b3627700 1 --2- 172.21.15.135:0/3559690932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57ac069fa0 0x7f57ac1978a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.205+0000 7f57b3627700 1 -- 172.21.15.135:0/3559690932 >> 172.21.15.135:0/3559690932 conn(0x7f57ac076c40 msgr2=0x7f57ac0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:55.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.205+0000 7f57b3627700 1 -- 172.21.15.135:0/3559690932 shutdown_connections 2024-05-08T23:14:55.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.205+0000 7f57b3627700 1 -- 172.21.15.135:0/3559690932 wait complete. 2024-05-08T23:14:55.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.715+0000 7fe50972c700 1 -- 172.21.15.135:0/1611130022 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe50404ec60 con 0x7fe504100890 2024-05-08T23:14:55.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.716+0000 7fe4ebfff700 1 -- 172.21.15.135:0/1611130022 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4f809aa50 con 0x7fe504100890 2024-05-08T23:14:55.716 INFO:teuthology.orchestra.run.smithi135.stdout:214748364830 2024-05-08T23:14:55.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.718+0000 7fe50972c700 1 -- 172.21.15.135:0/1611130022 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe4ec0a11b0 msgr2=0x7fe4ec0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:55.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.718+0000 7fe50972c700 1 --2- 172.21.15.135:0/1611130022 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe4ec0a11b0 0x7fe4ec0a3670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4005950 tx=0x7fe4f400a300 comp rx=0 tx=0).stop 2024-05-08T23:14:55.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.718+0000 7fe50972c700 1 -- 172.21.15.135:0/1611130022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe504100890 msgr2=0x7fe5041020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:55.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.718+0000 7fe50972c700 1 --2- 172.21.15.135:0/1611130022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe504100890 0x7fe5041020b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80098e0 tx=0x7fe4f800f670 comp rx=0 tx=0).stop 2024-05-08T23:14:55.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.718+0000 7fe50972c700 1 -- 172.21.15.135:0/1611130022 shutdown_connections 2024-05-08T23:14:55.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.718+0000 7fe50972c700 1 --2- 172.21.15.135:0/1611130022 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe4ec0a11b0 0x7fe4ec0a3670 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.718+0000 7fe50972c700 1 --2- 172.21.15.135:0/1611130022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe504105f00 0x7fe5041025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.718+0000 7fe50972c700 1 --2- 172.21.15.135:0/1611130022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5040ffed0 0x7fe504101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.718+0000 7fe50972c700 1 --2- 172.21.15.135:0/1611130022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe504100890 0x7fe5041020b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.718+0000 7fe50972c700 1 -- 172.21.15.135:0/1611130022 >> 172.21.15.135:0/1611130022 conn(0x7fe504075f80 msgr2=0x7fe504068bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:55.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.718+0000 7fe50972c700 1 -- 172.21.15.135:0/1611130022 shutdown_connections 2024-05-08T23:14:55.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.718+0000 7fe50972c700 1 -- 172.21.15.135:0/1611130022 wait complete. 2024-05-08T23:14:55.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.808+0000 7f7441cef700 1 -- 172.21.15.135:0/3001106892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f743c069bd0 msgr2=0x7f743c10de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:55.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.808+0000 7f7441cef700 1 --2- 172.21.15.135:0/3001106892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f743c069bd0 0x7f743c10de00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f743400b0d0 tx=0x7f743400b3e0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.808+0000 7f7441cef700 1 -- 172.21.15.135:0/3001106892 shutdown_connections 2024-05-08T23:14:55.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.808+0000 7f7441cef700 1 --2- 172.21.15.135:0/3001106892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f743c106fe0 0x7f743c1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.808+0000 7f7441cef700 1 --2- 172.21.15.135:0/3001106892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f743c069bd0 0x7f743c10de00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.808+0000 7f7441cef700 1 --2- 172.21.15.135:0/3001106892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f743c069210 0x7f743c069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.808+0000 7f7441cef700 1 -- 172.21.15.135:0/3001106892 >> 172.21.15.135:0/3001106892 conn(0x7f743c076e70 msgr2=0x7f743c077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:55.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.808+0000 7f7441cef700 1 -- 172.21.15.135:0/3001106892 shutdown_connections 2024-05-08T23:14:55.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.808+0000 7f7441cef700 1 -- 172.21.15.135:0/3001106892 wait complete. 2024-05-08T23:14:55.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.809+0000 7f7441cef700 1 Processor -- start 2024-05-08T23:14:55.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.809+0000 7f7441cef700 1 -- start start 2024-05-08T23:14:55.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f7441cef700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f743c069210 0x7f743c1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:55.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f7441cef700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f743c069bd0 0x7f743c197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:55.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f7441cef700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f743c106fe0 0x7f743c19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:55.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f7441cef700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c19c380 con 0x7f743c069bd0 2024-05-08T23:14:55.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f7441cef700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c19c4f0 con 0x7f743c069210 2024-05-08T23:14:55.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f7441cef700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c19c6b0 con 0x7f743c106fe0 2024-05-08T23:14:55.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f743affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f743c069bd0 0x7f743c197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:55.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f743b7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f743c069210 0x7f743c1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:55.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f743affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f743c069bd0 0x7f743c197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54632/0 (socket says 172.21.15.135:54632) 2024-05-08T23:14:55.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f743affd700 1 -- 172.21.15.135:0/925908153 learned_addr learned my addr 172.21.15.135:0/925908153 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:55.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f743bfff700 1 --2- 172.21.15.135:0/925908153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f743c106fe0 0x7f743c19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:55.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f743b7fe700 1 -- 172.21.15.135:0/925908153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f743c106fe0 msgr2=0x7f743c19bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:55.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f743b7fe700 1 --2- 172.21.15.135:0/925908153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f743c106fe0 0x7f743c19bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f743b7fe700 1 -- 172.21.15.135:0/925908153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f743c069bd0 msgr2=0x7f743c197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:55.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f743b7fe700 1 --2- 172.21.15.135:0/925908153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f743c069bd0 0x7f743c197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:55.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f743b7fe700 1 -- 172.21.15.135:0/925908153 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7434009d00 con 0x7f743c069210 2024-05-08T23:14:55.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f743affd700 1 --2- 172.21.15.135:0/925908153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f743c069bd0 0x7f743c197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:14:55.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f743bfff700 1 --2- 172.21.15.135:0/925908153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f743c106fe0 0x7f743c19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:14:55.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f743b7fe700 1 --2- 172.21.15.135:0/925908153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f743c069210 0x7f743c1974d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f742c00d950 tx=0x7f742c00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:55.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f7438ff9700 1 -- 172.21.15.135:0/925908153 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c009930 con 0x7f743c069210 2024-05-08T23:14:55.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.810+0000 7f7441cef700 1 -- 172.21.15.135:0/925908153 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c19c990 con 0x7f743c069210 2024-05-08T23:14:55.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.811+0000 7f7441cef700 1 -- 172.21.15.135:0/925908153 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c1a41f0 con 0x7f743c069210 2024-05-08T23:14:55.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.811+0000 7f7438ff9700 1 -- 172.21.15.135:0/925908153 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f742c010460 con 0x7f743c069210 2024-05-08T23:14:55.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.811+0000 7f7438ff9700 1 -- 172.21.15.135:0/925908153 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c00b5d0 con 0x7f743c069210 2024-05-08T23:14:55.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.811+0000 7f7441cef700 1 -- 172.21.15.135:0/925908153 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74280052f0 con 0x7f743c069210 2024-05-08T23:14:55.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.813+0000 7f7438ff9700 1 -- 172.21.15.135:0/925908153 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f742c009a90 con 0x7f743c069210 2024-05-08T23:14:55.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.813+0000 7f7438ff9700 1 --2- 172.21.15.135:0/925908153 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f74240a11b0 0x7f74240a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:55.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.814+0000 7f743affd700 1 --2- 172.21.15.135:0/925908153 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f74240a11b0 0x7f74240a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:55.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.814+0000 7f7438ff9700 1 -- 172.21.15.135:0/925908153 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f742c0cc3c0 con 0x7f743c069210 2024-05-08T23:14:55.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.814+0000 7f743affd700 1 --2- 172.21.15.135:0/925908153 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f74240a11b0 0x7f74240a3670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f743c1989e0 tx=0x7f743000a400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:55.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:55.817+0000 7f7438ff9700 1 -- 172.21.15.135:0/925908153 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f742c095aa0 con 0x7f743c069210 2024-05-08T23:14:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:56.017+0000 7f7441cef700 1 -- 172.21.15.135:0/925908153 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7428005160 con 0x7f743c069210 2024-05-08T23:14:56.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:56.018+0000 7f7438ff9700 1 -- 172.21.15.135:0/925908153 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f742c021090 con 0x7f743c069210 2024-05-08T23:14:56.018 INFO:teuthology.orchestra.run.smithi135.stdout:141733920809 2024-05-08T23:14:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:56.020+0000 7f7441cef700 1 -- 172.21.15.135:0/925908153 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f74240a11b0 msgr2=0x7f74240a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:56.020+0000 7f7441cef700 1 --2- 172.21.15.135:0/925908153 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f74240a11b0 0x7f74240a3670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f743c1989e0 tx=0x7f743000a400 comp rx=0 tx=0).stop 2024-05-08T23:14:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:56.020+0000 7f7441cef700 1 -- 172.21.15.135:0/925908153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f743c069210 msgr2=0x7f743c1974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:56.020+0000 7f7441cef700 1 --2- 172.21.15.135:0/925908153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f743c069210 0x7f743c1974d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f742c00d950 tx=0x7f742c00dc60 comp rx=0 tx=0).stop 2024-05-08T23:14:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:56.020+0000 7f7441cef700 1 -- 172.21.15.135:0/925908153 shutdown_connections 2024-05-08T23:14:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:56.020+0000 7f7441cef700 1 --2- 172.21.15.135:0/925908153 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f74240a11b0 0x7f74240a3670 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:56.020+0000 7f7441cef700 1 --2- 172.21.15.135:0/925908153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f743c106fe0 0x7f743c19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:56.020+0000 7f7441cef700 1 --2- 172.21.15.135:0/925908153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f743c069210 0x7f743c1974d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:56.020+0000 7f7441cef700 1 --2- 172.21.15.135:0/925908153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f743c069bd0 0x7f743c197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:56.020+0000 7f7441cef700 1 -- 172.21.15.135:0/925908153 >> 172.21.15.135:0/925908153 conn(0x7f743c076e70 msgr2=0x7f743c0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:56.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:56.020+0000 7f7441cef700 1 -- 172.21.15.135:0/925908153 shutdown_connections 2024-05-08T23:14:56.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:56.020+0000 7f7441cef700 1 -- 172.21.15.135:0/925908153 wait complete. 2024-05-08T23:14:56.292 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:56 smithi135 ceph-mon[42440]: pgmap v240: 97 pgs: 97 active+clean; 642 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-08T23:14:56.293 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:56 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1611130022' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-08T23:14:56.293 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:56 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/925908153' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-08T23:14:56.456 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364829 got 214748364830 for osd.7 2024-05-08T23:14:56.456 DEBUG:teuthology.parallel:result is None 2024-05-08T23:14:56.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:56 smithi179 ceph-mon[46314]: pgmap v240: 97 pgs: 97 active+clean; 642 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-08T23:14:56.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:56 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1611130022' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-08T23:14:56.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:56 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/925908153' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-08T23:14:56.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:56 smithi195 ceph-mon[46516]: pgmap v240: 97 pgs: 97 active+clean; 642 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-08T23:14:56.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:56 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1611130022' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-08T23:14:56.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:56 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/925908153' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-08T23:14:57.015 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:57.772 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874262 got 279172874263 for osd.9 2024-05-08T23:14:57.773 DEBUG:teuthology.parallel:result is None 2024-05-08T23:14:57.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.888+0000 7f072871b700 1 -- 172.21.15.135:0/796331389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07201005e0 msgr2=0x7f0720105d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:57.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.888+0000 7f072871b700 1 --2- 172.21.15.135:0/796331389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07201005e0 0x7f0720105d20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f07100099c0 tx=0x7f0710009cd0 comp rx=0 tx=0).stop 2024-05-08T23:14:57.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.888+0000 7f072871b700 1 -- 172.21.15.135:0/796331389 shutdown_connections 2024-05-08T23:14:57.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.888+0000 7f072871b700 1 --2- 172.21.15.135:0/796331389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0720106450 0x7f072010df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:57.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.888+0000 7f072871b700 1 --2- 172.21.15.135:0/796331389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07200ffc30 0x7f0720100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:57.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.888+0000 7f072871b700 1 --2- 172.21.15.135:0/796331389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07201005e0 0x7f0720105d20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:57.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.888+0000 7f072871b700 1 -- 172.21.15.135:0/796331389 >> 172.21.15.135:0/796331389 conn(0x7f0720075220 msgr2=0x7f0720075630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:57.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.888+0000 7f072871b700 1 -- 172.21.15.135:0/796331389 shutdown_connections 2024-05-08T23:14:57.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.888+0000 7f072871b700 1 -- 172.21.15.135:0/796331389 wait complete. 2024-05-08T23:14:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.889+0000 7f072871b700 1 Processor -- start 2024-05-08T23:14:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.889+0000 7f072871b700 1 -- start start 2024-05-08T23:14:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.889+0000 7f072871b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07200ffc30 0x7f07201973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.889+0000 7f072871b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07201005e0 0x7f07201978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.889+0000 7f072871b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0720106450 0x7f072019bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.889+0000 7f072871b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072019c2b0 con 0x7f0720106450 2024-05-08T23:14:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.889+0000 7f072871b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072019c420 con 0x7f07200ffc30 2024-05-08T23:14:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.889+0000 7f072871b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072019c5e0 con 0x7f07201005e0 2024-05-08T23:14:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.890+0000 7f0725cb6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07201005e0 0x7f07201978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.890+0000 7f0725cb6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07201005e0 0x7f07201978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.135:43356/0 (socket says 172.21.15.135:43356) 2024-05-08T23:14:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.890+0000 7f0725cb6700 1 -- 172.21.15.135:0/2584088801 learned_addr learned my addr 172.21.15.135:0/2584088801 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.890+0000 7f0725cb6700 1 -- 172.21.15.135:0/2584088801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07200ffc30 msgr2=0x7f07201973b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T23:14:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.890+0000 7f0725cb6700 1 --2- 172.21.15.135:0/2584088801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07200ffc30 0x7f07201973b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.890+0000 7f0725cb6700 1 -- 172.21.15.135:0/2584088801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0720106450 msgr2=0x7f072019bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.890+0000 7f0725cb6700 1 --2- 172.21.15.135:0/2584088801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0720106450 0x7f072019bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.890+0000 7f0725cb6700 1 -- 172.21.15.135:0/2584088801 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07100095f0 con 0x7f07201005e0 2024-05-08T23:14:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.890+0000 7f0725cb6700 1 --2- 172.21.15.135:0/2584088801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07201005e0 0x7f07201978f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f071000f690 tx=0x7f071000f770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.890+0000 7f07177fe700 1 -- 172.21.15.135:0/2584088801 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071001d070 con 0x7f07201005e0 2024-05-08T23:14:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.890+0000 7f072871b700 1 -- 172.21.15.135:0/2584088801 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072019c860 con 0x7f07201005e0 2024-05-08T23:14:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.890+0000 7f07177fe700 1 -- 172.21.15.135:0/2584088801 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0710005510 con 0x7f07201005e0 2024-05-08T23:14:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.890+0000 7f07177fe700 1 -- 172.21.15.135:0/2584088801 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0710004a70 con 0x7f07201005e0 2024-05-08T23:14:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.890+0000 7f072871b700 1 -- 172.21.15.135:0/2584088801 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072006ab90 con 0x7f07201005e0 2024-05-08T23:14:57.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.891+0000 7f072871b700 1 -- 172.21.15.135:0/2584088801 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0720109630 con 0x7f07201005e0 2024-05-08T23:14:57.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.893+0000 7f07177fe700 1 -- 172.21.15.135:0/2584088801 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f071000fb90 con 0x7f07201005e0 2024-05-08T23:14:57.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.893+0000 7f07177fe700 1 --2- 172.21.15.135:0/2584088801 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f070c0a11b0 0x7f070c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:57.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.894+0000 7f07177fe700 1 -- 172.21.15.135:0/2584088801 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f07100cdac0 con 0x7f07201005e0 2024-05-08T23:14:57.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.894+0000 7f07264b7700 1 --2- 172.21.15.135:0/2584088801 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f070c0a11b0 0x7f070c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:57.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.894+0000 7f07264b7700 1 --2- 172.21.15.135:0/2584088801 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f070c0a11b0 0x7f070c0a3670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f071c009af0 tx=0x7f071c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:57.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.897+0000 7f07177fe700 1 -- 172.21.15.135:0/2584088801 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f07100973f0 con 0x7f07201005e0 2024-05-08T23:14:57.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.958+0000 7fa3f9b8e700 1 -- 172.21.15.135:0/3006207726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4069680 msgr2=0x7fa3f4069a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:57.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.958+0000 7fa3f9b8e700 1 --2- 172.21.15.135:0/3006207726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4069680 0x7fa3f4069a60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009990 tx=0x7fa3e4009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:57.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.958+0000 7fa3f9b8e700 1 -- 172.21.15.135:0/3006207726 shutdown_connections 2024-05-08T23:14:57.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.958+0000 7fa3f9b8e700 1 --2- 172.21.15.135:0/3006207726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3f410d9f0 0x7fa3f410fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:57.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.958+0000 7fa3f9b8e700 1 --2- 172.21.15.135:0/3006207726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4069680 0x7fa3f4069a60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:57.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.958+0000 7fa3f9b8e700 1 --2- 172.21.15.135:0/3006207726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3f4069fa0 0x7fa3f410d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:57.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.958+0000 7fa3f9b8e700 1 -- 172.21.15.135:0/3006207726 >> 172.21.15.135:0/3006207726 conn(0x7fa3f4076ec0 msgr2=0x7fa3f40772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:57.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.958+0000 7fa3f9b8e700 1 -- 172.21.15.135:0/3006207726 shutdown_connections 2024-05-08T23:14:57.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.958+0000 7fa3f9b8e700 1 -- 172.21.15.135:0/3006207726 wait complete. 2024-05-08T23:14:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f9b8e700 1 Processor -- start 2024-05-08T23:14:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f9b8e700 1 -- start start 2024-05-08T23:14:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f9b8e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4069680 0x7fa3f4199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f9b8e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3f4069fa0 0x7fa3f4199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f9b8e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3f410d9f0 0x7fa3f419df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f9b8e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f419e510 con 0x7fa3f4069680 2024-05-08T23:14:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f9b8e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f419e680 con 0x7fa3f410d9f0 2024-05-08T23:14:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f9b8e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f419e840 con 0x7fa3f4069fa0 2024-05-08T23:14:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4069680 0x7fa3f4199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4069680 0x7fa3f4199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54648/0 (socket says 172.21.15.135:54648) 2024-05-08T23:14:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f37fe700 1 -- 172.21.15.135:0/435090673 learned_addr learned my addr 172.21.15.135:0/435090673 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f2ffd700 1 --2- 172.21.15.135:0/435090673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3f4069fa0 0x7fa3f4199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f37fe700 1 -- 172.21.15.135:0/435090673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3f4069fa0 msgr2=0x7fa3f4199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f37fe700 1 --2- 172.21.15.135:0/435090673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3f4069fa0 0x7fa3f4199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f37fe700 1 -- 172.21.15.135:0/435090673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3f410d9f0 msgr2=0x7fa3f419df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f37fe700 1 --2- 172.21.15.135:0/435090673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3f410d9f0 0x7fa3f419df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.959+0000 7fa3f37fe700 1 -- 172.21.15.135:0/435090673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e40095f0 con 0x7fa3f4069680 2024-05-08T23:14:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.960+0000 7fa3f37fe700 1 --2- 172.21.15.135:0/435090673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4069680 0x7fa3f4199610 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4000c00 tx=0x7fa3e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.960+0000 7fa3f0ff9700 1 -- 172.21.15.135:0/435090673 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e401d070 con 0x7fa3f4069680 2024-05-08T23:14:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.960+0000 7fa3f9b8e700 1 -- 172.21.15.135:0/435090673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f419eac0 con 0x7fa3f4069680 2024-05-08T23:14:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.960+0000 7fa3f0ff9700 1 -- 172.21.15.135:0/435090673 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3e4022470 con 0x7fa3f4069680 2024-05-08T23:14:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.960+0000 7fa3f0ff9700 1 -- 172.21.15.135:0/435090673 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4017650 con 0x7fa3f4069680 2024-05-08T23:14:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.960+0000 7fa3f9b8e700 1 -- 172.21.15.135:0/435090673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f41a6380 con 0x7fa3f4069680 2024-05-08T23:14:57.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.961+0000 7fa3f9b8e700 1 -- 172.21.15.135:0/435090673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f4108c10 con 0x7fa3f4069680 2024-05-08T23:14:57.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.962+0000 7fa3f0ff9700 1 -- 172.21.15.135:0/435090673 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fa3e40225e0 con 0x7fa3f4069680 2024-05-08T23:14:57.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.962+0000 7fa3f0ff9700 1 --2- 172.21.15.135:0/435090673 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa3dc0a1230 0x7fa3dc0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:57.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.963+0000 7fa3f2ffd700 1 --2- 172.21.15.135:0/435090673 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa3dc0a1230 0x7fa3dc0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:57.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.963+0000 7fa3f0ff9700 1 -- 172.21.15.135:0/435090673 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa3e40cdc30 con 0x7fa3f4069680 2024-05-08T23:14:57.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.963+0000 7fa3f2ffd700 1 --2- 172.21.15.135:0/435090673 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa3dc0a1230 0x7fa3dc0a36f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa3f419ab70 tx=0x7fa3e8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:57.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:57.971+0000 7fa3f0ff9700 1 -- 172.21.15.135:0/435090673 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa3e40973a0 con 0x7fa3f4069680 2024-05-08T23:14:58.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.109+0000 7f072871b700 1 -- 172.21.15.135:0/2584088801 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f072004ec60 con 0x7f07201005e0 2024-05-08T23:14:58.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.109+0000 7f07177fe700 1 -- 172.21.15.135:0/2584088801 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f0710026020 con 0x7f07201005e0 2024-05-08T23:14:58.110 INFO:teuthology.orchestra.run.smithi135.stdout:300647710739 2024-05-08T23:14:58.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.111+0000 7f072871b700 1 -- 172.21.15.135:0/2584088801 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f070c0a11b0 msgr2=0x7f070c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:58.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.111+0000 7f072871b700 1 --2- 172.21.15.135:0/2584088801 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f070c0a11b0 0x7f070c0a3670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f071c009af0 tx=0x7f071c009260 comp rx=0 tx=0).stop 2024-05-08T23:14:58.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.111+0000 7f072871b700 1 -- 172.21.15.135:0/2584088801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07201005e0 msgr2=0x7f07201978f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:58.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.111+0000 7f072871b700 1 --2- 172.21.15.135:0/2584088801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07201005e0 0x7f07201978f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f071000f690 tx=0x7f071000f770 comp rx=0 tx=0).stop 2024-05-08T23:14:58.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.111+0000 7f072871b700 1 -- 172.21.15.135:0/2584088801 shutdown_connections 2024-05-08T23:14:58.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.111+0000 7f072871b700 1 --2- 172.21.15.135:0/2584088801 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f070c0a11b0 0x7f070c0a3670 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.111+0000 7f072871b700 1 --2- 172.21.15.135:0/2584088801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0720106450 0x7f072019bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.111+0000 7f072871b700 1 --2- 172.21.15.135:0/2584088801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07200ffc30 0x7f07201973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.111+0000 7f072871b700 1 --2- 172.21.15.135:0/2584088801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07201005e0 0x7f07201978f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.111+0000 7f072871b700 1 -- 172.21.15.135:0/2584088801 >> 172.21.15.135:0/2584088801 conn(0x7f0720075220 msgr2=0x7f07200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:58.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.112+0000 7f072871b700 1 -- 172.21.15.135:0/2584088801 shutdown_connections 2024-05-08T23:14:58.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.112+0000 7f072871b700 1 -- 172.21.15.135:0/2584088801 wait complete. 2024-05-08T23:14:58.163 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920808 got 141733920809 for osd.4 2024-05-08T23:14:58.163 DEBUG:teuthology.parallel:result is None 2024-05-08T23:14:58.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.178+0000 7fa3f9b8e700 1 -- 172.21.15.135:0/435090673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa3f419a920 con 0x7fa3f4069680 2024-05-08T23:14:58.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.178+0000 7fa3f0ff9700 1 -- 172.21.15.135:0/435090673 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa3e409a9c0 con 0x7fa3f4069680 2024-05-08T23:14:58.178 INFO:teuthology.orchestra.run.smithi135.stdout:55834574900 2024-05-08T23:14:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.180+0000 7fa3f9b8e700 1 -- 172.21.15.135:0/435090673 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa3dc0a1230 msgr2=0x7fa3dc0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.180+0000 7fa3f9b8e700 1 --2- 172.21.15.135:0/435090673 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa3dc0a1230 0x7fa3dc0a36f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa3f419ab70 tx=0x7fa3e8009190 comp rx=0 tx=0).stop 2024-05-08T23:14:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.180+0000 7fa3f9b8e700 1 -- 172.21.15.135:0/435090673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4069680 msgr2=0x7fa3f4199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.180+0000 7fa3f9b8e700 1 --2- 172.21.15.135:0/435090673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4069680 0x7fa3f4199610 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4000c00 tx=0x7fa3e4004730 comp rx=0 tx=0).stop 2024-05-08T23:14:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.180+0000 7fa3f9b8e700 1 -- 172.21.15.135:0/435090673 shutdown_connections 2024-05-08T23:14:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.180+0000 7fa3f9b8e700 1 --2- 172.21.15.135:0/435090673 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa3dc0a1230 0x7fa3dc0a36f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.180+0000 7fa3f9b8e700 1 --2- 172.21.15.135:0/435090673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3f410d9f0 0x7fa3f419df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.180+0000 7fa3f9b8e700 1 --2- 172.21.15.135:0/435090673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f4069680 0x7fa3f4199610 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.180+0000 7fa3f9b8e700 1 --2- 172.21.15.135:0/435090673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3f4069fa0 0x7fa3f4199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.180+0000 7fa3f9b8e700 1 -- 172.21.15.135:0/435090673 >> 172.21.15.135:0/435090673 conn(0x7fa3f4076ec0 msgr2=0x7fa3f410f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.181+0000 7fa3f9b8e700 1 -- 172.21.15.135:0/435090673 shutdown_connections 2024-05-08T23:14:58.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.181+0000 7fa3f9b8e700 1 -- 172.21.15.135:0/435090673 wait complete. 2024-05-08T23:14:58.296 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:14:58.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:58 smithi179 ceph-mon[46314]: pgmap v241: 97 pgs: 97 active+clean; 642 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-08T23:14:58.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:58 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2584088801' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-08T23:14:58.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:58 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/435090673' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-08T23:14:58.624 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:58 smithi135 ceph-mon[42440]: pgmap v241: 97 pgs: 97 active+clean; 642 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-08T23:14:58.624 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:58 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2584088801' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-08T23:14:58.624 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:58 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/435090673' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-08T23:14:58.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:58 smithi195 ceph-mon[46516]: pgmap v241: 97 pgs: 97 active+clean; 642 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-08T23:14:58.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:58 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2584088801' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-08T23:14:58.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:58 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/435090673' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-08T23:14:58.954 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574898 got 55834574900 for osd.1 2024-05-08T23:14:58.954 DEBUG:teuthology.parallel:result is None 2024-05-08T23:14:58.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.770+0000 7fa44b9ea700 1 -- 172.21.15.135:0/2383746067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4440ffed0 msgr2=0x7fa444100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:58.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.770+0000 7fa44b9ea700 1 --2- 172.21.15.135:0/2383746067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4440ffed0 0x7fa444100350 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa440009990 tx=0x7fa440009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.770+0000 7fa44b9ea700 1 -- 172.21.15.135:0/2383746067 shutdown_connections 2024-05-08T23:14:58.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.770+0000 7fa44b9ea700 1 --2- 172.21.15.135:0/2383746067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa444105f00 0x7fa4441062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.770+0000 7fa44b9ea700 1 --2- 172.21.15.135:0/2383746067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa444100890 0x7fa44410cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.770+0000 7fa44b9ea700 1 --2- 172.21.15.135:0/2383746067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4440ffed0 0x7fa444100350 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.770+0000 7fa44b9ea700 1 -- 172.21.15.135:0/2383746067 >> 172.21.15.135:0/2383746067 conn(0x7fa444075f80 msgr2=0x7fa444076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:58.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.770+0000 7fa44b9ea700 1 -- 172.21.15.135:0/2383746067 shutdown_connections 2024-05-08T23:14:58.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.770+0000 7fa44b9ea700 1 -- 172.21.15.135:0/2383746067 wait complete. 2024-05-08T23:14:58.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.771+0000 7fa44b9ea700 1 Processor -- start 2024-05-08T23:14:58.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.771+0000 7fa44b9ea700 1 -- start start 2024-05-08T23:14:58.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.771+0000 7fa44b9ea700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4440ffed0 0x7fa4441982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:58.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.771+0000 7fa44b9ea700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa444100890 0x7fa444198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:58.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.771+0000 7fa44b9ea700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444105f00 0x7fa4441a3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:58.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.771+0000 7fa44b9ea700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa444199060 con 0x7fa444105f00 2024-05-08T23:14:58.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.771+0000 7fa44b9ea700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4441a3890 con 0x7fa4440ffed0 2024-05-08T23:14:58.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.771+0000 7fa44b9ea700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4441a39d0 con 0x7fa444100890 2024-05-08T23:14:58.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa449f87700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444105f00 0x7fa4441a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:58.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa449f87700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444105f00 0x7fa4441a3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39554/0 (socket says 172.21.15.135:39554) 2024-05-08T23:14:58.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa449f87700 1 -- 172.21.15.135:0/3548928109 learned_addr learned my addr 172.21.15.135:0/3548928109 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:58.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa449786700 1 --2- 172.21.15.135:0/3548928109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4440ffed0 0x7fa4441982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:58.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa448f85700 1 --2- 172.21.15.135:0/3548928109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa444100890 0x7fa444198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:58.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa449f87700 1 -- 172.21.15.135:0/3548928109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa444100890 msgr2=0x7fa444198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:58.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa449f87700 1 --2- 172.21.15.135:0/3548928109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa444100890 0x7fa444198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa449f87700 1 -- 172.21.15.135:0/3548928109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4440ffed0 msgr2=0x7fa4441982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:58.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa449f87700 1 --2- 172.21.15.135:0/3548928109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4440ffed0 0x7fa4441982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa449f87700 1 -- 172.21.15.135:0/3548928109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4400095f0 con 0x7fa444105f00 2024-05-08T23:14:58.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa448f85700 1 --2- 172.21.15.135:0/3548928109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa444100890 0x7fa444198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:14:58.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa449f87700 1 --2- 172.21.15.135:0/3548928109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444105f00 0x7fa4441a3350 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00add0 tx=0x7fa43c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:58.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa43a7fc700 1 -- 172.21.15.135:0/3548928109 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00f070 con 0x7fa444105f00 2024-05-08T23:14:58.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa43a7fc700 1 -- 172.21.15.135:0/3548928109 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa43c007b30 con 0x7fa444105f00 2024-05-08T23:14:58.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa44b9ea700 1 -- 172.21.15.135:0/3548928109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4441a3c30 con 0x7fa444105f00 2024-05-08T23:14:58.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa43a7fc700 1 -- 172.21.15.135:0/3548928109 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c005310 con 0x7fa444105f00 2024-05-08T23:14:58.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.772+0000 7fa44b9ea700 1 -- 172.21.15.135:0/3548928109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4441a40e0 con 0x7fa444105f00 2024-05-08T23:14:58.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.773+0000 7fa44b9ea700 1 -- 172.21.15.135:0/3548928109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa444108420 con 0x7fa444105f00 2024-05-08T23:14:58.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.774+0000 7fa43a7fc700 1 -- 172.21.15.135:0/3548928109 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fa43c00c940 con 0x7fa444105f00 2024-05-08T23:14:58.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.775+0000 7fa43a7fc700 1 --2- 172.21.15.135:0/3548928109 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa4300a11b0 0x7fa4300a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:58.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.775+0000 7fa43a7fc700 1 -- 172.21.15.135:0/3548928109 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa43c0cbff0 con 0x7fa444105f00 2024-05-08T23:14:58.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.775+0000 7fa449786700 1 --2- 172.21.15.135:0/3548928109 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa4300a11b0 0x7fa4300a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:58.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.775+0000 7fa449786700 1 --2- 172.21.15.135:0/3548928109 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa4300a11b0 0x7fa4300a3670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa434009a10 tx=0x7fa434009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:58.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.779+0000 7fa43a7fc700 1 -- 172.21.15.135:0/3548928109 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa43c095760 con 0x7fa444105f00 2024-05-08T23:14:58.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.990+0000 7fa44b9ea700 1 -- 172.21.15.135:0/3548928109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa4441015b0 con 0x7fa444105f00 2024-05-08T23:14:58.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.991+0000 7fa43a7fc700 1 -- 172.21.15.135:0/3548928109 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa43c09f070 con 0x7fa444105f00 2024-05-08T23:14:58.993 INFO:teuthology.orchestra.run.smithi135.stdout:111669149741 2024-05-08T23:14:58.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.993+0000 7fa44b9ea700 1 -- 172.21.15.135:0/3548928109 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa4300a11b0 msgr2=0x7fa4300a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:58.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.993+0000 7fa44b9ea700 1 --2- 172.21.15.135:0/3548928109 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa4300a11b0 0x7fa4300a3670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa434009a10 tx=0x7fa434009190 comp rx=0 tx=0).stop 2024-05-08T23:14:58.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.993+0000 7fa44b9ea700 1 -- 172.21.15.135:0/3548928109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444105f00 msgr2=0x7fa4441a3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:58.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.993+0000 7fa44b9ea700 1 --2- 172.21.15.135:0/3548928109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444105f00 0x7fa4441a3350 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00add0 tx=0x7fa43c00c330 comp rx=0 tx=0).stop 2024-05-08T23:14:58.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.993+0000 7fa44b9ea700 1 -- 172.21.15.135:0/3548928109 shutdown_connections 2024-05-08T23:14:58.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.993+0000 7fa44b9ea700 1 --2- 172.21.15.135:0/3548928109 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa4300a11b0 0x7fa4300a3670 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.993+0000 7fa44b9ea700 1 --2- 172.21.15.135:0/3548928109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444105f00 0x7fa4441a3350 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.993+0000 7fa44b9ea700 1 --2- 172.21.15.135:0/3548928109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4440ffed0 0x7fa4441982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.993+0000 7fa44b9ea700 1 --2- 172.21.15.135:0/3548928109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa444100890 0x7fa444198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:58.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.993+0000 7fa44b9ea700 1 -- 172.21.15.135:0/3548928109 >> 172.21.15.135:0/3548928109 conn(0x7fa444075f80 msgr2=0x7fa4440fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:58.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.993+0000 7fa44b9ea700 1 -- 172.21.15.135:0/3548928109 shutdown_connections 2024-05-08T23:14:58.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:58.993+0000 7fa44b9ea700 1 -- 172.21.15.135:0/3548928109 wait complete. 2024-05-08T23:14:59.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:14:59 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3548928109' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-08T23:14:59.602 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:14:59 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3548928109' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-08T23:14:59.621 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710738 got 300647710739 for osd.10 2024-05-08T23:14:59.621 DEBUG:teuthology.parallel:result is None 2024-05-08T23:14:59.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:14:59 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3548928109' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-08T23:14:59.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.737+0000 7fad8765d700 1 -- 172.21.15.135:0/893985624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad80100ff0 msgr2=0x7fad80101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.737+0000 7fad8765d700 1 --2- 172.21.15.135:0/893985624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad80100ff0 0x7fad80101470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fad70009990 tx=0x7fad70009ca0 comp rx=0 tx=0).stop 2024-05-08T23:14:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.737+0000 7fad8765d700 1 -- 172.21.15.135:0/893985624 shutdown_connections 2024-05-08T23:14:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.737+0000 7fad8765d700 1 --2- 172.21.15.135:0/893985624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad80107030 0x7fad80107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.737+0000 7fad8765d700 1 --2- 172.21.15.135:0/893985624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad801019b0 0x7fad8010dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.737+0000 7fad8765d700 1 --2- 172.21.15.135:0/893985624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad80100ff0 0x7fad80101470 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.737+0000 7fad8765d700 1 -- 172.21.15.135:0/893985624 >> 172.21.15.135:0/893985624 conn(0x7fad80078100 msgr2=0x7fad80078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.738+0000 7fad8765d700 1 -- 172.21.15.135:0/893985624 shutdown_connections 2024-05-08T23:14:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.738+0000 7fad8765d700 1 -- 172.21.15.135:0/893985624 wait complete. 2024-05-08T23:14:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.738+0000 7fad8765d700 1 Processor -- start 2024-05-08T23:14:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.738+0000 7fad8765d700 1 -- start start 2024-05-08T23:14:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.738+0000 7fad8765d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad80100ff0 0x7fad80197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:59.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.738+0000 7fad8765d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad801019b0 0x7fad801978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.738+0000 7fad8765d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad80107030 0x7fad8019bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.738+0000 7fad8765d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8019c290 con 0x7fad801019b0 2024-05-08T23:14:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.738+0000 7fad8765d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8019c400 con 0x7fad80107030 2024-05-08T23:14:59.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.738+0000 7fad8765d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8019c5c0 con 0x7fad80100ff0 2024-05-08T23:14:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.738+0000 7fad84bf8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad801019b0 0x7fad801978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad84bf8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad801019b0 0x7fad801978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39576/0 (socket says 172.21.15.135:39576) 2024-05-08T23:14:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad84bf8700 1 -- 172.21.15.135:0/1368760215 learned_addr learned my addr 172.21.15.135:0/1368760215 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:14:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad85bfa700 1 --2- 172.21.15.135:0/1368760215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad80107030 0x7fad8019bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad853f9700 1 --2- 172.21.15.135:0/1368760215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad80100ff0 0x7fad80197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad84bf8700 1 -- 172.21.15.135:0/1368760215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad80100ff0 msgr2=0x7fad80197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad84bf8700 1 --2- 172.21.15.135:0/1368760215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad80100ff0 0x7fad80197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad84bf8700 1 -- 172.21.15.135:0/1368760215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad80107030 msgr2=0x7fad8019bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad84bf8700 1 --2- 172.21.15.135:0/1368760215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad80107030 0x7fad8019bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad84bf8700 1 -- 172.21.15.135:0/1368760215 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad700095f0 con 0x7fad801019b0 2024-05-08T23:14:59.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad853f9700 1 --2- 172.21.15.135:0/1368760215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad80100ff0 0x7fad80197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:14:59.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad84bf8700 1 --2- 172.21.15.135:0/1368760215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad801019b0 0x7fad801978d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad70000c00 tx=0x7fad7000f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:59.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad767fc700 1 -- 172.21.15.135:0/1368760215 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7001d070 con 0x7fad801019b0 2024-05-08T23:14:59.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad767fc700 1 -- 172.21.15.135:0/1368760215 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad7000fd30 con 0x7fad801019b0 2024-05-08T23:14:59.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad767fc700 1 -- 172.21.15.135:0/1368760215 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70017630 con 0x7fad801019b0 2024-05-08T23:14:59.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad8765d700 1 -- 172.21.15.135:0/1368760215 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8019c840 con 0x7fad801019b0 2024-05-08T23:14:59.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.739+0000 7fad8765d700 1 -- 172.21.15.135:0/1368760215 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8006ab90 con 0x7fad801019b0 2024-05-08T23:14:59.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.740+0000 7fad8765d700 1 -- 172.21.15.135:0/1368760215 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad801094c0 con 0x7fad801019b0 2024-05-08T23:14:59.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.741+0000 7fad767fc700 1 -- 172.21.15.135:0/1368760215 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fad700177d0 con 0x7fad801019b0 2024-05-08T23:14:59.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.742+0000 7fad767fc700 1 --2- 172.21.15.135:0/1368760215 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fad6c0a1230 0x7fad6c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:14:59.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.742+0000 7fad853f9700 1 --2- 172.21.15.135:0/1368760215 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fad6c0a1230 0x7fad6c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:14:59.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.742+0000 7fad767fc700 1 -- 172.21.15.135:0/1368760215 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fad700cdcf0 con 0x7fad801019b0 2024-05-08T23:14:59.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.742+0000 7fad853f9700 1 --2- 172.21.15.135:0/1368760215 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fad6c0a1230 0x7fad6c0a36f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0098b0 tx=0x7fad7c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:14:59.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.746+0000 7fad767fc700 1 -- 172.21.15.135:0/1368760215 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fad7005dd60 con 0x7fad801019b0 2024-05-08T23:14:59.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.948+0000 7fad8765d700 1 -- 172.21.15.135:0/1368760215 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fad8004ec60 con 0x7fad801019b0 2024-05-08T23:14:59.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.948+0000 7fad767fc700 1 -- 172.21.15.135:0/1368760215 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad70097560 con 0x7fad801019b0 2024-05-08T23:14:59.949 INFO:teuthology.orchestra.run.smithi135.stdout:163208757285 2024-05-08T23:14:59.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.950+0000 7fad8765d700 1 -- 172.21.15.135:0/1368760215 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fad6c0a1230 msgr2=0x7fad6c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:59.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.950+0000 7fad8765d700 1 --2- 172.21.15.135:0/1368760215 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fad6c0a1230 0x7fad6c0a36f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0098b0 tx=0x7fad7c008040 comp rx=0 tx=0).stop 2024-05-08T23:14:59.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.950+0000 7fad8765d700 1 -- 172.21.15.135:0/1368760215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad801019b0 msgr2=0x7fad801978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:14:59.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.950+0000 7fad8765d700 1 --2- 172.21.15.135:0/1368760215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad801019b0 0x7fad801978d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad70000c00 tx=0x7fad7000f7d0 comp rx=0 tx=0).stop 2024-05-08T23:14:59.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.951+0000 7fad8765d700 1 -- 172.21.15.135:0/1368760215 shutdown_connections 2024-05-08T23:14:59.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.951+0000 7fad8765d700 1 --2- 172.21.15.135:0/1368760215 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fad6c0a1230 0x7fad6c0a36f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:59.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.951+0000 7fad8765d700 1 --2- 172.21.15.135:0/1368760215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad80100ff0 0x7fad80197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:59.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.951+0000 7fad8765d700 1 --2- 172.21.15.135:0/1368760215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad80107030 0x7fad8019bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:59.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.951+0000 7fad8765d700 1 --2- 172.21.15.135:0/1368760215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad801019b0 0x7fad801978d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:14:59.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.951+0000 7fad8765d700 1 -- 172.21.15.135:0/1368760215 >> 172.21.15.135:0/1368760215 conn(0x7fad80078100 msgr2=0x7fad800ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:14:59.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.951+0000 7fad8765d700 1 -- 172.21.15.135:0/1368760215 shutdown_connections 2024-05-08T23:14:59.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:14:59.951+0000 7fad8765d700 1 -- 172.21.15.135:0/1368760215 wait complete. 2024-05-08T23:15:00.312 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149739 got 111669149741 for osd.3 2024-05-08T23:15:00.312 DEBUG:teuthology.parallel:result is None 2024-05-08T23:15:00.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.571+0000 7f582a441700 1 -- 172.21.15.135:0/3336585862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58240ffed0 msgr2=0x7f5824100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:00.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.571+0000 7f582a441700 1 --2- 172.21.15.135:0/3336585862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58240ffed0 0x7f5824100350 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5818009990 tx=0x7f5818009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:00.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.571+0000 7f582a441700 1 -- 172.21.15.135:0/3336585862 shutdown_connections 2024-05-08T23:15:00.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.571+0000 7f582a441700 1 --2- 172.21.15.135:0/3336585862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5824105f00 0x7f58241062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:00.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.571+0000 7f582a441700 1 --2- 172.21.15.135:0/3336585862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5824100890 0x7f582410cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:00.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.571+0000 7f582a441700 1 --2- 172.21.15.135:0/3336585862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58240ffed0 0x7f5824100350 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:00.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.571+0000 7f582a441700 1 -- 172.21.15.135:0/3336585862 >> 172.21.15.135:0/3336585862 conn(0x7f5824075f80 msgr2=0x7f5824076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:00.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.571+0000 7f582a441700 1 -- 172.21.15.135:0/3336585862 shutdown_connections 2024-05-08T23:15:00.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.571+0000 7f582a441700 1 -- 172.21.15.135:0/3336585862 wait complete. 2024-05-08T23:15:00.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.571+0000 7f582a441700 1 Processor -- start 2024-05-08T23:15:00.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.571+0000 7f582a441700 1 -- start start 2024-05-08T23:15:00.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f582a441700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58240ffed0 0x7f5824197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:00.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f582a441700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5824100890 0x7f5824197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:00.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f582a441700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5824105f00 0x7f582419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:00.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f582a441700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582419c330 con 0x7f58240ffed0 2024-05-08T23:15:00.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f582a441700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582419c4a0 con 0x7f5824105f00 2024-05-08T23:15:00.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f582a441700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582419c660 con 0x7f5824100890 2024-05-08T23:15:00.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f5823fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58240ffed0 0x7f5824197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:00.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f5823fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58240ffed0 0x7f5824197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39594/0 (socket says 172.21.15.135:39594) 2024-05-08T23:15:00.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f5823fff700 1 -- 172.21.15.135:0/3767267728 learned_addr learned my addr 172.21.15.135:0/3767267728 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:00.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f58237fe700 1 --2- 172.21.15.135:0/3767267728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5824100890 0x7f5824197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:00.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f58289de700 1 --2- 172.21.15.135:0/3767267728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5824105f00 0x7f582419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:00.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f5823fff700 1 -- 172.21.15.135:0/3767267728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5824100890 msgr2=0x7f5824197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:00.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f5823fff700 1 --2- 172.21.15.135:0/3767267728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5824100890 0x7f5824197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:00.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f5823fff700 1 -- 172.21.15.135:0/3767267728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5824105f00 msgr2=0x7f582419bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:00.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f5823fff700 1 --2- 172.21.15.135:0/3767267728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5824105f00 0x7f582419bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:00.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f5823fff700 1 -- 172.21.15.135:0/3767267728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58180095f0 con 0x7f58240ffed0 2024-05-08T23:15:00.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f58237fe700 1 --2- 172.21.15.135:0/3767267728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5824100890 0x7f5824197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:00.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f5823fff700 1 --2- 172.21.15.135:0/3767267728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58240ffed0 0x7f5824197430 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f581400c920 tx=0x7f581400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:00.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.572+0000 7f58217fa700 1 -- 172.21.15.135:0/3767267728 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5814007b00 con 0x7f58240ffed0 2024-05-08T23:15:00.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.573+0000 7f58217fa700 1 -- 172.21.15.135:0/3767267728 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5814004cf0 con 0x7f58240ffed0 2024-05-08T23:15:00.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.573+0000 7f582a441700 1 -- 172.21.15.135:0/3767267728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582419c940 con 0x7f58240ffed0 2024-05-08T23:15:00.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.573+0000 7f58217fa700 1 -- 172.21.15.135:0/3767267728 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5814005610 con 0x7f58240ffed0 2024-05-08T23:15:00.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.573+0000 7f582a441700 1 -- 172.21.15.135:0/3767267728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58241a41a0 con 0x7f58240ffed0 2024-05-08T23:15:00.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.574+0000 7f582a441700 1 -- 172.21.15.135:0/3767267728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58241015b0 con 0x7f58240ffed0 2024-05-08T23:15:00.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.575+0000 7f58217fa700 1 -- 172.21.15.135:0/3767267728 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f5814004750 con 0x7f58240ffed0 2024-05-08T23:15:00.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.575+0000 7f58217fa700 1 --2- 172.21.15.135:0/3767267728 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f580c0a11b0 0x7f580c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:00.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.575+0000 7f58217fa700 1 -- 172.21.15.135:0/3767267728 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f58140cc4c0 con 0x7f58240ffed0 2024-05-08T23:15:00.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.576+0000 7f58237fe700 1 --2- 172.21.15.135:0/3767267728 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f580c0a11b0 0x7f580c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:00.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.576+0000 7f58237fe700 1 --2- 172.21.15.135:0/3767267728 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f580c0a11b0 0x7f580c0a3670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5818006010 tx=0x7f581801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:00.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.580+0000 7f58217fa700 1 -- 172.21.15.135:0/3767267728 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5814095ca0 con 0x7f58240ffed0 2024-05-08T23:15:00.586 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:00 smithi135 ceph-mon[42440]: pgmap v242: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-08T23:15:00.586 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:00 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1368760215' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-08T23:15:00.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:00 smithi179 ceph-mon[46314]: pgmap v242: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-08T23:15:00.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:00 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1368760215' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-08T23:15:00.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:00 smithi195 ceph-mon[46516]: pgmap v242: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-05-08T23:15:00.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:00 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1368760215' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-08T23:15:00.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.788+0000 7f582a441700 1 -- 172.21.15.135:0/3767267728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f582404ec60 con 0x7f58240ffed0 2024-05-08T23:15:00.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.789+0000 7f58217fa700 1 -- 172.21.15.135:0/3767267728 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58140992c0 con 0x7f58240ffed0 2024-05-08T23:15:00.789 INFO:teuthology.orchestra.run.smithi135.stdout:244813135900 2024-05-08T23:15:00.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.791+0000 7f582a441700 1 -- 172.21.15.135:0/3767267728 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f580c0a11b0 msgr2=0x7f580c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:00.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.791+0000 7f582a441700 1 --2- 172.21.15.135:0/3767267728 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f580c0a11b0 0x7f580c0a3670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5818006010 tx=0x7f581801a040 comp rx=0 tx=0).stop 2024-05-08T23:15:00.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.791+0000 7f582a441700 1 -- 172.21.15.135:0/3767267728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58240ffed0 msgr2=0x7f5824197430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:00.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.791+0000 7f582a441700 1 --2- 172.21.15.135:0/3767267728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58240ffed0 0x7f5824197430 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f581400c920 tx=0x7f581400cce0 comp rx=0 tx=0).stop 2024-05-08T23:15:00.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.791+0000 7f582a441700 1 -- 172.21.15.135:0/3767267728 shutdown_connections 2024-05-08T23:15:00.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.791+0000 7f582a441700 1 --2- 172.21.15.135:0/3767267728 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f580c0a11b0 0x7f580c0a3670 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:00.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.791+0000 7f582a441700 1 --2- 172.21.15.135:0/3767267728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5824105f00 0x7f582419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:00.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.791+0000 7f582a441700 1 --2- 172.21.15.135:0/3767267728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58240ffed0 0x7f5824197430 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:00.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.791+0000 7f582a441700 1 --2- 172.21.15.135:0/3767267728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5824100890 0x7f5824197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:00.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.791+0000 7f582a441700 1 -- 172.21.15.135:0/3767267728 >> 172.21.15.135:0/3767267728 conn(0x7f5824075f80 msgr2=0x7f58240fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:00.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.791+0000 7f582a441700 1 -- 172.21.15.135:0/3767267728 shutdown_connections 2024-05-08T23:15:00.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:00.791+0000 7f582a441700 1 -- 172.21.15.135:0/3767267728 wait complete. 2024-05-08T23:15:01.249 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135898 got 244813135900 for osd.8 2024-05-08T23:15:01.249 DEBUG:teuthology.parallel:result is None 2024-05-08T23:15:01.289 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757283 got 163208757285 for osd.5 2024-05-08T23:15:01.289 DEBUG:teuthology.parallel:result is None 2024-05-08T23:15:01.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.340+0000 7f084bf3a700 1 -- 172.21.15.135:0/1039215449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0844068950 msgr2=0x7f0844068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:01.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.340+0000 7f084bf3a700 1 --2- 172.21.15.135:0/1039215449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0844068950 0x7f0844068d30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0840009990 tx=0x7f0840009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.340+0000 7f084bf3a700 1 -- 172.21.15.135:0/1039215449 shutdown_connections 2024-05-08T23:15:01.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.340+0000 7f084bf3a700 1 --2- 172.21.15.135:0/1039215449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f084410da80 0x7f084410fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.341+0000 7f084bf3a700 1 --2- 172.21.15.135:0/1039215449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0844068950 0x7f0844068d30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.341+0000 7f084bf3a700 1 --2- 172.21.15.135:0/1039215449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0844069270 0x7f084410d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.341+0000 7f084bf3a700 1 -- 172.21.15.135:0/1039215449 >> 172.21.15.135:0/1039215449 conn(0x7f0844075f80 msgr2=0x7f0844076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:01.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.341+0000 7f084bf3a700 1 -- 172.21.15.135:0/1039215449 shutdown_connections 2024-05-08T23:15:01.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.341+0000 7f084bf3a700 1 -- 172.21.15.135:0/1039215449 wait complete. 2024-05-08T23:15:01.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.341+0000 7f084bf3a700 1 Processor -- start 2024-05-08T23:15:01.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.341+0000 7f084bf3a700 1 -- start start 2024-05-08T23:15:01.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.341+0000 7f084bf3a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0844068950 0x7f08441995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:01.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.341+0000 7f084bf3a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0844069270 0x7f0844199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:01.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.341+0000 7f084bf3a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f084410da80 0x7f084419dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:01.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.341+0000 7f084bf3a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084419e4d0 con 0x7f0844068950 2024-05-08T23:15:01.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.341+0000 7f084bf3a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084419e640 con 0x7f0844069270 2024-05-08T23:15:01.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.341+0000 7f084bf3a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084419e800 con 0x7f084410da80 2024-05-08T23:15:01.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f0849cd6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0844068950 0x7f08441995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:01.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f0849cd6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0844068950 0x7f08441995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39604/0 (socket says 172.21.15.135:39604) 2024-05-08T23:15:01.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f0849cd6700 1 -- 172.21.15.135:0/3469577448 learned_addr learned my addr 172.21.15.135:0/3469577448 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:01.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f084a4d7700 1 --2- 172.21.15.135:0/3469577448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f084410da80 0x7f084419dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:01.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f08494d5700 1 --2- 172.21.15.135:0/3469577448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0844069270 0x7f0844199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:01.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f0849cd6700 1 -- 172.21.15.135:0/3469577448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f084410da80 msgr2=0x7f084419dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:01.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f0849cd6700 1 --2- 172.21.15.135:0/3469577448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f084410da80 0x7f084419dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f0849cd6700 1 -- 172.21.15.135:0/3469577448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0844069270 msgr2=0x7f0844199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:01.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f0849cd6700 1 --2- 172.21.15.135:0/3469577448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0844069270 0x7f0844199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f0849cd6700 1 -- 172.21.15.135:0/3469577448 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08400095f0 con 0x7f0844068950 2024-05-08T23:15:01.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f0849cd6700 1 --2- 172.21.15.135:0/3469577448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0844068950 0x7f08441995d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0840000c00 tx=0x7f084000f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:01.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f083affd700 1 -- 172.21.15.135:0/3469577448 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084001d070 con 0x7f0844068950 2024-05-08T23:15:01.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f083affd700 1 -- 172.21.15.135:0/3469577448 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f084000fd30 con 0x7f0844068950 2024-05-08T23:15:01.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f083affd700 1 -- 172.21.15.135:0/3469577448 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840017630 con 0x7f0844068950 2024-05-08T23:15:01.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f084bf3a700 1 -- 172.21.15.135:0/3469577448 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084419ea80 con 0x7f0844068950 2024-05-08T23:15:01.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.342+0000 7f084bf3a700 1 -- 172.21.15.135:0/3469577448 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08441a6170 con 0x7f0844068950 2024-05-08T23:15:01.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.343+0000 7f084bf3a700 1 -- 172.21.15.135:0/3469577448 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0844108ca0 con 0x7f0844068950 2024-05-08T23:15:01.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.344+0000 7f083affd700 1 -- 172.21.15.135:0/3469577448 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f08400177b0 con 0x7f0844068950 2024-05-08T23:15:01.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.345+0000 7f083affd700 1 --2- 172.21.15.135:0/3469577448 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f08300a11b0 0x7f08300a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:01.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.345+0000 7f08494d5700 1 --2- 172.21.15.135:0/3469577448 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f08300a11b0 0x7f08300a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:01.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.345+0000 7f083affd700 1 -- 172.21.15.135:0/3469577448 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f08400cdc90 con 0x7f0844068950 2024-05-08T23:15:01.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.345+0000 7f08494d5700 1 --2- 172.21.15.135:0/3469577448 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f08300a11b0 0x7f08300a3670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0834005fd0 tx=0x7f083400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:01.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.353+0000 7f083affd700 1 -- 172.21.15.135:0/3469577448 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f084005dd60 con 0x7f0844068950 2024-05-08T23:15:01.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.431+0000 7ff5d0103700 1 -- 172.21.15.135:0/4177657746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c8068950 msgr2=0x7ff5c8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:01.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.431+0000 7ff5d0103700 1 --2- 172.21.15.135:0/4177657746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c8068950 0x7ff5c8068db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009990 tx=0x7ff5b8009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.431+0000 7ff5d0103700 1 -- 172.21.15.135:0/4177657746 shutdown_connections 2024-05-08T23:15:01.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.431+0000 7ff5d0103700 1 --2- 172.21.15.135:0/4177657746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5c80692f0 0x7ff5c810de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.431+0000 7ff5d0103700 1 --2- 172.21.15.135:0/4177657746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5c8107020 0x7ff5c8107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.431+0000 7ff5d0103700 1 --2- 172.21.15.135:0/4177657746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c8068950 0x7ff5c8068db0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.431+0000 7ff5d0103700 1 -- 172.21.15.135:0/4177657746 >> 172.21.15.135:0/4177657746 conn(0x7ff5c8075f80 msgr2=0x7ff5c8076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:01.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.431+0000 7ff5d0103700 1 -- 172.21.15.135:0/4177657746 shutdown_connections 2024-05-08T23:15:01.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.431+0000 7ff5d0103700 1 -- 172.21.15.135:0/4177657746 wait complete. 2024-05-08T23:15:01.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5d0103700 1 Processor -- start 2024-05-08T23:15:01.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5d0103700 1 -- start start 2024-05-08T23:15:01.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5d0103700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5c8068950 0x7ff5c80fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:01.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5d0103700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c80692f0 0x7ff5c81004e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:01.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5d0103700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5c8107020 0x7ff5c8100a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:01.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5d0103700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c81a5770 con 0x7ff5c80692f0 2024-05-08T23:15:01.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5d0103700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c81a58e0 con 0x7ff5c8068950 2024-05-08T23:15:01.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5d0103700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c81a5aa0 con 0x7ff5c8107020 2024-05-08T23:15:01.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5cd69e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c80692f0 0x7ff5c81004e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:01.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5cd69e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c80692f0 0x7ff5c81004e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39630/0 (socket says 172.21.15.135:39630) 2024-05-08T23:15:01.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5cd69e700 1 -- 172.21.15.135:0/2500712492 learned_addr learned my addr 172.21.15.135:0/2500712492 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:01.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5cde9f700 1 --2- 172.21.15.135:0/2500712492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5c8068950 0x7ff5c80fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:01.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5cd69e700 1 -- 172.21.15.135:0/2500712492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5c8107020 msgr2=0x7ff5c8100a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:01.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5cd69e700 1 --2- 172.21.15.135:0/2500712492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5c8107020 0x7ff5c8100a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5cd69e700 1 -- 172.21.15.135:0/2500712492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5c8068950 msgr2=0x7ff5c80fffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:01.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5cd69e700 1 --2- 172.21.15.135:0/2500712492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5c8068950 0x7ff5c80fffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5cd69e700 1 -- 172.21.15.135:0/2500712492 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b80095f0 con 0x7ff5c80692f0 2024-05-08T23:15:01.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.432+0000 7ff5cd69e700 1 --2- 172.21.15.135:0/2500712492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c80692f0 0x7ff5c81004e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8000c00 tx=0x7ff5b8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:01.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.433+0000 7ff5beffd700 1 -- 172.21.15.135:0/2500712492 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b801d070 con 0x7ff5c80692f0 2024-05-08T23:15:01.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.433+0000 7ff5beffd700 1 -- 172.21.15.135:0/2500712492 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5b8022470 con 0x7ff5c80692f0 2024-05-08T23:15:01.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.433+0000 7ff5d0103700 1 -- 172.21.15.135:0/2500712492 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c81a5d20 con 0x7ff5c80692f0 2024-05-08T23:15:01.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.433+0000 7ff5beffd700 1 -- 172.21.15.135:0/2500712492 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8017650 con 0x7ff5c80692f0 2024-05-08T23:15:01.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.433+0000 7ff5d0103700 1 -- 172.21.15.135:0/2500712492 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c81a6130 con 0x7ff5c80692f0 2024-05-08T23:15:01.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.434+0000 7ff5d0103700 1 -- 172.21.15.135:0/2500712492 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c8109540 con 0x7ff5c80692f0 2024-05-08T23:15:01.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.435+0000 7ff5beffd700 1 -- 172.21.15.135:0/2500712492 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7ff5b80225e0 con 0x7ff5c80692f0 2024-05-08T23:15:01.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.435+0000 7ff5beffd700 1 --2- 172.21.15.135:0/2500712492 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff5b40a11b0 0x7ff5b40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:01.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.435+0000 7ff5cde9f700 1 --2- 172.21.15.135:0/2500712492 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff5b40a11b0 0x7ff5b40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:01.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.435+0000 7ff5beffd700 1 -- 172.21.15.135:0/2500712492 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff5b80cddc0 con 0x7ff5c80692f0 2024-05-08T23:15:01.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.436+0000 7ff5cde9f700 1 --2- 172.21.15.135:0/2500712492 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff5b40a11b0 0x7ff5b40a3670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009bd0 tx=0x7ff5c4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:01.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.440+0000 7ff5beffd700 1 -- 172.21.15.135:0/2500712492 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff5b8097630 con 0x7ff5c80692f0 2024-05-08T23:15:01.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:01 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3767267728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-08T23:15:01.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.563+0000 7f084bf3a700 1 -- 172.21.15.135:0/3469577448 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f084419a8e0 con 0x7f0844068950 2024-05-08T23:15:01.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.563+0000 7f083affd700 1 -- 172.21.15.135:0/3469577448 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f0840027020 con 0x7f0844068950 2024-05-08T23:15:01.564 INFO:teuthology.orchestra.run.smithi135.stdout:335007449106 2024-05-08T23:15:01.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.565+0000 7f084bf3a700 1 -- 172.21.15.135:0/3469577448 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f08300a11b0 msgr2=0x7f08300a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:01.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.565+0000 7f084bf3a700 1 --2- 172.21.15.135:0/3469577448 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f08300a11b0 0x7f08300a3670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0834005fd0 tx=0x7f083400a560 comp rx=0 tx=0).stop 2024-05-08T23:15:01.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.565+0000 7f084bf3a700 1 -- 172.21.15.135:0/3469577448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0844068950 msgr2=0x7f08441995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:01.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.565+0000 7f084bf3a700 1 --2- 172.21.15.135:0/3469577448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0844068950 0x7f08441995d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0840000c00 tx=0x7f084000f7d0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.565+0000 7f084bf3a700 1 -- 172.21.15.135:0/3469577448 shutdown_connections 2024-05-08T23:15:01.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.565+0000 7f084bf3a700 1 --2- 172.21.15.135:0/3469577448 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f08300a11b0 0x7f08300a3670 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.565+0000 7f084bf3a700 1 --2- 172.21.15.135:0/3469577448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f084410da80 0x7f084419dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.565+0000 7f084bf3a700 1 --2- 172.21.15.135:0/3469577448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0844068950 0x7f08441995d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.565+0000 7f084bf3a700 1 --2- 172.21.15.135:0/3469577448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0844069270 0x7f0844199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.565+0000 7f084bf3a700 1 -- 172.21.15.135:0/3469577448 >> 172.21.15.135:0/3469577448 conn(0x7f0844075f80 msgr2=0x7f084410f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:01.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.566+0000 7f084bf3a700 1 -- 172.21.15.135:0/3469577448 shutdown_connections 2024-05-08T23:15:01.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.566+0000 7f084bf3a700 1 -- 172.21.15.135:0/3469577448 wait complete. 2024-05-08T23:15:01.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:01 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3767267728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-08T23:15:01.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:01 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3767267728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-08T23:15:01.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.644+0000 7ff5d0103700 1 -- 172.21.15.135:0/2500712492 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff5c81026d0 con 0x7ff5c80692f0 2024-05-08T23:15:01.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.644+0000 7ff5beffd700 1 -- 172.21.15.135:0/2500712492 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5b8027090 con 0x7ff5c80692f0 2024-05-08T23:15:01.645 INFO:teuthology.orchestra.run.smithi135.stdout:193273528355 2024-05-08T23:15:01.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.647+0000 7ff5d0103700 1 -- 172.21.15.135:0/2500712492 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff5b40a11b0 msgr2=0x7ff5b40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:01.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.647+0000 7ff5d0103700 1 --2- 172.21.15.135:0/2500712492 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff5b40a11b0 0x7ff5b40a3670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009bd0 tx=0x7ff5c4009260 comp rx=0 tx=0).stop 2024-05-08T23:15:01.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.647+0000 7ff5d0103700 1 -- 172.21.15.135:0/2500712492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c80692f0 msgr2=0x7ff5c81004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:01.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.647+0000 7ff5d0103700 1 --2- 172.21.15.135:0/2500712492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c80692f0 0x7ff5c81004e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8000c00 tx=0x7ff5b8005ef0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.647+0000 7ff5d0103700 1 -- 172.21.15.135:0/2500712492 shutdown_connections 2024-05-08T23:15:01.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.647+0000 7ff5d0103700 1 --2- 172.21.15.135:0/2500712492 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff5b40a11b0 0x7ff5b40a3670 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.647+0000 7ff5d0103700 1 --2- 172.21.15.135:0/2500712492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5c8107020 0x7ff5c8100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.647+0000 7ff5d0103700 1 --2- 172.21.15.135:0/2500712492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5c8068950 0x7ff5c80fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.647+0000 7ff5d0103700 1 --2- 172.21.15.135:0/2500712492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c80692f0 0x7ff5c81004e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:01.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.647+0000 7ff5d0103700 1 -- 172.21.15.135:0/2500712492 >> 172.21.15.135:0/2500712492 conn(0x7ff5c8075f80 msgr2=0x7ff5c80fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:01.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.647+0000 7ff5d0103700 1 -- 172.21.15.135:0/2500712492 shutdown_connections 2024-05-08T23:15:01.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:01.647+0000 7ff5d0103700 1 -- 172.21.15.135:0/2500712492 wait complete. 2024-05-08T23:15:02.188 INFO:tasks.cephadm.ceph_manager.ceph:need seq 335007449104 got 335007449106 for osd.11 2024-05-08T23:15:02.188 DEBUG:teuthology.parallel:result is None 2024-05-08T23:15:02.227 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528353 got 193273528355 for osd.6 2024-05-08T23:15:02.228 DEBUG:teuthology.parallel:result is None 2024-05-08T23:15:02.228 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-08T23:15:02.228 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T23:15:02.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:02 smithi135 ceph-mon[42440]: pgmap v243: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T23:15:02.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:02 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3469577448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-08T23:15:02.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:02 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2500712492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-08T23:15:02.496 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:15:02.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:02 smithi179 ceph-mon[46314]: pgmap v243: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T23:15:02.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:02 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3469577448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-08T23:15:02.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:02 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2500712492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-08T23:15:02.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:02 smithi195 ceph-mon[46516]: pgmap v243: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T23:15:02.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:02 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3469577448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-08T23:15:02.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:02 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2500712492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-08T23:15:03.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.491+0000 7ffb509ec700 1 -- 172.21.15.135:0/2294046118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb4c106fe0 msgr2=0x7ffb4c1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:03.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.491+0000 7ffb509ec700 1 --2- 172.21.15.135:0/2294046118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb4c106fe0 0x7ffb4c1073c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c0099c0 tx=0x7ffb3c009cd0 comp rx=0 tx=0).stop 2024-05-08T23:15:03.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.491+0000 7ffb509ec700 1 -- 172.21.15.135:0/2294046118 shutdown_connections 2024-05-08T23:15:03.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.491+0000 7ffb509ec700 1 --2- 172.21.15.135:0/2294046118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb4c069c10 0x7ffb4c10de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:03.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.491+0000 7ffb509ec700 1 --2- 172.21.15.135:0/2294046118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb4c106fe0 0x7ffb4c1073c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:03.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.491+0000 7ffb509ec700 1 --2- 172.21.15.135:0/2294046118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb4c069250 0x7ffb4c0696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:03.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.491+0000 7ffb509ec700 1 -- 172.21.15.135:0/2294046118 >> 172.21.15.135:0/2294046118 conn(0x7ffb4c076e70 msgr2=0x7ffb4c077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:03.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.491+0000 7ffb509ec700 1 -- 172.21.15.135:0/2294046118 shutdown_connections 2024-05-08T23:15:03.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.491+0000 7ffb509ec700 1 -- 172.21.15.135:0/2294046118 wait complete. 2024-05-08T23:15:03.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb509ec700 1 Processor -- start 2024-05-08T23:15:03.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb509ec700 1 -- start start 2024-05-08T23:15:03.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb509ec700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb4c069250 0x7ffb4c197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:03.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb509ec700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb4c069c10 0x7ffb4c197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:03.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb509ec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb4c106fe0 0x7ffb4c19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:03.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb509ec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c19c330 con 0x7ffb4c106fe0 2024-05-08T23:15:03.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb509ec700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c19c4a0 con 0x7ffb4c069250 2024-05-08T23:15:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb509ec700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c19c660 con 0x7ffb4c069c10 2024-05-08T23:15:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb4ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb4c106fe0 0x7ffb4c19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb4ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb4c106fe0 0x7ffb4c19bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39652/0 (socket says 172.21.15.135:39652) 2024-05-08T23:15:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb4ad9d700 1 -- 172.21.15.135:0/3886938264 learned_addr learned my addr 172.21.15.135:0/3886938264 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb49d9b700 1 --2- 172.21.15.135:0/3886938264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb4c069c10 0x7ffb4c197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb4a59c700 1 --2- 172.21.15.135:0/3886938264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb4c069250 0x7ffb4c197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb4ad9d700 1 -- 172.21.15.135:0/3886938264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb4c069c10 msgr2=0x7ffb4c197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb4ad9d700 1 --2- 172.21.15.135:0/3886938264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb4c069c10 0x7ffb4c197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb4ad9d700 1 -- 172.21.15.135:0/3886938264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb4c069250 msgr2=0x7ffb4c197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb4ad9d700 1 --2- 172.21.15.135:0/3886938264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb4c069250 0x7ffb4c197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb4ad9d700 1 -- 172.21.15.135:0/3886938264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c0095f0 con 0x7ffb4c106fe0 2024-05-08T23:15:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb4ad9d700 1 --2- 172.21.15.135:0/3886938264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb4c106fe0 0x7ffb4c19bd20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb44007ee0 tx=0x7ffb4400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.492+0000 7ffb3b7fe700 1 -- 172.21.15.135:0/3886938264 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb44017070 con 0x7ffb4c106fe0 2024-05-08T23:15:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.493+0000 7ffb509ec700 1 -- 172.21.15.135:0/3886938264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4c19c940 con 0x7ffb4c106fe0 2024-05-08T23:15:03.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.493+0000 7ffb3b7fe700 1 -- 172.21.15.135:0/3886938264 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb4400f040 con 0x7ffb4c106fe0 2024-05-08T23:15:03.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.493+0000 7ffb3b7fe700 1 -- 172.21.15.135:0/3886938264 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb44005740 con 0x7ffb4c106fe0 2024-05-08T23:15:03.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.493+0000 7ffb509ec700 1 -- 172.21.15.135:0/3886938264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4c1a41a0 con 0x7ffb4c106fe0 2024-05-08T23:15:03.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.494+0000 7ffb509ec700 1 -- 172.21.15.135:0/3886938264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb4c1094e0 con 0x7ffb4c106fe0 2024-05-08T23:15:03.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.495+0000 7ffb3b7fe700 1 -- 172.21.15.135:0/3886938264 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7ffb4400dc60 con 0x7ffb4c106fe0 2024-05-08T23:15:03.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.496+0000 7ffb3b7fe700 1 --2- 172.21.15.135:0/3886938264 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ffb340a11b0 0x7ffb340a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:03.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.496+0000 7ffb4a59c700 1 --2- 172.21.15.135:0/3886938264 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ffb340a11b0 0x7ffb340a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:03.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.496+0000 7ffb3b7fe700 1 -- 172.21.15.135:0/3886938264 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ffb440cc710 con 0x7ffb4c106fe0 2024-05-08T23:15:03.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.496+0000 7ffb4a59c700 1 --2- 172.21.15.135:0/3886938264 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ffb340a11b0 0x7ffb340a3670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c006010 tx=0x7ffb3c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:03.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.500+0000 7ffb3b7fe700 1 -- 172.21.15.135:0/3886938264 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ffb44095ef0 con 0x7ffb4c106fe0 2024-05-08T23:15:03.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.686+0000 7ffb509ec700 1 -- 172.21.15.135:0/3886938264 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb4c198740 con 0x7ffb340a11b0 2024-05-08T23:15:03.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.697+0000 7ffb3b7fe700 1 -- 172.21.15.135:0/3886938264 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341410 (secure 0 0 0) 0x7ffb4c198740 con 0x7ffb340a11b0 2024-05-08T23:15:03.702 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:03.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.700+0000 7ffb509ec700 1 -- 172.21.15.135:0/3886938264 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ffb340a11b0 msgr2=0x7ffb340a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:03.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.700+0000 7ffb509ec700 1 --2- 172.21.15.135:0/3886938264 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ffb340a11b0 0x7ffb340a3670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c006010 tx=0x7ffb3c000bc0 comp rx=0 tx=0).stop 2024-05-08T23:15:03.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.700+0000 7ffb509ec700 1 -- 172.21.15.135:0/3886938264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb4c106fe0 msgr2=0x7ffb4c19bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:03.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.700+0000 7ffb509ec700 1 --2- 172.21.15.135:0/3886938264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb4c106fe0 0x7ffb4c19bd20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb44007ee0 tx=0x7ffb4400d3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:03.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.700+0000 7ffb509ec700 1 -- 172.21.15.135:0/3886938264 shutdown_connections 2024-05-08T23:15:03.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.700+0000 7ffb509ec700 1 --2- 172.21.15.135:0/3886938264 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ffb340a11b0 0x7ffb340a3670 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:03.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.700+0000 7ffb509ec700 1 --2- 172.21.15.135:0/3886938264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb4c106fe0 0x7ffb4c19bd20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:03.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.700+0000 7ffb509ec700 1 --2- 172.21.15.135:0/3886938264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb4c069250 0x7ffb4c197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:03.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.700+0000 7ffb509ec700 1 --2- 172.21.15.135:0/3886938264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb4c069c10 0x7ffb4c197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:03.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.700+0000 7ffb509ec700 1 -- 172.21.15.135:0/3886938264 >> 172.21.15.135:0/3886938264 conn(0x7ffb4c076e70 msgr2=0x7ffb4c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:03.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.700+0000 7ffb509ec700 1 -- 172.21.15.135:0/3886938264 shutdown_connections 2024-05-08T23:15:03.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:03.700+0000 7ffb509ec700 1 -- 172.21.15.135:0/3886938264 wait complete. 2024-05-08T23:15:03.705 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T23:15:04.103 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-05-08T23:15:03.041238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659011,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":512,"num_read_kb":376,"num_write":415,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363980,"kb_used_data":11116,"kb_used_omap":18,"kb_used_meta":352749,"kb_avail":1124577844,"statfs":{"total":1151940427776,"available":1151567712256,"internally_reserved":0,"allocated":11382784,"data_stored":7121925,"data_compressed":113157,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19142,"internal_metadata":361215290},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":63,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003035"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934695+0000","last_change":"2024-05-08T23:14:21.938982+0000","last_active":"2024-05-08T23:14:22.934695+0000","last_peered":"2024-05-08T23:14:22.934695+0000","last_clean":"2024-05-08T23:14:22.934695+0000","last_became_active":"2024-05-08T23:14:21.938630+0000","last_became_peered":"2024-05-08T23:14:21.938630+0000","last_unstale":"2024-05-08T23:14:22.934695+0000","last_undegraded":"2024-05-08T23:14:22.934695+0000","last_fullsized":"2024-05-08T23:14:22.934695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:33.421139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125505+0000","last_change":"2024-05-08T23:14:21.952126+0000","last_active":"2024-05-08T23:14:24.125505+0000","last_peered":"2024-05-08T23:14:24.125505+0000","last_clean":"2024-05-08T23:14:24.125505+0000","last_became_active":"2024-05-08T23:14:21.951155+0000","last_became_peered":"2024-05-08T23:14:21.951155+0000","last_unstale":"2024-05-08T23:14:24.125505+0000","last_undegraded":"2024-05-08T23:14:24.125505+0000","last_fullsized":"2024-05-08T23:14:24.125505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:24.931166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125409+0000","last_change":"2024-05-08T23:14:21.947520+0000","last_active":"2024-05-08T23:14:24.125409+0000","last_peered":"2024-05-08T23:14:24.125409+0000","last_clean":"2024-05-08T23:14:24.125409+0000","last_became_active":"2024-05-08T23:14:21.947258+0000","last_became_peered":"2024-05-08T23:14:21.947258+0000","last_unstale":"2024-05-08T23:14:24.125409+0000","last_undegraded":"2024-05-08T23:14:24.125409+0000","last_fullsized":"2024-05-08T23:14:24.125409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:37.173840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.850109+0000","last_change":"2024-05-08T23:14:21.951221+0000","last_active":"2024-05-08T23:14:23.850109+0000","last_peered":"2024-05-08T23:14:23.850109+0000","last_clean":"2024-05-08T23:14:23.850109+0000","last_became_active":"2024-05-08T23:14:21.950398+0000","last_became_peered":"2024-05-08T23:14:21.950398+0000","last_unstale":"2024-05-08T23:14:23.850109+0000","last_undegraded":"2024-05-08T23:14:23.850109+0000","last_fullsized":"2024-05-08T23:14:23.850109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:26.360521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169189+0000","last_change":"2024-05-08T23:14:21.947783+0000","last_active":"2024-05-08T23:14:24.169189+0000","last_peered":"2024-05-08T23:14:24.169189+0000","last_clean":"2024-05-08T23:14:24.169189+0000","last_became_active":"2024-05-08T23:14:21.947448+0000","last_became_peered":"2024-05-08T23:14:21.947448+0000","last_unstale":"2024-05-08T23:14:24.169189+0000","last_undegraded":"2024-05-08T23:14:24.169189+0000","last_fullsized":"2024-05-08T23:14:24.169189+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:21.447674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.071003+0000","last_change":"2024-05-08T23:14:21.945541+0000","last_active":"2024-05-08T23:14:22.071003+0000","last_peered":"2024-05-08T23:14:22.071003+0000","last_clean":"2024-05-08T23:14:22.071003+0000","last_became_active":"2024-05-08T23:14:21.945135+0000","last_became_peered":"2024-05-08T23:14:21.945135+0000","last_unstale":"2024-05-08T23:14:22.071003+0000","last_undegraded":"2024-05-08T23:14:22.071003+0000","last_fullsized":"2024-05-08T23:14:22.071003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:44.143289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041794+0000","last_change":"2024-05-08T23:14:21.958827+0000","last_active":"2024-05-08T23:14:22.041794+0000","last_peered":"2024-05-08T23:14:22.041794+0000","last_clean":"2024-05-08T23:14:22.041794+0000","last_became_active":"2024-05-08T23:14:21.958400+0000","last_became_peered":"2024-05-08T23:14:21.958400+0000","last_unstale":"2024-05-08T23:14:22.041794+0000","last_undegraded":"2024-05-08T23:14:22.041794+0000","last_fullsized":"2024-05-08T23:14:22.041794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:39.280896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099219+0000","last_change":"2024-05-08T23:14:21.960924+0000","last_active":"2024-05-08T23:14:23.099219+0000","last_peered":"2024-05-08T23:14:23.099219+0000","last_clean":"2024-05-08T23:14:23.099219+0000","last_became_active":"2024-05-08T23:14:21.960651+0000","last_became_peered":"2024-05-08T23:14:21.960651+0000","last_unstale":"2024-05-08T23:14:23.099219+0000","last_undegraded":"2024-05-08T23:14:23.099219+0000","last_fullsized":"2024-05-08T23:14:23.099219+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:14:22.284354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468928+0000","last_change":"2024-05-08T23:14:21.961059+0000","last_active":"2024-05-08T23:14:22.468928+0000","last_peered":"2024-05-08T23:14:22.468928+0000","last_clean":"2024-05-08T23:14:22.468928+0000","last_became_active":"2024-05-08T23:14:21.960730+0000","last_became_peered":"2024-05-08T23:14:21.960730+0000","last_unstale":"2024-05-08T23:14:22.468928+0000","last_undegraded":"2024-05-08T23:14:22.468928+0000","last_fullsized":"2024-05-08T23:14:22.468928+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:01.448480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.071052+0000","last_change":"2024-05-08T23:14:21.950267+0000","last_active":"2024-05-08T23:14:22.071052+0000","last_peered":"2024-05-08T23:14:22.071052+0000","last_clean":"2024-05-08T23:14:22.071052+0000","last_became_active":"2024-05-08T23:14:21.949477+0000","last_became_peered":"2024-05-08T23:14:21.949477+0000","last_unstale":"2024-05-08T23:14:22.071052+0000","last_undegraded":"2024-05-08T23:14:22.071052+0000","last_fullsized":"2024-05-08T23:14:22.071052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:36.123316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041851+0000","last_change":"2024-05-08T23:14:21.955566+0000","last_active":"2024-05-08T23:14:22.041851+0000","last_peered":"2024-05-08T23:14:22.041851+0000","last_clean":"2024-05-08T23:14:22.041851+0000","last_became_active":"2024-05-08T23:14:21.955208+0000","last_became_peered":"2024-05-08T23:14:21.955208+0000","last_unstale":"2024-05-08T23:14:22.041851+0000","last_undegraded":"2024-05-08T23:14:22.041851+0000","last_fullsized":"2024-05-08T23:14:22.041851+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:29.478197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.850194+0000","last_change":"2024-05-08T23:14:21.939532+0000","last_active":"2024-05-08T23:14:23.850194+0000","last_peered":"2024-05-08T23:14:23.850194+0000","last_clean":"2024-05-08T23:14:23.850194+0000","last_became_active":"2024-05-08T23:14:21.938590+0000","last_became_peered":"2024-05-08T23:14:21.938590+0000","last_unstale":"2024-05-08T23:14:23.850194+0000","last_undegraded":"2024-05-08T23:14:23.850194+0000","last_fullsized":"2024-05-08T23:14:23.850194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:50.525121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067896+0000","last_change":"2024-05-08T23:14:21.942720+0000","last_active":"2024-05-08T23:14:24.067896+0000","last_peered":"2024-05-08T23:14:24.067896+0000","last_clean":"2024-05-08T23:14:24.067896+0000","last_became_active":"2024-05-08T23:14:21.942396+0000","last_became_peered":"2024-05-08T23:14:21.942396+0000","last_unstale":"2024-05-08T23:14:24.067896+0000","last_undegraded":"2024-05-08T23:14:24.067896+0000","last_fullsized":"2024-05-08T23:14:24.067896+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:17.893007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125207+0000","last_change":"2024-05-08T23:14:21.946955+0000","last_active":"2024-05-08T23:14:24.125207+0000","last_peered":"2024-05-08T23:14:24.125207+0000","last_clean":"2024-05-08T23:14:24.125207+0000","last_became_active":"2024-05-08T23:14:21.946733+0000","last_became_peered":"2024-05-08T23:14:21.946733+0000","last_unstale":"2024-05-08T23:14:24.125207+0000","last_undegraded":"2024-05-08T23:14:24.125207+0000","last_fullsized":"2024-05-08T23:14:24.125207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:39.097612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125239+0000","last_change":"2024-05-08T23:14:21.945827+0000","last_active":"2024-05-08T23:14:24.125239+0000","last_peered":"2024-05-08T23:14:24.125239+0000","last_clean":"2024-05-08T23:14:24.125239+0000","last_became_active":"2024-05-08T23:14:21.945606+0000","last_became_peered":"2024-05-08T23:14:21.945606+0000","last_unstale":"2024-05-08T23:14:24.125239+0000","last_undegraded":"2024-05-08T23:14:24.125239+0000","last_fullsized":"2024-05-08T23:14:24.125239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:22.689917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468793+0000","last_change":"2024-05-08T23:14:21.952640+0000","last_active":"2024-05-08T23:14:22.468793+0000","last_peered":"2024-05-08T23:14:22.468793+0000","last_clean":"2024-05-08T23:14:22.468793+0000","last_became_active":"2024-05-08T23:14:21.952283+0000","last_became_peered":"2024-05-08T23:14:21.952283+0000","last_unstale":"2024-05-08T23:14:22.468793+0000","last_undegraded":"2024-05-08T23:14:22.468793+0000","last_fullsized":"2024-05-08T23:14:22.468793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:42.211479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934813+0000","last_change":"2024-05-08T23:14:21.947950+0000","last_active":"2024-05-08T23:14:22.934813+0000","last_peered":"2024-05-08T23:14:22.934813+0000","last_clean":"2024-05-08T23:14:22.934813+0000","last_became_active":"2024-05-08T23:14:21.947621+0000","last_became_peered":"2024-05-08T23:14:21.947621+0000","last_unstale":"2024-05-08T23:14:22.934813+0000","last_undegraded":"2024-05-08T23:14:22.934813+0000","last_fullsized":"2024-05-08T23:14:22.934813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:54:47.736649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.933859+0000","last_change":"2024-05-08T23:14:21.950172+0000","last_active":"2024-05-08T23:14:22.933859+0000","last_peered":"2024-05-08T23:14:22.933859+0000","last_clean":"2024-05-08T23:14:22.933859+0000","last_became_active":"2024-05-08T23:14:21.949844+0000","last_became_peered":"2024-05-08T23:14:21.949844+0000","last_unstale":"2024-05-08T23:14:22.933859+0000","last_undegraded":"2024-05-08T23:14:22.933859+0000","last_fullsized":"2024-05-08T23:14:22.933859+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:18.216174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685351+0000","last_change":"2024-05-08T23:14:21.943336+0000","last_active":"2024-05-08T23:14:23.685351+0000","last_peered":"2024-05-08T23:14:23.685351+0000","last_clean":"2024-05-08T23:14:23.685351+0000","last_became_active":"2024-05-08T23:14:21.942697+0000","last_became_peered":"2024-05-08T23:14:21.942697+0000","last_unstale":"2024-05-08T23:14:23.685351+0000","last_undegraded":"2024-05-08T23:14:23.685351+0000","last_fullsized":"2024-05-08T23:14:23.685351+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:54.332708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:57.403673+0000","last_change":"2024-05-08T23:14:21.526822+0000","last_active":"2024-05-08T23:14:57.403673+0000","last_peered":"2024-05-08T23:14:57.403673+0000","last_clean":"2024-05-08T23:14:57.403673+0000","last_became_active":"2024-05-08T23:14:21.526561+0000","last_became_peered":"2024-05-08T23:14:21.526561+0000","last_unstale":"2024-05-08T23:14:57.403673+0000","last_undegraded":"2024-05-08T23:14:57.403673+0000","last_fullsized":"2024-05-08T23:14:57.403673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:45.360865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099287+0000","last_change":"2024-05-08T23:14:21.961315+0000","last_active":"2024-05-08T23:14:23.099287+0000","last_peered":"2024-05-08T23:14:23.099287+0000","last_clean":"2024-05-08T23:14:23.099287+0000","last_became_active":"2024-05-08T23:14:21.961039+0000","last_became_peered":"2024-05-08T23:14:21.961039+0000","last_unstale":"2024-05-08T23:14:23.099287+0000","last_undegraded":"2024-05-08T23:14:23.099287+0000","last_fullsized":"2024-05-08T23:14:23.099287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:01.163246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.168432+0000","last_change":"2024-05-08T23:14:21.523353+0000","last_active":"2024-05-08T23:14:24.168432+0000","last_peered":"2024-05-08T23:14:24.168432+0000","last_clean":"2024-05-08T23:14:24.168432+0000","last_became_active":"2024-05-08T23:14:21.523046+0000","last_became_peered":"2024-05-08T23:14:21.523046+0000","last_unstale":"2024-05-08T23:14:24.168432+0000","last_undegraded":"2024-05-08T23:14:24.168432+0000","last_fullsized":"2024-05-08T23:14:24.168432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:04:54.448457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125580+0000","last_change":"2024-05-08T23:14:21.948093+0000","last_active":"2024-05-08T23:14:24.125580+0000","last_peered":"2024-05-08T23:14:24.125580+0000","last_clean":"2024-05-08T23:14:24.125580+0000","last_became_active":"2024-05-08T23:14:21.947812+0000","last_became_peered":"2024-05-08T23:14:21.947812+0000","last_unstale":"2024-05-08T23:14:24.125580+0000","last_undegraded":"2024-05-08T23:14:24.125580+0000","last_fullsized":"2024-05-08T23:14:24.125580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:47.804387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:28.360310+0000","last_change":"2024-05-08T23:14:21.527205+0000","last_active":"2024-05-08T23:14:28.360310+0000","last_peered":"2024-05-08T23:14:28.360310+0000","last_clean":"2024-05-08T23:14:28.360310+0000","last_became_active":"2024-05-08T23:14:21.526699+0000","last_became_peered":"2024-05-08T23:14:21.526699+0000","last_unstale":"2024-05-08T23:14:28.360310+0000","last_undegraded":"2024-05-08T23:14:28.360310+0000","last_fullsized":"2024-05-08T23:14:28.360310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:04.818255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468855+0000","last_change":"2024-05-08T23:14:21.946804+0000","last_active":"2024-05-08T23:14:22.468855+0000","last_peered":"2024-05-08T23:14:22.468855+0000","last_clean":"2024-05-08T23:14:22.468855+0000","last_became_active":"2024-05-08T23:14:21.946448+0000","last_became_peered":"2024-05-08T23:14:21.946448+0000","last_unstale":"2024-05-08T23:14:22.468855+0000","last_undegraded":"2024-05-08T23:14:22.468855+0000","last_fullsized":"2024-05-08T23:14:22.468855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:40.495644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.354442+0000","last_change":"2024-05-08T23:14:21.521146+0000","last_active":"2024-05-08T23:14:27.354442+0000","last_peered":"2024-05-08T23:14:27.354442+0000","last_clean":"2024-05-08T23:14:27.354442+0000","last_became_active":"2024-05-08T23:14:21.520936+0000","last_became_peered":"2024-05-08T23:14:21.520936+0000","last_unstale":"2024-05-08T23:14:27.354442+0000","last_undegraded":"2024-05-08T23:14:27.354442+0000","last_fullsized":"2024-05-08T23:14:27.354442+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:30.725824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.102003+0000","last_change":"2024-05-08T23:14:21.961059+0000","last_active":"2024-05-08T23:14:22.102003+0000","last_peered":"2024-05-08T23:14:22.102003+0000","last_clean":"2024-05-08T23:14:22.102003+0000","last_became_active":"2024-05-08T23:14:21.960719+0000","last_became_peered":"2024-05-08T23:14:21.960719+0000","last_unstale":"2024-05-08T23:14:22.102003+0000","last_undegraded":"2024-05-08T23:14:22.102003+0000","last_fullsized":"2024-05-08T23:14:22.102003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:13.004002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:15:00.389649+0000","last_change":"2024-05-08T23:14:21.527091+0000","last_active":"2024-05-08T23:15:00.389649+0000","last_peered":"2024-05-08T23:15:00.389649+0000","last_clean":"2024-05-08T23:15:00.389649+0000","last_became_active":"2024-05-08T23:14:21.526750+0000","last_became_peered":"2024-05-08T23:14:21.526750+0000","last_unstale":"2024-05-08T23:15:00.389649+0000","last_undegraded":"2024-05-08T23:15:00.389649+0000","last_fullsized":"2024-05-08T23:15:00.389649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:35.059241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169216+0000","last_change":"2024-05-08T23:14:21.942050+0000","last_active":"2024-05-08T23:14:24.169216+0000","last_peered":"2024-05-08T23:14:24.169216+0000","last_clean":"2024-05-08T23:14:24.169216+0000","last_became_active":"2024-05-08T23:14:21.941719+0000","last_became_peered":"2024-05-08T23:14:21.941719+0000","last_unstale":"2024-05-08T23:14:24.169216+0000","last_undegraded":"2024-05-08T23:14:24.169216+0000","last_fullsized":"2024-05-08T23:14:24.169216+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:03.821820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.344926+0000","last_change":"2024-05-08T23:14:21.523760+0000","last_active":"2024-05-08T23:14:26.344926+0000","last_peered":"2024-05-08T23:14:26.344926+0000","last_clean":"2024-05-08T23:14:26.344926+0000","last_became_active":"2024-05-08T23:14:21.523213+0000","last_became_peered":"2024-05-08T23:14:21.523213+0000","last_unstale":"2024-05-08T23:14:26.344926+0000","last_undegraded":"2024-05-08T23:14:26.344926+0000","last_fullsized":"2024-05-08T23:14:26.344926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:12.225427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101977+0000","last_change":"2024-05-08T23:14:21.959473+0000","last_active":"2024-05-08T23:14:22.101977+0000","last_peered":"2024-05-08T23:14:22.101977+0000","last_clean":"2024-05-08T23:14:22.101977+0000","last_became_active":"2024-05-08T23:14:21.959127+0000","last_became_peered":"2024-05-08T23:14:21.959127+0000","last_unstale":"2024-05-08T23:14:22.101977+0000","last_undegraded":"2024-05-08T23:14:22.101977+0000","last_fullsized":"2024-05-08T23:14:22.101977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:50.181028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.960065+0000","last_change":"2024-05-08T23:14:21.520072+0000","last_active":"2024-05-08T23:14:25.960065+0000","last_peered":"2024-05-08T23:14:25.960065+0000","last_clean":"2024-05-08T23:14:25.960065+0000","last_became_active":"2024-05-08T23:14:21.519753+0000","last_became_peered":"2024-05-08T23:14:21.519753+0000","last_unstale":"2024-05-08T23:14:25.960065+0000","last_undegraded":"2024-05-08T23:14:25.960065+0000","last_fullsized":"2024-05-08T23:14:25.960065+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:35.966643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099236+0000","last_change":"2024-05-08T23:14:21.946034+0000","last_active":"2024-05-08T23:14:23.099236+0000","last_peered":"2024-05-08T23:14:23.099236+0000","last_clean":"2024-05-08T23:14:23.099236+0000","last_became_active":"2024-05-08T23:14:21.945652+0000","last_became_peered":"2024-05-08T23:14:21.945652+0000","last_unstale":"2024-05-08T23:14:23.099236+0000","last_undegraded":"2024-05-08T23:14:23.099236+0000","last_fullsized":"2024-05-08T23:14:23.099236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:13.527673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.355671+0000","last_change":"2024-05-08T23:14:21.522394+0000","last_active":"2024-05-08T23:14:27.355671+0000","last_peered":"2024-05-08T23:14:27.355671+0000","last_clean":"2024-05-08T23:14:27.355671+0000","last_became_active":"2024-05-08T23:14:21.522038+0000","last_became_peered":"2024-05-08T23:14:21.522038+0000","last_unstale":"2024-05-08T23:14:27.355671+0000","last_undegraded":"2024-05-08T23:14:27.355671+0000","last_fullsized":"2024-05-08T23:14:27.355671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:18.958647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.933815+0000","last_change":"2024-05-08T23:14:21.946005+0000","last_active":"2024-05-08T23:14:22.933815+0000","last_peered":"2024-05-08T23:14:22.933815+0000","last_clean":"2024-05-08T23:14:22.933815+0000","last_became_active":"2024-05-08T23:14:21.945681+0000","last_became_peered":"2024-05-08T23:14:21.945681+0000","last_unstale":"2024-05-08T23:14:22.933815+0000","last_undegraded":"2024-05-08T23:14:22.933815+0000","last_fullsized":"2024-05-08T23:14:22.933815+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:17.511869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":86,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:15:01.390444+0000","last_change":"2024-05-08T23:14:21.521775+0000","last_active":"2024-05-08T23:15:01.390444+0000","last_peered":"2024-05-08T23:15:01.390444+0000","last_clean":"2024-05-08T23:15:01.390444+0000","last_became_active":"2024-05-08T23:14:21.521428+0000","last_became_peered":"2024-05-08T23:14:21.521428+0000","last_unstale":"2024-05-08T23:15:01.390444+0000","last_undegraded":"2024-05-08T23:15:01.390444+0000","last_fullsized":"2024-05-08T23:15:01.390444+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:13.379322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468911+0000","last_change":"2024-05-08T23:14:21.944886+0000","last_active":"2024-05-08T23:14:22.468911+0000","last_peered":"2024-05-08T23:14:22.468911+0000","last_clean":"2024-05-08T23:14:22.468911+0000","last_became_active":"2024-05-08T23:14:21.944585+0000","last_became_peered":"2024-05-08T23:14:21.944585+0000","last_unstale":"2024-05-08T23:14:22.468911+0000","last_undegraded":"2024-05-08T23:14:22.468911+0000","last_fullsized":"2024-05-08T23:14:22.468911+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:00.519286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.354442+0000","last_change":"2024-05-08T23:14:21.527500+0000","last_active":"2024-05-08T23:14:27.354442+0000","last_peered":"2024-05-08T23:14:27.354442+0000","last_clean":"2024-05-08T23:14:27.354442+0000","last_became_active":"2024-05-08T23:14:21.526709+0000","last_became_peered":"2024-05-08T23:14:21.526709+0000","last_unstale":"2024-05-08T23:14:27.354442+0000","last_undegraded":"2024-05-08T23:14:27.354442+0000","last_fullsized":"2024-05-08T23:14:27.354442+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:49.584194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125526+0000","last_change":"2024-05-08T23:14:21.952026+0000","last_active":"2024-05-08T23:14:24.125526+0000","last_peered":"2024-05-08T23:14:24.125526+0000","last_clean":"2024-05-08T23:14:24.125526+0000","last_became_active":"2024-05-08T23:14:21.951817+0000","last_became_peered":"2024-05-08T23:14:21.951817+0000","last_unstale":"2024-05-08T23:14:24.125526+0000","last_undegraded":"2024-05-08T23:14:24.125526+0000","last_fullsized":"2024-05-08T23:14:24.125526+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:45.239470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.338428+0000","last_change":"2024-05-08T23:14:21.519296+0000","last_active":"2024-05-08T23:14:26.338428+0000","last_peered":"2024-05-08T23:14:26.338428+0000","last_clean":"2024-05-08T23:14:26.338428+0000","last_became_active":"2024-05-08T23:14:21.518975+0000","last_became_peered":"2024-05-08T23:14:21.518975+0000","last_unstale":"2024-05-08T23:14:26.338428+0000","last_undegraded":"2024-05-08T23:14:26.338428+0000","last_fullsized":"2024-05-08T23:14:26.338428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:12.663513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468873+0000","last_change":"2024-05-08T23:14:21.947768+0000","last_active":"2024-05-08T23:14:22.468873+0000","last_peered":"2024-05-08T23:14:22.468873+0000","last_clean":"2024-05-08T23:14:22.468873+0000","last_became_active":"2024-05-08T23:14:21.947247+0000","last_became_peered":"2024-05-08T23:14:21.947247+0000","last_unstale":"2024-05-08T23:14:22.468873+0000","last_undegraded":"2024-05-08T23:14:22.468873+0000","last_fullsized":"2024-05-08T23:14:22.468873+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:16:58.283218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'30","reported_seq":122,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:15:01.406037+0000","last_change":"2024-05-08T23:14:21.519630+0000","last_active":"2024-05-08T23:15:01.406037+0000","last_peered":"2024-05-08T23:15:01.406037+0000","last_clean":"2024-05-08T23:15:01.406037+0000","last_became_active":"2024-05-08T23:14:21.519151+0000","last_became_peered":"2024-05-08T23:14:21.519151+0000","last_unstale":"2024-05-08T23:15:01.406037+0000","last_undegraded":"2024-05-08T23:15:01.406037+0000","last_fullsized":"2024-05-08T23:15:01.406037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61000,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":99,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169605+0000","last_change":"2024-05-08T23:14:21.950966+0000","last_active":"2024-05-08T23:14:24.169605+0000","last_peered":"2024-05-08T23:14:24.169605+0000","last_clean":"2024-05-08T23:14:24.169605+0000","last_became_active":"2024-05-08T23:14:21.950694+0000","last_became_peered":"2024-05-08T23:14:21.950694+0000","last_unstale":"2024-05-08T23:14:24.169605+0000","last_undegraded":"2024-05-08T23:14:24.169605+0000","last_fullsized":"2024-05-08T23:14:24.169605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:41.599529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.352965+0000","last_change":"2024-05-08T23:14:21.519509+0000","last_active":"2024-05-08T23:14:27.352965+0000","last_peered":"2024-05-08T23:14:27.352965+0000","last_clean":"2024-05-08T23:14:27.352965+0000","last_became_active":"2024-05-08T23:14:21.519237+0000","last_became_peered":"2024-05-08T23:14:21.519237+0000","last_unstale":"2024-05-08T23:14:27.352965+0000","last_undegraded":"2024-05-08T23:14:27.352965+0000","last_fullsized":"2024-05-08T23:14:27.352965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:52.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067695+0000","last_change":"2024-05-08T23:14:21.944225+0000","last_active":"2024-05-08T23:14:24.067695+0000","last_peered":"2024-05-08T23:14:24.067695+0000","last_clean":"2024-05-08T23:14:24.067695+0000","last_became_active":"2024-05-08T23:14:21.943909+0000","last_became_peered":"2024-05-08T23:14:21.943909+0000","last_unstale":"2024-05-08T23:14:24.067695+0000","last_undegraded":"2024-05-08T23:14:24.067695+0000","last_fullsized":"2024-05-08T23:14:24.067695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:52.003909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.355657+0000","last_change":"2024-05-08T23:14:21.522565+0000","last_active":"2024-05-08T23:14:27.355657+0000","last_peered":"2024-05-08T23:14:27.355657+0000","last_clean":"2024-05-08T23:14:27.355657+0000","last_became_active":"2024-05-08T23:14:21.522224+0000","last_became_peered":"2024-05-08T23:14:21.522224+0000","last_unstale":"2024-05-08T23:14:27.355657+0000","last_undegraded":"2024-05-08T23:14:27.355657+0000","last_fullsized":"2024-05-08T23:14:27.355657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.768309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041830+0000","last_change":"2024-05-08T23:14:21.953759+0000","last_active":"2024-05-08T23:14:22.041830+0000","last_peered":"2024-05-08T23:14:22.041830+0000","last_clean":"2024-05-08T23:14:22.041830+0000","last_became_active":"2024-05-08T23:14:21.953425+0000","last_became_peered":"2024-05-08T23:14:21.953425+0000","last_unstale":"2024-05-08T23:14:22.041830+0000","last_undegraded":"2024-05-08T23:14:22.041830+0000","last_fullsized":"2024-05-08T23:14:22.041830+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:36.189067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:59.392422+0000","last_change":"2024-05-08T23:14:21.525305+0000","last_active":"2024-05-08T23:14:59.392422+0000","last_peered":"2024-05-08T23:14:59.392422+0000","last_clean":"2024-05-08T23:14:59.392422+0000","last_became_active":"2024-05-08T23:14:21.524985+0000","last_became_peered":"2024-05-08T23:14:21.524985+0000","last_unstale":"2024-05-08T23:14:59.392422+0000","last_undegraded":"2024-05-08T23:14:59.392422+0000","last_fullsized":"2024-05-08T23:14:59.392422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:20:23.814736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041755+0000","last_change":"2024-05-08T23:14:21.958958+0000","last_active":"2024-05-08T23:14:22.041755+0000","last_peered":"2024-05-08T23:14:22.041755+0000","last_clean":"2024-05-08T23:14:22.041755+0000","last_became_active":"2024-05-08T23:14:21.958613+0000","last_became_peered":"2024-05-08T23:14:21.958613+0000","last_unstale":"2024-05-08T23:14:22.041755+0000","last_undegraded":"2024-05-08T23:14:22.041755+0000","last_fullsized":"2024-05-08T23:14:22.041755+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:07.245634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.346718+0000","last_change":"2024-05-08T23:14:21.525484+0000","last_active":"2024-05-08T23:14:26.346718+0000","last_peered":"2024-05-08T23:14:26.346718+0000","last_clean":"2024-05-08T23:14:26.346718+0000","last_became_active":"2024-05-08T23:14:21.525142+0000","last_became_peered":"2024-05-08T23:14:21.525142+0000","last_unstale":"2024-05-08T23:14:26.346718+0000","last_undegraded":"2024-05-08T23:14:26.346718+0000","last_fullsized":"2024-05-08T23:14:26.346718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:43.273230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101938+0000","last_change":"2024-05-08T23:14:21.962233+0000","last_active":"2024-05-08T23:14:22.101938+0000","last_peered":"2024-05-08T23:14:22.101938+0000","last_clean":"2024-05-08T23:14:22.101938+0000","last_became_active":"2024-05-08T23:14:21.961720+0000","last_became_peered":"2024-05-08T23:14:21.961720+0000","last_unstale":"2024-05-08T23:14:22.101938+0000","last_undegraded":"2024-05-08T23:14:22.101938+0000","last_fullsized":"2024-05-08T23:14:22.101938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:49:29.797724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.335420+0000","last_change":"2024-05-08T23:14:21.525125+0000","last_active":"2024-05-08T23:14:26.335420+0000","last_peered":"2024-05-08T23:14:26.335420+0000","last_clean":"2024-05-08T23:14:26.335420+0000","last_became_active":"2024-05-08T23:14:21.524759+0000","last_became_peered":"2024-05-08T23:14:21.524759+0000","last_unstale":"2024-05-08T23:14:26.335420+0000","last_undegraded":"2024-05-08T23:14:26.335420+0000","last_fullsized":"2024-05-08T23:14:26.335420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:45.267925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934649+0000","last_change":"2024-05-08T23:14:21.949084+0000","last_active":"2024-05-08T23:14:22.934649+0000","last_peered":"2024-05-08T23:14:22.934649+0000","last_clean":"2024-05-08T23:14:22.934649+0000","last_became_active":"2024-05-08T23:14:21.948567+0000","last_became_peered":"2024-05-08T23:14:21.948567+0000","last_unstale":"2024-05-08T23:14:22.934649+0000","last_undegraded":"2024-05-08T23:14:22.934649+0000","last_fullsized":"2024-05-08T23:14:22.934649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:50:33.466144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.814965+0000","last_change":"2024-05-08T23:14:21.519758+0000","last_active":"2024-05-08T23:14:23.814965+0000","last_peered":"2024-05-08T23:14:23.814965+0000","last_clean":"2024-05-08T23:14:23.814965+0000","last_became_active":"2024-05-08T23:14:21.519403+0000","last_became_peered":"2024-05-08T23:14:21.519403+0000","last_unstale":"2024-05-08T23:14:23.814965+0000","last_undegraded":"2024-05-08T23:14:23.814965+0000","last_fullsized":"2024-05-08T23:14:23.814965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:49.080141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.168820+0000","last_change":"2024-05-08T23:14:21.944315+0000","last_active":"2024-05-08T23:14:24.168820+0000","last_peered":"2024-05-08T23:14:24.168820+0000","last_clean":"2024-05-08T23:14:24.168820+0000","last_became_active":"2024-05-08T23:14:21.943542+0000","last_became_peered":"2024-05-08T23:14:21.943542+0000","last_unstale":"2024-05-08T23:14:24.168820+0000","last_undegraded":"2024-05-08T23:14:24.168820+0000","last_fullsized":"2024-05-08T23:14:24.168820+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:10.667516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:15:00.407664+0000","last_change":"2024-05-08T23:14:21.526576+0000","last_active":"2024-05-08T23:15:00.407664+0000","last_peered":"2024-05-08T23:15:00.407664+0000","last_clean":"2024-05-08T23:15:00.407664+0000","last_became_active":"2024-05-08T23:14:21.524611+0000","last_became_peered":"2024-05-08T23:14:21.524611+0000","last_unstale":"2024-05-08T23:15:00.407664+0000","last_undegraded":"2024-05-08T23:15:00.407664+0000","last_fullsized":"2024-05-08T23:15:00.407664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:52.929531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.071016+0000","last_change":"2024-05-08T23:14:21.951870+0000","last_active":"2024-05-08T23:14:22.071016+0000","last_peered":"2024-05-08T23:14:22.071016+0000","last_clean":"2024-05-08T23:14:22.071016+0000","last_became_active":"2024-05-08T23:14:21.949810+0000","last_became_peered":"2024-05-08T23:14:21.949810+0000","last_unstale":"2024-05-08T23:14:22.071016+0000","last_undegraded":"2024-05-08T23:14:22.071016+0000","last_fullsized":"2024-05-08T23:14:22.071016+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:01.727234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101925+0000","last_change":"2024-05-08T23:14:21.958705+0000","last_active":"2024-05-08T23:14:22.101925+0000","last_peered":"2024-05-08T23:14:22.101925+0000","last_clean":"2024-05-08T23:14:22.101925+0000","last_became_active":"2024-05-08T23:14:21.958392+0000","last_became_peered":"2024-05-08T23:14:21.958392+0000","last_unstale":"2024-05-08T23:14:22.101925+0000","last_undegraded":"2024-05-08T23:14:22.101925+0000","last_fullsized":"2024-05-08T23:14:22.101925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:34.417439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:59.391753+0000","last_change":"2024-05-08T23:14:21.520978+0000","last_active":"2024-05-08T23:14:59.391753+0000","last_peered":"2024-05-08T23:14:59.391753+0000","last_clean":"2024-05-08T23:14:59.391753+0000","last_became_active":"2024-05-08T23:14:21.520688+0000","last_became_peered":"2024-05-08T23:14:21.520688+0000","last_unstale":"2024-05-08T23:14:59.391753+0000","last_undegraded":"2024-05-08T23:14:59.391753+0000","last_fullsized":"2024-05-08T23:14:59.391753+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:59:43.000719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099268+0000","last_change":"2024-05-08T23:14:21.946315+0000","last_active":"2024-05-08T23:14:23.099268+0000","last_peered":"2024-05-08T23:14:23.099268+0000","last_clean":"2024-05-08T23:14:23.099268+0000","last_became_active":"2024-05-08T23:14:21.945542+0000","last_became_peered":"2024-05-08T23:14:21.945542+0000","last_unstale":"2024-05-08T23:14:23.099268+0000","last_undegraded":"2024-05-08T23:14:23.099268+0000","last_fullsized":"2024-05-08T23:14:23.099268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:35.027035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.354653+0000","last_change":"2024-05-08T23:14:21.521066+0000","last_active":"2024-05-08T23:14:27.354653+0000","last_peered":"2024-05-08T23:14:27.354653+0000","last_clean":"2024-05-08T23:14:27.354653+0000","last_became_active":"2024-05-08T23:14:21.520730+0000","last_became_peered":"2024-05-08T23:14:21.520730+0000","last_unstale":"2024-05-08T23:14:27.354653+0000","last_undegraded":"2024-05-08T23:14:27.354653+0000","last_fullsized":"2024-05-08T23:14:27.354653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:11.033062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":324,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.168670+0000","last_change":"2024-05-08T23:13:34.449454+0000","last_active":"2024-05-08T23:14:24.168670+0000","last_peered":"2024-05-08T23:14:24.168670+0000","last_clean":"2024-05-08T23:14:24.168670+0000","last_became_active":"2024-05-08T23:13:34.448953+0000","last_became_peered":"2024-05-08T23:13:34.448953+0000","last_unstale":"2024-05-08T23:14:24.168670+0000","last_undegraded":"2024-05-08T23:14:24.168670+0000","last_fullsized":"2024-05-08T23:14:24.168670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:11:11.941444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:11:11.941444+0000","last_clean_scrub_stamp":"2024-05-08T23:11:11.941444+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:49.039661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067594+0000","last_change":"2024-05-08T23:14:21.947145+0000","last_active":"2024-05-08T23:14:24.067594+0000","last_peered":"2024-05-08T23:14:24.067594+0000","last_clean":"2024-05-08T23:14:24.067594+0000","last_became_active":"2024-05-08T23:14:21.946842+0000","last_became_peered":"2024-05-08T23:14:21.946842+0000","last_unstale":"2024-05-08T23:14:24.067594+0000","last_undegraded":"2024-05-08T23:14:24.067594+0000","last_fullsized":"2024-05-08T23:14:24.067594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:27.070888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.960008+0000","last_change":"2024-05-08T23:14:21.525571+0000","last_active":"2024-05-08T23:14:25.960008+0000","last_peered":"2024-05-08T23:14:25.960008+0000","last_clean":"2024-05-08T23:14:25.960008+0000","last_became_active":"2024-05-08T23:14:21.524486+0000","last_became_peered":"2024-05-08T23:14:21.524486+0000","last_unstale":"2024-05-08T23:14:25.960008+0000","last_undegraded":"2024-05-08T23:14:25.960008+0000","last_fullsized":"2024-05-08T23:14:25.960008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:07.575183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.346892+0000","last_change":"2024-05-08T23:14:21.527012+0000","last_active":"2024-05-08T23:14:26.346892+0000","last_peered":"2024-05-08T23:14:26.346892+0000","last_clean":"2024-05-08T23:14:26.346892+0000","last_became_active":"2024-05-08T23:14:21.526263+0000","last_became_peered":"2024-05-08T23:14:21.526263+0000","last_unstale":"2024-05-08T23:14:26.346892+0000","last_undegraded":"2024-05-08T23:14:26.346892+0000","last_fullsized":"2024-05-08T23:14:26.346892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:42.930529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067797+0000","last_change":"2024-05-08T23:14:21.948803+0000","last_active":"2024-05-08T23:14:24.067797+0000","last_peered":"2024-05-08T23:14:24.067797+0000","last_clean":"2024-05-08T23:14:24.067797+0000","last_became_active":"2024-05-08T23:14:21.947787+0000","last_became_peered":"2024-05-08T23:14:21.947787+0000","last_unstale":"2024-05-08T23:14:24.067797+0000","last_undegraded":"2024-05-08T23:14:24.067797+0000","last_fullsized":"2024-05-08T23:14:24.067797+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:25.521045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:31.168017+0000","last_change":"2024-05-08T23:14:21.522944+0000","last_active":"2024-05-08T23:14:31.168017+0000","last_peered":"2024-05-08T23:14:31.168017+0000","last_clean":"2024-05-08T23:14:31.168017+0000","last_became_active":"2024-05-08T23:14:21.522644+0000","last_became_peered":"2024-05-08T23:14:21.522644+0000","last_unstale":"2024-05-08T23:14:31.168017+0000","last_undegraded":"2024-05-08T23:14:31.168017+0000","last_fullsized":"2024-05-08T23:14:31.168017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:17.008946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099353+0000","last_change":"2024-05-08T23:14:21.947133+0000","last_active":"2024-05-08T23:14:23.099353+0000","last_peered":"2024-05-08T23:14:23.099353+0000","last_clean":"2024-05-08T23:14:23.099353+0000","last_became_active":"2024-05-08T23:14:21.946373+0000","last_became_peered":"2024-05-08T23:14:21.946373+0000","last_unstale":"2024-05-08T23:14:23.099353+0000","last_undegraded":"2024-05-08T23:14:23.099353+0000","last_fullsized":"2024-05-08T23:14:23.099353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:08.784990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.355529+0000","last_change":"2024-05-08T23:14:21.525172+0000","last_active":"2024-05-08T23:14:27.355529+0000","last_peered":"2024-05-08T23:14:27.355529+0000","last_clean":"2024-05-08T23:14:27.355529+0000","last_became_active":"2024-05-08T23:14:21.524721+0000","last_became_peered":"2024-05-08T23:14:21.524721+0000","last_unstale":"2024-05-08T23:14:27.355529+0000","last_undegraded":"2024-05-08T23:14:27.355529+0000","last_fullsized":"2024-05-08T23:14:27.355529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:21.051347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125579+0000","last_change":"2024-05-08T23:14:21.951912+0000","last_active":"2024-05-08T23:14:24.125579+0000","last_peered":"2024-05-08T23:14:24.125579+0000","last_clean":"2024-05-08T23:14:24.125579+0000","last_became_active":"2024-05-08T23:14:21.951620+0000","last_became_peered":"2024-05-08T23:14:21.951620+0000","last_unstale":"2024-05-08T23:14:24.125579+0000","last_undegraded":"2024-05-08T23:14:24.125579+0000","last_fullsized":"2024-05-08T23:14:24.125579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:28.218680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.955304+0000","last_change":"2024-05-08T23:14:21.521707+0000","last_active":"2024-05-08T23:14:24.955304+0000","last_peered":"2024-05-08T23:14:24.955304+0000","last_clean":"2024-05-08T23:14:24.955304+0000","last_became_active":"2024-05-08T23:14:21.521376+0000","last_became_peered":"2024-05-08T23:14:21.521376+0000","last_unstale":"2024-05-08T23:14:24.955304+0000","last_undegraded":"2024-05-08T23:14:24.955304+0000","last_fullsized":"2024-05-08T23:14:24.955304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:39.192259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.168939+0000","last_change":"2024-05-08T23:14:21.952825+0000","last_active":"2024-05-08T23:14:24.168939+0000","last_peered":"2024-05-08T23:14:24.168939+0000","last_clean":"2024-05-08T23:14:24.168939+0000","last_became_active":"2024-05-08T23:14:21.952494+0000","last_became_peered":"2024-05-08T23:14:21.952494+0000","last_unstale":"2024-05-08T23:14:24.168939+0000","last_undegraded":"2024-05-08T23:14:24.168939+0000","last_fullsized":"2024-05-08T23:14:24.168939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:31:29.439165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.354216+0000","last_change":"2024-05-08T23:14:21.516550+0000","last_active":"2024-05-08T23:14:27.354216+0000","last_peered":"2024-05-08T23:14:27.354216+0000","last_clean":"2024-05-08T23:14:27.354216+0000","last_became_active":"2024-05-08T23:14:21.516211+0000","last_became_peered":"2024-05-08T23:14:21.516211+0000","last_unstale":"2024-05-08T23:14:27.354216+0000","last_undegraded":"2024-05-08T23:14:27.354216+0000","last_fullsized":"2024-05-08T23:14:27.354216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:37.112939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934466+0000","last_change":"2024-05-08T23:14:21.945018+0000","last_active":"2024-05-08T23:14:22.934466+0000","last_peered":"2024-05-08T23:14:22.934466+0000","last_clean":"2024-05-08T23:14:22.934466+0000","last_became_active":"2024-05-08T23:14:21.944691+0000","last_became_peered":"2024-05-08T23:14:21.944691+0000","last_unstale":"2024-05-08T23:14:22.934466+0000","last_undegraded":"2024-05-08T23:14:22.934466+0000","last_fullsized":"2024-05-08T23:14:22.934466+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:36.323757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.421439+0000","last_change":"2024-05-08T23:14:21.518130+0000","last_active":"2024-05-08T23:14:26.421439+0000","last_peered":"2024-05-08T23:14:26.421439+0000","last_clean":"2024-05-08T23:14:26.421439+0000","last_became_active":"2024-05-08T23:14:21.517828+0000","last_became_peered":"2024-05-08T23:14:21.517828+0000","last_unstale":"2024-05-08T23:14:26.421439+0000","last_undegraded":"2024-05-08T23:14:26.421439+0000","last_fullsized":"2024-05-08T23:14:26.421439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:47.201096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099277+0000","last_change":"2024-05-08T23:14:21.952081+0000","last_active":"2024-05-08T23:14:23.099277+0000","last_peered":"2024-05-08T23:14:23.099277+0000","last_clean":"2024-05-08T23:14:23.099277+0000","last_became_active":"2024-05-08T23:14:21.951794+0000","last_became_peered":"2024-05-08T23:14:21.951794+0000","last_unstale":"2024-05-08T23:14:23.099277+0000","last_undegraded":"2024-05-08T23:14:23.099277+0000","last_fullsized":"2024-05-08T23:14:23.099277+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:41.957442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.953592+0000","last_change":"2024-05-08T23:14:21.525362+0000","last_active":"2024-05-08T23:14:24.953592+0000","last_peered":"2024-05-08T23:14:24.953592+0000","last_clean":"2024-05-08T23:14:24.953592+0000","last_became_active":"2024-05-08T23:14:21.525033+0000","last_became_peered":"2024-05-08T23:14:21.525033+0000","last_unstale":"2024-05-08T23:14:24.953592+0000","last_undegraded":"2024-05-08T23:14:24.953592+0000","last_fullsized":"2024-05-08T23:14:24.953592+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:41.610041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041817+0000","last_change":"2024-05-08T23:14:21.950784+0000","last_active":"2024-05-08T23:14:22.041817+0000","last_peered":"2024-05-08T23:14:22.041817+0000","last_clean":"2024-05-08T23:14:22.041817+0000","last_became_active":"2024-05-08T23:14:21.950504+0000","last_became_peered":"2024-05-08T23:14:21.950504+0000","last_unstale":"2024-05-08T23:14:22.041817+0000","last_undegraded":"2024-05-08T23:14:22.041817+0000","last_fullsized":"2024-05-08T23:14:22.041817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.096546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:59.426444+0000","last_change":"2024-05-08T23:14:21.524636+0000","last_active":"2024-05-08T23:14:59.426444+0000","last_peered":"2024-05-08T23:14:59.426444+0000","last_clean":"2024-05-08T23:14:59.426444+0000","last_became_active":"2024-05-08T23:14:21.524323+0000","last_became_peered":"2024-05-08T23:14:21.524323+0000","last_unstale":"2024-05-08T23:14:59.426444+0000","last_undegraded":"2024-05-08T23:14:59.426444+0000","last_fullsized":"2024-05-08T23:14:59.426444+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:59.714443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041863+0000","last_change":"2024-05-08T23:14:21.950109+0000","last_active":"2024-05-08T23:14:22.041863+0000","last_peered":"2024-05-08T23:14:22.041863+0000","last_clean":"2024-05-08T23:14:22.041863+0000","last_became_active":"2024-05-08T23:14:21.949803+0000","last_became_peered":"2024-05-08T23:14:21.949803+0000","last_unstale":"2024-05-08T23:14:22.041863+0000","last_undegraded":"2024-05-08T23:14:22.041863+0000","last_fullsized":"2024-05-08T23:14:22.041863+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:00.025947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.347699+0000","last_change":"2024-05-08T23:14:21.517997+0000","last_active":"2024-05-08T23:14:26.347699+0000","last_peered":"2024-05-08T23:14:26.347699+0000","last_clean":"2024-05-08T23:14:26.347699+0000","last_became_active":"2024-05-08T23:14:21.517635+0000","last_became_peered":"2024-05-08T23:14:21.517635+0000","last_unstale":"2024-05-08T23:14:26.347699+0000","last_undegraded":"2024-05-08T23:14:26.347699+0000","last_fullsized":"2024-05-08T23:14:26.347699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:55.088301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169009+0000","last_change":"2024-05-08T23:14:21.958863+0000","last_active":"2024-05-08T23:14:24.169009+0000","last_peered":"2024-05-08T23:14:24.169009+0000","last_clean":"2024-05-08T23:14:24.169009+0000","last_became_active":"2024-05-08T23:14:21.958462+0000","last_became_peered":"2024-05-08T23:14:21.958462+0000","last_unstale":"2024-05-08T23:14:24.169009+0000","last_undegraded":"2024-05-08T23:14:24.169009+0000","last_fullsized":"2024-05-08T23:14:24.169009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:41:42.202867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.353916+0000","last_change":"2024-05-08T23:14:21.522669+0000","last_active":"2024-05-08T23:14:27.353916+0000","last_peered":"2024-05-08T23:14:27.353916+0000","last_clean":"2024-05-08T23:14:27.353916+0000","last_became_active":"2024-05-08T23:14:21.522348+0000","last_became_peered":"2024-05-08T23:14:21.522348+0000","last_unstale":"2024-05-08T23:14:27.353916+0000","last_undegraded":"2024-05-08T23:14:27.353916+0000","last_fullsized":"2024-05-08T23:14:27.353916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:37.824190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041886+0000","last_change":"2024-05-08T23:14:21.960656+0000","last_active":"2024-05-08T23:14:22.041886+0000","last_peered":"2024-05-08T23:14:22.041886+0000","last_clean":"2024-05-08T23:14:22.041886+0000","last_became_active":"2024-05-08T23:14:21.960336+0000","last_became_peered":"2024-05-08T23:14:21.960336+0000","last_unstale":"2024-05-08T23:14:22.041886+0000","last_undegraded":"2024-05-08T23:14:22.041886+0000","last_fullsized":"2024-05-08T23:14:22.041886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:55.101942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934706+0000","last_change":"2024-05-08T23:14:21.965928+0000","last_active":"2024-05-08T23:14:22.934706+0000","last_peered":"2024-05-08T23:14:22.934706+0000","last_clean":"2024-05-08T23:14:22.934706+0000","last_became_active":"2024-05-08T23:14:21.965570+0000","last_became_peered":"2024-05-08T23:14:21.965570+0000","last_unstale":"2024-05-08T23:14:22.934706+0000","last_undegraded":"2024-05-08T23:14:22.934706+0000","last_fullsized":"2024-05-08T23:14:22.934706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:01.963727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685021+0000","last_change":"2024-05-08T23:14:21.948795+0000","last_active":"2024-05-08T23:14:23.685021+0000","last_peered":"2024-05-08T23:14:23.685021+0000","last_clean":"2024-05-08T23:14:23.685021+0000","last_became_active":"2024-05-08T23:14:21.948275+0000","last_became_peered":"2024-05-08T23:14:21.948275+0000","last_unstale":"2024-05-08T23:14:23.685021+0000","last_undegraded":"2024-05-08T23:14:23.685021+0000","last_fullsized":"2024-05-08T23:14:23.685021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:27.812089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685000+0000","last_change":"2024-05-08T23:14:21.942911+0000","last_active":"2024-05-08T23:14:23.685000+0000","last_peered":"2024-05-08T23:14:23.685000+0000","last_clean":"2024-05-08T23:14:23.685000+0000","last_became_active":"2024-05-08T23:14:21.942050+0000","last_became_peered":"2024-05-08T23:14:21.942050+0000","last_unstale":"2024-05-08T23:14:23.685000+0000","last_undegraded":"2024-05-08T23:14:23.685000+0000","last_fullsized":"2024-05-08T23:14:23.685000+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:05.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125373+0000","last_change":"2024-05-08T23:14:21.952424+0000","last_active":"2024-05-08T23:14:24.125373+0000","last_peered":"2024-05-08T23:14:24.125373+0000","last_clean":"2024-05-08T23:14:24.125373+0000","last_became_active":"2024-05-08T23:14:21.952132+0000","last_became_peered":"2024-05-08T23:14:21.952132+0000","last_unstale":"2024-05-08T23:14:24.125373+0000","last_undegraded":"2024-05-08T23:14:24.125373+0000","last_fullsized":"2024-05-08T23:14:24.125373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:55.035476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067879+0000","last_change":"2024-05-08T23:14:21.933701+0000","last_active":"2024-05-08T23:14:24.067879+0000","last_peered":"2024-05-08T23:14:24.067879+0000","last_clean":"2024-05-08T23:14:24.067879+0000","last_became_active":"2024-05-08T23:14:21.933275+0000","last_became_peered":"2024-05-08T23:14:21.933275+0000","last_unstale":"2024-05-08T23:14:24.067879+0000","last_undegraded":"2024-05-08T23:14:24.067879+0000","last_fullsized":"2024-05-08T23:14:24.067879+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:47.660620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934618+0000","last_change":"2024-05-08T23:14:21.958705+0000","last_active":"2024-05-08T23:14:22.934618+0000","last_peered":"2024-05-08T23:14:22.934618+0000","last_clean":"2024-05-08T23:14:22.934618+0000","last_became_active":"2024-05-08T23:14:21.958410+0000","last_became_peered":"2024-05-08T23:14:21.958410+0000","last_unstale":"2024-05-08T23:14:22.934618+0000","last_undegraded":"2024-05-08T23:14:22.934618+0000","last_fullsized":"2024-05-08T23:14:22.934618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:42:31.167722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685346+0000","last_change":"2024-05-08T23:14:21.963814+0000","last_active":"2024-05-08T23:14:23.685346+0000","last_peered":"2024-05-08T23:14:23.685346+0000","last_clean":"2024-05-08T23:14:23.685346+0000","last_became_active":"2024-05-08T23:14:21.963485+0000","last_became_peered":"2024-05-08T23:14:21.963485+0000","last_unstale":"2024-05-08T23:14:23.685346+0000","last_undegraded":"2024-05-08T23:14:23.685346+0000","last_fullsized":"2024-05-08T23:14:23.685346+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:22.782637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099336+0000","last_change":"2024-05-08T23:14:21.947887+0000","last_active":"2024-05-08T23:14:23.099336+0000","last_peered":"2024-05-08T23:14:23.099336+0000","last_clean":"2024-05-08T23:14:23.099336+0000","last_became_active":"2024-05-08T23:14:21.947577+0000","last_became_peered":"2024-05-08T23:14:21.947577+0000","last_unstale":"2024-05-08T23:14:23.099336+0000","last_undegraded":"2024-05-08T23:14:23.099336+0000","last_fullsized":"2024-05-08T23:14:23.099336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:33.022146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101912+0000","last_change":"2024-05-08T23:14:21.963857+0000","last_active":"2024-05-08T23:14:22.101912+0000","last_peered":"2024-05-08T23:14:22.101912+0000","last_clean":"2024-05-08T23:14:22.101912+0000","last_became_active":"2024-05-08T23:14:21.963366+0000","last_became_peered":"2024-05-08T23:14:21.963366+0000","last_unstale":"2024-05-08T23:14:22.101912+0000","last_undegraded":"2024-05-08T23:14:22.101912+0000","last_fullsized":"2024-05-08T23:14:22.101912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:34.402188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099246+0000","last_change":"2024-05-08T23:14:21.946956+0000","last_active":"2024-05-08T23:14:23.099246+0000","last_peered":"2024-05-08T23:14:23.099246+0000","last_clean":"2024-05-08T23:14:23.099246+0000","last_became_active":"2024-05-08T23:14:21.946669+0000","last_became_peered":"2024-05-08T23:14:21.946669+0000","last_unstale":"2024-05-08T23:14:23.099246+0000","last_undegraded":"2024-05-08T23:14:23.099246+0000","last_fullsized":"2024-05-08T23:14:23.099246+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:29.826418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468837+0000","last_change":"2024-05-08T23:14:21.952852+0000","last_active":"2024-05-08T23:14:22.468837+0000","last_peered":"2024-05-08T23:14:22.468837+0000","last_clean":"2024-05-08T23:14:22.468837+0000","last_became_active":"2024-05-08T23:14:21.952515+0000","last_became_peered":"2024-05-08T23:14:21.952515+0000","last_unstale":"2024-05-08T23:14:22.468837+0000","last_undegraded":"2024-05-08T23:14:22.468837+0000","last_fullsized":"2024-05-08T23:14:22.468837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:15.611960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067841+0000","last_change":"2024-05-08T23:14:21.944967+0000","last_active":"2024-05-08T23:14:24.067841+0000","last_peered":"2024-05-08T23:14:24.067841+0000","last_clean":"2024-05-08T23:14:24.067841+0000","last_became_active":"2024-05-08T23:14:21.944588+0000","last_became_peered":"2024-05-08T23:14:21.944588+0000","last_unstale":"2024-05-08T23:14:24.067841+0000","last_undegraded":"2024-05-08T23:14:24.067841+0000","last_fullsized":"2024-05-08T23:14:24.067841+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:40:12.545764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934362+0000","last_change":"2024-05-08T23:14:21.948689+0000","last_active":"2024-05-08T23:14:22.934362+0000","last_peered":"2024-05-08T23:14:22.934362+0000","last_clean":"2024-05-08T23:14:22.934362+0000","last_became_active":"2024-05-08T23:14:21.948335+0000","last_became_peered":"2024-05-08T23:14:21.948335+0000","last_unstale":"2024-05-08T23:14:22.934362+0000","last_undegraded":"2024-05-08T23:14:22.934362+0000","last_fullsized":"2024-05-08T23:14:22.934362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:41.767077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282110,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68409,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":386,"num_read_kb":267,"num_write":232,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":205227,"data_compressed":5523,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449106,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36088,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709064,"statfs":{"total":95995035648,"available":95958081536,"internally_reserved":0,"allocated":901120,"data_stored":430329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36043205},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.64000000000000001}]},{"osd":1,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.71599999999999997}]},{"osd":2,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.79000000000000004}]},{"osd":5,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.753}]},{"osd":6,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.76500000000000001}]},{"osd":7,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.88800000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":9,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.92700000000000005}]},{"osd":10,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.876}]}]},{"osd":10,"up_from":70,"seq":300647710741,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":1048576,"data_stored":1082077,"data_compressed":37719,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":31848896},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.56499999999999995}]},{"osd":2,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.82599999999999996}]},{"osd":3,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.65700000000000003}]},{"osd":4,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.622}]},{"osd":5,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.77800000000000002}]},{"osd":6,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":8,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.87},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.85999999999999999}]},{"osd":9,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.71999999999999997}]},{"osd":11,"last update":"Wed May 8 23:14:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.90800000000000003}]}]},{"osd":9,"up_from":65,"seq":279172874265,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":925696,"data_stored":429914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31848896},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57299999999999995}]},{"osd":1,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.751},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.65200000000000002}]},{"osd":3,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.42299999999999999}]},{"osd":4,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.745},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.69499999999999995}]},{"osd":5,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.58699999999999997}]},{"osd":6,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.54400000000000004}]},{"osd":7,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.76400000000000001}]},{"osd":8,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.624}]},{"osd":10,"last update":"Wed May 8 23:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68999999999999995}]}]},{"osd":8,"up_from":57,"seq":244813135901,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":430292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.48699999999999999}]},{"osd":1,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.434,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.48099999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.47799999999999998}]},{"osd":2,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.48199999999999998,"15min":0.47299999999999998},"min":{"1min":0.33900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.42699999999999999}]},{"osd":3,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56100000000000005}]},{"osd":4,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.503},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.65300000000000002,"15min":0.63900000000000001},"min":{"1min":0.54400000000000004,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.59599999999999997}]},{"osd":5,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.57899999999999996,"15min":0.57099999999999995},"min":{"1min":0.35299999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68799999999999994}]},{"osd":6,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.68000000000000005,"15min":0.66400000000000003},"min":{"1min":0.54300000000000004,"5min":0.379,"15min":0.379},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.55100000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.74299999999999999}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.79400000000000004}]},{"osd":10,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.82099999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]}]},{"osd":7,"up_from":50,"seq":214748364832,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":1023061,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Wed May 8 23:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41599999999999998,"15min":0.41699999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57999999999999996,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.47799999999999998,"15min":0.47999999999999998},"min":{"1min":0.314,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78400000000000003,"5min":0.996,"15min":0.996},"last":0.44700000000000001}]},{"osd":2,"last update":"Wed May 8 23:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.72899999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75700000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.627}]},{"osd":3,"last update":"Wed May 8 23:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.40000000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78200000000000003,"5min":1.206,"15min":1.206},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.66900000000000004,"15min":0.63900000000000001},"min":{"1min":0.45500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":5.0890000000000004,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.66600000000000004}]},{"osd":4,"last update":"Wed May 8 23:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.86099999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.51100000000000001,"15min":0.51900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63500000000000001,"5min":0.88,"15min":0.88},"last":0.48899999999999999}]},{"osd":5,"last update":"Wed May 8 23:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.76400000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.46800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.70199999999999996}]},{"osd":6,"last update":"Wed May 8 23:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.74099999999999999,"15min":0.71499999999999997},"min":{"1min":0.48999999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":5.1139999999999999,"5min":5.1139999999999999,"15min":5.1139999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.61299999999999999,"15min":0.623},"min":{"1min":0.42999999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79800000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65100000000000002}]},{"osd":8,"last update":"Wed May 8 23:15:01 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90700000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.81399999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.68899999999999995}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.77900000000000003}]},{"osd":10,"last update":"Wed May 8 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.79600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":6,"up_from":45,"seq":193273528356,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":909312,"data_stored":429583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.27900000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61299999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42099999999999999,"15min":0.42299999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65900000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.313}]},{"osd":1,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.502,"15min":0.495},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72499999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.56799999999999995}]},{"osd":3,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68600000000000005,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.498,"15min":0.501},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78700000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.374,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77100000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52900000000000003}]},{"osd":5,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.748,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.629,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed May 8 23:14:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.028,"5min":1.141,"15min":1.141},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.83999999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.60999999999999999}]},{"osd":8,"last update":"Wed May 8 23:14:59 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67000000000000004,"15min":0.67800000000000005},"min":{"1min":0.495,"5min":0.438,"15min":0.438},"max":{"1min":0.77000000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.628,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.46999999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91100000000000003,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.61699999999999999}]},{"osd":9,"last update":"Wed May 8 23:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.48099999999999998}]},{"osd":10,"last update":"Wed May 8 23:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.65300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":491496,"data_compressed":1841,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:58 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.56299999999999994,"15min":0.52100000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":4.3209999999999997,"5min":4.3209999999999997,"15min":4.3209999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.496}]},{"osd":2,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.41699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.73699999999999999}]},{"osd":3,"last update":"Wed May 8 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52500000000000002,"15min":0.51600000000000001},"min":{"1min":0.34000000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71999999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55200000000000005,"15min":0.54500000000000004},"min":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.64000000000000001}]},{"osd":4,"last update":"Wed May 8 23:14:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.42899999999999999,"15min":0.39900000000000002},"min":{"1min":0.371,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69099999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.433,"15min":0.41699999999999998},"min":{"1min":0.318,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46899999999999997}]},{"osd":5,"last update":"Wed May 8 23:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.46400000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.59799999999999998,"15min":0.58199999999999996},"min":{"1min":0.51600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.436},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.59599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52600000000000002}]},{"osd":7,"last update":"Wed May 8 23:14:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58299999999999996,"15min":0.57199999999999995},"min":{"1min":0.47799999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.88500000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.61199999999999999,"15min":0.59799999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.62}]},{"osd":8,"last update":"Wed May 8 23:14:58 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69199999999999995,"15min":0.68500000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.49099999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.78300000000000003}]},{"osd":9,"last update":"Wed May 8 23:14:14 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.68600000000000005}]},{"osd":10,"last update":"Wed May 8 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.79800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":431315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 23:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.499,"15min":0.5},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72999999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.501,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45400000000000001}]},{"osd":2,"last update":"Wed May 8 23:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68700000000000006,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.499},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.66000000000000003}]},{"osd":3,"last update":"Wed May 8 23:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.41099999999999998},"min":{"1min":0.28000000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58799999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.40899999999999997},"min":{"1min":0.27600000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.46899999999999997}]},{"osd":4,"last update":"Wed May 8 23:14:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.40699999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73499999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.443,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.70499999999999996,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.54800000000000004}]},{"osd":5,"last update":"Wed May 8 23:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.40300000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56599999999999995}]},{"osd":6,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69399999999999995,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.80900000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.495}]},{"osd":7,"last update":"Wed May 8 23:13:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64300000000000002}]},{"osd":8,"last update":"Wed May 8 23:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.624}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.60999999999999999}]},{"osd":10,"last update":"Wed May 8 23:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.57599999999999996}]},{"osd":11,"last update":"Wed May 8 23:14:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.64300000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411377,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":492454,"data_compressed":1841,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.44500000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.496,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52100000000000002,"15min":0.504},"min":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.67800000000000005,"5min":0.751,"15min":0.751},"last":0.72899999999999998}]},{"osd":3,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.503,"15min":0.502},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.495},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.48699999999999999,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.60699999999999998}]},{"osd":4,"last update":"Wed May 8 23:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.746,"5min":0.747,"15min":0.747},"last":0.624}]},{"osd":5,"last update":"Wed May 8 23:14:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.435,"15min":0.438},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58699999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61699999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52900000000000003}]},{"osd":6,"last update":"Wed May 8 23:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.57299999999999995}]},{"osd":7,"last update":"Wed May 8 23:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51100000000000001}]},{"osd":8,"last update":"Wed May 8 23:14:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.52800000000000002,"15min":0.51500000000000001},"min":{"1min":0.38,"5min":0.318,"15min":0.318},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.499,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.753}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.76300000000000001}]},{"osd":10,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.80600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149742,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":921600,"data_stored":429125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.32300000000000001},"min":{"1min":0.26100000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51300000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.35099999999999998,"15min":0.34000000000000002},"min":{"1min":0.23899999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.53300000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.376}]},{"osd":1,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.50600000000000001,"15min":0.48399999999999999},"min":{"1min":0.40200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.499,"15min":0.48399999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.63100000000000001}]},{"osd":2,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.34799999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71199999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67700000000000005,"5min":0.751,"15min":0.751},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed May 8 23:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.376,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.752,"15min":0.752},"last":0.505},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.65800000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.77700000000000002}]},{"osd":5,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.56399999999999995,"15min":0.55100000000000005},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.58799999999999997}]},{"osd":6,"last update":"Wed May 8 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.31},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.39500000000000002}]},{"osd":7,"last update":"Wed May 8 23:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59799999999999998,"15min":0.60699999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78400000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.55900000000000005}]},{"osd":8,"last update":"Wed May 8 23:13:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.53400000000000003}]},{"osd":9,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.68899999999999995}]},{"osd":10,"last update":"Wed May 8 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.79900000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":4,"up_from":33,"seq":141733920811,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":909312,"data_stored":429837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:13:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48499999999999999,"15min":0.47999999999999998},"min":{"1min":0.33100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.36099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.60699999999999998}]},{"osd":1,"last update":"Wed May 8 23:14:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.36699999999999999,"15min":0.34399999999999997},"min":{"1min":0.30399999999999999,"5min":0.222,"15min":0.222},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.39800000000000002,"15min":0.372},"min":{"1min":0.30099999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Wed May 8 23:14:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.56599999999999995,"15min":0.54800000000000004},"min":{"1min":0.44600000000000001,"5min":0.312,"15min":0.312},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.628}]},{"osd":3,"last update":"Wed May 8 23:14:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.54400000000000004,"15min":0.51500000000000001},"min":{"1min":0.47599999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.35099999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":0.64400000000000002}]},{"osd":5,"last update":"Wed May 8 23:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69099999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.751}]},{"osd":6,"last update":"Wed May 8 23:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.67300000000000004}]},{"osd":7,"last update":"Wed May 8 23:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.51800000000000002,"15min":0.501},"min":{"1min":0.40799999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.56399999999999995,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":3.1699999999999999,"5min":3.1699999999999999,"15min":3.1699999999999999},"last":0.60999999999999999}]},{"osd":8,"last update":"Wed May 8 23:15:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65900000000000003,"15min":0.65100000000000002},"min":{"1min":0.54000000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93600000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.67800000000000005,"15min":0.65400000000000003},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.6669999999999998,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":0.76600000000000001}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.407,"5min":2.407,"15min":2.407},"last":0.59499999999999997}]},{"osd":10,"last update":"Wed May 8 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.70099999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":5,"up_from":38,"seq":163208757286,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":1022442,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.47299999999999998}]},{"osd":1,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40000000000000002,"15min":0.39200000000000002},"min":{"1min":0.27700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.29499999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.36899999999999999}]},{"osd":3,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.318,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55700000000000005}]},{"osd":4,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.498,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77200000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74199999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58199999999999996}]},{"osd":6,"last update":"Wed May 8 23:14:25 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.505},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.48599999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.77200000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed May 8 23:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66500000000000004,"15min":0.67100000000000004},"min":{"1min":0.45100000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80400000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71099999999999997,"15min":0.71799999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.77900000000000003,"5min":1.143,"15min":1.143},"last":0.64400000000000002}]},{"osd":8,"last update":"Wed May 8 23:15:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47599999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84399999999999997,"5min":0.877,"15min":0.877},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.499,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83599999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.625}]},{"osd":9,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.71899999999999997}]},{"osd":10,"last update":"Wed May 8 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34240,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34240,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34240,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62704,"data_compressed":1841,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63662,"data_compressed":1841,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":63081,"data_compressed":1841,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T23:15:04.110 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T23:15:04.336 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:15:04.438 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:04 smithi135 ceph-mon[42440]: pgmap v244: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-08T23:15:04.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:04 smithi179 ceph-mon[46314]: pgmap v244: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-08T23:15:04.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:04 smithi195 ceph-mon[46516]: pgmap v244: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-08T23:15:05.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.283+0000 7f00ed2c9700 1 -- 172.21.15.135:0/922159705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00e81051c0 msgr2=0x7f00e810cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:05.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.283+0000 7f00ed2c9700 1 --2- 172.21.15.135:0/922159705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00e81051c0 0x7f00e810cd90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009990 tx=0x7f00e0009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:05.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.283+0000 7f00ed2c9700 1 -- 172.21.15.135:0/922159705 shutdown_connections 2024-05-08T23:15:05.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.283+0000 7f00ed2c9700 1 --2- 172.21.15.135:0/922159705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00e81000e0 0x7f00e81004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:05.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.283+0000 7f00ed2c9700 1 --2- 172.21.15.135:0/922159705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00e81051c0 0x7f00e810cd90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:05.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.283+0000 7f00ed2c9700 1 --2- 172.21.15.135:0/922159705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e8100a90 0x7f00e8104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:05.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.283+0000 7f00ed2c9700 1 -- 172.21.15.135:0/922159705 >> 172.21.15.135:0/922159705 conn(0x7f00e8076f40 msgr2=0x7f00e8077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:05.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.283+0000 7f00ed2c9700 1 -- 172.21.15.135:0/922159705 shutdown_connections 2024-05-08T23:15:05.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.283+0000 7f00ed2c9700 1 -- 172.21.15.135:0/922159705 wait complete. 2024-05-08T23:15:05.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.284+0000 7f00ed2c9700 1 Processor -- start 2024-05-08T23:15:05.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.284+0000 7f00ed2c9700 1 -- start start 2024-05-08T23:15:05.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.284+0000 7f00ed2c9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00e81000e0 0x7f00e8197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:05.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.284+0000 7f00ed2c9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e8100a90 0x7f00e8197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:05.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.284+0000 7f00ed2c9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00e81051c0 0x7f00e819bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:05.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.284+0000 7f00ed2c9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e819c250 con 0x7f00e81051c0 2024-05-08T23:15:05.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.284+0000 7f00ed2c9700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e819c3c0 con 0x7f00e8100a90 2024-05-08T23:15:05.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.284+0000 7f00ed2c9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e819c580 con 0x7f00e81000e0 2024-05-08T23:15:05.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.284+0000 7f00e77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00e81051c0 0x7f00e819bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:05.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.284+0000 7f00e77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00e81051c0 0x7f00e819bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39680/0 (socket says 172.21.15.135:39680) 2024-05-08T23:15:05.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.284+0000 7f00e77fe700 1 -- 172.21.15.135:0/1905610899 learned_addr learned my addr 172.21.15.135:0/1905610899 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:05.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.284+0000 7f00e6ffd700 1 --2- 172.21.15.135:0/1905610899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00e81000e0 0x7f00e8197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:05.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.284+0000 7f00e67fc700 1 --2- 172.21.15.135:0/1905610899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e8100a90 0x7f00e8197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:05.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.285+0000 7f00e77fe700 1 -- 172.21.15.135:0/1905610899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00e81000e0 msgr2=0x7f00e8197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:05.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.285+0000 7f00e77fe700 1 --2- 172.21.15.135:0/1905610899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00e81000e0 0x7f00e8197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:05.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.285+0000 7f00e77fe700 1 -- 172.21.15.135:0/1905610899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e8100a90 msgr2=0x7f00e8197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:05.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.285+0000 7f00e77fe700 1 --2- 172.21.15.135:0/1905610899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e8100a90 0x7f00e8197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:05.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.285+0000 7f00e77fe700 1 -- 172.21.15.135:0/1905610899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e00095f0 con 0x7f00e81051c0 2024-05-08T23:15:05.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.285+0000 7f00e67fc700 1 --2- 172.21.15.135:0/1905610899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e8100a90 0x7f00e8197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:05.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.285+0000 7f00e77fe700 1 --2- 172.21.15.135:0/1905610899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00e81051c0 0x7f00e819bc40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c010 tx=0x7f00e000f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:05.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.285+0000 7f00dffff700 1 -- 172.21.15.135:0/1905610899 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e001d070 con 0x7f00e81051c0 2024-05-08T23:15:05.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.285+0000 7f00dffff700 1 -- 172.21.15.135:0/1905610899 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00e000fc20 con 0x7f00e81051c0 2024-05-08T23:15:05.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.285+0000 7f00dffff700 1 -- 172.21.15.135:0/1905610899 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0017650 con 0x7f00e81051c0 2024-05-08T23:15:05.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.285+0000 7f00ed2c9700 1 -- 172.21.15.135:0/1905610899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e819c800 con 0x7f00e81051c0 2024-05-08T23:15:05.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.285+0000 7f00ed2c9700 1 -- 172.21.15.135:0/1905610899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e81a3ef0 con 0x7f00e81051c0 2024-05-08T23:15:05.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.286+0000 7f00ed2c9700 1 -- 172.21.15.135:0/1905610899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e81084a0 con 0x7f00e81051c0 2024-05-08T23:15:05.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.287+0000 7f00dffff700 1 -- 172.21.15.135:0/1905610899 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f00e0022470 con 0x7f00e81051c0 2024-05-08T23:15:05.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.288+0000 7f00dffff700 1 --2- 172.21.15.135:0/1905610899 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f00d40a11b0 0x7f00d40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:05.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.288+0000 7f00e6ffd700 1 --2- 172.21.15.135:0/1905610899 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f00d40a11b0 0x7f00d40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:05.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.288+0000 7f00dffff700 1 -- 172.21.15.135:0/1905610899 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f00e00ce030 con 0x7f00e81051c0 2024-05-08T23:15:05.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.288+0000 7f00e6ffd700 1 --2- 172.21.15.135:0/1905610899 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f00d40a11b0 0x7f00d40a3670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f00d80060b0 tx=0x7f00d800c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:05.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.291+0000 7f00dffff700 1 -- 172.21.15.135:0/1905610899 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f00e00978a0 con 0x7f00e81051c0 2024-05-08T23:15:05.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:05 smithi135 ceph-mon[42440]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:15:05.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.482+0000 7f00ed2c9700 1 -- 172.21.15.135:0/1905610899 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00e81986d0 con 0x7f00d40a11b0 2024-05-08T23:15:05.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.492+0000 7f00dffff700 1 -- 172.21.15.135:0/1905610899 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341424 (secure 0 0 0) 0x7f00e81986d0 con 0x7f00d40a11b0 2024-05-08T23:15:05.496 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:05.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.495+0000 7f00ed2c9700 1 -- 172.21.15.135:0/1905610899 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f00d40a11b0 msgr2=0x7f00d40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:05.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.495+0000 7f00ed2c9700 1 --2- 172.21.15.135:0/1905610899 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f00d40a11b0 0x7f00d40a3670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f00d80060b0 tx=0x7f00d800c040 comp rx=0 tx=0).stop 2024-05-08T23:15:05.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.495+0000 7f00ed2c9700 1 -- 172.21.15.135:0/1905610899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00e81051c0 msgr2=0x7f00e819bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:05.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.495+0000 7f00ed2c9700 1 --2- 172.21.15.135:0/1905610899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00e81051c0 0x7f00e819bc40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c010 tx=0x7f00e000f700 comp rx=0 tx=0).stop 2024-05-08T23:15:05.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.495+0000 7f00ed2c9700 1 -- 172.21.15.135:0/1905610899 shutdown_connections 2024-05-08T23:15:05.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.495+0000 7f00ed2c9700 1 --2- 172.21.15.135:0/1905610899 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f00d40a11b0 0x7f00d40a3670 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:05.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.495+0000 7f00ed2c9700 1 --2- 172.21.15.135:0/1905610899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00e81000e0 0x7f00e8197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:05.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.495+0000 7f00ed2c9700 1 --2- 172.21.15.135:0/1905610899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00e81051c0 0x7f00e819bc40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:05.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.495+0000 7f00ed2c9700 1 --2- 172.21.15.135:0/1905610899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e8100a90 0x7f00e8197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:05.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.495+0000 7f00ed2c9700 1 -- 172.21.15.135:0/1905610899 >> 172.21.15.135:0/1905610899 conn(0x7f00e8076f40 msgr2=0x7f00e80ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:05.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.495+0000 7f00ed2c9700 1 -- 172.21.15.135:0/1905610899 shutdown_connections 2024-05-08T23:15:05.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:05.495+0000 7f00ed2c9700 1 -- 172.21.15.135:0/1905610899 wait complete. 2024-05-08T23:15:05.499 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T23:15:05.602 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:05 smithi179 ceph-mon[46314]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:15:05.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:05 smithi195 ceph-mon[46516]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:15:05.870 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-05-08T23:15:05.041768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659011,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":517,"num_read_kb":381,"num_write":415,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363980,"kb_used_data":11116,"kb_used_omap":18,"kb_used_meta":352749,"kb_avail":1124577844,"statfs":{"total":1151940427776,"available":1151567712256,"internally_reserved":0,"allocated":11382784,"data_stored":7121925,"data_compressed":113157,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19142,"internal_metadata":361215290},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":57,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002963"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934695+0000","last_change":"2024-05-08T23:14:21.938982+0000","last_active":"2024-05-08T23:14:22.934695+0000","last_peered":"2024-05-08T23:14:22.934695+0000","last_clean":"2024-05-08T23:14:22.934695+0000","last_became_active":"2024-05-08T23:14:21.938630+0000","last_became_peered":"2024-05-08T23:14:21.938630+0000","last_unstale":"2024-05-08T23:14:22.934695+0000","last_undegraded":"2024-05-08T23:14:22.934695+0000","last_fullsized":"2024-05-08T23:14:22.934695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:33.421139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125505+0000","last_change":"2024-05-08T23:14:21.952126+0000","last_active":"2024-05-08T23:14:24.125505+0000","last_peered":"2024-05-08T23:14:24.125505+0000","last_clean":"2024-05-08T23:14:24.125505+0000","last_became_active":"2024-05-08T23:14:21.951155+0000","last_became_peered":"2024-05-08T23:14:21.951155+0000","last_unstale":"2024-05-08T23:14:24.125505+0000","last_undegraded":"2024-05-08T23:14:24.125505+0000","last_fullsized":"2024-05-08T23:14:24.125505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:24.931166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125409+0000","last_change":"2024-05-08T23:14:21.947520+0000","last_active":"2024-05-08T23:14:24.125409+0000","last_peered":"2024-05-08T23:14:24.125409+0000","last_clean":"2024-05-08T23:14:24.125409+0000","last_became_active":"2024-05-08T23:14:21.947258+0000","last_became_peered":"2024-05-08T23:14:21.947258+0000","last_unstale":"2024-05-08T23:14:24.125409+0000","last_undegraded":"2024-05-08T23:14:24.125409+0000","last_fullsized":"2024-05-08T23:14:24.125409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:01:37.173840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.850109+0000","last_change":"2024-05-08T23:14:21.951221+0000","last_active":"2024-05-08T23:14:23.850109+0000","last_peered":"2024-05-08T23:14:23.850109+0000","last_clean":"2024-05-08T23:14:23.850109+0000","last_became_active":"2024-05-08T23:14:21.950398+0000","last_became_peered":"2024-05-08T23:14:21.950398+0000","last_unstale":"2024-05-08T23:14:23.850109+0000","last_undegraded":"2024-05-08T23:14:23.850109+0000","last_fullsized":"2024-05-08T23:14:23.850109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:26.360521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169189+0000","last_change":"2024-05-08T23:14:21.947783+0000","last_active":"2024-05-08T23:14:24.169189+0000","last_peered":"2024-05-08T23:14:24.169189+0000","last_clean":"2024-05-08T23:14:24.169189+0000","last_became_active":"2024-05-08T23:14:21.947448+0000","last_became_peered":"2024-05-08T23:14:21.947448+0000","last_unstale":"2024-05-08T23:14:24.169189+0000","last_undegraded":"2024-05-08T23:14:24.169189+0000","last_fullsized":"2024-05-08T23:14:24.169189+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:21.447674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.071003+0000","last_change":"2024-05-08T23:14:21.945541+0000","last_active":"2024-05-08T23:14:22.071003+0000","last_peered":"2024-05-08T23:14:22.071003+0000","last_clean":"2024-05-08T23:14:22.071003+0000","last_became_active":"2024-05-08T23:14:21.945135+0000","last_became_peered":"2024-05-08T23:14:21.945135+0000","last_unstale":"2024-05-08T23:14:22.071003+0000","last_undegraded":"2024-05-08T23:14:22.071003+0000","last_fullsized":"2024-05-08T23:14:22.071003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:44.143289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041794+0000","last_change":"2024-05-08T23:14:21.958827+0000","last_active":"2024-05-08T23:14:22.041794+0000","last_peered":"2024-05-08T23:14:22.041794+0000","last_clean":"2024-05-08T23:14:22.041794+0000","last_became_active":"2024-05-08T23:14:21.958400+0000","last_became_peered":"2024-05-08T23:14:21.958400+0000","last_unstale":"2024-05-08T23:14:22.041794+0000","last_undegraded":"2024-05-08T23:14:22.041794+0000","last_fullsized":"2024-05-08T23:14:22.041794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:39.280896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099219+0000","last_change":"2024-05-08T23:14:21.960924+0000","last_active":"2024-05-08T23:14:23.099219+0000","last_peered":"2024-05-08T23:14:23.099219+0000","last_clean":"2024-05-08T23:14:23.099219+0000","last_became_active":"2024-05-08T23:14:21.960651+0000","last_became_peered":"2024-05-08T23:14:21.960651+0000","last_unstale":"2024-05-08T23:14:23.099219+0000","last_undegraded":"2024-05-08T23:14:23.099219+0000","last_fullsized":"2024-05-08T23:14:23.099219+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:14:22.284354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468928+0000","last_change":"2024-05-08T23:14:21.961059+0000","last_active":"2024-05-08T23:14:22.468928+0000","last_peered":"2024-05-08T23:14:22.468928+0000","last_clean":"2024-05-08T23:14:22.468928+0000","last_became_active":"2024-05-08T23:14:21.960730+0000","last_became_peered":"2024-05-08T23:14:21.960730+0000","last_unstale":"2024-05-08T23:14:22.468928+0000","last_undegraded":"2024-05-08T23:14:22.468928+0000","last_fullsized":"2024-05-08T23:14:22.468928+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:01.448480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.071052+0000","last_change":"2024-05-08T23:14:21.950267+0000","last_active":"2024-05-08T23:14:22.071052+0000","last_peered":"2024-05-08T23:14:22.071052+0000","last_clean":"2024-05-08T23:14:22.071052+0000","last_became_active":"2024-05-08T23:14:21.949477+0000","last_became_peered":"2024-05-08T23:14:21.949477+0000","last_unstale":"2024-05-08T23:14:22.071052+0000","last_undegraded":"2024-05-08T23:14:22.071052+0000","last_fullsized":"2024-05-08T23:14:22.071052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:36.123316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041851+0000","last_change":"2024-05-08T23:14:21.955566+0000","last_active":"2024-05-08T23:14:22.041851+0000","last_peered":"2024-05-08T23:14:22.041851+0000","last_clean":"2024-05-08T23:14:22.041851+0000","last_became_active":"2024-05-08T23:14:21.955208+0000","last_became_peered":"2024-05-08T23:14:21.955208+0000","last_unstale":"2024-05-08T23:14:22.041851+0000","last_undegraded":"2024-05-08T23:14:22.041851+0000","last_fullsized":"2024-05-08T23:14:22.041851+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:29.478197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.850194+0000","last_change":"2024-05-08T23:14:21.939532+0000","last_active":"2024-05-08T23:14:23.850194+0000","last_peered":"2024-05-08T23:14:23.850194+0000","last_clean":"2024-05-08T23:14:23.850194+0000","last_became_active":"2024-05-08T23:14:21.938590+0000","last_became_peered":"2024-05-08T23:14:21.938590+0000","last_unstale":"2024-05-08T23:14:23.850194+0000","last_undegraded":"2024-05-08T23:14:23.850194+0000","last_fullsized":"2024-05-08T23:14:23.850194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:50.525121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067896+0000","last_change":"2024-05-08T23:14:21.942720+0000","last_active":"2024-05-08T23:14:24.067896+0000","last_peered":"2024-05-08T23:14:24.067896+0000","last_clean":"2024-05-08T23:14:24.067896+0000","last_became_active":"2024-05-08T23:14:21.942396+0000","last_became_peered":"2024-05-08T23:14:21.942396+0000","last_unstale":"2024-05-08T23:14:24.067896+0000","last_undegraded":"2024-05-08T23:14:24.067896+0000","last_fullsized":"2024-05-08T23:14:24.067896+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:17.893007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125207+0000","last_change":"2024-05-08T23:14:21.946955+0000","last_active":"2024-05-08T23:14:24.125207+0000","last_peered":"2024-05-08T23:14:24.125207+0000","last_clean":"2024-05-08T23:14:24.125207+0000","last_became_active":"2024-05-08T23:14:21.946733+0000","last_became_peered":"2024-05-08T23:14:21.946733+0000","last_unstale":"2024-05-08T23:14:24.125207+0000","last_undegraded":"2024-05-08T23:14:24.125207+0000","last_fullsized":"2024-05-08T23:14:24.125207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:39.097612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125239+0000","last_change":"2024-05-08T23:14:21.945827+0000","last_active":"2024-05-08T23:14:24.125239+0000","last_peered":"2024-05-08T23:14:24.125239+0000","last_clean":"2024-05-08T23:14:24.125239+0000","last_became_active":"2024-05-08T23:14:21.945606+0000","last_became_peered":"2024-05-08T23:14:21.945606+0000","last_unstale":"2024-05-08T23:14:24.125239+0000","last_undegraded":"2024-05-08T23:14:24.125239+0000","last_fullsized":"2024-05-08T23:14:24.125239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:22.689917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468793+0000","last_change":"2024-05-08T23:14:21.952640+0000","last_active":"2024-05-08T23:14:22.468793+0000","last_peered":"2024-05-08T23:14:22.468793+0000","last_clean":"2024-05-08T23:14:22.468793+0000","last_became_active":"2024-05-08T23:14:21.952283+0000","last_became_peered":"2024-05-08T23:14:21.952283+0000","last_unstale":"2024-05-08T23:14:22.468793+0000","last_undegraded":"2024-05-08T23:14:22.468793+0000","last_fullsized":"2024-05-08T23:14:22.468793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:30:42.211479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934813+0000","last_change":"2024-05-08T23:14:21.947950+0000","last_active":"2024-05-08T23:14:22.934813+0000","last_peered":"2024-05-08T23:14:22.934813+0000","last_clean":"2024-05-08T23:14:22.934813+0000","last_became_active":"2024-05-08T23:14:21.947621+0000","last_became_peered":"2024-05-08T23:14:21.947621+0000","last_unstale":"2024-05-08T23:14:22.934813+0000","last_undegraded":"2024-05-08T23:14:22.934813+0000","last_fullsized":"2024-05-08T23:14:22.934813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:54:47.736649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.933859+0000","last_change":"2024-05-08T23:14:21.950172+0000","last_active":"2024-05-08T23:14:22.933859+0000","last_peered":"2024-05-08T23:14:22.933859+0000","last_clean":"2024-05-08T23:14:22.933859+0000","last_became_active":"2024-05-08T23:14:21.949844+0000","last_became_peered":"2024-05-08T23:14:21.949844+0000","last_unstale":"2024-05-08T23:14:22.933859+0000","last_undegraded":"2024-05-08T23:14:22.933859+0000","last_fullsized":"2024-05-08T23:14:22.933859+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:18.216174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685351+0000","last_change":"2024-05-08T23:14:21.943336+0000","last_active":"2024-05-08T23:14:23.685351+0000","last_peered":"2024-05-08T23:14:23.685351+0000","last_clean":"2024-05-08T23:14:23.685351+0000","last_became_active":"2024-05-08T23:14:21.942697+0000","last_became_peered":"2024-05-08T23:14:21.942697+0000","last_unstale":"2024-05-08T23:14:23.685351+0000","last_undegraded":"2024-05-08T23:14:23.685351+0000","last_fullsized":"2024-05-08T23:14:23.685351+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:54.332708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:15:02.409454+0000","last_change":"2024-05-08T23:14:21.526822+0000","last_active":"2024-05-08T23:15:02.409454+0000","last_peered":"2024-05-08T23:15:02.409454+0000","last_clean":"2024-05-08T23:15:02.409454+0000","last_became_active":"2024-05-08T23:14:21.526561+0000","last_became_peered":"2024-05-08T23:14:21.526561+0000","last_unstale":"2024-05-08T23:15:02.409454+0000","last_undegraded":"2024-05-08T23:15:02.409454+0000","last_fullsized":"2024-05-08T23:15:02.409454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:45.360865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099287+0000","last_change":"2024-05-08T23:14:21.961315+0000","last_active":"2024-05-08T23:14:23.099287+0000","last_peered":"2024-05-08T23:14:23.099287+0000","last_clean":"2024-05-08T23:14:23.099287+0000","last_became_active":"2024-05-08T23:14:21.961039+0000","last_became_peered":"2024-05-08T23:14:21.961039+0000","last_unstale":"2024-05-08T23:14:23.099287+0000","last_undegraded":"2024-05-08T23:14:23.099287+0000","last_fullsized":"2024-05-08T23:14:23.099287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:01.163246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.168432+0000","last_change":"2024-05-08T23:14:21.523353+0000","last_active":"2024-05-08T23:14:24.168432+0000","last_peered":"2024-05-08T23:14:24.168432+0000","last_clean":"2024-05-08T23:14:24.168432+0000","last_became_active":"2024-05-08T23:14:21.523046+0000","last_became_peered":"2024-05-08T23:14:21.523046+0000","last_unstale":"2024-05-08T23:14:24.168432+0000","last_undegraded":"2024-05-08T23:14:24.168432+0000","last_fullsized":"2024-05-08T23:14:24.168432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:04:54.448457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125580+0000","last_change":"2024-05-08T23:14:21.948093+0000","last_active":"2024-05-08T23:14:24.125580+0000","last_peered":"2024-05-08T23:14:24.125580+0000","last_clean":"2024-05-08T23:14:24.125580+0000","last_became_active":"2024-05-08T23:14:21.947812+0000","last_became_peered":"2024-05-08T23:14:21.947812+0000","last_unstale":"2024-05-08T23:14:24.125580+0000","last_undegraded":"2024-05-08T23:14:24.125580+0000","last_fullsized":"2024-05-08T23:14:24.125580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:47.804387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:28.360310+0000","last_change":"2024-05-08T23:14:21.527205+0000","last_active":"2024-05-08T23:14:28.360310+0000","last_peered":"2024-05-08T23:14:28.360310+0000","last_clean":"2024-05-08T23:14:28.360310+0000","last_became_active":"2024-05-08T23:14:21.526699+0000","last_became_peered":"2024-05-08T23:14:21.526699+0000","last_unstale":"2024-05-08T23:14:28.360310+0000","last_undegraded":"2024-05-08T23:14:28.360310+0000","last_fullsized":"2024-05-08T23:14:28.360310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:04.818255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468855+0000","last_change":"2024-05-08T23:14:21.946804+0000","last_active":"2024-05-08T23:14:22.468855+0000","last_peered":"2024-05-08T23:14:22.468855+0000","last_clean":"2024-05-08T23:14:22.468855+0000","last_became_active":"2024-05-08T23:14:21.946448+0000","last_became_peered":"2024-05-08T23:14:21.946448+0000","last_unstale":"2024-05-08T23:14:22.468855+0000","last_undegraded":"2024-05-08T23:14:22.468855+0000","last_fullsized":"2024-05-08T23:14:22.468855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:40.495644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.354442+0000","last_change":"2024-05-08T23:14:21.521146+0000","last_active":"2024-05-08T23:14:27.354442+0000","last_peered":"2024-05-08T23:14:27.354442+0000","last_clean":"2024-05-08T23:14:27.354442+0000","last_became_active":"2024-05-08T23:14:21.520936+0000","last_became_peered":"2024-05-08T23:14:21.520936+0000","last_unstale":"2024-05-08T23:14:27.354442+0000","last_undegraded":"2024-05-08T23:14:27.354442+0000","last_fullsized":"2024-05-08T23:14:27.354442+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:30.725824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.102003+0000","last_change":"2024-05-08T23:14:21.961059+0000","last_active":"2024-05-08T23:14:22.102003+0000","last_peered":"2024-05-08T23:14:22.102003+0000","last_clean":"2024-05-08T23:14:22.102003+0000","last_became_active":"2024-05-08T23:14:21.960719+0000","last_became_peered":"2024-05-08T23:14:21.960719+0000","last_unstale":"2024-05-08T23:14:22.102003+0000","last_undegraded":"2024-05-08T23:14:22.102003+0000","last_fullsized":"2024-05-08T23:14:22.102003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:13.004002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:15:00.389649+0000","last_change":"2024-05-08T23:14:21.527091+0000","last_active":"2024-05-08T23:15:00.389649+0000","last_peered":"2024-05-08T23:15:00.389649+0000","last_clean":"2024-05-08T23:15:00.389649+0000","last_became_active":"2024-05-08T23:14:21.526750+0000","last_became_peered":"2024-05-08T23:14:21.526750+0000","last_unstale":"2024-05-08T23:15:00.389649+0000","last_undegraded":"2024-05-08T23:15:00.389649+0000","last_fullsized":"2024-05-08T23:15:00.389649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:35.059241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169216+0000","last_change":"2024-05-08T23:14:21.942050+0000","last_active":"2024-05-08T23:14:24.169216+0000","last_peered":"2024-05-08T23:14:24.169216+0000","last_clean":"2024-05-08T23:14:24.169216+0000","last_became_active":"2024-05-08T23:14:21.941719+0000","last_became_peered":"2024-05-08T23:14:21.941719+0000","last_unstale":"2024-05-08T23:14:24.169216+0000","last_undegraded":"2024-05-08T23:14:24.169216+0000","last_fullsized":"2024-05-08T23:14:24.169216+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:03.821820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.344926+0000","last_change":"2024-05-08T23:14:21.523760+0000","last_active":"2024-05-08T23:14:26.344926+0000","last_peered":"2024-05-08T23:14:26.344926+0000","last_clean":"2024-05-08T23:14:26.344926+0000","last_became_active":"2024-05-08T23:14:21.523213+0000","last_became_peered":"2024-05-08T23:14:21.523213+0000","last_unstale":"2024-05-08T23:14:26.344926+0000","last_undegraded":"2024-05-08T23:14:26.344926+0000","last_fullsized":"2024-05-08T23:14:26.344926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:12.225427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101977+0000","last_change":"2024-05-08T23:14:21.959473+0000","last_active":"2024-05-08T23:14:22.101977+0000","last_peered":"2024-05-08T23:14:22.101977+0000","last_clean":"2024-05-08T23:14:22.101977+0000","last_became_active":"2024-05-08T23:14:21.959127+0000","last_became_peered":"2024-05-08T23:14:21.959127+0000","last_unstale":"2024-05-08T23:14:22.101977+0000","last_undegraded":"2024-05-08T23:14:22.101977+0000","last_fullsized":"2024-05-08T23:14:22.101977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:50.181028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.960065+0000","last_change":"2024-05-08T23:14:21.520072+0000","last_active":"2024-05-08T23:14:25.960065+0000","last_peered":"2024-05-08T23:14:25.960065+0000","last_clean":"2024-05-08T23:14:25.960065+0000","last_became_active":"2024-05-08T23:14:21.519753+0000","last_became_peered":"2024-05-08T23:14:21.519753+0000","last_unstale":"2024-05-08T23:14:25.960065+0000","last_undegraded":"2024-05-08T23:14:25.960065+0000","last_fullsized":"2024-05-08T23:14:25.960065+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:35.966643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099236+0000","last_change":"2024-05-08T23:14:21.946034+0000","last_active":"2024-05-08T23:14:23.099236+0000","last_peered":"2024-05-08T23:14:23.099236+0000","last_clean":"2024-05-08T23:14:23.099236+0000","last_became_active":"2024-05-08T23:14:21.945652+0000","last_became_peered":"2024-05-08T23:14:21.945652+0000","last_unstale":"2024-05-08T23:14:23.099236+0000","last_undegraded":"2024-05-08T23:14:23.099236+0000","last_fullsized":"2024-05-08T23:14:23.099236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:13.527673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.355671+0000","last_change":"2024-05-08T23:14:21.522394+0000","last_active":"2024-05-08T23:14:27.355671+0000","last_peered":"2024-05-08T23:14:27.355671+0000","last_clean":"2024-05-08T23:14:27.355671+0000","last_became_active":"2024-05-08T23:14:21.522038+0000","last_became_peered":"2024-05-08T23:14:21.522038+0000","last_unstale":"2024-05-08T23:14:27.355671+0000","last_undegraded":"2024-05-08T23:14:27.355671+0000","last_fullsized":"2024-05-08T23:14:27.355671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:18.958647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.933815+0000","last_change":"2024-05-08T23:14:21.946005+0000","last_active":"2024-05-08T23:14:22.933815+0000","last_peered":"2024-05-08T23:14:22.933815+0000","last_clean":"2024-05-08T23:14:22.933815+0000","last_became_active":"2024-05-08T23:14:21.945681+0000","last_became_peered":"2024-05-08T23:14:21.945681+0000","last_unstale":"2024-05-08T23:14:22.933815+0000","last_undegraded":"2024-05-08T23:14:22.933815+0000","last_fullsized":"2024-05-08T23:14:22.933815+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:17.511869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":86,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:15:01.390444+0000","last_change":"2024-05-08T23:14:21.521775+0000","last_active":"2024-05-08T23:15:01.390444+0000","last_peered":"2024-05-08T23:15:01.390444+0000","last_clean":"2024-05-08T23:15:01.390444+0000","last_became_active":"2024-05-08T23:14:21.521428+0000","last_became_peered":"2024-05-08T23:14:21.521428+0000","last_unstale":"2024-05-08T23:15:01.390444+0000","last_undegraded":"2024-05-08T23:15:01.390444+0000","last_fullsized":"2024-05-08T23:15:01.390444+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:13.379322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468911+0000","last_change":"2024-05-08T23:14:21.944886+0000","last_active":"2024-05-08T23:14:22.468911+0000","last_peered":"2024-05-08T23:14:22.468911+0000","last_clean":"2024-05-08T23:14:22.468911+0000","last_became_active":"2024-05-08T23:14:21.944585+0000","last_became_peered":"2024-05-08T23:14:21.944585+0000","last_unstale":"2024-05-08T23:14:22.468911+0000","last_undegraded":"2024-05-08T23:14:22.468911+0000","last_fullsized":"2024-05-08T23:14:22.468911+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:00.519286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.354442+0000","last_change":"2024-05-08T23:14:21.527500+0000","last_active":"2024-05-08T23:14:27.354442+0000","last_peered":"2024-05-08T23:14:27.354442+0000","last_clean":"2024-05-08T23:14:27.354442+0000","last_became_active":"2024-05-08T23:14:21.526709+0000","last_became_peered":"2024-05-08T23:14:21.526709+0000","last_unstale":"2024-05-08T23:14:27.354442+0000","last_undegraded":"2024-05-08T23:14:27.354442+0000","last_fullsized":"2024-05-08T23:14:27.354442+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:49.584194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125526+0000","last_change":"2024-05-08T23:14:21.952026+0000","last_active":"2024-05-08T23:14:24.125526+0000","last_peered":"2024-05-08T23:14:24.125526+0000","last_clean":"2024-05-08T23:14:24.125526+0000","last_became_active":"2024-05-08T23:14:21.951817+0000","last_became_peered":"2024-05-08T23:14:21.951817+0000","last_unstale":"2024-05-08T23:14:24.125526+0000","last_undegraded":"2024-05-08T23:14:24.125526+0000","last_fullsized":"2024-05-08T23:14:24.125526+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:45.239470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.338428+0000","last_change":"2024-05-08T23:14:21.519296+0000","last_active":"2024-05-08T23:14:26.338428+0000","last_peered":"2024-05-08T23:14:26.338428+0000","last_clean":"2024-05-08T23:14:26.338428+0000","last_became_active":"2024-05-08T23:14:21.518975+0000","last_became_peered":"2024-05-08T23:14:21.518975+0000","last_unstale":"2024-05-08T23:14:26.338428+0000","last_undegraded":"2024-05-08T23:14:26.338428+0000","last_fullsized":"2024-05-08T23:14:26.338428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:12.663513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468873+0000","last_change":"2024-05-08T23:14:21.947768+0000","last_active":"2024-05-08T23:14:22.468873+0000","last_peered":"2024-05-08T23:14:22.468873+0000","last_clean":"2024-05-08T23:14:22.468873+0000","last_became_active":"2024-05-08T23:14:21.947247+0000","last_became_peered":"2024-05-08T23:14:21.947247+0000","last_unstale":"2024-05-08T23:14:22.468873+0000","last_undegraded":"2024-05-08T23:14:22.468873+0000","last_fullsized":"2024-05-08T23:14:22.468873+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:16:58.283218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'30","reported_seq":122,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:15:01.406037+0000","last_change":"2024-05-08T23:14:21.519630+0000","last_active":"2024-05-08T23:15:01.406037+0000","last_peered":"2024-05-08T23:15:01.406037+0000","last_clean":"2024-05-08T23:15:01.406037+0000","last_became_active":"2024-05-08T23:14:21.519151+0000","last_became_peered":"2024-05-08T23:14:21.519151+0000","last_unstale":"2024-05-08T23:15:01.406037+0000","last_undegraded":"2024-05-08T23:15:01.406037+0000","last_fullsized":"2024-05-08T23:15:01.406037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:50.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61000,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":99,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169605+0000","last_change":"2024-05-08T23:14:21.950966+0000","last_active":"2024-05-08T23:14:24.169605+0000","last_peered":"2024-05-08T23:14:24.169605+0000","last_clean":"2024-05-08T23:14:24.169605+0000","last_became_active":"2024-05-08T23:14:21.950694+0000","last_became_peered":"2024-05-08T23:14:21.950694+0000","last_unstale":"2024-05-08T23:14:24.169605+0000","last_undegraded":"2024-05-08T23:14:24.169605+0000","last_fullsized":"2024-05-08T23:14:24.169605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:41.599529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.352965+0000","last_change":"2024-05-08T23:14:21.519509+0000","last_active":"2024-05-08T23:14:27.352965+0000","last_peered":"2024-05-08T23:14:27.352965+0000","last_clean":"2024-05-08T23:14:27.352965+0000","last_became_active":"2024-05-08T23:14:21.519237+0000","last_became_peered":"2024-05-08T23:14:21.519237+0000","last_unstale":"2024-05-08T23:14:27.352965+0000","last_undegraded":"2024-05-08T23:14:27.352965+0000","last_fullsized":"2024-05-08T23:14:27.352965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:52.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067695+0000","last_change":"2024-05-08T23:14:21.944225+0000","last_active":"2024-05-08T23:14:24.067695+0000","last_peered":"2024-05-08T23:14:24.067695+0000","last_clean":"2024-05-08T23:14:24.067695+0000","last_became_active":"2024-05-08T23:14:21.943909+0000","last_became_peered":"2024-05-08T23:14:21.943909+0000","last_unstale":"2024-05-08T23:14:24.067695+0000","last_undegraded":"2024-05-08T23:14:24.067695+0000","last_fullsized":"2024-05-08T23:14:24.067695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:52.003909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.355657+0000","last_change":"2024-05-08T23:14:21.522565+0000","last_active":"2024-05-08T23:14:27.355657+0000","last_peered":"2024-05-08T23:14:27.355657+0000","last_clean":"2024-05-08T23:14:27.355657+0000","last_became_active":"2024-05-08T23:14:21.522224+0000","last_became_peered":"2024-05-08T23:14:21.522224+0000","last_unstale":"2024-05-08T23:14:27.355657+0000","last_undegraded":"2024-05-08T23:14:27.355657+0000","last_fullsized":"2024-05-08T23:14:27.355657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:34.768309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041830+0000","last_change":"2024-05-08T23:14:21.953759+0000","last_active":"2024-05-08T23:14:22.041830+0000","last_peered":"2024-05-08T23:14:22.041830+0000","last_clean":"2024-05-08T23:14:22.041830+0000","last_became_active":"2024-05-08T23:14:21.953425+0000","last_became_peered":"2024-05-08T23:14:21.953425+0000","last_unstale":"2024-05-08T23:14:22.041830+0000","last_undegraded":"2024-05-08T23:14:22.041830+0000","last_fullsized":"2024-05-08T23:14:22.041830+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:36.189067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:59.392422+0000","last_change":"2024-05-08T23:14:21.525305+0000","last_active":"2024-05-08T23:14:59.392422+0000","last_peered":"2024-05-08T23:14:59.392422+0000","last_clean":"2024-05-08T23:14:59.392422+0000","last_became_active":"2024-05-08T23:14:21.524985+0000","last_became_peered":"2024-05-08T23:14:21.524985+0000","last_unstale":"2024-05-08T23:14:59.392422+0000","last_undegraded":"2024-05-08T23:14:59.392422+0000","last_fullsized":"2024-05-08T23:14:59.392422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:20:23.814736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041755+0000","last_change":"2024-05-08T23:14:21.958958+0000","last_active":"2024-05-08T23:14:22.041755+0000","last_peered":"2024-05-08T23:14:22.041755+0000","last_clean":"2024-05-08T23:14:22.041755+0000","last_became_active":"2024-05-08T23:14:21.958613+0000","last_became_peered":"2024-05-08T23:14:21.958613+0000","last_unstale":"2024-05-08T23:14:22.041755+0000","last_undegraded":"2024-05-08T23:14:22.041755+0000","last_fullsized":"2024-05-08T23:14:22.041755+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:07.245634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.346718+0000","last_change":"2024-05-08T23:14:21.525484+0000","last_active":"2024-05-08T23:14:26.346718+0000","last_peered":"2024-05-08T23:14:26.346718+0000","last_clean":"2024-05-08T23:14:26.346718+0000","last_became_active":"2024-05-08T23:14:21.525142+0000","last_became_peered":"2024-05-08T23:14:21.525142+0000","last_unstale":"2024-05-08T23:14:26.346718+0000","last_undegraded":"2024-05-08T23:14:26.346718+0000","last_fullsized":"2024-05-08T23:14:26.346718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:43.273230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101938+0000","last_change":"2024-05-08T23:14:21.962233+0000","last_active":"2024-05-08T23:14:22.101938+0000","last_peered":"2024-05-08T23:14:22.101938+0000","last_clean":"2024-05-08T23:14:22.101938+0000","last_became_active":"2024-05-08T23:14:21.961720+0000","last_became_peered":"2024-05-08T23:14:21.961720+0000","last_unstale":"2024-05-08T23:14:22.101938+0000","last_undegraded":"2024-05-08T23:14:22.101938+0000","last_fullsized":"2024-05-08T23:14:22.101938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:49:29.797724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.335420+0000","last_change":"2024-05-08T23:14:21.525125+0000","last_active":"2024-05-08T23:14:26.335420+0000","last_peered":"2024-05-08T23:14:26.335420+0000","last_clean":"2024-05-08T23:14:26.335420+0000","last_became_active":"2024-05-08T23:14:21.524759+0000","last_became_peered":"2024-05-08T23:14:21.524759+0000","last_unstale":"2024-05-08T23:14:26.335420+0000","last_undegraded":"2024-05-08T23:14:26.335420+0000","last_fullsized":"2024-05-08T23:14:26.335420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:45.267925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934649+0000","last_change":"2024-05-08T23:14:21.949084+0000","last_active":"2024-05-08T23:14:22.934649+0000","last_peered":"2024-05-08T23:14:22.934649+0000","last_clean":"2024-05-08T23:14:22.934649+0000","last_became_active":"2024-05-08T23:14:21.948567+0000","last_became_peered":"2024-05-08T23:14:21.948567+0000","last_unstale":"2024-05-08T23:14:22.934649+0000","last_undegraded":"2024-05-08T23:14:22.934649+0000","last_fullsized":"2024-05-08T23:14:22.934649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:50:33.466144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.814965+0000","last_change":"2024-05-08T23:14:21.519758+0000","last_active":"2024-05-08T23:14:23.814965+0000","last_peered":"2024-05-08T23:14:23.814965+0000","last_clean":"2024-05-08T23:14:23.814965+0000","last_became_active":"2024-05-08T23:14:21.519403+0000","last_became_peered":"2024-05-08T23:14:21.519403+0000","last_unstale":"2024-05-08T23:14:23.814965+0000","last_undegraded":"2024-05-08T23:14:23.814965+0000","last_fullsized":"2024-05-08T23:14:23.814965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:13:49.080141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.168820+0000","last_change":"2024-05-08T23:14:21.944315+0000","last_active":"2024-05-08T23:14:24.168820+0000","last_peered":"2024-05-08T23:14:24.168820+0000","last_clean":"2024-05-08T23:14:24.168820+0000","last_became_active":"2024-05-08T23:14:21.943542+0000","last_became_peered":"2024-05-08T23:14:21.943542+0000","last_unstale":"2024-05-08T23:14:24.168820+0000","last_undegraded":"2024-05-08T23:14:24.168820+0000","last_fullsized":"2024-05-08T23:14:24.168820+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:10.667516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:15:00.407664+0000","last_change":"2024-05-08T23:14:21.526576+0000","last_active":"2024-05-08T23:15:00.407664+0000","last_peered":"2024-05-08T23:15:00.407664+0000","last_clean":"2024-05-08T23:15:00.407664+0000","last_became_active":"2024-05-08T23:14:21.524611+0000","last_became_peered":"2024-05-08T23:14:21.524611+0000","last_unstale":"2024-05-08T23:15:00.407664+0000","last_undegraded":"2024-05-08T23:15:00.407664+0000","last_fullsized":"2024-05-08T23:15:00.407664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:51:52.929531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.071016+0000","last_change":"2024-05-08T23:14:21.951870+0000","last_active":"2024-05-08T23:14:22.071016+0000","last_peered":"2024-05-08T23:14:22.071016+0000","last_clean":"2024-05-08T23:14:22.071016+0000","last_became_active":"2024-05-08T23:14:21.949810+0000","last_became_peered":"2024-05-08T23:14:21.949810+0000","last_unstale":"2024-05-08T23:14:22.071016+0000","last_undegraded":"2024-05-08T23:14:22.071016+0000","last_fullsized":"2024-05-08T23:14:22.071016+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:01.727234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101925+0000","last_change":"2024-05-08T23:14:21.958705+0000","last_active":"2024-05-08T23:14:22.101925+0000","last_peered":"2024-05-08T23:14:22.101925+0000","last_clean":"2024-05-08T23:14:22.101925+0000","last_became_active":"2024-05-08T23:14:21.958392+0000","last_became_peered":"2024-05-08T23:14:21.958392+0000","last_unstale":"2024-05-08T23:14:22.101925+0000","last_undegraded":"2024-05-08T23:14:22.101925+0000","last_fullsized":"2024-05-08T23:14:22.101925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:34.417439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:59.391753+0000","last_change":"2024-05-08T23:14:21.520978+0000","last_active":"2024-05-08T23:14:59.391753+0000","last_peered":"2024-05-08T23:14:59.391753+0000","last_clean":"2024-05-08T23:14:59.391753+0000","last_became_active":"2024-05-08T23:14:21.520688+0000","last_became_peered":"2024-05-08T23:14:21.520688+0000","last_unstale":"2024-05-08T23:14:59.391753+0000","last_undegraded":"2024-05-08T23:14:59.391753+0000","last_fullsized":"2024-05-08T23:14:59.391753+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:59:43.000719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099268+0000","last_change":"2024-05-08T23:14:21.946315+0000","last_active":"2024-05-08T23:14:23.099268+0000","last_peered":"2024-05-08T23:14:23.099268+0000","last_clean":"2024-05-08T23:14:23.099268+0000","last_became_active":"2024-05-08T23:14:21.945542+0000","last_became_peered":"2024-05-08T23:14:21.945542+0000","last_unstale":"2024-05-08T23:14:23.099268+0000","last_undegraded":"2024-05-08T23:14:23.099268+0000","last_fullsized":"2024-05-08T23:14:23.099268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:35.027035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.354653+0000","last_change":"2024-05-08T23:14:21.521066+0000","last_active":"2024-05-08T23:14:27.354653+0000","last_peered":"2024-05-08T23:14:27.354653+0000","last_clean":"2024-05-08T23:14:27.354653+0000","last_became_active":"2024-05-08T23:14:21.520730+0000","last_became_peered":"2024-05-08T23:14:21.520730+0000","last_unstale":"2024-05-08T23:14:27.354653+0000","last_undegraded":"2024-05-08T23:14:27.354653+0000","last_fullsized":"2024-05-08T23:14:27.354653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:11.033062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":324,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.168670+0000","last_change":"2024-05-08T23:13:34.449454+0000","last_active":"2024-05-08T23:14:24.168670+0000","last_peered":"2024-05-08T23:14:24.168670+0000","last_clean":"2024-05-08T23:14:24.168670+0000","last_became_active":"2024-05-08T23:13:34.448953+0000","last_became_peered":"2024-05-08T23:13:34.448953+0000","last_unstale":"2024-05-08T23:14:24.168670+0000","last_undegraded":"2024-05-08T23:14:24.168670+0000","last_fullsized":"2024-05-08T23:14:24.168670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:11:11.941444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:11:11.941444+0000","last_clean_scrub_stamp":"2024-05-08T23:11:11.941444+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:49.039661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067594+0000","last_change":"2024-05-08T23:14:21.947145+0000","last_active":"2024-05-08T23:14:24.067594+0000","last_peered":"2024-05-08T23:14:24.067594+0000","last_clean":"2024-05-08T23:14:24.067594+0000","last_became_active":"2024-05-08T23:14:21.946842+0000","last_became_peered":"2024-05-08T23:14:21.946842+0000","last_unstale":"2024-05-08T23:14:24.067594+0000","last_undegraded":"2024-05-08T23:14:24.067594+0000","last_fullsized":"2024-05-08T23:14:24.067594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:27.070888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:25.960008+0000","last_change":"2024-05-08T23:14:21.525571+0000","last_active":"2024-05-08T23:14:25.960008+0000","last_peered":"2024-05-08T23:14:25.960008+0000","last_clean":"2024-05-08T23:14:25.960008+0000","last_became_active":"2024-05-08T23:14:21.524486+0000","last_became_peered":"2024-05-08T23:14:21.524486+0000","last_unstale":"2024-05-08T23:14:25.960008+0000","last_undegraded":"2024-05-08T23:14:25.960008+0000","last_fullsized":"2024-05-08T23:14:25.960008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:07.575183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.346892+0000","last_change":"2024-05-08T23:14:21.527012+0000","last_active":"2024-05-08T23:14:26.346892+0000","last_peered":"2024-05-08T23:14:26.346892+0000","last_clean":"2024-05-08T23:14:26.346892+0000","last_became_active":"2024-05-08T23:14:21.526263+0000","last_became_peered":"2024-05-08T23:14:21.526263+0000","last_unstale":"2024-05-08T23:14:26.346892+0000","last_undegraded":"2024-05-08T23:14:26.346892+0000","last_fullsized":"2024-05-08T23:14:26.346892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:42.930529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067797+0000","last_change":"2024-05-08T23:14:21.948803+0000","last_active":"2024-05-08T23:14:24.067797+0000","last_peered":"2024-05-08T23:14:24.067797+0000","last_clean":"2024-05-08T23:14:24.067797+0000","last_became_active":"2024-05-08T23:14:21.947787+0000","last_became_peered":"2024-05-08T23:14:21.947787+0000","last_unstale":"2024-05-08T23:14:24.067797+0000","last_undegraded":"2024-05-08T23:14:24.067797+0000","last_fullsized":"2024-05-08T23:14:24.067797+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:25.521045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:31.168017+0000","last_change":"2024-05-08T23:14:21.522944+0000","last_active":"2024-05-08T23:14:31.168017+0000","last_peered":"2024-05-08T23:14:31.168017+0000","last_clean":"2024-05-08T23:14:31.168017+0000","last_became_active":"2024-05-08T23:14:21.522644+0000","last_became_peered":"2024-05-08T23:14:21.522644+0000","last_unstale":"2024-05-08T23:14:31.168017+0000","last_undegraded":"2024-05-08T23:14:31.168017+0000","last_fullsized":"2024-05-08T23:14:31.168017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:17.008946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099353+0000","last_change":"2024-05-08T23:14:21.947133+0000","last_active":"2024-05-08T23:14:23.099353+0000","last_peered":"2024-05-08T23:14:23.099353+0000","last_clean":"2024-05-08T23:14:23.099353+0000","last_became_active":"2024-05-08T23:14:21.946373+0000","last_became_peered":"2024-05-08T23:14:21.946373+0000","last_unstale":"2024-05-08T23:14:23.099353+0000","last_undegraded":"2024-05-08T23:14:23.099353+0000","last_fullsized":"2024-05-08T23:14:23.099353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:08.784990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.355529+0000","last_change":"2024-05-08T23:14:21.525172+0000","last_active":"2024-05-08T23:14:27.355529+0000","last_peered":"2024-05-08T23:14:27.355529+0000","last_clean":"2024-05-08T23:14:27.355529+0000","last_became_active":"2024-05-08T23:14:21.524721+0000","last_became_peered":"2024-05-08T23:14:21.524721+0000","last_unstale":"2024-05-08T23:14:27.355529+0000","last_undegraded":"2024-05-08T23:14:27.355529+0000","last_fullsized":"2024-05-08T23:14:27.355529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:21.051347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125579+0000","last_change":"2024-05-08T23:14:21.951912+0000","last_active":"2024-05-08T23:14:24.125579+0000","last_peered":"2024-05-08T23:14:24.125579+0000","last_clean":"2024-05-08T23:14:24.125579+0000","last_became_active":"2024-05-08T23:14:21.951620+0000","last_became_peered":"2024-05-08T23:14:21.951620+0000","last_unstale":"2024-05-08T23:14:24.125579+0000","last_undegraded":"2024-05-08T23:14:24.125579+0000","last_fullsized":"2024-05-08T23:14:24.125579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:28.218680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.955304+0000","last_change":"2024-05-08T23:14:21.521707+0000","last_active":"2024-05-08T23:14:24.955304+0000","last_peered":"2024-05-08T23:14:24.955304+0000","last_clean":"2024-05-08T23:14:24.955304+0000","last_became_active":"2024-05-08T23:14:21.521376+0000","last_became_peered":"2024-05-08T23:14:21.521376+0000","last_unstale":"2024-05-08T23:14:24.955304+0000","last_undegraded":"2024-05-08T23:14:24.955304+0000","last_fullsized":"2024-05-08T23:14:24.955304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:39.192259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.168939+0000","last_change":"2024-05-08T23:14:21.952825+0000","last_active":"2024-05-08T23:14:24.168939+0000","last_peered":"2024-05-08T23:14:24.168939+0000","last_clean":"2024-05-08T23:14:24.168939+0000","last_became_active":"2024-05-08T23:14:21.952494+0000","last_became_peered":"2024-05-08T23:14:21.952494+0000","last_unstale":"2024-05-08T23:14:24.168939+0000","last_undegraded":"2024-05-08T23:14:24.168939+0000","last_fullsized":"2024-05-08T23:14:24.168939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:31:29.439165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.354216+0000","last_change":"2024-05-08T23:14:21.516550+0000","last_active":"2024-05-08T23:14:27.354216+0000","last_peered":"2024-05-08T23:14:27.354216+0000","last_clean":"2024-05-08T23:14:27.354216+0000","last_became_active":"2024-05-08T23:14:21.516211+0000","last_became_peered":"2024-05-08T23:14:21.516211+0000","last_unstale":"2024-05-08T23:14:27.354216+0000","last_undegraded":"2024-05-08T23:14:27.354216+0000","last_fullsized":"2024-05-08T23:14:27.354216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:37.112939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934466+0000","last_change":"2024-05-08T23:14:21.945018+0000","last_active":"2024-05-08T23:14:22.934466+0000","last_peered":"2024-05-08T23:14:22.934466+0000","last_clean":"2024-05-08T23:14:22.934466+0000","last_became_active":"2024-05-08T23:14:21.944691+0000","last_became_peered":"2024-05-08T23:14:21.944691+0000","last_unstale":"2024-05-08T23:14:22.934466+0000","last_undegraded":"2024-05-08T23:14:22.934466+0000","last_fullsized":"2024-05-08T23:14:22.934466+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:36.323757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.421439+0000","last_change":"2024-05-08T23:14:21.518130+0000","last_active":"2024-05-08T23:14:26.421439+0000","last_peered":"2024-05-08T23:14:26.421439+0000","last_clean":"2024-05-08T23:14:26.421439+0000","last_became_active":"2024-05-08T23:14:21.517828+0000","last_became_peered":"2024-05-08T23:14:21.517828+0000","last_unstale":"2024-05-08T23:14:26.421439+0000","last_undegraded":"2024-05-08T23:14:26.421439+0000","last_fullsized":"2024-05-08T23:14:26.421439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:47.201096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099277+0000","last_change":"2024-05-08T23:14:21.952081+0000","last_active":"2024-05-08T23:14:23.099277+0000","last_peered":"2024-05-08T23:14:23.099277+0000","last_clean":"2024-05-08T23:14:23.099277+0000","last_became_active":"2024-05-08T23:14:21.951794+0000","last_became_peered":"2024-05-08T23:14:21.951794+0000","last_unstale":"2024-05-08T23:14:23.099277+0000","last_undegraded":"2024-05-08T23:14:23.099277+0000","last_fullsized":"2024-05-08T23:14:23.099277+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:41.957442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.953592+0000","last_change":"2024-05-08T23:14:21.525362+0000","last_active":"2024-05-08T23:14:24.953592+0000","last_peered":"2024-05-08T23:14:24.953592+0000","last_clean":"2024-05-08T23:14:24.953592+0000","last_became_active":"2024-05-08T23:14:21.525033+0000","last_became_peered":"2024-05-08T23:14:21.525033+0000","last_unstale":"2024-05-08T23:14:24.953592+0000","last_undegraded":"2024-05-08T23:14:24.953592+0000","last_fullsized":"2024-05-08T23:14:24.953592+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:41.610041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041817+0000","last_change":"2024-05-08T23:14:21.950784+0000","last_active":"2024-05-08T23:14:22.041817+0000","last_peered":"2024-05-08T23:14:22.041817+0000","last_clean":"2024-05-08T23:14:22.041817+0000","last_became_active":"2024-05-08T23:14:21.950504+0000","last_became_peered":"2024-05-08T23:14:21.950504+0000","last_unstale":"2024-05-08T23:14:22.041817+0000","last_undegraded":"2024-05-08T23:14:22.041817+0000","last_fullsized":"2024-05-08T23:14:22.041817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.096546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:59.426444+0000","last_change":"2024-05-08T23:14:21.524636+0000","last_active":"2024-05-08T23:14:59.426444+0000","last_peered":"2024-05-08T23:14:59.426444+0000","last_clean":"2024-05-08T23:14:59.426444+0000","last_became_active":"2024-05-08T23:14:21.524323+0000","last_became_peered":"2024-05-08T23:14:21.524323+0000","last_unstale":"2024-05-08T23:14:59.426444+0000","last_undegraded":"2024-05-08T23:14:59.426444+0000","last_fullsized":"2024-05-08T23:14:59.426444+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:59.714443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041863+0000","last_change":"2024-05-08T23:14:21.950109+0000","last_active":"2024-05-08T23:14:22.041863+0000","last_peered":"2024-05-08T23:14:22.041863+0000","last_clean":"2024-05-08T23:14:22.041863+0000","last_became_active":"2024-05-08T23:14:21.949803+0000","last_became_peered":"2024-05-08T23:14:21.949803+0000","last_unstale":"2024-05-08T23:14:22.041863+0000","last_undegraded":"2024-05-08T23:14:22.041863+0000","last_fullsized":"2024-05-08T23:14:22.041863+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:00.025947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:26.347699+0000","last_change":"2024-05-08T23:14:21.517997+0000","last_active":"2024-05-08T23:14:26.347699+0000","last_peered":"2024-05-08T23:14:26.347699+0000","last_clean":"2024-05-08T23:14:26.347699+0000","last_became_active":"2024-05-08T23:14:21.517635+0000","last_became_peered":"2024-05-08T23:14:21.517635+0000","last_unstale":"2024-05-08T23:14:26.347699+0000","last_undegraded":"2024-05-08T23:14:26.347699+0000","last_fullsized":"2024-05-08T23:14:26.347699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:55.088301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.169009+0000","last_change":"2024-05-08T23:14:21.958863+0000","last_active":"2024-05-08T23:14:24.169009+0000","last_peered":"2024-05-08T23:14:24.169009+0000","last_clean":"2024-05-08T23:14:24.169009+0000","last_became_active":"2024-05-08T23:14:21.958462+0000","last_became_peered":"2024-05-08T23:14:21.958462+0000","last_unstale":"2024-05-08T23:14:24.169009+0000","last_undegraded":"2024-05-08T23:14:24.169009+0000","last_fullsized":"2024-05-08T23:14:24.169009+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:41:42.202867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:27.353916+0000","last_change":"2024-05-08T23:14:21.522669+0000","last_active":"2024-05-08T23:14:27.353916+0000","last_peered":"2024-05-08T23:14:27.353916+0000","last_clean":"2024-05-08T23:14:27.353916+0000","last_became_active":"2024-05-08T23:14:21.522348+0000","last_became_peered":"2024-05-08T23:14:21.522348+0000","last_unstale":"2024-05-08T23:14:27.353916+0000","last_undegraded":"2024-05-08T23:14:27.353916+0000","last_fullsized":"2024-05-08T23:14:27.353916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:20.496040+0000","last_clean_scrub_stamp":"2024-05-08T23:14:20.496040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:37.824190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.041886+0000","last_change":"2024-05-08T23:14:21.960656+0000","last_active":"2024-05-08T23:14:22.041886+0000","last_peered":"2024-05-08T23:14:22.041886+0000","last_clean":"2024-05-08T23:14:22.041886+0000","last_became_active":"2024-05-08T23:14:21.960336+0000","last_became_peered":"2024-05-08T23:14:21.960336+0000","last_unstale":"2024-05-08T23:14:22.041886+0000","last_undegraded":"2024-05-08T23:14:22.041886+0000","last_fullsized":"2024-05-08T23:14:22.041886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:55.101942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934706+0000","last_change":"2024-05-08T23:14:21.965928+0000","last_active":"2024-05-08T23:14:22.934706+0000","last_peered":"2024-05-08T23:14:22.934706+0000","last_clean":"2024-05-08T23:14:22.934706+0000","last_became_active":"2024-05-08T23:14:21.965570+0000","last_became_peered":"2024-05-08T23:14:21.965570+0000","last_unstale":"2024-05-08T23:14:22.934706+0000","last_undegraded":"2024-05-08T23:14:22.934706+0000","last_fullsized":"2024-05-08T23:14:22.934706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:01.963727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685021+0000","last_change":"2024-05-08T23:14:21.948795+0000","last_active":"2024-05-08T23:14:23.685021+0000","last_peered":"2024-05-08T23:14:23.685021+0000","last_clean":"2024-05-08T23:14:23.685021+0000","last_became_active":"2024-05-08T23:14:21.948275+0000","last_became_peered":"2024-05-08T23:14:21.948275+0000","last_unstale":"2024-05-08T23:14:23.685021+0000","last_undegraded":"2024-05-08T23:14:23.685021+0000","last_fullsized":"2024-05-08T23:14:23.685021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:27.812089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685000+0000","last_change":"2024-05-08T23:14:21.942911+0000","last_active":"2024-05-08T23:14:23.685000+0000","last_peered":"2024-05-08T23:14:23.685000+0000","last_clean":"2024-05-08T23:14:23.685000+0000","last_became_active":"2024-05-08T23:14:21.942050+0000","last_became_peered":"2024-05-08T23:14:21.942050+0000","last_unstale":"2024-05-08T23:14:23.685000+0000","last_undegraded":"2024-05-08T23:14:23.685000+0000","last_fullsized":"2024-05-08T23:14:23.685000+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:05.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.125373+0000","last_change":"2024-05-08T23:14:21.952424+0000","last_active":"2024-05-08T23:14:24.125373+0000","last_peered":"2024-05-08T23:14:24.125373+0000","last_clean":"2024-05-08T23:14:24.125373+0000","last_became_active":"2024-05-08T23:14:21.952132+0000","last_became_peered":"2024-05-08T23:14:21.952132+0000","last_unstale":"2024-05-08T23:14:24.125373+0000","last_undegraded":"2024-05-08T23:14:24.125373+0000","last_fullsized":"2024-05-08T23:14:24.125373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:55.035476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067879+0000","last_change":"2024-05-08T23:14:21.933701+0000","last_active":"2024-05-08T23:14:24.067879+0000","last_peered":"2024-05-08T23:14:24.067879+0000","last_clean":"2024-05-08T23:14:24.067879+0000","last_became_active":"2024-05-08T23:14:21.933275+0000","last_became_peered":"2024-05-08T23:14:21.933275+0000","last_unstale":"2024-05-08T23:14:24.067879+0000","last_undegraded":"2024-05-08T23:14:24.067879+0000","last_fullsized":"2024-05-08T23:14:24.067879+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:47.660620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934618+0000","last_change":"2024-05-08T23:14:21.958705+0000","last_active":"2024-05-08T23:14:22.934618+0000","last_peered":"2024-05-08T23:14:22.934618+0000","last_clean":"2024-05-08T23:14:22.934618+0000","last_became_active":"2024-05-08T23:14:21.958410+0000","last_became_peered":"2024-05-08T23:14:21.958410+0000","last_unstale":"2024-05-08T23:14:22.934618+0000","last_undegraded":"2024-05-08T23:14:22.934618+0000","last_fullsized":"2024-05-08T23:14:22.934618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:42:31.167722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.685346+0000","last_change":"2024-05-08T23:14:21.963814+0000","last_active":"2024-05-08T23:14:23.685346+0000","last_peered":"2024-05-08T23:14:23.685346+0000","last_clean":"2024-05-08T23:14:23.685346+0000","last_became_active":"2024-05-08T23:14:21.963485+0000","last_became_peered":"2024-05-08T23:14:21.963485+0000","last_unstale":"2024-05-08T23:14:23.685346+0000","last_undegraded":"2024-05-08T23:14:23.685346+0000","last_fullsized":"2024-05-08T23:14:23.685346+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:22.782637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099336+0000","last_change":"2024-05-08T23:14:21.947887+0000","last_active":"2024-05-08T23:14:23.099336+0000","last_peered":"2024-05-08T23:14:23.099336+0000","last_clean":"2024-05-08T23:14:23.099336+0000","last_became_active":"2024-05-08T23:14:21.947577+0000","last_became_peered":"2024-05-08T23:14:21.947577+0000","last_unstale":"2024-05-08T23:14:23.099336+0000","last_undegraded":"2024-05-08T23:14:23.099336+0000","last_fullsized":"2024-05-08T23:14:23.099336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:33.022146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.101912+0000","last_change":"2024-05-08T23:14:21.963857+0000","last_active":"2024-05-08T23:14:22.101912+0000","last_peered":"2024-05-08T23:14:22.101912+0000","last_clean":"2024-05-08T23:14:22.101912+0000","last_became_active":"2024-05-08T23:14:21.963366+0000","last_became_peered":"2024-05-08T23:14:21.963366+0000","last_unstale":"2024-05-08T23:14:22.101912+0000","last_undegraded":"2024-05-08T23:14:22.101912+0000","last_fullsized":"2024-05-08T23:14:22.101912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:34.402188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:23.099246+0000","last_change":"2024-05-08T23:14:21.946956+0000","last_active":"2024-05-08T23:14:23.099246+0000","last_peered":"2024-05-08T23:14:23.099246+0000","last_clean":"2024-05-08T23:14:23.099246+0000","last_became_active":"2024-05-08T23:14:21.946669+0000","last_became_peered":"2024-05-08T23:14:21.946669+0000","last_unstale":"2024-05-08T23:14:23.099246+0000","last_undegraded":"2024-05-08T23:14:23.099246+0000","last_fullsized":"2024-05-08T23:14:23.099246+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:29.826418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.468837+0000","last_change":"2024-05-08T23:14:21.952852+0000","last_active":"2024-05-08T23:14:22.468837+0000","last_peered":"2024-05-08T23:14:22.468837+0000","last_clean":"2024-05-08T23:14:22.468837+0000","last_became_active":"2024-05-08T23:14:21.952515+0000","last_became_peered":"2024-05-08T23:14:21.952515+0000","last_unstale":"2024-05-08T23:14:22.468837+0000","last_undegraded":"2024-05-08T23:14:22.468837+0000","last_fullsized":"2024-05-08T23:14:22.468837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:15.611960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:24.067841+0000","last_change":"2024-05-08T23:14:21.944967+0000","last_active":"2024-05-08T23:14:24.067841+0000","last_peered":"2024-05-08T23:14:24.067841+0000","last_clean":"2024-05-08T23:14:24.067841+0000","last_became_active":"2024-05-08T23:14:21.944588+0000","last_became_peered":"2024-05-08T23:14:21.944588+0000","last_unstale":"2024-05-08T23:14:24.067841+0000","last_undegraded":"2024-05-08T23:14:24.067841+0000","last_fullsized":"2024-05-08T23:14:24.067841+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:40:12.545764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-08T23:14:22.934362+0000","last_change":"2024-05-08T23:14:21.948689+0000","last_active":"2024-05-08T23:14:22.934362+0000","last_peered":"2024-05-08T23:14:22.934362+0000","last_clean":"2024-05-08T23:14:22.934362+0000","last_became_active":"2024-05-08T23:14:21.948335+0000","last_became_peered":"2024-05-08T23:14:21.948335+0000","last_unstale":"2024-05-08T23:14:22.934362+0000","last_undegraded":"2024-05-08T23:14:22.934362+0000","last_fullsized":"2024-05-08T23:14:22.934362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:14:21.498025+0000","last_clean_scrub_stamp":"2024-05-08T23:14:21.498025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:41.767077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282110,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68409,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":391,"num_read_kb":272,"num_write":232,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":205227,"data_compressed":5523,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449107,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36088,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709064,"statfs":{"total":95995035648,"available":95958081536,"internally_reserved":0,"allocated":901120,"data_stored":430329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36043205},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.48299999999999998}]},{"osd":1,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68100000000000005}]},{"osd":2,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.63100000000000001}]},{"osd":5,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.66900000000000004}]},{"osd":7,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.72799999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":9,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.78100000000000003}]},{"osd":10,"last update":"Wed May 8 23:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.73899999999999999}]}]},{"osd":10,"up_from":70,"seq":300647710741,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":1048576,"data_stored":1082077,"data_compressed":37719,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":31848896},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.56499999999999995}]},{"osd":2,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.82599999999999996}]},{"osd":3,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.65700000000000003}]},{"osd":4,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.622}]},{"osd":5,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.77800000000000002}]},{"osd":6,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":8,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.87},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.85999999999999999}]},{"osd":9,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.71999999999999997}]},{"osd":11,"last update":"Wed May 8 23:14:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.90800000000000003}]}]},{"osd":9,"up_from":65,"seq":279172874266,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":925696,"data_stored":429914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31848896},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.377},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.44}]},{"osd":1,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.40200000000000002}]},{"osd":4,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.72199999999999998}]},{"osd":5,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.51000000000000001}]},{"osd":6,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.48899999999999999}]},{"osd":7,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.69999999999999996}]},{"osd":8,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.63800000000000001}]},{"osd":10,"last update":"Wed May 8 23:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.629}]}]},{"osd":8,"up_from":57,"seq":244813135901,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":430292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.48699999999999999}]},{"osd":1,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.434,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.48099999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.47799999999999998}]},{"osd":2,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.48199999999999998,"15min":0.47299999999999998},"min":{"1min":0.33900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.42699999999999999}]},{"osd":3,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56100000000000005}]},{"osd":4,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.503},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.65300000000000002,"15min":0.63900000000000001},"min":{"1min":0.54400000000000004,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.59599999999999997}]},{"osd":5,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.57899999999999996,"15min":0.57099999999999995},"min":{"1min":0.35299999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68799999999999994}]},{"osd":6,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Wed May 8 23:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.68000000000000005,"15min":0.66400000000000003},"min":{"1min":0.54300000000000004,"5min":0.379,"15min":0.379},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.55100000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.74299999999999999}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.79400000000000004}]},{"osd":10,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.82099999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]}]},{"osd":7,"up_from":50,"seq":214748364832,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":1023061,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Wed May 8 23:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41599999999999998,"15min":0.41699999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57999999999999996,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.47799999999999998,"15min":0.47999999999999998},"min":{"1min":0.314,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78400000000000003,"5min":0.996,"15min":0.996},"last":0.44700000000000001}]},{"osd":2,"last update":"Wed May 8 23:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.72899999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75700000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.627}]},{"osd":3,"last update":"Wed May 8 23:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.40000000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78200000000000003,"5min":1.206,"15min":1.206},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.66900000000000004,"15min":0.63900000000000001},"min":{"1min":0.45500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":5.0890000000000004,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.66600000000000004}]},{"osd":4,"last update":"Wed May 8 23:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.86099999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.51100000000000001,"15min":0.51900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63500000000000001,"5min":0.88,"15min":0.88},"last":0.48899999999999999}]},{"osd":5,"last update":"Wed May 8 23:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.76400000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.46800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.70199999999999996}]},{"osd":6,"last update":"Wed May 8 23:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.74099999999999999,"15min":0.71499999999999997},"min":{"1min":0.48999999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":5.1139999999999999,"5min":5.1139999999999999,"15min":5.1139999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.61299999999999999,"15min":0.623},"min":{"1min":0.42999999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79800000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65100000000000002}]},{"osd":8,"last update":"Wed May 8 23:15:01 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90700000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.81399999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.68899999999999995}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.77900000000000003}]},{"osd":10,"last update":"Wed May 8 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.79600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":6,"up_from":45,"seq":193273528356,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":909312,"data_stored":429583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38100000000000001},"min":{"1min":0.27900000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61299999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42099999999999999,"15min":0.42299999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65900000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.313}]},{"osd":1,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.502,"15min":0.495},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72499999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.56799999999999995}]},{"osd":3,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68600000000000005,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.498,"15min":0.501},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78700000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.374,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77100000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52900000000000003}]},{"osd":5,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.748,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.629,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed May 8 23:14:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.028,"5min":1.141,"15min":1.141},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.83999999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.60999999999999999}]},{"osd":8,"last update":"Wed May 8 23:14:59 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67000000000000004,"15min":0.67800000000000005},"min":{"1min":0.495,"5min":0.438,"15min":0.438},"max":{"1min":0.77000000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.628,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.46999999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91100000000000003,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.61699999999999999}]},{"osd":9,"last update":"Wed May 8 23:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.48099999999999998}]},{"osd":10,"last update":"Wed May 8 23:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.65300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":491496,"data_compressed":1841,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:58 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.56299999999999994,"15min":0.52100000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":4.3209999999999997,"5min":4.3209999999999997,"15min":4.3209999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.496}]},{"osd":2,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.41699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.73699999999999999}]},{"osd":3,"last update":"Wed May 8 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52500000000000002,"15min":0.51600000000000001},"min":{"1min":0.34000000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71999999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55200000000000005,"15min":0.54500000000000004},"min":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.64000000000000001}]},{"osd":4,"last update":"Wed May 8 23:14:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.42899999999999999,"15min":0.39900000000000002},"min":{"1min":0.371,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.69099999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.433,"15min":0.41699999999999998},"min":{"1min":0.318,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46899999999999997}]},{"osd":5,"last update":"Wed May 8 23:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.46400000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.59799999999999998,"15min":0.58199999999999996},"min":{"1min":0.51600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.436},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.59599999999999997,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52600000000000002}]},{"osd":7,"last update":"Wed May 8 23:14:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58299999999999996,"15min":0.57199999999999995},"min":{"1min":0.47799999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.88500000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.61199999999999999,"15min":0.59799999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.62}]},{"osd":8,"last update":"Wed May 8 23:14:58 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69199999999999995,"15min":0.68500000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.49099999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.78300000000000003}]},{"osd":9,"last update":"Wed May 8 23:14:14 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.68600000000000005}]},{"osd":10,"last update":"Wed May 8 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.79800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":431315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 23:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.499,"15min":0.5},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72999999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.501,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45400000000000001}]},{"osd":2,"last update":"Wed May 8 23:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68700000000000006,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.499},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.66000000000000003}]},{"osd":3,"last update":"Wed May 8 23:13:30 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.41099999999999998},"min":{"1min":0.28000000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58799999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.40899999999999997},"min":{"1min":0.27600000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.46899999999999997}]},{"osd":4,"last update":"Wed May 8 23:14:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.40699999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73499999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.443,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.70499999999999996,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.54800000000000004}]},{"osd":5,"last update":"Wed May 8 23:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.40300000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56599999999999995}]},{"osd":6,"last update":"Wed May 8 23:14:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69399999999999995,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.80900000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.495}]},{"osd":7,"last update":"Wed May 8 23:13:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.64300000000000002}]},{"osd":8,"last update":"Wed May 8 23:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.624}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.60999999999999999}]},{"osd":10,"last update":"Wed May 8 23:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.57599999999999996}]},{"osd":11,"last update":"Wed May 8 23:14:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.64300000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411377,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":492454,"data_compressed":1841,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.44500000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.496,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52100000000000002,"15min":0.504},"min":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.67800000000000005,"5min":0.751,"15min":0.751},"last":0.72899999999999998}]},{"osd":3,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.503,"15min":0.502},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.495},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.48699999999999999,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.60699999999999998}]},{"osd":4,"last update":"Wed May 8 23:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.746,"5min":0.747,"15min":0.747},"last":0.624}]},{"osd":5,"last update":"Wed May 8 23:14:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.435,"15min":0.438},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58699999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.61699999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52900000000000003}]},{"osd":6,"last update":"Wed May 8 23:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.57299999999999995}]},{"osd":7,"last update":"Wed May 8 23:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51100000000000001}]},{"osd":8,"last update":"Wed May 8 23:14:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.52800000000000002,"15min":0.51500000000000001},"min":{"1min":0.38,"5min":0.318,"15min":0.318},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.499,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.753}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.76300000000000001}]},{"osd":10,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.80600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149743,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":921600,"data_stored":429125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.32300000000000001},"min":{"1min":0.26100000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51300000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.371,"5min":0.35099999999999998,"15min":0.34000000000000002},"min":{"1min":0.23899999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.53300000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.308}]},{"osd":1,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.50600000000000001,"15min":0.48399999999999999},"min":{"1min":0.40200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.499,"15min":0.48399999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.58499999999999996}]},{"osd":2,"last update":"Wed May 8 23:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.34799999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71199999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67700000000000005,"5min":0.751,"15min":0.751},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed May 8 23:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.376,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.752,"15min":0.752},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.65800000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.54100000000000004}]},{"osd":5,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.56399999999999995,"15min":0.55100000000000005},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.42499999999999999}]},{"osd":6,"last update":"Wed May 8 23:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.48599999999999999,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.377}]},{"osd":7,"last update":"Wed May 8 23:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59799999999999998,"15min":0.60699999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78400000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59699999999999998}]},{"osd":8,"last update":"Wed May 8 23:13:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.53400000000000003}]},{"osd":9,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.436}]},{"osd":10,"last update":"Wed May 8 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57699999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":4,"up_from":33,"seq":141733920811,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":909312,"data_stored":429837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:13:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48499999999999999,"15min":0.47999999999999998},"min":{"1min":0.33100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.36099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67300000000000004,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.60699999999999998}]},{"osd":1,"last update":"Wed May 8 23:14:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.36699999999999999,"15min":0.34399999999999997},"min":{"1min":0.30399999999999999,"5min":0.222,"15min":0.222},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.39800000000000002,"15min":0.372},"min":{"1min":0.30099999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Wed May 8 23:14:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.56599999999999995,"15min":0.54800000000000004},"min":{"1min":0.44600000000000001,"5min":0.312,"15min":0.312},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.628}]},{"osd":3,"last update":"Wed May 8 23:14:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.54400000000000004,"15min":0.51500000000000001},"min":{"1min":0.47599999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.35099999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":0.64400000000000002}]},{"osd":5,"last update":"Wed May 8 23:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69099999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.751}]},{"osd":6,"last update":"Wed May 8 23:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.67300000000000004}]},{"osd":7,"last update":"Wed May 8 23:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.51800000000000002,"15min":0.501},"min":{"1min":0.40799999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.56399999999999995,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":3.1699999999999999,"5min":3.1699999999999999,"15min":3.1699999999999999},"last":0.60999999999999999}]},{"osd":8,"last update":"Wed May 8 23:15:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65900000000000003,"15min":0.65100000000000002},"min":{"1min":0.54000000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93600000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.67800000000000005,"15min":0.65400000000000003},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.6669999999999998,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":0.76600000000000001}]},{"osd":9,"last update":"Wed May 8 23:14:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.407,"5min":2.407,"15min":2.407},"last":0.59499999999999997}]},{"osd":10,"last update":"Wed May 8 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.70099999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":5,"up_from":38,"seq":163208757286,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":1022442,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.47299999999999998}]},{"osd":1,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.40000000000000002,"15min":0.39200000000000002},"min":{"1min":0.27700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.29499999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.36899999999999999}]},{"osd":3,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.318,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55700000000000005}]},{"osd":4,"last update":"Wed May 8 23:14:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.498,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77200000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74199999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58199999999999996}]},{"osd":6,"last update":"Wed May 8 23:14:25 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.505},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.48599999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.77200000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed May 8 23:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66500000000000004,"15min":0.67100000000000004},"min":{"1min":0.45100000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80400000000000005,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71099999999999997,"15min":0.71799999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.77900000000000003,"5min":1.143,"15min":1.143},"last":0.64400000000000002}]},{"osd":8,"last update":"Wed May 8 23:15:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47599999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84399999999999997,"5min":0.877,"15min":0.877},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.499,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83599999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.625}]},{"osd":9,"last update":"Wed May 8 23:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.71899999999999997}]},{"osd":10,"last update":"Wed May 8 23:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34240,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34240,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34240,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35878,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62704,"data_compressed":1841,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63662,"data_compressed":1841,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":63081,"data_compressed":1841,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T23:15:05.876 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-08T23:15:05.876 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T23:15:05.876 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-08T23:15:05.876 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-08T23:15:06.102 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:15:06.530 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:06 smithi135 ceph-mon[42440]: pgmap v245: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-05-08T23:15:06.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:06 smithi179 ceph-mon[46314]: pgmap v245: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-05-08T23:15:06.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:06 smithi195 ceph-mon[46516]: pgmap v245: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-05-08T23:15:07.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.082+0000 7f3b22251700 1 -- 172.21.15.135:0/1501383336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b1c0ffed0 msgr2=0x7f3b1c100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:07.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.082+0000 7f3b22251700 1 --2- 172.21.15.135:0/1501383336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b1c0ffed0 0x7f3b1c100350 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009990 tx=0x7f3b0c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.082+0000 7f3b22251700 1 -- 172.21.15.135:0/1501383336 shutdown_connections 2024-05-08T23:15:07.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.082+0000 7f3b22251700 1 --2- 172.21.15.135:0/1501383336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b1c100890 0x7f3b1c10cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.082+0000 7f3b22251700 1 --2- 172.21.15.135:0/1501383336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b1c105f00 0x7f3b1c1062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.082+0000 7f3b22251700 1 --2- 172.21.15.135:0/1501383336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b1c0ffed0 0x7f3b1c100350 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.082+0000 7f3b22251700 1 -- 172.21.15.135:0/1501383336 >> 172.21.15.135:0/1501383336 conn(0x7f3b1c075f80 msgr2=0x7f3b1c076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:07.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.082+0000 7f3b22251700 1 -- 172.21.15.135:0/1501383336 shutdown_connections 2024-05-08T23:15:07.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.082+0000 7f3b22251700 1 -- 172.21.15.135:0/1501383336 wait complete. 2024-05-08T23:15:07.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.083+0000 7f3b22251700 1 Processor -- start 2024-05-08T23:15:07.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.083+0000 7f3b22251700 1 -- start start 2024-05-08T23:15:07.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.083+0000 7f3b22251700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b1c0ffed0 0x7f3b1c1962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:07.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.083+0000 7f3b22251700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b1c100890 0x7f3b1c196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:07.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b22251700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b1c105f00 0x7f3b1c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:07.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b22251700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c19b1c0 con 0x7f3b1c105f00 2024-05-08T23:15:07.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b22251700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c19b330 con 0x7f3b1c100890 2024-05-08T23:15:07.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b22251700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c19b4f0 con 0x7f3b1c0ffed0 2024-05-08T23:15:07.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b1bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b1c105f00 0x7f3b1c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:07.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b1bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b1c105f00 0x7f3b1c19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39694/0 (socket says 172.21.15.135:39694) 2024-05-08T23:15:07.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b1b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b1c0ffed0 0x7f3b1c1962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:07.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b1bfff700 1 -- 172.21.15.135:0/101568633 learned_addr learned my addr 172.21.15.135:0/101568633 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:07.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b1affd700 1 --2- 172.21.15.135:0/101568633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b1c100890 0x7f3b1c196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:07.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b1bfff700 1 -- 172.21.15.135:0/101568633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b1c0ffed0 msgr2=0x7f3b1c1962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:07.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b1bfff700 1 --2- 172.21.15.135:0/101568633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b1c0ffed0 0x7f3b1c1962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b1bfff700 1 -- 172.21.15.135:0/101568633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b1c100890 msgr2=0x7f3b1c196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:07.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b1bfff700 1 --2- 172.21.15.135:0/101568633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b1c100890 0x7f3b1c196800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b1bfff700 1 -- 172.21.15.135:0/101568633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c0095f0 con 0x7f3b1c105f00 2024-05-08T23:15:07.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b1bfff700 1 --2- 172.21.15.135:0/101568633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b1c105f00 0x7f3b1c19abb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3b14007ee0 tx=0x7f3b1400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:07.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b18ff9700 1 -- 172.21.15.135:0/101568633 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14017070 con 0x7f3b1c105f00 2024-05-08T23:15:07.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b18ff9700 1 -- 172.21.15.135:0/101568633 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b1400f040 con 0x7f3b1c105f00 2024-05-08T23:15:07.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b18ff9700 1 -- 172.21.15.135:0/101568633 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14005740 con 0x7f3b1c105f00 2024-05-08T23:15:07.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b22251700 1 -- 172.21.15.135:0/101568633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1c19b7d0 con 0x7f3b1c105f00 2024-05-08T23:15:07.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.084+0000 7f3b22251700 1 -- 172.21.15.135:0/101568633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1c1a3030 con 0x7f3b1c105f00 2024-05-08T23:15:07.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.085+0000 7f3b22251700 1 -- 172.21.15.135:0/101568633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1c108420 con 0x7f3b1c105f00 2024-05-08T23:15:07.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.086+0000 7f3b18ff9700 1 -- 172.21.15.135:0/101568633 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f3b1400dc60 con 0x7f3b1c105f00 2024-05-08T23:15:07.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.087+0000 7f3b18ff9700 1 --2- 172.21.15.135:0/101568633 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3b040a11b0 0x7f3b040a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:07.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.087+0000 7f3b1b7fe700 1 --2- 172.21.15.135:0/101568633 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3b040a11b0 0x7f3b040a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:07.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.087+0000 7f3b18ff9700 1 -- 172.21.15.135:0/101568633 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3b140cc0d0 con 0x7f3b1c105f00 2024-05-08T23:15:07.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.087+0000 7f3b1b7fe700 1 --2- 172.21.15.135:0/101568633 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3b040a11b0 0x7f3b040a3670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3b10005950 tx=0x7f3b1000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:07.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.091+0000 7f3b18ff9700 1 -- 172.21.15.135:0/101568633 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3b140958b0 con 0x7f3b1c105f00 2024-05-08T23:15:07.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.328+0000 7f3b22251700 1 -- 172.21.15.135:0/101568633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3b1c1015b0 con 0x7f3b1c105f00 2024-05-08T23:15:07.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.329+0000 7f3b18ff9700 1 -- 172.21.15.135:0/101568633 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3b14098ed0 con 0x7f3b1c105f00 2024-05-08T23:15:07.328 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:07.328 INFO:teuthology.orchestra.run.smithi135.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T23:15:07.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.331+0000 7f3b22251700 1 -- 172.21.15.135:0/101568633 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3b040a11b0 msgr2=0x7f3b040a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:07.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.331+0000 7f3b22251700 1 --2- 172.21.15.135:0/101568633 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3b040a11b0 0x7f3b040a3670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3b10005950 tx=0x7f3b1000b410 comp rx=0 tx=0).stop 2024-05-08T23:15:07.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.331+0000 7f3b22251700 1 -- 172.21.15.135:0/101568633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b1c105f00 msgr2=0x7f3b1c19abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:07.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.331+0000 7f3b22251700 1 --2- 172.21.15.135:0/101568633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b1c105f00 0x7f3b1c19abb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3b14007ee0 tx=0x7f3b1400d3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.331+0000 7f3b22251700 1 -- 172.21.15.135:0/101568633 shutdown_connections 2024-05-08T23:15:07.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.331+0000 7f3b22251700 1 --2- 172.21.15.135:0/101568633 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3b040a11b0 0x7f3b040a3670 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.331+0000 7f3b22251700 1 --2- 172.21.15.135:0/101568633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b1c0ffed0 0x7f3b1c1962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.331+0000 7f3b22251700 1 --2- 172.21.15.135:0/101568633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b1c105f00 0x7f3b1c19abb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.331+0000 7f3b22251700 1 --2- 172.21.15.135:0/101568633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b1c100890 0x7f3b1c196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.331+0000 7f3b22251700 1 -- 172.21.15.135:0/101568633 >> 172.21.15.135:0/101568633 conn(0x7f3b1c075f80 msgr2=0x7f3b1c0fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:07.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.331+0000 7f3b22251700 1 -- 172.21.15.135:0/101568633 shutdown_connections 2024-05-08T23:15:07.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.331+0000 7f3b22251700 1 -- 172.21.15.135:0/101568633 wait complete. 2024-05-08T23:15:07.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:07 smithi179 ceph-mon[46314]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:15:07.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:07 smithi195 ceph-mon[46516]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:15:07.642 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:07 smithi135 ceph-mon[42440]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:15:07.711 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-08T23:15:07.711 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T23:15:07.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.840+0000 7f64b93a8700 1 -- 172.21.15.135:0/1646006956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b4102130 msgr2=0x7f64b4102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:07.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.840+0000 7f64b93a8700 1 --2- 172.21.15.135:0/1646006956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b4102130 0x7f64b4102590 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009990 tx=0x7f64a4009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.840+0000 7f64b93a8700 1 -- 172.21.15.135:0/1646006956 shutdown_connections 2024-05-08T23:15:07.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.840+0000 7f64b93a8700 1 --2- 172.21.15.135:0/1646006956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64b4102ad0 0x7f64b4109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.840+0000 7f64b93a8700 1 --2- 172.21.15.135:0/1646006956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64b40ff160 0x7f64b40ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.840+0000 7f64b93a8700 1 --2- 172.21.15.135:0/1646006956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b4102130 0x7f64b4102590 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.840+0000 7f64b93a8700 1 -- 172.21.15.135:0/1646006956 >> 172.21.15.135:0/1646006956 conn(0x7f64b40faab0 msgr2=0x7f64b40fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:07.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.840+0000 7f64b93a8700 1 -- 172.21.15.135:0/1646006956 shutdown_connections 2024-05-08T23:15:07.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.840+0000 7f64b93a8700 1 -- 172.21.15.135:0/1646006956 wait complete. 2024-05-08T23:15:07.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.841+0000 7f64b93a8700 1 Processor -- start 2024-05-08T23:15:07.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.841+0000 7f64b93a8700 1 -- start start 2024-05-08T23:15:07.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.841+0000 7f64b93a8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64b40ff160 0x7f64b4196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:07.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.841+0000 7f64b93a8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64b4102130 0x7f64b4197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:07.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.841+0000 7f64b93a8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b4102ad0 0x7f64b419e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:07.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.841+0000 7f64b93a8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b419e8f0 con 0x7f64b4102ad0 2024-05-08T23:15:07.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.841+0000 7f64b93a8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b419ea30 con 0x7f64b4102130 2024-05-08T23:15:07.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.841+0000 7f64b93a8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b419ebc0 con 0x7f64b40ff160 2024-05-08T23:15:07.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.841+0000 7f64b37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b4102ad0 0x7f64b419e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:07.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.841+0000 7f64b37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b4102ad0 0x7f64b419e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39702/0 (socket says 172.21.15.135:39702) 2024-05-08T23:15:07.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.841+0000 7f64b37fe700 1 -- 172.21.15.135:0/1648392696 learned_addr learned my addr 172.21.15.135:0/1648392696 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:07.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.841+0000 7f64b27fc700 1 --2- 172.21.15.135:0/1648392696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64b4102130 0x7f64b4197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:07.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.841+0000 7f64b2ffd700 1 --2- 172.21.15.135:0/1648392696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64b40ff160 0x7f64b4196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:07.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.842+0000 7f64b37fe700 1 -- 172.21.15.135:0/1648392696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64b40ff160 msgr2=0x7f64b4196dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:07.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.842+0000 7f64b37fe700 1 --2- 172.21.15.135:0/1648392696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64b40ff160 0x7f64b4196dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.842+0000 7f64b37fe700 1 -- 172.21.15.135:0/1648392696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64b4102130 msgr2=0x7f64b4197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:07.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.842+0000 7f64b37fe700 1 --2- 172.21.15.135:0/1648392696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64b4102130 0x7f64b4197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:07.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.842+0000 7f64b37fe700 1 -- 172.21.15.135:0/1648392696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a40095f0 con 0x7f64b4102ad0 2024-05-08T23:15:07.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.842+0000 7f64b2ffd700 1 --2- 172.21.15.135:0/1648392696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64b40ff160 0x7f64b4196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:07.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.842+0000 7f64b37fe700 1 --2- 172.21.15.135:0/1648392696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b4102ad0 0x7f64b419e320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f64ac007ee0 tx=0x7f64ac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:07.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.842+0000 7f649bfff700 1 -- 172.21.15.135:0/1648392696 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac017070 con 0x7f64b4102ad0 2024-05-08T23:15:07.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.842+0000 7f649bfff700 1 -- 172.21.15.135:0/1648392696 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64ac00f040 con 0x7f64b4102ad0 2024-05-08T23:15:07.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.842+0000 7f64b93a8700 1 -- 172.21.15.135:0/1648392696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b419eea0 con 0x7f64b4102ad0 2024-05-08T23:15:07.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.842+0000 7f649bfff700 1 -- 172.21.15.135:0/1648392696 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac005740 con 0x7f64b4102ad0 2024-05-08T23:15:07.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.842+0000 7f64b93a8700 1 -- 172.21.15.135:0/1648392696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b419f2d0 con 0x7f64b4102ad0 2024-05-08T23:15:07.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.843+0000 7f64b93a8700 1 -- 172.21.15.135:0/1648392696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b41083c0 con 0x7f64b4102ad0 2024-05-08T23:15:07.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.845+0000 7f649bfff700 1 -- 172.21.15.135:0/1648392696 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f64ac00dc60 con 0x7f64b4102ad0 2024-05-08T23:15:07.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.845+0000 7f649bfff700 1 --2- 172.21.15.135:0/1648392696 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f649c0a11b0 0x7f649c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:07.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.845+0000 7f64b2ffd700 1 --2- 172.21.15.135:0/1648392696 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f649c0a11b0 0x7f649c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:07.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.845+0000 7f649bfff700 1 -- 172.21.15.135:0/1648392696 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f64ac0cc6c0 con 0x7f64b4102ad0 2024-05-08T23:15:07.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.846+0000 7f64b2ffd700 1 --2- 172.21.15.135:0/1648392696 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f649c0a11b0 0x7f649c0a3670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f64a8005950 tx=0x7f64a80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:07.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:07.849+0000 7f649bfff700 1 -- 172.21.15.135:0/1648392696 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f64ac095ea0 con 0x7f64b4102ad0 2024-05-08T23:15:08.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.048+0000 7f64b93a8700 1 -- 172.21.15.135:0/1648392696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64b4068060 con 0x7f64b4102ad0 2024-05-08T23:15:08.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.049+0000 7f649bfff700 1 -- 172.21.15.135:0/1648392696 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22176 (secure 0 0 0) 0x7f64ac0994c0 con 0x7f64b4102ad0 2024-05-08T23:15:08.049 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:08.049 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":83,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:14:22.924945+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T23:14:19.726838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T23:14:21.097732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:15:08.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.052+0000 7f64b93a8700 1 -- 172.21.15.135:0/1648392696 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f649c0a11b0 msgr2=0x7f649c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:08.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.052+0000 7f64b93a8700 1 --2- 172.21.15.135:0/1648392696 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f649c0a11b0 0x7f649c0a3670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f64a8005950 tx=0x7f64a80058e0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.052+0000 7f64b93a8700 1 -- 172.21.15.135:0/1648392696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b4102ad0 msgr2=0x7f64b419e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:08.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.052+0000 7f64b93a8700 1 --2- 172.21.15.135:0/1648392696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b4102ad0 0x7f64b419e320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f64ac007ee0 tx=0x7f64ac00d3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.052+0000 7f64b93a8700 1 -- 172.21.15.135:0/1648392696 shutdown_connections 2024-05-08T23:15:08.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.052+0000 7f64b93a8700 1 --2- 172.21.15.135:0/1648392696 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f649c0a11b0 0x7f649c0a3670 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.052+0000 7f64b93a8700 1 --2- 172.21.15.135:0/1648392696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64b40ff160 0x7f64b4196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.052+0000 7f64b93a8700 1 --2- 172.21.15.135:0/1648392696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b4102ad0 0x7f64b419e320 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.052+0000 7f64b93a8700 1 --2- 172.21.15.135:0/1648392696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64b4102130 0x7f64b4197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.052+0000 7f64b93a8700 1 -- 172.21.15.135:0/1648392696 >> 172.21.15.135:0/1648392696 conn(0x7f64b40faab0 msgr2=0x7f64b4105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:08.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.052+0000 7f64b93a8700 1 -- 172.21.15.135:0/1648392696 shutdown_connections 2024-05-08T23:15:08.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.052+0000 7f64b93a8700 1 -- 172.21.15.135:0/1648392696 wait complete. 2024-05-08T23:15:08.064 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:11:11.282550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T23:14:19.726838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T23:14:21.097732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T23:15:08.065 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T23:15:08.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.191+0000 7fe162dd6700 1 -- 172.21.15.135:0/2978671899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe15c100f80 msgr2=0x7fe15c1013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:08.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.191+0000 7fe162dd6700 1 --2- 172.21.15.135:0/2978671899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe15c100f80 0x7fe15c1013a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe1500099c0 tx=0x7fe150009cd0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.191+0000 7fe162dd6700 1 -- 172.21.15.135:0/2978671899 shutdown_connections 2024-05-08T23:15:08.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.191+0000 7fe162dd6700 1 --2- 172.21.15.135:0/2978671899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe15c102b10 0x7fe15c1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.191+0000 7fe162dd6700 1 --2- 172.21.15.135:0/2978671899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe15c100f80 0x7fe15c1013a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.191+0000 7fe162dd6700 1 --2- 172.21.15.135:0/2978671899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe15c102170 0x7fe15c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.191+0000 7fe162dd6700 1 -- 172.21.15.135:0/2978671899 >> 172.21.15.135:0/2978671899 conn(0x7fe15c0fc4f0 msgr2=0x7fe15c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:08.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.191+0000 7fe162dd6700 1 -- 172.21.15.135:0/2978671899 shutdown_connections 2024-05-08T23:15:08.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.191+0000 7fe162dd6700 1 -- 172.21.15.135:0/2978671899 wait complete. 2024-05-08T23:15:08.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.191+0000 7fe162dd6700 1 Processor -- start 2024-05-08T23:15:08.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe162dd6700 1 -- start start 2024-05-08T23:15:08.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe162dd6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe15c100f80 0x7fe15c074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:08.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe162dd6700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe15c102170 0x7fe15c073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:08.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe162dd6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe15c102b10 0x7fe15c0738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:08.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe162dd6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c074070 con 0x7fe15c102b10 2024-05-08T23:15:08.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe162dd6700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0741e0 con 0x7fe15c102170 2024-05-08T23:15:08.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe162dd6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c1a0f90 con 0x7fe15c100f80 2024-05-08T23:15:08.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe161373700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe15c102b10 0x7fe15c0738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:08.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe161373700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe15c102b10 0x7fe15c0738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39710/0 (socket says 172.21.15.135:39710) 2024-05-08T23:15:08.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe161373700 1 -- 172.21.15.135:0/4058577899 learned_addr learned my addr 172.21.15.135:0/4058577899 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:08.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe15bfff700 1 --2- 172.21.15.135:0/4058577899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe15c102170 0x7fe15c073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:08.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe160b72700 1 --2- 172.21.15.135:0/4058577899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe15c100f80 0x7fe15c074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:08.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe161373700 1 -- 172.21.15.135:0/4058577899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe15c100f80 msgr2=0x7fe15c074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:08.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe161373700 1 --2- 172.21.15.135:0/4058577899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe15c100f80 0x7fe15c074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe161373700 1 -- 172.21.15.135:0/4058577899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe15c102170 msgr2=0x7fe15c073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:08.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe161373700 1 --2- 172.21.15.135:0/4058577899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe15c102170 0x7fe15c073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe161373700 1 -- 172.21.15.135:0/4058577899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1500095f0 con 0x7fe15c102b10 2024-05-08T23:15:08.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe160b72700 1 --2- 172.21.15.135:0/4058577899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe15c100f80 0x7fe15c074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:08.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe161373700 1 --2- 172.21.15.135:0/4058577899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe15c102b10 0x7fe15c0738d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe15400ef30 tx=0x7fe15400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:08.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe159ffb700 1 -- 172.21.15.135:0/4058577899 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe154018070 con 0x7fe15c102b10 2024-05-08T23:15:08.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe162dd6700 1 -- 172.21.15.135:0/4058577899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15c1a11c0 con 0x7fe15c102b10 2024-05-08T23:15:08.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe159ffb700 1 -- 172.21.15.135:0/4058577899 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe15400f040 con 0x7fe15c102b10 2024-05-08T23:15:08.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.192+0000 7fe159ffb700 1 -- 172.21.15.135:0/4058577899 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15400ce00 con 0x7fe15c102b10 2024-05-08T23:15:08.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.193+0000 7fe162dd6700 1 -- 172.21.15.135:0/4058577899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15c1a16d0 con 0x7fe15c102b10 2024-05-08T23:15:08.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.193+0000 7fe162dd6700 1 -- 172.21.15.135:0/4058577899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15c108470 con 0x7fe15c102b10 2024-05-08T23:15:08.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.194+0000 7fe159ffb700 1 -- 172.21.15.135:0/4058577899 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fe154003a00 con 0x7fe15c102b10 2024-05-08T23:15:08.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.195+0000 7fe159ffb700 1 --2- 172.21.15.135:0/4058577899 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe14c0a1230 0x7fe14c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:08.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.195+0000 7fe160b72700 1 --2- 172.21.15.135:0/4058577899 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe14c0a1230 0x7fe14c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:08.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.195+0000 7fe159ffb700 1 -- 172.21.15.135:0/4058577899 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe1540cc450 con 0x7fe15c102b10 2024-05-08T23:15:08.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.195+0000 7fe160b72700 1 --2- 172.21.15.135:0/4058577899 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe14c0a1230 0x7fe14c0a36f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe1500098e0 tx=0x7fe150019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:08.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.199+0000 7fe159ffb700 1 -- 172.21.15.135:0/4058577899 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe154095cc0 con 0x7fe15c102b10 2024-05-08T23:15:08.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.396+0000 7fe162dd6700 1 -- 172.21.15.135:0/4058577899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe15c10c8f0 con 0x7fe15c102b10 2024-05-08T23:15:08.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.397+0000 7fe159ffb700 1 -- 172.21.15.135:0/4058577899 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1540992e0 con 0x7fe15c102b10 2024-05-08T23:15:08.396 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T23:15:08.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.399+0000 7fe162dd6700 1 -- 172.21.15.135:0/4058577899 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe14c0a1230 msgr2=0x7fe14c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:08.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.399+0000 7fe162dd6700 1 --2- 172.21.15.135:0/4058577899 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe14c0a1230 0x7fe14c0a36f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe1500098e0 tx=0x7fe150019040 comp rx=0 tx=0).stop 2024-05-08T23:15:08.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.399+0000 7fe162dd6700 1 -- 172.21.15.135:0/4058577899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe15c102b10 msgr2=0x7fe15c0738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:08.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.399+0000 7fe162dd6700 1 --2- 172.21.15.135:0/4058577899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe15c102b10 0x7fe15c0738d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe15400ef30 tx=0x7fe15400c450 comp rx=0 tx=0).stop 2024-05-08T23:15:08.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.399+0000 7fe162dd6700 1 -- 172.21.15.135:0/4058577899 shutdown_connections 2024-05-08T23:15:08.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.399+0000 7fe162dd6700 1 --2- 172.21.15.135:0/4058577899 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe14c0a1230 0x7fe14c0a36f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.399+0000 7fe162dd6700 1 --2- 172.21.15.135:0/4058577899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe15c100f80 0x7fe15c074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.399+0000 7fe162dd6700 1 --2- 172.21.15.135:0/4058577899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe15c102b10 0x7fe15c0738d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.399+0000 7fe162dd6700 1 --2- 172.21.15.135:0/4058577899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe15c102170 0x7fe15c073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.399+0000 7fe162dd6700 1 -- 172.21.15.135:0/4058577899 >> 172.21.15.135:0/4058577899 conn(0x7fe15c0fc4f0 msgr2=0x7fe15c1055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:08.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.399+0000 7fe162dd6700 1 -- 172.21.15.135:0/4058577899 shutdown_connections 2024-05-08T23:15:08.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.399+0000 7fe162dd6700 1 -- 172.21.15.135:0/4058577899 wait complete. 2024-05-08T23:15:08.410 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:08 smithi135 ceph-mon[42440]: pgmap v246: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-08T23:15:08.410 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:08 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/101568633' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-08T23:15:08.410 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:08 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1648392696' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:08.411 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T23:15:08.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.537+0000 7f1335bab700 1 -- 172.21.15.135:0/4134677328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1330100f20 msgr2=0x7f1330101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:08.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.537+0000 7f1335bab700 1 --2- 172.21.15.135:0/4134677328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1330100f20 0x7f1330101360 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1318009990 tx=0x7f1318009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.537+0000 7f1335bab700 1 -- 172.21.15.135:0/4134677328 shutdown_connections 2024-05-08T23:15:08.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.537+0000 7f1335bab700 1 --2- 172.21.15.135:0/4134677328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1330102ab0 0x7f13301093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.537+0000 7f1335bab700 1 --2- 172.21.15.135:0/4134677328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1330100f20 0x7f1330101360 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.537+0000 7f1335bab700 1 --2- 172.21.15.135:0/4134677328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13301020f0 0x7f1330102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.537+0000 7f1335bab700 1 -- 172.21.15.135:0/4134677328 >> 172.21.15.135:0/4134677328 conn(0x7f13300fc4e0 msgr2=0x7f13300fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:08.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.537+0000 7f1335bab700 1 -- 172.21.15.135:0/4134677328 shutdown_connections 2024-05-08T23:15:08.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.537+0000 7f1335bab700 1 -- 172.21.15.135:0/4134677328 wait complete. 2024-05-08T23:15:08.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f1335bab700 1 Processor -- start 2024-05-08T23:15:08.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f1335bab700 1 -- start start 2024-05-08T23:15:08.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f1335bab700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1330100f20 0x7f1330074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:08.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f1335bab700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13301020f0 0x7f1330073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:08.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f1335bab700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1330102ab0 0x7f13300738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:08.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f1335bab700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330074070 con 0x7f13301020f0 2024-05-08T23:15:08.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f1335bab700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13300741e0 con 0x7f1330100f20 2024-05-08T23:15:08.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f1335bab700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13301a0fc0 con 0x7f1330102ab0 2024-05-08T23:15:08.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f132effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13301020f0 0x7f1330073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:08.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f132effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13301020f0 0x7f1330073390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36554/0 (socket says 172.21.15.135:36554) 2024-05-08T23:15:08.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f132effd700 1 -- 172.21.15.135:0/2757971458 learned_addr learned my addr 172.21.15.135:0/2757971458 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:08.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f132ffff700 1 --2- 172.21.15.135:0/2757971458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1330102ab0 0x7f13300738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:08.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f132effd700 1 -- 172.21.15.135:0/2757971458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1330102ab0 msgr2=0x7f13300738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:08.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f132effd700 1 --2- 172.21.15.135:0/2757971458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1330102ab0 0x7f13300738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f132effd700 1 -- 172.21.15.135:0/2757971458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1330100f20 msgr2=0x7f1330074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:08.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f132effd700 1 --2- 172.21.15.135:0/2757971458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1330100f20 0x7f1330074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f132effd700 1 -- 172.21.15.135:0/2757971458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13180095f0 con 0x7f13301020f0 2024-05-08T23:15:08.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f132ffff700 1 --2- 172.21.15.135:0/2757971458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1330102ab0 0x7f13300738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:08.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.538+0000 7f132effd700 1 --2- 172.21.15.135:0/2757971458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13301020f0 0x7f1330073390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f132000d950 tx=0x7f132000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:08.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.539+0000 7f132cff9700 1 -- 172.21.15.135:0/2757971458 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320009ae0 con 0x7f13301020f0 2024-05-08T23:15:08.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.539+0000 7f1335bab700 1 -- 172.21.15.135:0/2757971458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13301a1250 con 0x7f13301020f0 2024-05-08T23:15:08.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.539+0000 7f132cff9700 1 -- 172.21.15.135:0/2757971458 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1320009c40 con 0x7f13301020f0 2024-05-08T23:15:08.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.539+0000 7f132cff9700 1 -- 172.21.15.135:0/2757971458 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132000f620 con 0x7f13301020f0 2024-05-08T23:15:08.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.539+0000 7f1335bab700 1 -- 172.21.15.135:0/2757971458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13301a1760 con 0x7f13301020f0 2024-05-08T23:15:08.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.540+0000 7f1335bab700 1 -- 172.21.15.135:0/2757971458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1330108460 con 0x7f13301020f0 2024-05-08T23:15:08.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.541+0000 7f132cff9700 1 -- 172.21.15.135:0/2757971458 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f1320010460 con 0x7f13301020f0 2024-05-08T23:15:08.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.541+0000 7f132cff9700 1 --2- 172.21.15.135:0/2757971458 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f131c0a11b0 0x7f131c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:08.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.541+0000 7f132cff9700 1 -- 172.21.15.135:0/2757971458 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f13200cc7b0 con 0x7f13301020f0 2024-05-08T23:15:08.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.541+0000 7f132f7fe700 1 --2- 172.21.15.135:0/2757971458 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f131c0a11b0 0x7f131c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:08.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.542+0000 7f132f7fe700 1 --2- 172.21.15.135:0/2757971458 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f131c0a11b0 0x7f131c0a3670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f13180037f0 tx=0x7f1318005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:08.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.545+0000 7f132cff9700 1 -- 172.21.15.135:0/2757971458 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1320095f90 con 0x7f13301020f0 2024-05-08T23:15:08.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:08 smithi179 ceph-mon[46314]: pgmap v246: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-08T23:15:08.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:08 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/101568633' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-08T23:15:08.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:08 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1648392696' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:08.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:08 smithi195 ceph-mon[46516]: pgmap v246: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-08T23:15:08.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:08 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/101568633' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-08T23:15:08.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:08 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1648392696' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:08.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.742+0000 7f1335bab700 1 -- 172.21.15.135:0/2757971458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f133010ca30 con 0x7f13301020f0 2024-05-08T23:15:08.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.743+0000 7f132cff9700 1 -- 172.21.15.135:0/2757971458 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13200995b0 con 0x7f13301020f0 2024-05-08T23:15:08.742 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T23:15:08.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.745+0000 7f1335bab700 1 -- 172.21.15.135:0/2757971458 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f131c0a11b0 msgr2=0x7f131c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:08.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.745+0000 7f1335bab700 1 --2- 172.21.15.135:0/2757971458 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f131c0a11b0 0x7f131c0a3670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f13180037f0 tx=0x7f1318005fb0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.745+0000 7f1335bab700 1 -- 172.21.15.135:0/2757971458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13301020f0 msgr2=0x7f1330073390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:08.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.745+0000 7f1335bab700 1 --2- 172.21.15.135:0/2757971458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13301020f0 0x7f1330073390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f132000d950 tx=0x7f132000dd10 comp rx=0 tx=0).stop 2024-05-08T23:15:08.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.745+0000 7f1335bab700 1 -- 172.21.15.135:0/2757971458 shutdown_connections 2024-05-08T23:15:08.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.745+0000 7f1335bab700 1 --2- 172.21.15.135:0/2757971458 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f131c0a11b0 0x7f131c0a3670 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.745+0000 7f1335bab700 1 --2- 172.21.15.135:0/2757971458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1330102ab0 0x7f13300738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.745+0000 7f1335bab700 1 --2- 172.21.15.135:0/2757971458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1330100f20 0x7f1330074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.745+0000 7f1335bab700 1 --2- 172.21.15.135:0/2757971458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13301020f0 0x7f1330073390 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.745+0000 7f1335bab700 1 -- 172.21.15.135:0/2757971458 >> 172.21.15.135:0/2757971458 conn(0x7f13300fc4e0 msgr2=0x7f13301055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:08.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.746+0000 7f1335bab700 1 -- 172.21.15.135:0/2757971458 shutdown_connections 2024-05-08T23:15:08.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.746+0000 7f1335bab700 1 -- 172.21.15.135:0/2757971458 wait complete. 2024-05-08T23:15:08.757 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T23:15:08.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.883+0000 7f2ccb6c0700 1 -- 172.21.15.135:0/1957050546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cc4104250 msgr2=0x7f2cc4106640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:08.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.883+0000 7f2ccb6c0700 1 --2- 172.21.15.135:0/1957050546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cc4104250 0x7f2cc4106640 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009990 tx=0x7f2cc0009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.883+0000 7f2ccb6c0700 1 -- 172.21.15.135:0/1957050546 shutdown_connections 2024-05-08T23:15:08.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.883+0000 7f2ccb6c0700 1 --2- 172.21.15.135:0/1957050546 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc4106b80 0x7f2cc4108ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.883+0000 7f2ccb6c0700 1 --2- 172.21.15.135:0/1957050546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cc4101920 0x7f2cc4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.883+0000 7f2ccb6c0700 1 --2- 172.21.15.135:0/1957050546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cc4104250 0x7f2cc4106640 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.883+0000 7f2ccb6c0700 1 -- 172.21.15.135:0/1957050546 >> 172.21.15.135:0/1957050546 conn(0x7f2cc40fb310 msgr2=0x7f2cc40fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:08.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.883+0000 7f2ccb6c0700 1 -- 172.21.15.135:0/1957050546 shutdown_connections 2024-05-08T23:15:08.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.883+0000 7f2ccb6c0700 1 -- 172.21.15.135:0/1957050546 wait complete. 2024-05-08T23:15:08.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2ccb6c0700 1 Processor -- start 2024-05-08T23:15:08.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2ccb6c0700 1 -- start start 2024-05-08T23:15:08.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2ccb6c0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cc4101920 0x7f2cc4196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:08.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2ccb6c0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc4104250 0x7f2cc41972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:08.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2ccb6c0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cc4106b80 0x7f2cc419e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:08.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2ccb6c0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc419e860 con 0x7f2cc4101920 2024-05-08T23:15:08.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2ccb6c0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc419e9d0 con 0x7f2cc4106b80 2024-05-08T23:15:08.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2ccb6c0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc419eb90 con 0x7f2cc4104250 2024-05-08T23:15:08.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2cc945c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cc4101920 0x7f2cc4196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:08.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2cc945c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cc4101920 0x7f2cc4196d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36564/0 (socket says 172.21.15.135:36564) 2024-05-08T23:15:08.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2cc945c700 1 -- 172.21.15.135:0/2208076758 learned_addr learned my addr 172.21.15.135:0/2208076758 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:08.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2cc8c5b700 1 --2- 172.21.15.135:0/2208076758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc4104250 0x7f2cc41972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:08.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2cc9c5d700 1 --2- 172.21.15.135:0/2208076758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cc4106b80 0x7f2cc419e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:08.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2cc945c700 1 -- 172.21.15.135:0/2208076758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc4104250 msgr2=0x7f2cc41972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:08.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2cc945c700 1 --2- 172.21.15.135:0/2208076758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc4104250 0x7f2cc41972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2cc945c700 1 -- 172.21.15.135:0/2208076758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cc4106b80 msgr2=0x7f2cc419e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:08.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2cc945c700 1 --2- 172.21.15.135:0/2208076758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cc4106b80 0x7f2cc419e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:08.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.884+0000 7f2cc945c700 1 -- 172.21.15.135:0/2208076758 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc00095f0 con 0x7f2cc4101920 2024-05-08T23:15:08.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.885+0000 7f2cc945c700 1 --2- 172.21.15.135:0/2208076758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cc4101920 0x7f2cc4196d70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400d950 tx=0x7f2cb400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:08.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.885+0000 7f2cba7fc700 1 -- 172.21.15.135:0/2208076758 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4009b40 con 0x7f2cc4101920 2024-05-08T23:15:08.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.885+0000 7f2cba7fc700 1 -- 172.21.15.135:0/2208076758 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cb4009ca0 con 0x7f2cc4101920 2024-05-08T23:15:08.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.885+0000 7f2ccb6c0700 1 -- 172.21.15.135:0/2208076758 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc419ee70 con 0x7f2cc4101920 2024-05-08T23:15:08.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.885+0000 7f2cba7fc700 1 -- 172.21.15.135:0/2208076758 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb400f620 con 0x7f2cc4101920 2024-05-08T23:15:08.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.885+0000 7f2ccb6c0700 1 -- 172.21.15.135:0/2208076758 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc419f290 con 0x7f2cc4101920 2024-05-08T23:15:08.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.886+0000 7f2ccb6c0700 1 -- 172.21.15.135:0/2208076758 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc40fce90 con 0x7f2cc4101920 2024-05-08T23:15:08.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.887+0000 7f2cba7fc700 1 -- 172.21.15.135:0/2208076758 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f2cb4010460 con 0x7f2cc4101920 2024-05-08T23:15:08.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.887+0000 7f2cba7fc700 1 --2- 172.21.15.135:0/2208076758 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2cb00a11a0 0x7f2cb00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:08.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.888+0000 7f2cc8c5b700 1 --2- 172.21.15.135:0/2208076758 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2cb00a11a0 0x7f2cb00a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:08.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.888+0000 7f2cba7fc700 1 -- 172.21.15.135:0/2208076758 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2cb40ccc30 con 0x7f2cc4101920 2024-05-08T23:15:08.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.888+0000 7f2cc8c5b700 1 --2- 172.21.15.135:0/2208076758 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2cb00a11a0 0x7f2cb00a3660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000b5c0 tx=0x7f2cc0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:08.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:08.892+0000 7f2cba7fc700 1 -- 172.21.15.135:0/2208076758 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2cb4096410 con 0x7f2cc4101920 2024-05-08T23:15:09.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.090+0000 7f2ccb6c0700 1 -- 172.21.15.135:0/2208076758 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2cc4068060 con 0x7f2cc4101920 2024-05-08T23:15:09.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.091+0000 7f2cba7fc700 1 -- 172.21.15.135:0/2208076758 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2cb40200a0 con 0x7f2cc4101920 2024-05-08T23:15:09.090 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-08T23:15:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.093+0000 7f2ccb6c0700 1 -- 172.21.15.135:0/2208076758 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2cb00a11a0 msgr2=0x7f2cb00a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.093+0000 7f2ccb6c0700 1 --2- 172.21.15.135:0/2208076758 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2cb00a11a0 0x7f2cb00a3660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000b5c0 tx=0x7f2cc0005fb0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.093+0000 7f2ccb6c0700 1 -- 172.21.15.135:0/2208076758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cc4101920 msgr2=0x7f2cc4196d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.093+0000 7f2ccb6c0700 1 --2- 172.21.15.135:0/2208076758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cc4101920 0x7f2cc4196d70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400d950 tx=0x7f2cb400dd10 comp rx=0 tx=0).stop 2024-05-08T23:15:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.093+0000 7f2ccb6c0700 1 -- 172.21.15.135:0/2208076758 shutdown_connections 2024-05-08T23:15:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.093+0000 7f2ccb6c0700 1 --2- 172.21.15.135:0/2208076758 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2cb00a11a0 0x7f2cb00a3660 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.093+0000 7f2ccb6c0700 1 --2- 172.21.15.135:0/2208076758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cc4106b80 0x7f2cc419e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.093+0000 7f2ccb6c0700 1 --2- 172.21.15.135:0/2208076758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cc4101920 0x7f2cc4196d70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.093+0000 7f2ccb6c0700 1 --2- 172.21.15.135:0/2208076758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc4104250 0x7f2cc41972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.093+0000 7f2ccb6c0700 1 -- 172.21.15.135:0/2208076758 >> 172.21.15.135:0/2208076758 conn(0x7f2cc40fb310 msgr2=0x7f2cc4102280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.093+0000 7f2ccb6c0700 1 -- 172.21.15.135:0/2208076758 shutdown_connections 2024-05-08T23:15:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.093+0000 7f2ccb6c0700 1 -- 172.21.15.135:0/2208076758 wait complete. 2024-05-08T23:15:09.105 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:15:09.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.228+0000 7fd426665700 1 -- 172.21.15.135:0/3304497114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd420100f50 msgr2=0x7fd4201013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:09.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.228+0000 7fd426665700 1 --2- 172.21.15.135:0/3304497114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd420100f50 0x7fd4201013b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd4140099c0 tx=0x7fd414009cd0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.229+0000 7fd426665700 1 -- 172.21.15.135:0/3304497114 shutdown_connections 2024-05-08T23:15:09.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.229+0000 7fd426665700 1 --2- 172.21.15.135:0/3304497114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4200ffd60 0x7fd420100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.229+0000 7fd426665700 1 --2- 172.21.15.135:0/3304497114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4201018f0 0x7fd4201081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.229+0000 7fd426665700 1 --2- 172.21.15.135:0/3304497114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd420100f50 0x7fd4201013b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.229+0000 7fd426665700 1 -- 172.21.15.135:0/3304497114 >> 172.21.15.135:0/3304497114 conn(0x7fd4200fb2f0 msgr2=0x7fd4200fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:09.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.229+0000 7fd426665700 1 -- 172.21.15.135:0/3304497114 shutdown_connections 2024-05-08T23:15:09.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.229+0000 7fd426665700 1 -- 172.21.15.135:0/3304497114 wait complete. 2024-05-08T23:15:09.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.229+0000 7fd426665700 1 Processor -- start 2024-05-08T23:15:09.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.229+0000 7fd426665700 1 -- start start 2024-05-08T23:15:09.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.229+0000 7fd426665700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4200ffd60 0x7fd420068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:09.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.229+0000 7fd426665700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd420100f50 0x7fd42019bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:09.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd426665700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4201018f0 0x7fd42019e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:09.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd426665700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42019e890 con 0x7fd4200ffd60 2024-05-08T23:15:09.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd426665700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42019ea00 con 0x7fd420100f50 2024-05-08T23:15:09.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd426665700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42019ebc0 con 0x7fd4201018f0 2024-05-08T23:15:09.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd41ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4200ffd60 0x7fd420068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:09.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd41ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4200ffd60 0x7fd420068b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36580/0 (socket says 172.21.15.135:36580) 2024-05-08T23:15:09.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd41ffff700 1 -- 172.21.15.135:0/2158901395 learned_addr learned my addr 172.21.15.135:0/2158901395 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:09.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd41f7fe700 1 --2- 172.21.15.135:0/2158901395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd420100f50 0x7fd42019bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:09.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd424c02700 1 --2- 172.21.15.135:0/2158901395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4201018f0 0x7fd42019e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:09.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd41ffff700 1 -- 172.21.15.135:0/2158901395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4201018f0 msgr2=0x7fd42019e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:09.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd41ffff700 1 --2- 172.21.15.135:0/2158901395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4201018f0 0x7fd42019e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd41ffff700 1 -- 172.21.15.135:0/2158901395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd420100f50 msgr2=0x7fd42019bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:09.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd41ffff700 1 --2- 172.21.15.135:0/2158901395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd420100f50 0x7fd42019bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd41ffff700 1 -- 172.21.15.135:0/2158901395 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4140095f0 con 0x7fd4200ffd60 2024-05-08T23:15:09.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd41ffff700 1 --2- 172.21.15.135:0/2158901395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4200ffd60 0x7fd420068b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd41000e970 tx=0x7fd41000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:09.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd41d7fa700 1 -- 172.21.15.135:0/2158901395 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd410009790 con 0x7fd4200ffd60 2024-05-08T23:15:09.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd426665700 1 -- 172.21.15.135:0/2158901395 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42019eea0 con 0x7fd4200ffd60 2024-05-08T23:15:09.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd41d7fa700 1 -- 172.21.15.135:0/2158901395 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd41000eec0 con 0x7fd4200ffd60 2024-05-08T23:15:09.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd41d7fa700 1 -- 172.21.15.135:0/2158901395 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd410003cf0 con 0x7fd4200ffd60 2024-05-08T23:15:09.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.230+0000 7fd426665700 1 -- 172.21.15.135:0/2158901395 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42019f320 con 0x7fd4200ffd60 2024-05-08T23:15:09.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.231+0000 7fd426665700 1 -- 172.21.15.135:0/2158901395 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd420107180 con 0x7fd4200ffd60 2024-05-08T23:15:09.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.232+0000 7fd41d7fa700 1 -- 172.21.15.135:0/2158901395 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fd41000ccd0 con 0x7fd4200ffd60 2024-05-08T23:15:09.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.233+0000 7fd41d7fa700 1 --2- 172.21.15.135:0/2158901395 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd4080a11b0 0x7fd4080a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:09.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.233+0000 7fd41d7fa700 1 -- 172.21.15.135:0/2158901395 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd410014070 con 0x7fd4200ffd60 2024-05-08T23:15:09.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.233+0000 7fd41f7fe700 1 --2- 172.21.15.135:0/2158901395 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd4080a11b0 0x7fd4080a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:09.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.233+0000 7fd41f7fe700 1 --2- 172.21.15.135:0/2158901395 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd4080a11b0 0x7fd4080a3670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd414009990 tx=0x7fd414000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:09.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.237+0000 7fd41d7fa700 1 -- 172.21.15.135:0/2158901395 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd410096460 con 0x7fd4200ffd60 2024-05-08T23:15:09.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:09 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/4058577899' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:15:09.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:09 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2757971458' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:15:09.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:09 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2208076758' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:15:09.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.480+0000 7fd426665700 1 -- 172.21.15.135:0/2158901395 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd420067c10 con 0x7fd4200ffd60 2024-05-08T23:15:09.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.481+0000 7fd41d7fa700 1 -- 172.21.15.135:0/2158901395 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10927 (secure 0 0 0) 0x7fd410099a80 con 0x7fd4200ffd60 2024-05-08T23:15:09.481 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:09.481 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2432614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2432614311},{"type":"v1","addr":"172.21.15.135:6837","nonce":2432614311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T23:14:21.921303+0000","modified":"2024-05-08T23:14:28.351004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24500,"mds_2":24484,"mds_3":24439,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/360966092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":360966092},{"type":"v1","addr":"172.21.15.135:6839","nonce":360966092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6841/1831266531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":1831266531},{"type":"v1","addr":"172.21.15.135:6841","nonce":1831266531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1024532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1024532},{"type":"v1","addr":"172.21.15.179:6835","nonce":1024532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/2957410160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2957410160},{"type":"v1","addr":"172.21.15.179:6837","nonce":2957410160}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/4199708510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":4199708510},{"type":"v1","addr":"172.21.15.195:6835","nonce":4199708510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6837/2390721751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2390721751},{"type":"v1","addr":"172.21.15.195:6837","nonce":2390721751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.179:6839/1135239419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":1135239419},{"type":"v1","addr":"172.21.15.179:6839","nonce":1135239419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6839/1730571841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1730571841},{"type":"v1","addr":"172.21.15.195:6839","nonce":1730571841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T23:15:09.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.483+0000 7fd426665700 1 -- 172.21.15.135:0/2158901395 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd4080a11b0 msgr2=0x7fd4080a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:09.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.483+0000 7fd426665700 1 --2- 172.21.15.135:0/2158901395 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd4080a11b0 0x7fd4080a3670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd414009990 tx=0x7fd414000bc0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.483+0000 7fd426665700 1 -- 172.21.15.135:0/2158901395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4200ffd60 msgr2=0x7fd420068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:09.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.483+0000 7fd426665700 1 --2- 172.21.15.135:0/2158901395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4200ffd60 0x7fd420068b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd41000e970 tx=0x7fd41000ec80 comp rx=0 tx=0).stop 2024-05-08T23:15:09.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.484+0000 7fd426665700 1 -- 172.21.15.135:0/2158901395 shutdown_connections 2024-05-08T23:15:09.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.484+0000 7fd426665700 1 --2- 172.21.15.135:0/2158901395 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd4080a11b0 0x7fd4080a3670 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.484+0000 7fd426665700 1 --2- 172.21.15.135:0/2158901395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4201018f0 0x7fd42019e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.484+0000 7fd426665700 1 --2- 172.21.15.135:0/2158901395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4200ffd60 0x7fd420068b10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.484+0000 7fd426665700 1 --2- 172.21.15.135:0/2158901395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd420100f50 0x7fd42019bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.484+0000 7fd426665700 1 -- 172.21.15.135:0/2158901395 >> 172.21.15.135:0/2158901395 conn(0x7fd4200fb2f0 msgr2=0x7fd4201042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:09.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.484+0000 7fd426665700 1 -- 172.21.15.135:0/2158901395 shutdown_connections 2024-05-08T23:15:09.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.484+0000 7fd426665700 1 -- 172.21.15.135:0/2158901395 wait complete. 2024-05-08T23:15:09.484 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 27 2024-05-08T23:15:09.496 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T23:15:09.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:09 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/4058577899' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:15:09.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:09 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2757971458' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:15:09.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:09 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2208076758' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:15:09.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.620+0000 7fb8c1951700 1 -- 172.21.15.135:0/2347394868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8bc0ffd60 msgr2=0x7fb8bc100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:09.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.620+0000 7fb8c1951700 1 --2- 172.21.15.135:0/2347394868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8bc0ffd60 0x7fb8bc100180 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0099c0 tx=0x7fb8ac009cd0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.620+0000 7fb8c1951700 1 -- 172.21.15.135:0/2347394868 shutdown_connections 2024-05-08T23:15:09.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.620+0000 7fb8c1951700 1 --2- 172.21.15.135:0/2347394868 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8bc1018f0 0x7fb8bc1081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.620+0000 7fb8c1951700 1 --2- 172.21.15.135:0/2347394868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8bc0ffd60 0x7fb8bc100180 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.620+0000 7fb8c1951700 1 --2- 172.21.15.135:0/2347394868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8bc100f50 0x7fb8bc1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.620+0000 7fb8c1951700 1 -- 172.21.15.135:0/2347394868 >> 172.21.15.135:0/2347394868 conn(0x7fb8bc0fb2f0 msgr2=0x7fb8bc0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:09.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.620+0000 7fb8c1951700 1 -- 172.21.15.135:0/2347394868 shutdown_connections 2024-05-08T23:15:09.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.620+0000 7fb8c1951700 1 -- 172.21.15.135:0/2347394868 wait complete. 2024-05-08T23:15:09.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8c1951700 1 Processor -- start 2024-05-08T23:15:09.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8c1951700 1 -- start start 2024-05-08T23:15:09.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8c1951700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8bc0ffd60 0x7fb8bc196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:09.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8c1951700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8bc100f50 0x7fb8bc197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:09.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8c1951700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8bc1018f0 0x7fb8bc19e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:09.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8c1951700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc19e8e0 con 0x7fb8bc0ffd60 2024-05-08T23:15:09.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8c1951700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc19ea50 con 0x7fb8bc1018f0 2024-05-08T23:15:09.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8c1951700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc19ec10 con 0x7fb8bc100f50 2024-05-08T23:15:09.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8baffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8bc0ffd60 0x7fb8bc196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:09.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8baffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8bc0ffd60 0x7fb8bc196df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36596/0 (socket says 172.21.15.135:36596) 2024-05-08T23:15:09.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8baffd700 1 -- 172.21.15.135:0/997339390 learned_addr learned my addr 172.21.15.135:0/997339390 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:09.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8ba7fc700 1 --2- 172.21.15.135:0/997339390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8bc100f50 0x7fb8bc197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:09.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8baffd700 1 -- 172.21.15.135:0/997339390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8bc100f50 msgr2=0x7fb8bc197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:09.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8baffd700 1 --2- 172.21.15.135:0/997339390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8bc100f50 0x7fb8bc197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8baffd700 1 -- 172.21.15.135:0/997339390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8bc1018f0 msgr2=0x7fb8bc19e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:09.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.621+0000 7fb8bb7fe700 1 --2- 172.21.15.135:0/997339390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8bc1018f0 0x7fb8bc19e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:09.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.622+0000 7fb8baffd700 1 --2- 172.21.15.135:0/997339390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8bc1018f0 0x7fb8bc19e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.622+0000 7fb8baffd700 1 -- 172.21.15.135:0/997339390 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac0095f0 con 0x7fb8bc0ffd60 2024-05-08T23:15:09.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.622+0000 7fb8baffd700 1 --2- 172.21.15.135:0/997339390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8bc0ffd60 0x7fb8bc196df0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009f50 tx=0x7fb8ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:09.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.622+0000 7fb8c094f700 1 -- 172.21.15.135:0/997339390 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac01d070 con 0x7fb8bc0ffd60 2024-05-08T23:15:09.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.622+0000 7fb8c094f700 1 -- 172.21.15.135:0/997339390 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8ac004180 con 0x7fb8bc0ffd60 2024-05-08T23:15:09.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.622+0000 7fb8c1951700 1 -- 172.21.15.135:0/997339390 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8bc19ee90 con 0x7fb8bc0ffd60 2024-05-08T23:15:09.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.622+0000 7fb8c094f700 1 -- 172.21.15.135:0/997339390 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac00f460 con 0x7fb8bc0ffd60 2024-05-08T23:15:09.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.622+0000 7fb8c1951700 1 -- 172.21.15.135:0/997339390 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8bc19f200 con 0x7fb8bc0ffd60 2024-05-08T23:15:09.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.623+0000 7fb8c1951700 1 -- 172.21.15.135:0/997339390 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8bc067c10 con 0x7fb8bc0ffd60 2024-05-08T23:15:09.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.624+0000 7fb8c094f700 1 -- 172.21.15.135:0/997339390 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fb8ac022650 con 0x7fb8bc0ffd60 2024-05-08T23:15:09.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.624+0000 7fb8c094f700 1 --2- 172.21.15.135:0/997339390 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb8a80a1230 0x7fb8a80a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:09.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.625+0000 7fb8ba7fc700 1 --2- 172.21.15.135:0/997339390 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb8a80a1230 0x7fb8a80a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:09.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.625+0000 7fb8c094f700 1 -- 172.21.15.135:0/997339390 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb8ac0ce4d0 con 0x7fb8bc0ffd60 2024-05-08T23:15:09.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.625+0000 7fb8ba7fc700 1 --2- 172.21.15.135:0/997339390 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb8a80a1230 0x7fb8a80a36f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4005fd0 tx=0x7fb8a400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:09.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.628+0000 7fb8c094f700 1 -- 172.21.15.135:0/997339390 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb8ac097d50 con 0x7fb8bc0ffd60 2024-05-08T23:15:09.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:09 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/4058577899' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:15:09.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:09 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2757971458' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:15:09.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:09 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2208076758' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:15:09.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.825+0000 7fb8c1951700 1 -- 172.21.15.135:0/997339390 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8bc10b830 con 0x7fb8bc0ffd60 2024-05-08T23:15:09.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.827+0000 7fb8c094f700 1 -- 172.21.15.135:0/997339390 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22176 (secure 0 0 0) 0x7fb8ac09b370 con 0x7fb8bc0ffd60 2024-05-08T23:15:09.827 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:09.827 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":83,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:14:22.924945+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T23:14:19.726838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T23:14:21.097732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:15:09.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.829+0000 7fb8c1951700 1 -- 172.21.15.135:0/997339390 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb8a80a1230 msgr2=0x7fb8a80a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:09.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.829+0000 7fb8c1951700 1 --2- 172.21.15.135:0/997339390 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb8a80a1230 0x7fb8a80a36f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4005fd0 tx=0x7fb8a400a560 comp rx=0 tx=0).stop 2024-05-08T23:15:09.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.829+0000 7fb8c1951700 1 -- 172.21.15.135:0/997339390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8bc0ffd60 msgr2=0x7fb8bc196df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:09.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.829+0000 7fb8c1951700 1 --2- 172.21.15.135:0/997339390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8bc0ffd60 0x7fb8bc196df0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009f50 tx=0x7fb8ac0057f0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.829+0000 7fb8c1951700 1 -- 172.21.15.135:0/997339390 shutdown_connections 2024-05-08T23:15:09.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.829+0000 7fb8c1951700 1 --2- 172.21.15.135:0/997339390 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb8a80a1230 0x7fb8a80a36f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.829+0000 7fb8c1951700 1 --2- 172.21.15.135:0/997339390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8bc1018f0 0x7fb8bc19e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.829+0000 7fb8c1951700 1 --2- 172.21.15.135:0/997339390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8bc0ffd60 0x7fb8bc196df0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.829+0000 7fb8c1951700 1 --2- 172.21.15.135:0/997339390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8bc100f50 0x7fb8bc197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.829+0000 7fb8c1951700 1 -- 172.21.15.135:0/997339390 >> 172.21.15.135:0/997339390 conn(0x7fb8bc0fb2f0 msgr2=0x7fb8bc0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:09.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.829+0000 7fb8c1951700 1 -- 172.21.15.135:0/997339390 shutdown_connections 2024-05-08T23:15:09.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.829+0000 7fb8c1951700 1 -- 172.21.15.135:0/997339390 wait complete. 2024-05-08T23:15:09.842 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:11:11.282550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T23:14:19.726838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T23:14:21.097732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T23:15:09.843 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T23:15:09.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.970+0000 7f5f849ac700 1 -- 172.21.15.135:0/1479265909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f801007d0 msgr2=0x7f5f80100c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:09.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.970+0000 7f5f849ac700 1 --2- 172.21.15.135:0/1479265909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f801007d0 0x7f5f80100c30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5f700099c0 tx=0x7f5f70009cd0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.970+0000 7f5f849ac700 1 -- 172.21.15.135:0/1479265909 shutdown_connections 2024-05-08T23:15:09.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.970+0000 7f5f849ac700 1 --2- 172.21.15.135:0/1479265909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f80101170 0x7f5f80107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.970+0000 7f5f849ac700 1 --2- 172.21.15.135:0/1479265909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f800ff5e0 0x7f5f800ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.970+0000 7f5f849ac700 1 --2- 172.21.15.135:0/1479265909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f801007d0 0x7f5f80100c30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.970+0000 7f5f849ac700 1 -- 172.21.15.135:0/1479265909 >> 172.21.15.135:0/1479265909 conn(0x7f5f800fab50 msgr2=0x7f5f800fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:09.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.970+0000 7f5f849ac700 1 -- 172.21.15.135:0/1479265909 shutdown_connections 2024-05-08T23:15:09.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.970+0000 7f5f849ac700 1 -- 172.21.15.135:0/1479265909 wait complete. 2024-05-08T23:15:09.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.971+0000 7f5f849ac700 1 Processor -- start 2024-05-08T23:15:09.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.971+0000 7f5f849ac700 1 -- start start 2024-05-08T23:15:09.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.971+0000 7f5f849ac700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f800ff5e0 0x7f5f80195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:09.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.971+0000 7f5f849ac700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f801007d0 0x7f5f801962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:09.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.971+0000 7f5f849ac700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f80101170 0x7f5f8019d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:09.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.971+0000 7f5f849ac700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8019d890 con 0x7f5f800ff5e0 2024-05-08T23:15:09.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.971+0000 7f5f849ac700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8019da00 con 0x7f5f80101170 2024-05-08T23:15:09.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.971+0000 7f5f849ac700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8019dbc0 con 0x7f5f801007d0 2024-05-08T23:15:09.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.971+0000 7f5f7e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f800ff5e0 0x7f5f80195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:09.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.971+0000 7f5f7e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f800ff5e0 0x7f5f80195da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36616/0 (socket says 172.21.15.135:36616) 2024-05-08T23:15:09.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.971+0000 7f5f7e59c700 1 -- 172.21.15.135:0/533524649 learned_addr learned my addr 172.21.15.135:0/533524649 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:09.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.971+0000 7f5f7dd9b700 1 --2- 172.21.15.135:0/533524649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f801007d0 0x7f5f801962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:09.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.972+0000 7f5f7ed9d700 1 --2- 172.21.15.135:0/533524649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f80101170 0x7f5f8019d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:09.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.972+0000 7f5f7e59c700 1 -- 172.21.15.135:0/533524649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f801007d0 msgr2=0x7f5f801962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:09.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.972+0000 7f5f7e59c700 1 --2- 172.21.15.135:0/533524649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f801007d0 0x7f5f801962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.972+0000 7f5f7e59c700 1 -- 172.21.15.135:0/533524649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f80101170 msgr2=0x7f5f8019d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:09.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.972+0000 7f5f7e59c700 1 --2- 172.21.15.135:0/533524649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f80101170 0x7f5f8019d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:09.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.972+0000 7f5f7e59c700 1 -- 172.21.15.135:0/533524649 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f700095f0 con 0x7f5f800ff5e0 2024-05-08T23:15:09.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.972+0000 7f5f7ed9d700 1 --2- 172.21.15.135:0/533524649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f80101170 0x7f5f8019d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:09.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.972+0000 7f5f7e59c700 1 --2- 172.21.15.135:0/533524649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f800ff5e0 0x7f5f80195da0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5f680098f0 tx=0x7f5f68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:09.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.972+0000 7f5f777fe700 1 -- 172.21.15.135:0/533524649 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68012070 con 0x7f5f800ff5e0 2024-05-08T23:15:09.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.972+0000 7f5f777fe700 1 -- 172.21.15.135:0/533524649 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f680044e0 con 0x7f5f800ff5e0 2024-05-08T23:15:09.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.972+0000 7f5f849ac700 1 -- 172.21.15.135:0/533524649 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f801083d0 con 0x7f5f800ff5e0 2024-05-08T23:15:09.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.972+0000 7f5f777fe700 1 -- 172.21.15.135:0/533524649 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68003df0 con 0x7f5f800ff5e0 2024-05-08T23:15:09.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.972+0000 7f5f849ac700 1 -- 172.21.15.135:0/533524649 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f801088e0 con 0x7f5f800ff5e0 2024-05-08T23:15:09.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.973+0000 7f5f849ac700 1 -- 172.21.15.135:0/533524649 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f80067460 con 0x7f5f800ff5e0 2024-05-08T23:15:09.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.974+0000 7f5f777fe700 1 -- 172.21.15.135:0/533524649 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f5f68016030 con 0x7f5f800ff5e0 2024-05-08T23:15:09.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.975+0000 7f5f777fe700 1 --2- 172.21.15.135:0/533524649 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5f6c0a11b0 0x7f5f6c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:09.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.975+0000 7f5f777fe700 1 -- 172.21.15.135:0/533524649 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5f680cdaa0 con 0x7f5f800ff5e0 2024-05-08T23:15:09.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.975+0000 7f5f7dd9b700 1 --2- 172.21.15.135:0/533524649 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5f6c0a11b0 0x7f5f6c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:09.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.975+0000 7f5f7dd9b700 1 --2- 172.21.15.135:0/533524649 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5f6c0a11b0 0x7f5f6c0a3670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009990 tx=0x7f5f7000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:09.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:09.979+0000 7f5f777fe700 1 -- 172.21.15.135:0/533524649 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5f68097280 con 0x7f5f800ff5e0 2024-05-08T23:15:10.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.174+0000 7f5f849ac700 1 -- 172.21.15.135:0/533524649 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f8010b6d0 con 0x7f5f800ff5e0 2024-05-08T23:15:10.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.174+0000 7f5f777fe700 1 -- 172.21.15.135:0/533524649 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f8010b6d0 con 0x7f5f800ff5e0 2024-05-08T23:15:10.174 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T23:15:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.176+0000 7f5f849ac700 1 -- 172.21.15.135:0/533524649 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5f6c0a11b0 msgr2=0x7f5f6c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.176+0000 7f5f849ac700 1 --2- 172.21.15.135:0/533524649 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5f6c0a11b0 0x7f5f6c0a3670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009990 tx=0x7f5f7000b540 comp rx=0 tx=0).stop 2024-05-08T23:15:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.176+0000 7f5f849ac700 1 -- 172.21.15.135:0/533524649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f800ff5e0 msgr2=0x7f5f80195da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.176+0000 7f5f849ac700 1 --2- 172.21.15.135:0/533524649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f800ff5e0 0x7f5f80195da0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5f680098f0 tx=0x7f5f68009c00 comp rx=0 tx=0).stop 2024-05-08T23:15:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.176+0000 7f5f849ac700 1 -- 172.21.15.135:0/533524649 shutdown_connections 2024-05-08T23:15:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.176+0000 7f5f849ac700 1 --2- 172.21.15.135:0/533524649 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5f6c0a11b0 0x7f5f6c0a3670 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.176+0000 7f5f849ac700 1 --2- 172.21.15.135:0/533524649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f80101170 0x7f5f8019d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.176+0000 7f5f849ac700 1 --2- 172.21.15.135:0/533524649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f800ff5e0 0x7f5f80195da0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.176+0000 7f5f849ac700 1 --2- 172.21.15.135:0/533524649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f801007d0 0x7f5f801962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.176+0000 7f5f849ac700 1 -- 172.21.15.135:0/533524649 >> 172.21.15.135:0/533524649 conn(0x7f5f800fab50 msgr2=0x7f5f80103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.176+0000 7f5f849ac700 1 -- 172.21.15.135:0/533524649 shutdown_connections 2024-05-08T23:15:10.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.176+0000 7f5f849ac700 1 -- 172.21.15.135:0/533524649 wait complete. 2024-05-08T23:15:10.188 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T23:15:10.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.315+0000 7f959201a700 1 -- 172.21.15.135:0/643356510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f958c104370 msgr2=0x7f958c106760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:10.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.315+0000 7f959201a700 1 --2- 172.21.15.135:0/643356510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f958c104370 0x7f958c106760 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9580009990 tx=0x7f9580009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.316+0000 7f959201a700 1 -- 172.21.15.135:0/643356510 shutdown_connections 2024-05-08T23:15:10.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.316+0000 7f959201a700 1 --2- 172.21.15.135:0/643356510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f958c106ca0 0x7f958c1090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.316+0000 7f959201a700 1 --2- 172.21.15.135:0/643356510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f958c101a40 0x7f958c103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.316+0000 7f959201a700 1 --2- 172.21.15.135:0/643356510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f958c104370 0x7f958c106760 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.316+0000 7f959201a700 1 -- 172.21.15.135:0/643356510 >> 172.21.15.135:0/643356510 conn(0x7f958c0fb3f0 msgr2=0x7f958c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:10.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.316+0000 7f959201a700 1 -- 172.21.15.135:0/643356510 shutdown_connections 2024-05-08T23:15:10.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.316+0000 7f959201a700 1 -- 172.21.15.135:0/643356510 wait complete. 2024-05-08T23:15:10.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.316+0000 7f959201a700 1 Processor -- start 2024-05-08T23:15:10.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.316+0000 7f959201a700 1 -- start start 2024-05-08T23:15:10.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.316+0000 7f959201a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f958c101a40 0x7f958c196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:10.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.316+0000 7f959201a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f958c104370 0x7f958c1973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:10.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.316+0000 7f959201a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f958c106ca0 0x7f958c19e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:10.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.316+0000 7f959201a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c19e9e0 con 0x7f958c104370 2024-05-08T23:15:10.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.316+0000 7f959201a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c19eb20 con 0x7f958c106ca0 2024-05-08T23:15:10.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.316+0000 7f959201a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c19ecb0 con 0x7f958c101a40 2024-05-08T23:15:10.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f958affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f958c104370 0x7f958c1973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:10.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f958affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f958c104370 0x7f958c1973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36630/0 (socket says 172.21.15.135:36630) 2024-05-08T23:15:10.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f958affd700 1 -- 172.21.15.135:0/958524189 learned_addr learned my addr 172.21.15.135:0/958524189 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:10.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f958b7fe700 1 --2- 172.21.15.135:0/958524189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f958c101a40 0x7f958c196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:10.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f958bfff700 1 --2- 172.21.15.135:0/958524189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f958c106ca0 0x7f958c19e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:10.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f958affd700 1 -- 172.21.15.135:0/958524189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f958c101a40 msgr2=0x7f958c196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:10.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f958affd700 1 --2- 172.21.15.135:0/958524189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f958c101a40 0x7f958c196eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f958affd700 1 -- 172.21.15.135:0/958524189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f958c106ca0 msgr2=0x7f958c19e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:10.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f958affd700 1 --2- 172.21.15.135:0/958524189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f958c106ca0 0x7f958c19e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f958affd700 1 -- 172.21.15.135:0/958524189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95800095f0 con 0x7f958c104370 2024-05-08T23:15:10.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f958affd700 1 --2- 172.21.15.135:0/958524189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f958c104370 0x7f958c1973f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f958000b5c0 tx=0x7f958000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:10.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f9588ff9700 1 -- 172.21.15.135:0/958524189 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958001d070 con 0x7f958c104370 2024-05-08T23:15:10.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f9588ff9700 1 -- 172.21.15.135:0/958524189 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9580022470 con 0x7f958c104370 2024-05-08T23:15:10.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f959201a700 1 -- 172.21.15.135:0/958524189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958c19ef30 con 0x7f958c104370 2024-05-08T23:15:10.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f9588ff9700 1 -- 172.21.15.135:0/958524189 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9580017650 con 0x7f958c104370 2024-05-08T23:15:10.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.317+0000 7f959201a700 1 -- 172.21.15.135:0/958524189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958c19f2f0 con 0x7f958c104370 2024-05-08T23:15:10.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.318+0000 7f959201a700 1 -- 172.21.15.135:0/958524189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958c0fcf70 con 0x7f958c104370 2024-05-08T23:15:10.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.319+0000 7f9588ff9700 1 -- 172.21.15.135:0/958524189 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f95800225e0 con 0x7f958c104370 2024-05-08T23:15:10.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.320+0000 7f9588ff9700 1 --2- 172.21.15.135:0/958524189 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f95740a11b0 0x7f95740a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:10.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.320+0000 7f958b7fe700 1 --2- 172.21.15.135:0/958524189 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f95740a11b0 0x7f95740a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:10.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.320+0000 7f9588ff9700 1 -- 172.21.15.135:0/958524189 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f95800cdec0 con 0x7f958c104370 2024-05-08T23:15:10.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.320+0000 7f958b7fe700 1 --2- 172.21.15.135:0/958524189 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f95740a11b0 0x7f95740a3670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f957c005950 tx=0x7f957c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:10.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.323+0000 7f9588ff9700 1 -- 172.21.15.135:0/958524189 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9580097630 con 0x7f958c104370 2024-05-08T23:15:10.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:10 smithi135 ceph-mon[42440]: pgmap v247: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-05-08T23:15:10.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:10 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2158901395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:15:10.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:10 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/997339390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:10.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:10 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/533524649' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:15:10.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.521+0000 7f959201a700 1 -- 172.21.15.135:0/958524189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f958c10c7a0 con 0x7f958c104370 2024-05-08T23:15:10.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.521+0000 7f9588ff9700 1 -- 172.21.15.135:0/958524189 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f958009ac50 con 0x7f958c104370 2024-05-08T23:15:10.521 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T23:15:10.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.523+0000 7f959201a700 1 -- 172.21.15.135:0/958524189 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f95740a11b0 msgr2=0x7f95740a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:10.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.523+0000 7f959201a700 1 --2- 172.21.15.135:0/958524189 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f95740a11b0 0x7f95740a3670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f957c005950 tx=0x7f957c00a300 comp rx=0 tx=0).stop 2024-05-08T23:15:10.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.523+0000 7f959201a700 1 -- 172.21.15.135:0/958524189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f958c104370 msgr2=0x7f958c1973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:10.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.523+0000 7f959201a700 1 --2- 172.21.15.135:0/958524189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f958c104370 0x7f958c1973f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f958000b5c0 tx=0x7f958000f670 comp rx=0 tx=0).stop 2024-05-08T23:15:10.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.523+0000 7f959201a700 1 -- 172.21.15.135:0/958524189 shutdown_connections 2024-05-08T23:15:10.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.523+0000 7f959201a700 1 --2- 172.21.15.135:0/958524189 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f95740a11b0 0x7f95740a3670 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.523+0000 7f959201a700 1 --2- 172.21.15.135:0/958524189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f958c101a40 0x7f958c196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.523+0000 7f959201a700 1 --2- 172.21.15.135:0/958524189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f958c106ca0 0x7f958c19e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.523+0000 7f959201a700 1 --2- 172.21.15.135:0/958524189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f958c104370 0x7f958c1973f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.523+0000 7f959201a700 1 -- 172.21.15.135:0/958524189 >> 172.21.15.135:0/958524189 conn(0x7f958c0fb3f0 msgr2=0x7f958c102380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:10.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.524+0000 7f959201a700 1 -- 172.21.15.135:0/958524189 shutdown_connections 2024-05-08T23:15:10.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.524+0000 7f959201a700 1 -- 172.21.15.135:0/958524189 wait complete. 2024-05-08T23:15:10.535 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T23:15:10.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:10 smithi179 ceph-mon[46314]: pgmap v247: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-05-08T23:15:10.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:10 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2158901395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:15:10.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:10 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/997339390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:10.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:10 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/533524649' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:15:10.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:10 smithi195 ceph-mon[46516]: pgmap v247: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-05-08T23:15:10.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:10 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2158901395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:15:10.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:10 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/997339390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:10.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:10 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/533524649' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:15:10.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.661+0000 7f9ae871c700 1 -- 172.21.15.135:0/3658527655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ae0102c30 msgr2=0x7f9ae01094e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:10.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.661+0000 7f9ae871c700 1 --2- 172.21.15.135:0/3658527655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ae0102c30 0x7f9ae01094e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800b0a0 tx=0x7f9ad800b3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.661+0000 7f9ae871c700 1 -- 172.21.15.135:0/3658527655 shutdown_connections 2024-05-08T23:15:10.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.661+0000 7f9ae871c700 1 --2- 172.21.15.135:0/3658527655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ae00ff220 0x7f9ae00ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.661+0000 7f9ae871c700 1 --2- 172.21.15.135:0/3658527655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ae0102c30 0x7f9ae01094e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.661+0000 7f9ae871c700 1 --2- 172.21.15.135:0/3658527655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae0102290 0x7f9ae01026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.661+0000 7f9ae871c700 1 -- 172.21.15.135:0/3658527655 >> 172.21.15.135:0/3658527655 conn(0x7f9ae00fab50 msgr2=0x7f9ae00fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:10.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.661+0000 7f9ae871c700 1 -- 172.21.15.135:0/3658527655 shutdown_connections 2024-05-08T23:15:10.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.661+0000 7f9ae871c700 1 -- 172.21.15.135:0/3658527655 wait complete. 2024-05-08T23:15:10.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.662+0000 7f9ae871c700 1 Processor -- start 2024-05-08T23:15:10.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.662+0000 7f9ae871c700 1 -- start start 2024-05-08T23:15:10.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.662+0000 7f9ae871c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ae00ff220 0x7f9ae0196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:10.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.662+0000 7f9ae871c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae0102290 0x7f9ae0197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:10.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.662+0000 7f9ae871c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ae0102c30 0x7f9ae019e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:10.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.662+0000 7f9ae871c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae019ea80 con 0x7f9ae00ff220 2024-05-08T23:15:10.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.662+0000 7f9ae871c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae019ebc0 con 0x7f9ae0102290 2024-05-08T23:15:10.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.662+0000 7f9ae871c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae019ed50 con 0x7f9ae0102c30 2024-05-08T23:15:10.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.662+0000 7f9ae64b8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ae00ff220 0x7f9ae0196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:10.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.662+0000 7f9ae64b8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ae00ff220 0x7f9ae0196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36650/0 (socket says 172.21.15.135:36650) 2024-05-08T23:15:10.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.662+0000 7f9ae64b8700 1 -- 172.21.15.135:0/2681988891 learned_addr learned my addr 172.21.15.135:0/2681988891 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:10.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.662+0000 7f9ae6cb9700 1 --2- 172.21.15.135:0/2681988891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ae0102c30 0x7f9ae019e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:10.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.663+0000 7f9ae5cb7700 1 --2- 172.21.15.135:0/2681988891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae0102290 0x7f9ae0197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:10.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.663+0000 7f9ae64b8700 1 -- 172.21.15.135:0/2681988891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ae0102c30 msgr2=0x7f9ae019e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:10.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.663+0000 7f9ae64b8700 1 --2- 172.21.15.135:0/2681988891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ae0102c30 0x7f9ae019e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.663+0000 7f9ae64b8700 1 -- 172.21.15.135:0/2681988891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae0102290 msgr2=0x7f9ae0197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:10.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.663+0000 7f9ae64b8700 1 --2- 172.21.15.135:0/2681988891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae0102290 0x7f9ae0197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.663+0000 7f9ae64b8700 1 -- 172.21.15.135:0/2681988891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad8009d00 con 0x7f9ae00ff220 2024-05-08T23:15:10.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.663+0000 7f9ae5cb7700 1 --2- 172.21.15.135:0/2681988891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae0102290 0x7f9ae0197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:10.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.663+0000 7f9ae64b8700 1 --2- 172.21.15.135:0/2681988891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ae00ff220 0x7f9ae0196f50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000d980 tx=0x7f9ad000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:10.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.663+0000 7f9ad77fe700 1 -- 172.21.15.135:0/2681988891 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0004020 con 0x7f9ae00ff220 2024-05-08T23:15:10.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.663+0000 7f9ad77fe700 1 -- 172.21.15.135:0/2681988891 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ad0009730 con 0x7f9ae00ff220 2024-05-08T23:15:10.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.663+0000 7f9ad77fe700 1 -- 172.21.15.135:0/2681988891 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0003a80 con 0x7f9ae00ff220 2024-05-08T23:15:10.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.663+0000 7f9ae871c700 1 -- 172.21.15.135:0/2681988891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae019efd0 con 0x7f9ae00ff220 2024-05-08T23:15:10.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.663+0000 7f9ae871c700 1 -- 172.21.15.135:0/2681988891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae019f450 con 0x7f9ae00ff220 2024-05-08T23:15:10.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.664+0000 7f9ae871c700 1 -- 172.21.15.135:0/2681988891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae0108450 con 0x7f9ae00ff220 2024-05-08T23:15:10.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.665+0000 7f9ad77fe700 1 -- 172.21.15.135:0/2681988891 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f9ad00098a0 con 0x7f9ae00ff220 2024-05-08T23:15:10.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.665+0000 7f9ad77fe700 1 --2- 172.21.15.135:0/2681988891 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9acc0a1230 0x7f9acc0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:10.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.666+0000 7f9ae5cb7700 1 --2- 172.21.15.135:0/2681988891 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9acc0a1230 0x7f9acc0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:10.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.666+0000 7f9ad77fe700 1 -- 172.21.15.135:0/2681988891 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9ad00cc960 con 0x7f9ae00ff220 2024-05-08T23:15:10.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.666+0000 7f9ae5cb7700 1 --2- 172.21.15.135:0/2681988891 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9acc0a1230 0x7f9acc0a36f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9adc005fd0 tx=0x7f9adc005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:10.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.669+0000 7f9ad77fe700 1 -- 172.21.15.135:0/2681988891 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9ad00960c0 con 0x7f9ae00ff220 2024-05-08T23:15:10.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.865+0000 7f9ae871c700 1 -- 172.21.15.135:0/2681988891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ae010c760 con 0x7f9ae00ff220 2024-05-08T23:15:10.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.865+0000 7f9ad77fe700 1 -- 172.21.15.135:0/2681988891 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ad00996e0 con 0x7f9ae00ff220 2024-05-08T23:15:10.865 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-08T23:15:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.867+0000 7f9ae871c700 1 -- 172.21.15.135:0/2681988891 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9acc0a1230 msgr2=0x7f9acc0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.867+0000 7f9ae871c700 1 --2- 172.21.15.135:0/2681988891 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9acc0a1230 0x7f9acc0a36f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9adc005fd0 tx=0x7f9adc005ee0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.867+0000 7f9ae871c700 1 -- 172.21.15.135:0/2681988891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ae00ff220 msgr2=0x7f9ae0196f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.867+0000 7f9ae871c700 1 --2- 172.21.15.135:0/2681988891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ae00ff220 0x7f9ae0196f50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000d980 tx=0x7f9ad000dc90 comp rx=0 tx=0).stop 2024-05-08T23:15:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.867+0000 7f9ae871c700 1 -- 172.21.15.135:0/2681988891 shutdown_connections 2024-05-08T23:15:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.867+0000 7f9ae871c700 1 --2- 172.21.15.135:0/2681988891 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9acc0a1230 0x7f9acc0a36f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.867+0000 7f9ae871c700 1 --2- 172.21.15.135:0/2681988891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ae0102c30 0x7f9ae019e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.867+0000 7f9ae871c700 1 --2- 172.21.15.135:0/2681988891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ae00ff220 0x7f9ae0196f50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.867+0000 7f9ae871c700 1 --2- 172.21.15.135:0/2681988891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ae0102290 0x7f9ae0197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.867+0000 7f9ae871c700 1 -- 172.21.15.135:0/2681988891 >> 172.21.15.135:0/2681988891 conn(0x7f9ae00fab50 msgr2=0x7f9ae0105590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.868+0000 7f9ae871c700 1 -- 172.21.15.135:0/2681988891 shutdown_connections 2024-05-08T23:15:10.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:10.868+0000 7f9ae871c700 1 -- 172.21.15.135:0/2681988891 wait complete. 2024-05-08T23:15:10.879 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:15:11.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.003+0000 7f2bbd35b700 1 -- 172.21.15.135:0/1812752808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bb8100f80 msgr2=0x7f2bb81013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:11.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.003+0000 7f2bbd35b700 1 --2- 172.21.15.135:0/1812752808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bb8100f80 0x7f2bb81013e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80099c0 tx=0x7f2ba8009cd0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.003+0000 7f2bbd35b700 1 -- 172.21.15.135:0/1812752808 shutdown_connections 2024-05-08T23:15:11.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.003+0000 7f2bbd35b700 1 --2- 172.21.15.135:0/1812752808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bb80ffd90 0x7f2bb81001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.003+0000 7f2bbd35b700 1 --2- 172.21.15.135:0/1812752808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb8101920 0x7f2bb81081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.003+0000 7f2bbd35b700 1 --2- 172.21.15.135:0/1812752808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bb8100f80 0x7f2bb81013e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.003+0000 7f2bbd35b700 1 -- 172.21.15.135:0/1812752808 >> 172.21.15.135:0/1812752808 conn(0x7f2bb80fb320 msgr2=0x7f2bb80fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:11.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.003+0000 7f2bbd35b700 1 -- 172.21.15.135:0/1812752808 shutdown_connections 2024-05-08T23:15:11.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.003+0000 7f2bbd35b700 1 -- 172.21.15.135:0/1812752808 wait complete. 2024-05-08T23:15:11.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.004+0000 7f2bbd35b700 1 Processor -- start 2024-05-08T23:15:11.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.004+0000 7f2bbd35b700 1 -- start start 2024-05-08T23:15:11.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.004+0000 7f2bbd35b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bb80ffd90 0x7f2bb8069fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:11.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.004+0000 7f2bbd35b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bb8100f80 0x7f2bb819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:11.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.004+0000 7f2bbd35b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb8101920 0x7f2bb819e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:11.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.004+0000 7f2bbd35b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb819e8d0 con 0x7f2bb8100f80 2024-05-08T23:15:11.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.004+0000 7f2bbd35b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb819ea40 con 0x7f2bb8101920 2024-05-08T23:15:11.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.004+0000 7f2bbd35b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb819ec00 con 0x7f2bb80ffd90 2024-05-08T23:15:11.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.004+0000 7f2bb67fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bb8100f80 0x7f2bb819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:11.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.004+0000 7f2bb6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bb80ffd90 0x7f2bb8069fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:11.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.004+0000 7f2bb67fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bb8100f80 0x7f2bb819bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36666/0 (socket says 172.21.15.135:36666) 2024-05-08T23:15:11.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.004+0000 7f2bb67fc700 1 -- 172.21.15.135:0/461089173 learned_addr learned my addr 172.21.15.135:0/461089173 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:11.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.004+0000 7f2bb77fe700 1 --2- 172.21.15.135:0/461089173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb8101920 0x7f2bb819e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:11.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.005+0000 7f2bb67fc700 1 -- 172.21.15.135:0/461089173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bb80ffd90 msgr2=0x7f2bb8069fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:11.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.005+0000 7f2bb67fc700 1 --2- 172.21.15.135:0/461089173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bb80ffd90 0x7f2bb8069fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.005+0000 7f2bb67fc700 1 -- 172.21.15.135:0/461089173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb8101920 msgr2=0x7f2bb819e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:11.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.005+0000 7f2bb67fc700 1 --2- 172.21.15.135:0/461089173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb8101920 0x7f2bb819e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.005+0000 7f2bb67fc700 1 -- 172.21.15.135:0/461089173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba80095f0 con 0x7f2bb8100f80 2024-05-08T23:15:11.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.005+0000 7f2bb67fc700 1 --2- 172.21.15.135:0/461089173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bb8100f80 0x7f2bb819bac0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80036f0 tx=0x7f2ba80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:11.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.005+0000 7f2baffff700 1 -- 172.21.15.135:0/461089173 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba801d070 con 0x7f2bb8100f80 2024-05-08T23:15:11.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.005+0000 7f2baffff700 1 -- 172.21.15.135:0/461089173 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ba8004090 con 0x7f2bb8100f80 2024-05-08T23:15:11.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.005+0000 7f2bbd35b700 1 -- 172.21.15.135:0/461089173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb819ee20 con 0x7f2bb8100f80 2024-05-08T23:15:11.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.005+0000 7f2baffff700 1 -- 172.21.15.135:0/461089173 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8022d40 con 0x7f2bb8100f80 2024-05-08T23:15:11.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.005+0000 7f2bbd35b700 1 -- 172.21.15.135:0/461089173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb819f270 con 0x7f2bb8100f80 2024-05-08T23:15:11.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.006+0000 7f2bbd35b700 1 -- 172.21.15.135:0/461089173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb8107140 con 0x7f2bb8100f80 2024-05-08T23:15:11.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.007+0000 7f2baffff700 1 -- 172.21.15.135:0/461089173 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f2ba8022470 con 0x7f2bb8100f80 2024-05-08T23:15:11.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.008+0000 7f2baffff700 1 --2- 172.21.15.135:0/461089173 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2ba40a11b0 0x7f2ba40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:11.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.008+0000 7f2bb6ffd700 1 --2- 172.21.15.135:0/461089173 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2ba40a11b0 0x7f2ba40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:11.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.008+0000 7f2baffff700 1 -- 172.21.15.135:0/461089173 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2ba80cda80 con 0x7f2bb8100f80 2024-05-08T23:15:11.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.008+0000 7f2bb6ffd700 1 --2- 172.21.15.135:0/461089173 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2ba40a11b0 0x7f2ba40a3670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8100de0 tx=0x7f2ba0007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:11.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.012+0000 7f2baffff700 1 -- 172.21.15.135:0/461089173 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2ba805dd60 con 0x7f2bb8100f80 2024-05-08T23:15:11.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.256+0000 7f2bbd35b700 1 -- 172.21.15.135:0/461089173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bb8068060 con 0x7f2bb8100f80 2024-05-08T23:15:11.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.256+0000 7f2baffff700 1 -- 172.21.15.135:0/461089173 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10927 (secure 0 0 0) 0x7f2ba80972f0 con 0x7f2bb8100f80 2024-05-08T23:15:11.256 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:11.256 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2432614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2432614311},{"type":"v1","addr":"172.21.15.135:6837","nonce":2432614311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T23:14:21.921303+0000","modified":"2024-05-08T23:14:28.351004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24500,"mds_2":24484,"mds_3":24439,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/360966092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":360966092},{"type":"v1","addr":"172.21.15.135:6839","nonce":360966092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6841/1831266531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":1831266531},{"type":"v1","addr":"172.21.15.135:6841","nonce":1831266531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1024532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1024532},{"type":"v1","addr":"172.21.15.179:6835","nonce":1024532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/2957410160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2957410160},{"type":"v1","addr":"172.21.15.179:6837","nonce":2957410160}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/4199708510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":4199708510},{"type":"v1","addr":"172.21.15.195:6835","nonce":4199708510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6837/2390721751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2390721751},{"type":"v1","addr":"172.21.15.195:6837","nonce":2390721751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.179:6839/1135239419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":1135239419},{"type":"v1","addr":"172.21.15.179:6839","nonce":1135239419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6839/1730571841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1730571841},{"type":"v1","addr":"172.21.15.195:6839","nonce":1730571841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T23:15:11.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.259+0000 7f2bbd35b700 1 -- 172.21.15.135:0/461089173 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2ba40a11b0 msgr2=0x7f2ba40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:11.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.259+0000 7f2bbd35b700 1 --2- 172.21.15.135:0/461089173 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2ba40a11b0 0x7f2ba40a3670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8100de0 tx=0x7f2ba0007400 comp rx=0 tx=0).stop 2024-05-08T23:15:11.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.259+0000 7f2bbd35b700 1 -- 172.21.15.135:0/461089173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bb8100f80 msgr2=0x7f2bb819bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:11.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.259+0000 7f2bbd35b700 1 --2- 172.21.15.135:0/461089173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bb8100f80 0x7f2bb819bac0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80036f0 tx=0x7f2ba80047b0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.259+0000 7f2bbd35b700 1 -- 172.21.15.135:0/461089173 shutdown_connections 2024-05-08T23:15:11.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.259+0000 7f2bbd35b700 1 --2- 172.21.15.135:0/461089173 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2ba40a11b0 0x7f2ba40a3670 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.259+0000 7f2bbd35b700 1 --2- 172.21.15.135:0/461089173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bb80ffd90 0x7f2bb8069fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.259+0000 7f2bbd35b700 1 --2- 172.21.15.135:0/461089173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb8101920 0x7f2bb819e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.259+0000 7f2bbd35b700 1 --2- 172.21.15.135:0/461089173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bb8100f80 0x7f2bb819bac0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.259+0000 7f2bbd35b700 1 -- 172.21.15.135:0/461089173 >> 172.21.15.135:0/461089173 conn(0x7f2bb80fb320 msgr2=0x7f2bb8104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:11.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.259+0000 7f2bbd35b700 1 -- 172.21.15.135:0/461089173 shutdown_connections 2024-05-08T23:15:11.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.259+0000 7f2bbd35b700 1 -- 172.21.15.135:0/461089173 wait complete. 2024-05-08T23:15:11.260 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 27 2024-05-08T23:15:11.271 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T23:15:11.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.395+0000 7f6f17be0700 1 -- 172.21.15.135:0/89614372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f10101920 msgr2=0x7f6f101081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:11.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.395+0000 7f6f17be0700 1 --2- 172.21.15.135:0/89614372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f10101920 0x7f6f101081d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800b0d0 tx=0x7f6f0800b3e0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.395+0000 7f6f17be0700 1 -- 172.21.15.135:0/89614372 shutdown_connections 2024-05-08T23:15:11.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.395+0000 7f6f17be0700 1 --2- 172.21.15.135:0/89614372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f10101920 0x7f6f101081d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.395+0000 7f6f17be0700 1 --2- 172.21.15.135:0/89614372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f100ffd90 0x7f6f101001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.395+0000 7f6f17be0700 1 --2- 172.21.15.135:0/89614372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f10100f80 0x7f6f101013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.395+0000 7f6f17be0700 1 -- 172.21.15.135:0/89614372 >> 172.21.15.135:0/89614372 conn(0x7f6f100fb300 msgr2=0x7f6f100fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:11.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.395+0000 7f6f17be0700 1 -- 172.21.15.135:0/89614372 shutdown_connections 2024-05-08T23:15:11.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.395+0000 7f6f17be0700 1 -- 172.21.15.135:0/89614372 wait complete. 2024-05-08T23:15:11.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f17be0700 1 Processor -- start 2024-05-08T23:15:11.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f17be0700 1 -- start start 2024-05-08T23:15:11.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f17be0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f100ffd90 0x7f6f10069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:11.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f17be0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f10100f80 0x7f6f1019e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:11.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f17be0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f10101920 0x7f6f101a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:11.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f17be0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f101a0bc0 con 0x7f6f10101920 2024-05-08T23:15:11.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f17be0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f101a0d30 con 0x7f6f100ffd90 2024-05-08T23:15:11.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f17be0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f101a0ef0 con 0x7f6f10100f80 2024-05-08T23:15:11.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f1617d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f10101920 0x7f6f101a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:11.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f1617d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f10101920 0x7f6f101a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36686/0 (socket says 172.21.15.135:36686) 2024-05-08T23:15:11.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f1617d700 1 -- 172.21.15.135:0/1348442918 learned_addr learned my addr 172.21.15.135:0/1348442918 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:11.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f1517b700 1 --2- 172.21.15.135:0/1348442918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f10100f80 0x7f6f1019e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:11.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f1617d700 1 -- 172.21.15.135:0/1348442918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f10100f80 msgr2=0x7f6f1019e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:11.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f1597c700 1 --2- 172.21.15.135:0/1348442918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f100ffd90 0x7f6f10069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:11.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f1617d700 1 --2- 172.21.15.135:0/1348442918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f10100f80 0x7f6f1019e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f1617d700 1 -- 172.21.15.135:0/1348442918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f100ffd90 msgr2=0x7f6f10069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:11.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f1617d700 1 --2- 172.21.15.135:0/1348442918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f100ffd90 0x7f6f10069cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f1617d700 1 -- 172.21.15.135:0/1348442918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f08009d00 con 0x7f6f10101920 2024-05-08T23:15:11.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.396+0000 7f6f1617d700 1 --2- 172.21.15.135:0/1348442918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f10101920 0x7f6f101a0560 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6f08007bd0 tx=0x7f6f080094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:11.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.397+0000 7f6f06ffd700 1 -- 172.21.15.135:0/1348442918 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0800e040 con 0x7f6f10101920 2024-05-08T23:15:11.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.397+0000 7f6f06ffd700 1 -- 172.21.15.135:0/1348442918 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f08012dc0 con 0x7f6f10101920 2024-05-08T23:15:11.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.397+0000 7f6f17be0700 1 -- 172.21.15.135:0/1348442918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f101a1170 con 0x7f6f10101920 2024-05-08T23:15:11.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.397+0000 7f6f06ffd700 1 -- 172.21.15.135:0/1348442918 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0801b450 con 0x7f6f10101920 2024-05-08T23:15:11.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.397+0000 7f6f17be0700 1 -- 172.21.15.135:0/1348442918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f101a15f0 con 0x7f6f10101920 2024-05-08T23:15:11.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.397+0000 7f6f17be0700 1 -- 172.21.15.135:0/1348442918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f10107140 con 0x7f6f10101920 2024-05-08T23:15:11.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.399+0000 7f6f06ffd700 1 -- 172.21.15.135:0/1348442918 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f6f0801d610 con 0x7f6f10101920 2024-05-08T23:15:11.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.399+0000 7f6f06ffd700 1 --2- 172.21.15.135:0/1348442918 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f6efc0a11b0 0x7f6efc0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:11.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.399+0000 7f6f06ffd700 1 -- 172.21.15.135:0/1348442918 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6f080ceef0 con 0x7f6f10101920 2024-05-08T23:15:11.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.399+0000 7f6f1597c700 1 --2- 172.21.15.135:0/1348442918 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f6efc0a11b0 0x7f6efc0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:11.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.400+0000 7f6f1597c700 1 --2- 172.21.15.135:0/1348442918 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f6efc0a11b0 0x7f6efc0a3670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6f10100de0 tx=0x7f6f00005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:11.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.403+0000 7f6f06ffd700 1 -- 172.21.15.135:0/1348442918 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6f08098760 con 0x7f6f10101920 2024-05-08T23:15:11.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:11 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/958524189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:15:11.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:11 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2681988891' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:15:11.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:11 smithi179 ceph-mon[46314]: pgmap v248: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-08T23:15:11.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:11 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/461089173' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:15:11.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.602+0000 7f6f17be0700 1 -- 172.21.15.135:0/1348442918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f1010b5b0 con 0x7f6f10101920 2024-05-08T23:15:11.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.604+0000 7f6f06ffd700 1 -- 172.21.15.135:0/1348442918 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22176 (secure 0 0 0) 0x7f6f080a2070 con 0x7f6f10101920 2024-05-08T23:15:11.603 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:11.603 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":83,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:14:22.924945+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T23:14:19.726838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T23:14:21.097732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:15:11.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.606+0000 7f6f17be0700 1 -- 172.21.15.135:0/1348442918 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f6efc0a11b0 msgr2=0x7f6efc0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:11.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.606+0000 7f6f17be0700 1 --2- 172.21.15.135:0/1348442918 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f6efc0a11b0 0x7f6efc0a3670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6f10100de0 tx=0x7f6f00005cf0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.606+0000 7f6f17be0700 1 -- 172.21.15.135:0/1348442918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f10101920 msgr2=0x7f6f101a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:11.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.606+0000 7f6f17be0700 1 --2- 172.21.15.135:0/1348442918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f10101920 0x7f6f101a0560 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6f08007bd0 tx=0x7f6f080094f0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.606+0000 7f6f17be0700 1 -- 172.21.15.135:0/1348442918 shutdown_connections 2024-05-08T23:15:11.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.606+0000 7f6f17be0700 1 --2- 172.21.15.135:0/1348442918 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f6efc0a11b0 0x7f6efc0a3670 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.606+0000 7f6f17be0700 1 --2- 172.21.15.135:0/1348442918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f10101920 0x7f6f101a0560 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.606+0000 7f6f17be0700 1 --2- 172.21.15.135:0/1348442918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f100ffd90 0x7f6f10069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.606+0000 7f6f17be0700 1 --2- 172.21.15.135:0/1348442918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f10100f80 0x7f6f1019e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.606+0000 7f6f17be0700 1 -- 172.21.15.135:0/1348442918 >> 172.21.15.135:0/1348442918 conn(0x7f6f100fb300 msgr2=0x7f6f10104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:11.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.606+0000 7f6f17be0700 1 -- 172.21.15.135:0/1348442918 shutdown_connections 2024-05-08T23:15:11.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.606+0000 7f6f17be0700 1 -- 172.21.15.135:0/1348442918 wait complete. 2024-05-08T23:15:11.617 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:11 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/958524189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:15:11.617 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:11 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2681988891' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:15:11.617 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:11 smithi135 ceph-mon[42440]: pgmap v248: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-08T23:15:11.617 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:11 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/461089173' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:15:11.619 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:15:11.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:11 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/958524189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:15:11.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:11 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2681988891' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:15:11.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:11 smithi195 ceph-mon[46516]: pgmap v248: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-08T23:15:11.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:11 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/461089173' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:15:11.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.741+0000 7f2331d8f700 1 -- 172.21.15.135:0/2133642819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c101910 msgr2=0x7f232c103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:11.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.741+0000 7f2331d8f700 1 --2- 172.21.15.135:0/2133642819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c101910 0x7f232c103d00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2320009990 tx=0x7f2320009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.742+0000 7f2331d8f700 1 -- 172.21.15.135:0/2133642819 shutdown_connections 2024-05-08T23:15:11.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.742+0000 7f2331d8f700 1 --2- 172.21.15.135:0/2133642819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f232c106b70 0x7f232c108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.742+0000 7f2331d8f700 1 --2- 172.21.15.135:0/2133642819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c101910 0x7f232c103d00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.742+0000 7f2331d8f700 1 --2- 172.21.15.135:0/2133642819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f232c104240 0x7f232c106630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.742+0000 7f2331d8f700 1 -- 172.21.15.135:0/2133642819 >> 172.21.15.135:0/2133642819 conn(0x7f232c0fb300 msgr2=0x7f232c0fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:11.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.742+0000 7f2331d8f700 1 -- 172.21.15.135:0/2133642819 shutdown_connections 2024-05-08T23:15:11.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.742+0000 7f2331d8f700 1 -- 172.21.15.135:0/2133642819 wait complete. 2024-05-08T23:15:11.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.742+0000 7f2331d8f700 1 Processor -- start 2024-05-08T23:15:11.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.742+0000 7f2331d8f700 1 -- start start 2024-05-08T23:15:11.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f2331d8f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f232c101910 0x7f232c196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:11.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f2331d8f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c104240 0x7f232c1972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:11.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f2331d8f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f232c106b70 0x7f232c19e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:11.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f2331d8f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c19e8d0 con 0x7f232c104240 2024-05-08T23:15:11.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f2331d8f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c19ea10 con 0x7f232c106b70 2024-05-08T23:15:11.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f2331d8f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c19eba0 con 0x7f232c101910 2024-05-08T23:15:11.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f232affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c104240 0x7f232c1972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:11.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f232affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c104240 0x7f232c1972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36710/0 (socket says 172.21.15.135:36710) 2024-05-08T23:15:11.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f232b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f232c101910 0x7f232c196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:11.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f232affd700 1 -- 172.21.15.135:0/833127920 learned_addr learned my addr 172.21.15.135:0/833127920 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:11.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f232bfff700 1 --2- 172.21.15.135:0/833127920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f232c106b70 0x7f232c19e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:11.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f232affd700 1 -- 172.21.15.135:0/833127920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f232c101910 msgr2=0x7f232c196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:11.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f232affd700 1 --2- 172.21.15.135:0/833127920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f232c101910 0x7f232c196da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f232affd700 1 -- 172.21.15.135:0/833127920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f232c106b70 msgr2=0x7f232c19e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:11.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f232affd700 1 --2- 172.21.15.135:0/833127920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f232c106b70 0x7f232c19e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f232affd700 1 -- 172.21.15.135:0/833127920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200095f0 con 0x7f232c104240 2024-05-08T23:15:11.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f232affd700 1 --2- 172.21.15.135:0/833127920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c104240 0x7f232c1972e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f231c00d950 tx=0x7f231c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:11.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f2328ff9700 1 -- 172.21.15.135:0/833127920 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c009940 con 0x7f232c104240 2024-05-08T23:15:11.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f2328ff9700 1 -- 172.21.15.135:0/833127920 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f231c010460 con 0x7f232c104240 2024-05-08T23:15:11.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f2331d8f700 1 -- 172.21.15.135:0/833127920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c19ee80 con 0x7f232c104240 2024-05-08T23:15:11.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f2328ff9700 1 -- 172.21.15.135:0/833127920 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00f620 con 0x7f232c104240 2024-05-08T23:15:11.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.743+0000 7f2331d8f700 1 -- 172.21.15.135:0/833127920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c19f300 con 0x7f232c104240 2024-05-08T23:15:11.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.744+0000 7f2331d8f700 1 -- 172.21.15.135:0/833127920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232c0fce80 con 0x7f232c104240 2024-05-08T23:15:11.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.745+0000 7f2328ff9700 1 -- 172.21.15.135:0/833127920 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f231c0108d0 con 0x7f232c104240 2024-05-08T23:15:11.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.746+0000 7f2328ff9700 1 --2- 172.21.15.135:0/833127920 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f23140a11b0 0x7f23140a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:11.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.746+0000 7f232b7fe700 1 --2- 172.21.15.135:0/833127920 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f23140a11b0 0x7f23140a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:11.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.746+0000 7f2328ff9700 1 -- 172.21.15.135:0/833127920 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f231c0cc710 con 0x7f232c104240 2024-05-08T23:15:11.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.746+0000 7f232b7fe700 1 --2- 172.21.15.135:0/833127920 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f23140a11b0 0x7f23140a3670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f232000b5c0 tx=0x7f2320003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:11.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.750+0000 7f2328ff9700 1 -- 172.21.15.135:0/833127920 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f231c095ef0 con 0x7f232c104240 2024-05-08T23:15:11.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.994+0000 7f2331d8f700 1 -- 172.21.15.135:0/833127920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f232c068060 con 0x7f232c104240 2024-05-08T23:15:11.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.995+0000 7f2328ff9700 1 -- 172.21.15.135:0/833127920 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10927 (secure 0 0 0) 0x7f231c099510 con 0x7f232c104240 2024-05-08T23:15:11.995 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:11.995 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2432614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2432614311},{"type":"v1","addr":"172.21.15.135:6837","nonce":2432614311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T23:14:21.921303+0000","modified":"2024-05-08T23:14:28.351004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24500,"mds_2":24484,"mds_3":24439,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/360966092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":360966092},{"type":"v1","addr":"172.21.15.135:6839","nonce":360966092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6841/1831266531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":1831266531},{"type":"v1","addr":"172.21.15.135:6841","nonce":1831266531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1024532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1024532},{"type":"v1","addr":"172.21.15.179:6835","nonce":1024532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/2957410160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2957410160},{"type":"v1","addr":"172.21.15.179:6837","nonce":2957410160}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/4199708510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":4199708510},{"type":"v1","addr":"172.21.15.195:6835","nonce":4199708510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6837/2390721751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2390721751},{"type":"v1","addr":"172.21.15.195:6837","nonce":2390721751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.179:6839/1135239419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":1135239419},{"type":"v1","addr":"172.21.15.179:6839","nonce":1135239419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6839/1730571841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1730571841},{"type":"v1","addr":"172.21.15.195:6839","nonce":1730571841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T23:15:11.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.997+0000 7f2331d8f700 1 -- 172.21.15.135:0/833127920 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f23140a11b0 msgr2=0x7f23140a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:11.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.997+0000 7f2331d8f700 1 --2- 172.21.15.135:0/833127920 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f23140a11b0 0x7f23140a3670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f232000b5c0 tx=0x7f2320003790 comp rx=0 tx=0).stop 2024-05-08T23:15:11.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.997+0000 7f2331d8f700 1 -- 172.21.15.135:0/833127920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c104240 msgr2=0x7f232c1972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:11.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.997+0000 7f2331d8f700 1 --2- 172.21.15.135:0/833127920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c104240 0x7f232c1972e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f231c00d950 tx=0x7f231c00dc60 comp rx=0 tx=0).stop 2024-05-08T23:15:11.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.997+0000 7f2331d8f700 1 -- 172.21.15.135:0/833127920 shutdown_connections 2024-05-08T23:15:11.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.997+0000 7f2331d8f700 1 --2- 172.21.15.135:0/833127920 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f23140a11b0 0x7f23140a3670 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.997+0000 7f2331d8f700 1 --2- 172.21.15.135:0/833127920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f232c101910 0x7f232c196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.997+0000 7f2331d8f700 1 --2- 172.21.15.135:0/833127920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f232c106b70 0x7f232c19e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.997+0000 7f2331d8f700 1 --2- 172.21.15.135:0/833127920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c104240 0x7f232c1972e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:11.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.997+0000 7f2331d8f700 1 -- 172.21.15.135:0/833127920 >> 172.21.15.135:0/833127920 conn(0x7f232c0fb300 msgr2=0x7f232c1037c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:11.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.998+0000 7f2331d8f700 1 -- 172.21.15.135:0/833127920 shutdown_connections 2024-05-08T23:15:11.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:11.998+0000 7f2331d8f700 1 -- 172.21.15.135:0/833127920 wait complete. 2024-05-08T23:15:11.999 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 27 2024-05-08T23:15:12.010 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-08T23:14:21.921303+0000', 'modified': '2024-05-08T23:14:28.351004+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24508, 'mds_1': 24500, 'mds_2': 24484, 'mds_3': 24439, 'mds_4': 24419}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14616': {'gid': 14616, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6839/360966092', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 360966092}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 360966092}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14622': {'gid': 14622, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6841/1831266531', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6840', 'nonce': 1831266531}, {'type': 'v1', 'addr': '172.21.15.135:6841', 'nonce': 1831266531}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24419': {'gid': 24419, 'name': 'k', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.179:6833/3953517264', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6832', 'nonce': 3953517264}, {'type': 'v1', 'addr': '172.21.15.179:6833', 'nonce': 3953517264}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24439': {'gid': 24439, 'name': 'l', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.195:6833/2264761272', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6832', 'nonce': 2264761272}, {'type': 'v1', 'addr': '172.21.15.195:6833', 'nonce': 2264761272}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24443': {'gid': 24443, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6835/1024532', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 1024532}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 1024532}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6837/2957410160', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6836', 'nonce': 2957410160}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 2957410160}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24472': {'gid': 24472, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.195:6835/4199708510', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6834', 'nonce': 4199708510}, {'type': 'v1', 'addr': '172.21.15.195:6835', 'nonce': 4199708510}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24484': {'gid': 24484, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.195:6837/2390721751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6836', 'nonce': 2390721751}, {'type': 'v1', 'addr': '172.21.15.195:6837', 'nonce': 2390721751}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24500': {'gid': 24500, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.179:6839/1135239419', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6838', 'nonce': 1135239419}, {'type': 'v1', 'addr': '172.21.15.179:6839', 'nonce': 1135239419}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24508': {'gid': 24508, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.195:6839/1730571841', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6838', 'nonce': 1730571841}, {'type': 'v1', 'addr': '172.21.15.195:6839', 'nonce': 1730571841}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T23:15:12.010 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-08T23:15:12.011 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2024-05-08T23:15:12.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.135+0000 7f733d131700 1 -- 172.21.15.135:0/3829491191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7338100f20 msgr2=0x7f7338101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.135+0000 7f733d131700 1 --2- 172.21.15.135:0/3829491191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7338100f20 0x7f7338101360 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7328009990 tx=0x7f7328009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.135+0000 7f733d131700 1 -- 172.21.15.135:0/3829491191 shutdown_connections 2024-05-08T23:15:12.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.135+0000 7f733d131700 1 --2- 172.21.15.135:0/3829491191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7338102ab0 0x7f73381093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.135+0000 7f733d131700 1 --2- 172.21.15.135:0/3829491191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7338100f20 0x7f7338101360 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.135+0000 7f733d131700 1 --2- 172.21.15.135:0/3829491191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73381020f0 0x7f7338102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.135+0000 7f733d131700 1 -- 172.21.15.135:0/3829491191 >> 172.21.15.135:0/3829491191 conn(0x7f73380fc4e0 msgr2=0x7f73380fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.135+0000 7f733d131700 1 -- 172.21.15.135:0/3829491191 shutdown_connections 2024-05-08T23:15:12.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.135+0000 7f733d131700 1 -- 172.21.15.135:0/3829491191 wait complete. 2024-05-08T23:15:12.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.136+0000 7f733d131700 1 Processor -- start 2024-05-08T23:15:12.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.136+0000 7f733d131700 1 -- start start 2024-05-08T23:15:12.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733d131700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7338100f20 0x7f7338196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733d131700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73381020f0 0x7f7338197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733d131700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7338102ab0 0x7f733819e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733d131700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733819ea10 con 0x7f7338102ab0 2024-05-08T23:15:12.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733d131700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733819eb50 con 0x7f73381020f0 2024-05-08T23:15:12.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733d131700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733819ece0 con 0x7f7338100f20 2024-05-08T23:15:12.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7338102ab0 0x7f733819e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7338102ab0 0x7f733819e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36734/0 (socket says 172.21.15.135:36734) 2024-05-08T23:15:12.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733759e700 1 -- 172.21.15.135:0/2286138815 learned_addr learned my addr 172.21.15.135:0/2286138815 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f7336d9d700 1 --2- 172.21.15.135:0/2286138815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7338100f20 0x7f7338196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733659c700 1 --2- 172.21.15.135:0/2286138815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73381020f0 0x7f7338197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733759e700 1 -- 172.21.15.135:0/2286138815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7338100f20 msgr2=0x7f7338196ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733759e700 1 --2- 172.21.15.135:0/2286138815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7338100f20 0x7f7338196ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733759e700 1 -- 172.21.15.135:0/2286138815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73381020f0 msgr2=0x7f7338197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733759e700 1 --2- 172.21.15.135:0/2286138815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73381020f0 0x7f7338197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733759e700 1 -- 172.21.15.135:0/2286138815 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73280095f0 con 0x7f7338102ab0 2024-05-08T23:15:12.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733759e700 1 --2- 172.21.15.135:0/2286138815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7338102ab0 0x7f733819e440 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7330007ee0 tx=0x7f733000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f731ffff700 1 -- 172.21.15.135:0/2286138815 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330017070 con 0x7f7338102ab0 2024-05-08T23:15:12.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f733d131700 1 -- 172.21.15.135:0/2286138815 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733819efc0 con 0x7f7338102ab0 2024-05-08T23:15:12.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f731ffff700 1 -- 172.21.15.135:0/2286138815 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f733000f040 con 0x7f7338102ab0 2024-05-08T23:15:12.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.137+0000 7f731ffff700 1 -- 172.21.15.135:0/2286138815 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330005740 con 0x7f7338102ab0 2024-05-08T23:15:12.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.138+0000 7f733d131700 1 -- 172.21.15.135:0/2286138815 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733819f3f0 con 0x7f7338102ab0 2024-05-08T23:15:12.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.139+0000 7f731ffff700 1 -- 172.21.15.135:0/2286138815 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f73300058a0 con 0x7f7338102ab0 2024-05-08T23:15:12.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.140+0000 7f731ffff700 1 --2- 172.21.15.135:0/2286138815 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73200a11b0 0x7f73200a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.140+0000 7f731ffff700 1 -- 172.21.15.135:0/2286138815 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f73300cc180 con 0x7f7338102ab0 2024-05-08T23:15:12.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.140+0000 7f7336d9d700 1 --2- 172.21.15.135:0/2286138815 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73200a11b0 0x7f73200a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.140+0000 7f7336d9d700 1 --2- 172.21.15.135:0/2286138815 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73200a11b0 0x7f73200a3670 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7328000c00 tx=0x7f7328005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.141+0000 7f73492ebb80 1 Processor -- start 2024-05-08T23:15:12.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.141+0000 7f73492ebb80 1 -- start start 2024-05-08T23:15:12.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.141+0000 7f73492ebb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fb4f0 0x555a176fb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.141+0000 7f73492ebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fbe50 0x555a176fc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.141+0000 7f73492ebb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 0x555a176fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.141+0000 7f73492ebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a17652100 con 0x555a176fbe50 2024-05-08T23:15:12.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.141+0000 7f73492ebb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a1764fac0 con 0x555a176fb4f0 2024-05-08T23:15:12.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.141+0000 7f73492ebb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a1764b3b0 con 0x555a176fc810 2024-05-08T23:15:12.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.141+0000 7f733659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fbe50 0x555a176fc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.142+0000 7f733659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fbe50 0x555a176fc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36746/0 (socket says 172.21.15.135:36746) 2024-05-08T23:15:12.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.142+0000 7f733659c700 1 -- 172.21.15.135:0/933722369 learned_addr learned my addr 172.21.15.135:0/933722369 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.142+0000 7f733759e700 1 --2- 172.21.15.135:0/933722369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 0x555a176fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.142+0000 7f7336d9d700 1 --2- 172.21.15.135:0/933722369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fb4f0 0x555a176fb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.142+0000 7f733659c700 1 -- 172.21.15.135:0/933722369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 msgr2=0x555a176fcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.142+0000 7f733659c700 1 --2- 172.21.15.135:0/933722369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 0x555a176fcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.142+0000 7f733659c700 1 -- 172.21.15.135:0/933722369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fb4f0 msgr2=0x555a176fb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.142+0000 7f733659c700 1 --2- 172.21.15.135:0/933722369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fb4f0 0x555a176fb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.142+0000 7f733659c700 1 -- 172.21.15.135:0/933722369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a174cc360 con 0x555a176fbe50 2024-05-08T23:15:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.142+0000 7f733659c700 1 --2- 172.21.15.135:0/933722369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fbe50 0x555a176fc2d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f732c009c40 tx=0x7f732c009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e582d032c85dc3a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.142+0000 7f731d7fa700 1 -- 172.21.15.135:0/933722369 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c00eb00 con 0x555a176fbe50 2024-05-08T23:15:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.142+0000 7f731d7fa700 1 -- 172.21.15.135:0/933722369 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f732c004cf0 con 0x555a176fbe50 2024-05-08T23:15:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.142+0000 7f731d7fa700 1 -- 172.21.15.135:0/933722369 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c0055f0 con 0x555a176fbe50 2024-05-08T23:15:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.143+0000 7f73492ebb80 1 -- 172.21.15.135:0/933722369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fbe50 msgr2=0x555a176fc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.143+0000 7f73492ebb80 1 --2- 172.21.15.135:0/933722369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fbe50 0x555a176fc2d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f732c009c40 tx=0x7f732c009f50 comp rx=0 tx=0).stop 2024-05-08T23:15:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.143+0000 7f73492ebb80 1 -- 172.21.15.135:0/933722369 shutdown_connections 2024-05-08T23:15:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.143+0000 7f73492ebb80 1 --2- 172.21.15.135:0/933722369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 0x555a176fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.143+0000 7f73492ebb80 1 --2- 172.21.15.135:0/933722369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fb4f0 0x555a176fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.143+0000 7f73492ebb80 1 --2- 172.21.15.135:0/933722369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fbe50 0x555a176fc2d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.143+0000 7f73492ebb80 1 -- 172.21.15.135:0/933722369 >> 172.21.15.135:0/933722369 conn(0x555a176591c0 msgr2=0x555a176f5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.143+0000 7f73492ebb80 1 -- 172.21.15.135:0/933722369 shutdown_connections 2024-05-08T23:15:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.143+0000 7f73492ebb80 1 -- 172.21.15.135:0/933722369 wait complete. 2024-05-08T23:15:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.143+0000 7f73492ebb80 1 -- start start 2024-05-08T23:15:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.143+0000 7f73492ebb80 1 Processor -- start 2024-05-08T23:15:12.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.143+0000 7f73492ebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fb4f0 0x555a17704d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.143+0000 7f73492ebb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fbe50 0x555a17705260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f73492ebb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 0x555a1770c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f73492ebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a175e7510 con 0x555a176fb4f0 2024-05-08T23:15:12.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f73492ebb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a175e71b0 con 0x555a176fbe50 2024-05-08T23:15:12.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f73492ebb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a174ce650 con 0x555a176fc810 2024-05-08T23:15:12.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f73492ebb80 10 client.0 _ll_register_callbacks cb 0x555a175f0ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:12.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f7336d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fb4f0 0x555a17704d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f7336d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fb4f0 0x555a17704d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36748/0 (socket says 172.21.15.135:36748) 2024-05-08T23:15:12.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f7336d9d700 1 -- 172.21.15.135:0/4156074020 learned_addr learned my addr 172.21.15.135:0/4156074020 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f733659c700 1 --2- 172.21.15.135:0/4156074020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fbe50 0x555a17705260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f733759e700 1 --2- 172.21.15.135:0/4156074020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 0x555a1770c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f7336d9d700 1 -- 172.21.15.135:0/4156074020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 msgr2=0x555a1770c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f7336d9d700 1 --2- 172.21.15.135:0/4156074020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 0x555a1770c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f7336d9d700 1 -- 172.21.15.135:0/4156074020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fbe50 msgr2=0x555a17705260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f7336d9d700 1 --2- 172.21.15.135:0/4156074020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fbe50 0x555a17705260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f7336d9d700 1 -- 172.21.15.135:0/4156074020 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732c0098a0 con 0x555a176fb4f0 2024-05-08T23:15:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f7336d9d700 1 --2- 172.21.15.135:0/4156074020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fb4f0 0x555a17704d20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f73280057c0 tx=0x7f7328009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79712141feba27e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f731aff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f731aff5700 1 -- 172.21.15.135:0/4156074020 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732802c070 con 0x555a176fb4f0 2024-05-08T23:15:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f731aff5700 1 -- 172.21.15.135:0/4156074020 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7328004710 con 0x555a176fb4f0 2024-05-08T23:15:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f73492ebb80 1 -- 172.21.15.135:0/4156074020 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a175a4220 con 0x555a176fb4f0 2024-05-08T23:15:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f731aff5700 1 -- 172.21.15.135:0/4156074020 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f732801e070 con 0x555a176fb4f0 2024-05-08T23:15:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f73492ebb80 10 client.15039 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.144+0000 7f73492ebb80 1 -- 172.21.15.135:0/4156074020 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x555a17478b10 con 0x555a176fb4f0 2024-05-08T23:15:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.145+0000 7f731aff5700 1 -- 172.21.15.135:0/4156074020 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555a175a4220 con 0x555a176fb4f0 2024-05-08T23:15:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.145+0000 7f731aff5700 1 -- 172.21.15.135:0/4156074020 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f732803b070 con 0x555a176fb4f0 2024-05-08T23:15:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.145+0000 7f73492ebb80 10 client.15039 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.145+0000 7f73492ebb80 10 client.15039 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-08T23:15:12.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.145+0000 7f73492ebb80 20 client.15039 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:12.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.145+0000 7f73492ebb80 1 --2- 172.21.15.135:0/4156074020 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x555a1770f490 0x555a177152d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.145+0000 7f73492ebb80 4 client.15039 mds_command: new command op to 24419 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:15:12.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.145+0000 7f73492ebb80 1 -- 172.21.15.135:0/4156074020 --> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a176ca7c0 con 0x555a1770f490 2024-05-08T23:15:12.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.145+0000 7f733659c700 1 --2- 172.21.15.135:0/4156074020 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x555a1770f490 0x555a177152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.145+0000 7f731aff5700 10 client.15039 ms_handle_connect on v2:172.21.15.179:6832/3953517264 2024-05-08T23:15:12.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.145+0000 7f733659c700 1 --2- 172.21.15.135:0/4156074020 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x555a1770f490 0x555a177152d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b53b92905f3b165c server_cookie=2a623125ff8955c2 in_seq=0 out_seq=0 2024-05-08T23:15:12.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.146+0000 7f731aff5700 1 -- 172.21.15.135:0/4156074020 <== mds.4 v2:172.21.15.179:6832/3953517264 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555a176ca7c0 con 0x555a1770f490 2024-05-08T23:15:12.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.146+0000 7f731aff5700 10 client.15039 handle_command_reply: tid=0 2024-05-08T23:15:12.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.146+0000 7f73492ebb80 1 client.15039 shutdown 2024-05-08T23:15:12.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.146+0000 7f73492ebb80 1 -- 172.21.15.135:0/4156074020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fb4f0 msgr2=0x555a17704d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.146+0000 7f73492ebb80 1 --2- 172.21.15.135:0/4156074020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fb4f0 0x555a17704d20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f73280057c0 tx=0x7f7328009310 comp rx=0 tx=0).stop 2024-05-08T23:15:12.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.146+0000 7f73492ebb80 1 -- 172.21.15.135:0/4156074020 shutdown_connections 2024-05-08T23:15:12.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.146+0000 7f73492ebb80 1 --2- 172.21.15.135:0/4156074020 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x555a1770f490 0x555a177152d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.146+0000 7f73492ebb80 1 --2- 172.21.15.135:0/4156074020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 0x555a1770c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.146+0000 7f73492ebb80 1 --2- 172.21.15.135:0/4156074020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fb4f0 0x555a17704d20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.146+0000 7f73492ebb80 1 --2- 172.21.15.135:0/4156074020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fbe50 0x555a17705260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.146+0000 7f731aff5700 0 client.15039 ms_handle_reset on v2:172.21.15.179:6832/3953517264 2024-05-08T23:15:12.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.146+0000 7f73492ebb80 1 -- 172.21.15.135:0/4156074020 >> 172.21.15.135:0/4156074020 conn(0x555a176591c0 msgr2=0x555a176f5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.146+0000 7f73492ebb80 1 -- 172.21.15.135:0/4156074020 shutdown_connections 2024-05-08T23:15:12.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.146+0000 7f73492ebb80 1 -- 172.21.15.135:0/4156074020 wait complete. 2024-05-08T23:15:12.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.146+0000 7f73492ebb80 20 client.15039 trim_cache size 0 max 16384 2024-05-08T23:15:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.164+0000 7f73492ebb80 1 Processor -- start 2024-05-08T23:15:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.164+0000 7f73492ebb80 1 -- start start 2024-05-08T23:15:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.164+0000 7f73492ebb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fb4f0 0x555a176fb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.164+0000 7f73492ebb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fbe50 0x555a1770c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.164+0000 7f73492ebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fc810 0x555a1770c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.164+0000 7f73492ebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a17648010 con 0x555a176fc810 2024-05-08T23:15:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.164+0000 7f73492ebb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a175ea5a0 con 0x555a176fbe50 2024-05-08T23:15:12.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.164+0000 7f73492ebb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a17710e00 con 0x555a176fb4f0 2024-05-08T23:15:12.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.164+0000 7f733759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fc810 0x555a1770c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.164+0000 7f733759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fc810 0x555a1770c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36762/0 (socket says 172.21.15.135:36762) 2024-05-08T23:15:12.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.164+0000 7f733759e700 1 -- 172.21.15.135:0/3991789455 learned_addr learned my addr 172.21.15.135:0/3991789455 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f7336d9d700 1 --2- 172.21.15.135:0/3991789455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fb4f0 0x555a176fb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f733759e700 1 -- 172.21.15.135:0/3991789455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fb4f0 msgr2=0x555a176fb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f733759e700 1 --2- 172.21.15.135:0/3991789455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fb4f0 0x555a176fb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f733759e700 1 -- 172.21.15.135:0/3991789455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fbe50 msgr2=0x555a1770c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f733759e700 1 --2- 172.21.15.135:0/3991789455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fbe50 0x555a1770c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f733759e700 1 -- 172.21.15.135:0/3991789455 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a17611510 con 0x555a176fc810 2024-05-08T23:15:12.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f733759e700 1 --2- 172.21.15.135:0/3991789455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fc810 0x555a1770c950 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f733000d7b0 tx=0x7f733000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e704d96c56bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f731dffb700 1 -- 172.21.15.135:0/3991789455 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73300b90c0 con 0x555a176fc810 2024-05-08T23:15:12.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f731dffb700 1 -- 172.21.15.135:0/3991789455 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7330099620 con 0x555a176fc810 2024-05-08T23:15:12.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f731dffb700 1 -- 172.21.15.135:0/3991789455 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73300840b0 con 0x555a176fc810 2024-05-08T23:15:12.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f73492ebb80 1 -- 172.21.15.135:0/3991789455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fc810 msgr2=0x555a1770c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f73492ebb80 1 --2- 172.21.15.135:0/3991789455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fc810 0x555a1770c950 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f733000d7b0 tx=0x7f733000b040 comp rx=0 tx=0).stop 2024-05-08T23:15:12.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f73492ebb80 1 -- 172.21.15.135:0/3991789455 shutdown_connections 2024-05-08T23:15:12.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f73492ebb80 1 --2- 172.21.15.135:0/3991789455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fb4f0 0x555a176fb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f73492ebb80 1 --2- 172.21.15.135:0/3991789455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fc810 0x555a1770c950 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f73492ebb80 1 --2- 172.21.15.135:0/3991789455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fbe50 0x555a1770c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.165+0000 7f73492ebb80 1 -- 172.21.15.135:0/3991789455 >> 172.21.15.135:0/3991789455 conn(0x555a176591c0 msgr2=0x555a176fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f73492ebb80 1 -- 172.21.15.135:0/3991789455 shutdown_connections 2024-05-08T23:15:12.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f73492ebb80 1 -- 172.21.15.135:0/3991789455 wait complete. 2024-05-08T23:15:12.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f73492ebb80 1 -- start start 2024-05-08T23:15:12.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f73492ebb80 1 Processor -- start 2024-05-08T23:15:12.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f73492ebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fb4f0 0x555a17709260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f73492ebb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fbe50 0x555a1770b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f73492ebb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 0x555a1770bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f73492ebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a1770c230 con 0x555a176fb4f0 2024-05-08T23:15:12.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f73492ebb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a1770c3a0 con 0x555a176fbe50 2024-05-08T23:15:12.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f73492ebb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a1770c560 con 0x555a176fc810 2024-05-08T23:15:12.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f73492ebb80 10 client.0 _ll_register_callbacks cb 0x555a175f0ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:12.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f7336d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fb4f0 0x555a17709260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f7336d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fb4f0 0x555a17709260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36766/0 (socket says 172.21.15.135:36766) 2024-05-08T23:15:12.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f7336d9d700 1 -- 172.21.15.135:0/2652504187 learned_addr learned my addr 172.21.15.135:0/2652504187 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f733759e700 1 --2- 172.21.15.135:0/2652504187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 0x555a1770bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f7336d9d700 1 -- 172.21.15.135:0/2652504187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 msgr2=0x555a1770bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f7336d9d700 1 --2- 172.21.15.135:0/2652504187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 0x555a1770bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f7336d9d700 1 -- 172.21.15.135:0/2652504187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fbe50 msgr2=0x555a1770b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f7336d9d700 1 --2- 172.21.15.135:0/2652504187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fbe50 0x555a1770b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f7336d9d700 1 -- 172.21.15.135:0/2652504187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7330082e70 con 0x555a176fb4f0 2024-05-08T23:15:12.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.166+0000 7f733759e700 1 --2- 172.21.15.135:0/2652504187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 0x555a1770bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:12.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f7336d9d700 1 --2- 172.21.15.135:0/2652504187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fb4f0 0x555a17709260 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7328009ce0 tx=0x7f7328004190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e892a6a247fdf7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f731aff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f731aff5700 1 -- 172.21.15.135:0/2652504187 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732802c040 con 0x555a176fb4f0 2024-05-08T23:15:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f731aff5700 1 -- 172.21.15.135:0/2652504187 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7328004920 con 0x555a176fb4f0 2024-05-08T23:15:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f73492ebb80 1 -- 172.21.15.135:0/2652504187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f732c004cf0 con 0x555a176fb4f0 2024-05-08T23:15:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f731aff5700 1 -- 172.21.15.135:0/2652504187 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f732801e040 con 0x555a176fb4f0 2024-05-08T23:15:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f73492ebb80 10 client.15045 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f73492ebb80 1 -- 172.21.15.135:0/2652504187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x555a174d0c80 con 0x555a176fb4f0 2024-05-08T23:15:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f731aff5700 1 -- 172.21.15.135:0/2652504187 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f732c004cf0 con 0x555a176fb4f0 2024-05-08T23:15:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f731aff5700 1 -- 172.21.15.135:0/2652504187 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f732800b820 con 0x555a176fb4f0 2024-05-08T23:15:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f73492ebb80 10 client.15045 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f73492ebb80 10 client.15045 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-08T23:15:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f73492ebb80 20 client.15045 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f73492ebb80 1 --2- 172.21.15.135:0/2652504187 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x555a1776b830 0x555a17768110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f73492ebb80 4 client.15045 mds_command: new command op to 24419 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T23:15:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.167+0000 7f73492ebb80 1 -- 172.21.15.135:0/2652504187 --> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555a17643e70 con 0x555a1776b830 2024-05-08T23:15:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f733659c700 1 --2- 172.21.15.135:0/2652504187 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x555a1776b830 0x555a17768110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f731aff5700 10 client.15045 ms_handle_connect on v2:172.21.15.179:6832/3953517264 2024-05-08T23:15:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f733659c700 1 --2- 172.21.15.135:0/2652504187 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x555a1776b830 0x555a17768110 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=271343b6a738a1a2 server_cookie=c92954844c3558fc in_seq=0 out_seq=0 2024-05-08T23:15:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f731aff5700 1 -- 172.21.15.135:0/2652504187 <== mds.4 v2:172.21.15.179:6832/3953517264 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x555a17643e70 con 0x555a1776b830 2024-05-08T23:15:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f731aff5700 10 client.15045 handle_command_reply: tid=0 2024-05-08T23:15:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f73492ebb80 1 client.15045 shutdown 2024-05-08T23:15:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f73492ebb80 1 -- 172.21.15.135:0/2652504187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fb4f0 msgr2=0x555a17709260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f73492ebb80 1 --2- 172.21.15.135:0/2652504187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fb4f0 0x555a17709260 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7328009ce0 tx=0x7f7328004190 comp rx=0 tx=0).stop 2024-05-08T23:15:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f73492ebb80 1 -- 172.21.15.135:0/2652504187 shutdown_connections 2024-05-08T23:15:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f73492ebb80 1 --2- 172.21.15.135:0/2652504187 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x555a1776b830 0x555a17768110 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f73492ebb80 1 --2- 172.21.15.135:0/2652504187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a176fc810 0x555a1770bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f73492ebb80 1 --2- 172.21.15.135:0/2652504187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555a176fb4f0 0x555a17709260 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f73492ebb80 1 --2- 172.21.15.135:0/2652504187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a176fbe50 0x555a1770b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f731aff5700 0 client.15045 ms_handle_reset on v2:172.21.15.179:6832/3953517264 2024-05-08T23:15:12.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f73492ebb80 1 -- 172.21.15.135:0/2652504187 >> 172.21.15.135:0/2652504187 conn(0x555a176591c0 msgr2=0x555a176ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f73492ebb80 1 -- 172.21.15.135:0/2652504187 shutdown_connections 2024-05-08T23:15:12.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f73492ebb80 1 -- 172.21.15.135:0/2652504187 wait complete. 2024-05-08T23:15:12.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.168+0000 7f73492ebb80 20 client.15045 trim_cache size 0 max 16384 2024-05-08T23:15:12.175 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:15:12.175 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "c804a50a-0d8f-11ef-bc97-c7b262605968", 2024-05-08T23:15:12.175 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 4, 2024-05-08T23:15:12.175 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24419, 2024-05-08T23:15:12.175 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-08T23:15:12.176 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-08T23:15:12.176 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-08T23:15:12.176 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 44.823408323000002, 2024-05-08T23:15:12.176 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 27, 2024-05-08T23:15:12.176 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 83, 2024-05-08T23:15:12.176 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 83, 2024-05-08T23:15:12.176 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 73.922629549999996 2024-05-08T23:15:12.176 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:15:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.169+0000 7f733d131700 1 -- 172.21.15.135:0/2286138815 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73200a11b0 msgr2=0x7f73200a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.169+0000 7f733d131700 1 --2- 172.21.15.135:0/2286138815 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73200a11b0 0x7f73200a3670 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7328000c00 tx=0x7f7328005fb0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.169+0000 7f733d131700 1 -- 172.21.15.135:0/2286138815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7338102ab0 msgr2=0x7f733819e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.169+0000 7f733d131700 1 --2- 172.21.15.135:0/2286138815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7338102ab0 0x7f733819e440 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7330007ee0 tx=0x7f733000d3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.169+0000 7f733d131700 1 -- 172.21.15.135:0/2286138815 shutdown_connections 2024-05-08T23:15:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.169+0000 7f733d131700 1 --2- 172.21.15.135:0/2286138815 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73200a11b0 0x7f73200a3670 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.169+0000 7f733d131700 1 --2- 172.21.15.135:0/2286138815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7338100f20 0x7f7338196ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.169+0000 7f733d131700 1 --2- 172.21.15.135:0/2286138815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7338102ab0 0x7f733819e440 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.169+0000 7f733d131700 1 --2- 172.21.15.135:0/2286138815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73381020f0 0x7f7338197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.169+0000 7f733d131700 1 -- 172.21.15.135:0/2286138815 >> 172.21.15.135:0/2286138815 conn(0x7f73380fc4e0 msgr2=0x7f73381055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.169+0000 7f733d131700 1 -- 172.21.15.135:0/2286138815 shutdown_connections 2024-05-08T23:15:12.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.169+0000 7f733d131700 1 -- 172.21.15.135:0/2286138815 wait complete. 2024-05-08T23:15:12.180 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2024-05-08T23:15:12.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.306+0000 7ff95588d700 1 -- 172.21.15.135:0/430547419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff950102220 msgr2=0x7ff950102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.306+0000 7ff95588d700 1 --2- 172.21.15.135:0/430547419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff950102220 0x7ff950102680 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff944009990 tx=0x7ff944009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.306+0000 7ff95588d700 1 -- 172.21.15.135:0/430547419 shutdown_connections 2024-05-08T23:15:12.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.306+0000 7ff95588d700 1 --2- 172.21.15.135:0/430547419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9500ff250 0x7ff9500ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.306+0000 7ff95588d700 1 --2- 172.21.15.135:0/430547419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff950102bc0 0x7ff950109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.306+0000 7ff95588d700 1 --2- 172.21.15.135:0/430547419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff950102220 0x7ff950102680 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.306+0000 7ff95588d700 1 -- 172.21.15.135:0/430547419 >> 172.21.15.135:0/430547419 conn(0x7ff9500fab80 msgr2=0x7ff9500fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.306+0000 7ff95588d700 1 -- 172.21.15.135:0/430547419 shutdown_connections 2024-05-08T23:15:12.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.306+0000 7ff95588d700 1 -- 172.21.15.135:0/430547419 wait complete. 2024-05-08T23:15:12.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.307+0000 7ff95588d700 1 Processor -- start 2024-05-08T23:15:12.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.307+0000 7ff95588d700 1 -- start start 2024-05-08T23:15:12.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.307+0000 7ff95588d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9500ff250 0x7ff950196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.307+0000 7ff95588d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff950102220 0x7ff950197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.307+0000 7ff95588d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff950102bc0 0x7ff95019e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.307+0000 7ff95588d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95019ea40 con 0x7ff9500ff250 2024-05-08T23:15:12.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.307+0000 7ff95588d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95019eb80 con 0x7ff950102bc0 2024-05-08T23:15:12.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.307+0000 7ff95588d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95019ed10 con 0x7ff950102220 2024-05-08T23:15:12.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.307+0000 7ff94effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9500ff250 0x7ff950196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff94effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9500ff250 0x7ff950196f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36784/0 (socket says 172.21.15.135:36784) 2024-05-08T23:15:12.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff94effd700 1 -- 172.21.15.135:0/1715767007 learned_addr learned my addr 172.21.15.135:0/1715767007 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff94f7fe700 1 --2- 172.21.15.135:0/1715767007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff950102bc0 0x7ff95019e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff94e7fc700 1 --2- 172.21.15.135:0/1715767007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff950102220 0x7ff950197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff94effd700 1 -- 172.21.15.135:0/1715767007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff950102220 msgr2=0x7ff950197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff94effd700 1 --2- 172.21.15.135:0/1715767007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff950102220 0x7ff950197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff94effd700 1 -- 172.21.15.135:0/1715767007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff950102bc0 msgr2=0x7ff95019e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff94effd700 1 --2- 172.21.15.135:0/1715767007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff950102bc0 0x7ff95019e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff94effd700 1 -- 172.21.15.135:0/1715767007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9440095f0 con 0x7ff9500ff250 2024-05-08T23:15:12.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff94e7fc700 1 --2- 172.21.15.135:0/1715767007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff950102220 0x7ff950197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:12.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff94effd700 1 --2- 172.21.15.135:0/1715767007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9500ff250 0x7ff950196f10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e970 tx=0x7ff94000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff95488b700 1 -- 172.21.15.135:0/1715767007 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940009790 con 0x7ff9500ff250 2024-05-08T23:15:12.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff95488b700 1 -- 172.21.15.135:0/1715767007 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff94000eec0 con 0x7ff9500ff250 2024-05-08T23:15:12.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff95588d700 1 -- 172.21.15.135:0/1715767007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95019eff0 con 0x7ff9500ff250 2024-05-08T23:15:12.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff95488b700 1 -- 172.21.15.135:0/1715767007 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940003cf0 con 0x7ff9500ff250 2024-05-08T23:15:12.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.308+0000 7ff95588d700 1 -- 172.21.15.135:0/1715767007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95019f420 con 0x7ff9500ff250 2024-05-08T23:15:12.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.310+0000 7ff95488b700 1 -- 172.21.15.135:0/1715767007 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7ff94000ccd0 con 0x7ff9500ff250 2024-05-08T23:15:12.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.311+0000 7ff95488b700 1 --2- 172.21.15.135:0/1715767007 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff9380a1230 0x7ff9380a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.311+0000 7ff94e7fc700 1 --2- 172.21.15.135:0/1715767007 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff9380a1230 0x7ff9380a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.311+0000 7ff95488b700 1 -- 172.21.15.135:0/1715767007 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff940014070 con 0x7ff9500ff250 2024-05-08T23:15:12.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.312+0000 7ff94e7fc700 1 --2- 172.21.15.135:0/1715767007 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff9380a1230 0x7ff9380a36f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff94400b2e0 tx=0x7ff944005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.312+0000 7ff961a47b80 1 Processor -- start 2024-05-08T23:15:12.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.312+0000 7ff961a47b80 1 -- start start 2024-05-08T23:15:12.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.312+0000 7ff961a47b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc7455910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.312+0000 7ff961a47b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7455e50 0x55bbc74562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.312+0000 7ff961a47b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc7456810 0x55bbc7456c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.312+0000 7ff961a47b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc73ac100 con 0x55bbc74554f0 2024-05-08T23:15:12.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.312+0000 7ff961a47b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc73a9ac0 con 0x55bbc7456810 2024-05-08T23:15:12.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.312+0000 7ff961a47b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc73a53b0 con 0x55bbc7455e50 2024-05-08T23:15:12.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.312+0000 7ff94effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc7455910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.312+0000 7ff94effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc7455910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36794/0 (socket says 172.21.15.135:36794) 2024-05-08T23:15:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.312+0000 7ff94effd700 1 -- 172.21.15.135:0/3558359092 learned_addr learned my addr 172.21.15.135:0/3558359092 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.313+0000 7ff94f7fe700 1 --2- 172.21.15.135:0/3558359092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc7456810 0x55bbc7456c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.313+0000 7ff94e7fc700 1 --2- 172.21.15.135:0/3558359092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7455e50 0x55bbc74562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.313+0000 7ff94effd700 1 -- 172.21.15.135:0/3558359092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7455e50 msgr2=0x55bbc74562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.313+0000 7ff94effd700 1 --2- 172.21.15.135:0/3558359092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7455e50 0x55bbc74562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.313+0000 7ff94effd700 1 -- 172.21.15.135:0/3558359092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc7456810 msgr2=0x55bbc7456c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.313+0000 7ff94effd700 1 --2- 172.21.15.135:0/3558359092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc7456810 0x55bbc7456c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.313+0000 7ff94effd700 1 -- 172.21.15.135:0/3558359092 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbc7226360 con 0x55bbc74554f0 2024-05-08T23:15:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.313+0000 7ff94f7fe700 1 --2- 172.21.15.135:0/3558359092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc7456810 0x55bbc7456c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.313+0000 7ff94effd700 1 --2- 172.21.15.135:0/3558359092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc7455910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff9400a1e80 tx=0x7ff940099e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7e4d881e331817 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.313+0000 7ff935ffb700 1 -- 172.21.15.135:0/3558359092 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94009dd60 con 0x55bbc74554f0 2024-05-08T23:15:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.313+0000 7ff935ffb700 1 -- 172.21.15.135:0/3558359092 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9400a23b0 con 0x55bbc74554f0 2024-05-08T23:15:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.313+0000 7ff935ffb700 1 -- 172.21.15.135:0/3558359092 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94009a3f0 con 0x55bbc74554f0 2024-05-08T23:15:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.314+0000 7ff961a47b80 1 -- 172.21.15.135:0/3558359092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 msgr2=0x55bbc7455910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.314+0000 7ff961a47b80 1 --2- 172.21.15.135:0/3558359092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc7455910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff9400a1e80 tx=0x7ff940099e30 comp rx=0 tx=0).stop 2024-05-08T23:15:12.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.314+0000 7ff961a47b80 1 -- 172.21.15.135:0/3558359092 shutdown_connections 2024-05-08T23:15:12.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.314+0000 7ff961a47b80 1 --2- 172.21.15.135:0/3558359092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc7456810 0x55bbc7456c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.314+0000 7ff961a47b80 1 --2- 172.21.15.135:0/3558359092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc7455910 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.314+0000 7ff961a47b80 1 --2- 172.21.15.135:0/3558359092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7455e50 0x55bbc74562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.314+0000 7ff961a47b80 1 -- 172.21.15.135:0/3558359092 >> 172.21.15.135:0/3558359092 conn(0x55bbc73b31c0 msgr2=0x55bbc744fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.314+0000 7ff961a47b80 1 -- 172.21.15.135:0/3558359092 shutdown_connections 2024-05-08T23:15:12.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.314+0000 7ff961a47b80 1 -- 172.21.15.135:0/3558359092 wait complete. 2024-05-08T23:15:12.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.314+0000 7ff961a47b80 1 -- start start 2024-05-08T23:15:12.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.314+0000 7ff961a47b80 1 Processor -- start 2024-05-08T23:15:12.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.314+0000 7ff961a47b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc74554f0 0x55bbc745ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.314+0000 7ff961a47b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7455e50 0x55bbc745f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.314+0000 7ff961a47b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc7456810 0x55bbc7466270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.314+0000 7ff961a47b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc7341510 con 0x55bbc7456810 2024-05-08T23:15:12.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff961a47b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc73411b0 con 0x55bbc74554f0 2024-05-08T23:15:12.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff961a47b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc7228650 con 0x55bbc7455e50 2024-05-08T23:15:12.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff961a47b80 10 client.0 _ll_register_callbacks cb 0x55bbc734aae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:12.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff94f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc7456810 0x55bbc7466270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff94effd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc74554f0 0x55bbc745ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff94f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc7456810 0x55bbc7466270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36798/0 (socket says 172.21.15.135:36798) 2024-05-08T23:15:12.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff94f7fe700 1 -- 172.21.15.135:0/4095355749 learned_addr learned my addr 172.21.15.135:0/4095355749 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff94e7fc700 1 --2- 172.21.15.135:0/4095355749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7455e50 0x55bbc745f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff94f7fe700 1 -- 172.21.15.135:0/4095355749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7455e50 msgr2=0x55bbc745f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff94f7fe700 1 --2- 172.21.15.135:0/4095355749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7455e50 0x55bbc745f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff94f7fe700 1 -- 172.21.15.135:0/4095355749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc74554f0 msgr2=0x55bbc745ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff94f7fe700 1 --2- 172.21.15.135:0/4095355749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc74554f0 0x55bbc745ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff94f7fe700 1 -- 172.21.15.135:0/4095355749 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95019f420 con 0x55bbc7456810 2024-05-08T23:15:12.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff94effd700 1 --2- 172.21.15.135:0/4095355749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc74554f0 0x55bbc745ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:15:12.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff94f7fe700 1 --2- 172.21.15.135:0/4095355749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc7456810 0x55bbc7466270 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff948007b00 tx=0x7ff948007b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a4fecf50163ebf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff92effd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:12.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff92effd700 1 -- 172.21.15.135:0/4095355749 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94800e040 con 0x55bbc7456810 2024-05-08T23:15:12.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff92effd700 1 -- 172.21.15.135:0/4095355749 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff948015720 con 0x55bbc7456810 2024-05-08T23:15:12.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff961a47b80 1 -- 172.21.15.135:0/4095355749 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbc72fe220 con 0x55bbc7456810 2024-05-08T23:15:12.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff92effd700 1 -- 172.21.15.135:0/4095355749 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9480158e0 con 0x55bbc7456810 2024-05-08T23:15:12.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff961a47b80 10 client.15057 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:12.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.315+0000 7ff961a47b80 1 -- 172.21.15.135:0/4095355749 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55bbc71d2b10 con 0x55bbc7456810 2024-05-08T23:15:12.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.316+0000 7ff92effd700 1 -- 172.21.15.135:0/4095355749 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bbc72fe220 con 0x55bbc7456810 2024-05-08T23:15:12.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.316+0000 7ff92effd700 1 -- 172.21.15.135:0/4095355749 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff948016c30 con 0x55bbc7456810 2024-05-08T23:15:12.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.316+0000 7ff961a47b80 10 client.15057 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:12.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.316+0000 7ff961a47b80 10 client.15057 resolve_mds: resolved name 'l' to daemon mds.l 2024-05-08T23:15:12.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.316+0000 7ff961a47b80 20 client.15057 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:12.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.316+0000 7ff961a47b80 1 --2- 172.21.15.135:0/4095355749 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55bbc7469460 0x55bbc746f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.316+0000 7ff961a47b80 4 client.15057 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:15:12.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.316+0000 7ff961a47b80 1 -- 172.21.15.135:0/4095355749 --> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbc74247c0 con 0x55bbc7469460 2024-05-08T23:15:12.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.316+0000 7ff94effd700 1 --2- 172.21.15.135:0/4095355749 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55bbc7469460 0x55bbc746f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.316+0000 7ff92effd700 10 client.15057 ms_handle_connect on v2:172.21.15.195:6832/2264761272 2024-05-08T23:15:12.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.316+0000 7ff94effd700 1 --2- 172.21.15.135:0/4095355749 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55bbc7469460 0x55bbc746f290 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6154a961f52786c3 server_cookie=3012b3d6f76fb5c2 in_seq=0 out_seq=0 2024-05-08T23:15:12.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.317+0000 7ff92effd700 1 -- 172.21.15.135:0/4095355749 <== mds.3 v2:172.21.15.195:6832/2264761272 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bbc74247c0 con 0x55bbc7469460 2024-05-08T23:15:12.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.317+0000 7ff92effd700 10 client.15057 handle_command_reply: tid=0 2024-05-08T23:15:12.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.317+0000 7ff961a47b80 1 client.15057 shutdown 2024-05-08T23:15:12.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.317+0000 7ff961a47b80 1 -- 172.21.15.135:0/4095355749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc7456810 msgr2=0x55bbc7466270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.317+0000 7ff961a47b80 1 --2- 172.21.15.135:0/4095355749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc7456810 0x55bbc7466270 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff948007b00 tx=0x7ff948007b30 comp rx=0 tx=0).stop 2024-05-08T23:15:12.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.317+0000 7ff961a47b80 1 -- 172.21.15.135:0/4095355749 shutdown_connections 2024-05-08T23:15:12.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.317+0000 7ff961a47b80 1 --2- 172.21.15.135:0/4095355749 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55bbc7469460 0x55bbc746f290 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.317+0000 7ff961a47b80 1 --2- 172.21.15.135:0/4095355749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc7456810 0x55bbc7466270 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.317+0000 7ff961a47b80 1 --2- 172.21.15.135:0/4095355749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc74554f0 0x55bbc745ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.317+0000 7ff92effd700 0 client.15057 ms_handle_reset on v2:172.21.15.195:6832/2264761272 2024-05-08T23:15:12.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.317+0000 7ff961a47b80 1 --2- 172.21.15.135:0/4095355749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7455e50 0x55bbc745f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.317+0000 7ff961a47b80 1 -- 172.21.15.135:0/4095355749 >> 172.21.15.135:0/4095355749 conn(0x55bbc73b31c0 msgr2=0x55bbc744f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.317+0000 7ff961a47b80 1 -- 172.21.15.135:0/4095355749 shutdown_connections 2024-05-08T23:15:12.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.317+0000 7ff961a47b80 1 -- 172.21.15.135:0/4095355749 wait complete. 2024-05-08T23:15:12.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.318+0000 7ff961a47b80 20 client.15057 trim_cache size 0 max 16384 2024-05-08T23:15:12.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.335+0000 7ff961a47b80 1 Processor -- start 2024-05-08T23:15:12.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff961a47b80 1 -- start start 2024-05-08T23:15:12.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff961a47b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc74558d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff961a47b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc7455e50 0x55bbc7466920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff961a47b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7456810 0x55bbc745e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff961a47b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc745dd30 con 0x55bbc74554f0 2024-05-08T23:15:12.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff961a47b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc74247c0 con 0x55bbc7455e50 2024-05-08T23:15:12.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff961a47b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc72fe220 con 0x55bbc7456810 2024-05-08T23:15:12.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff94effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc74558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff94effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc74558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36808/0 (socket says 172.21.15.135:36808) 2024-05-08T23:15:12.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff94effd700 1 -- 172.21.15.135:0/1619923136 learned_addr learned my addr 172.21.15.135:0/1619923136 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff94e7fc700 1 --2- 172.21.15.135:0/1619923136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc7455e50 0x55bbc7466920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff94f7fe700 1 --2- 172.21.15.135:0/1619923136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7456810 0x55bbc745e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff94effd700 1 -- 172.21.15.135:0/1619923136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7456810 msgr2=0x55bbc745e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff94effd700 1 --2- 172.21.15.135:0/1619923136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7456810 0x55bbc745e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff94effd700 1 -- 172.21.15.135:0/1619923136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc7455e50 msgr2=0x55bbc7466920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff94effd700 1 --2- 172.21.15.135:0/1619923136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc7455e50 0x55bbc7466920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff94effd700 1 -- 172.21.15.135:0/1619923136 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbc736b510 con 0x55bbc74554f0 2024-05-08T23:15:12.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff94effd700 1 --2- 172.21.15.135:0/1619923136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc74558d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff940009230 tx=0x7ff940003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7ba0169ea87aee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff9367fc700 1 -- 172.21.15.135:0/1619923136 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9400b6030 con 0x55bbc74554f0 2024-05-08T23:15:12.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff9367fc700 1 -- 172.21.15.135:0/1619923136 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9400b8040 con 0x55bbc74554f0 2024-05-08T23:15:12.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.336+0000 7ff9367fc700 1 -- 172.21.15.135:0/1619923136 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94009a190 con 0x55bbc74554f0 2024-05-08T23:15:12.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.337+0000 7ff961a47b80 1 -- 172.21.15.135:0/1619923136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 msgr2=0x55bbc74558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.337+0000 7ff961a47b80 1 --2- 172.21.15.135:0/1619923136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc74558d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff940009230 tx=0x7ff940003780 comp rx=0 tx=0).stop 2024-05-08T23:15:12.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.337+0000 7ff961a47b80 1 -- 172.21.15.135:0/1619923136 shutdown_connections 2024-05-08T23:15:12.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.337+0000 7ff961a47b80 1 --2- 172.21.15.135:0/1619923136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7456810 0x55bbc745e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.337+0000 7ff961a47b80 1 --2- 172.21.15.135:0/1619923136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc74558d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.337+0000 7ff961a47b80 1 --2- 172.21.15.135:0/1619923136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc7455e50 0x55bbc7466920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.337+0000 7ff961a47b80 1 -- 172.21.15.135:0/1619923136 >> 172.21.15.135:0/1619923136 conn(0x55bbc73b31c0 msgr2=0x55bbc7456bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.337+0000 7ff961a47b80 1 -- 172.21.15.135:0/1619923136 shutdown_connections 2024-05-08T23:15:12.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.337+0000 7ff961a47b80 1 -- 172.21.15.135:0/1619923136 wait complete. 2024-05-08T23:15:12.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.337+0000 7ff961a47b80 1 -- start start 2024-05-08T23:15:12.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff961a47b80 1 Processor -- start 2024-05-08T23:15:12.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff961a47b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc744ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff961a47b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7455e50 0x55bbc744f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff961a47b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc7456810 0x55bbc74651d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff961a47b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc7465710 con 0x55bbc74554f0 2024-05-08T23:15:12.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff961a47b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc7465880 con 0x55bbc7456810 2024-05-08T23:15:12.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff961a47b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc7465a40 con 0x55bbc7455e50 2024-05-08T23:15:12.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff961a47b80 10 client.0 _ll_register_callbacks cb 0x55bbc734aae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:12.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff94effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc744ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff94effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc744ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36810/0 (socket says 172.21.15.135:36810) 2024-05-08T23:15:12.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff94effd700 1 -- 172.21.15.135:0/1186303067 learned_addr learned my addr 172.21.15.135:0/1186303067 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff94e7fc700 1 --2- 172.21.15.135:0/1186303067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7455e50 0x55bbc744f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff94effd700 1 -- 172.21.15.135:0/1186303067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7455e50 msgr2=0x55bbc744f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff94effd700 1 --2- 172.21.15.135:0/1186303067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7455e50 0x55bbc744f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff94effd700 1 -- 172.21.15.135:0/1186303067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc7456810 msgr2=0x55bbc74651d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff94effd700 1 --2- 172.21.15.135:0/1186303067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc7456810 0x55bbc74651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff94effd700 1 -- 172.21.15.135:0/1186303067 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbc7226360 con 0x55bbc74554f0 2024-05-08T23:15:12.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff94effd700 1 --2- 172.21.15.135:0/1186303067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc744ef10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff9400a1e80 tx=0x7ff94009de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3381d304d2834694 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff92effd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:12.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff92effd700 1 -- 172.21.15.135:0/1186303067 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9400b6050 con 0x55bbc74554f0 2024-05-08T23:15:12.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff92effd700 1 -- 172.21.15.135:0/1186303067 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff9400b7070 con 0x55bbc74554f0 2024-05-08T23:15:12.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.338+0000 7ff961a47b80 1 -- 172.21.15.135:0/1186303067 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff9400a23b0 con 0x55bbc74554f0 2024-05-08T23:15:12.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.339+0000 7ff92effd700 1 -- 172.21.15.135:0/1186303067 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9400b82f0 con 0x55bbc74554f0 2024-05-08T23:15:12.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.339+0000 7ff961a47b80 10 client.15063 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:12.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.339+0000 7ff961a47b80 1 -- 172.21.15.135:0/1186303067 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55bbc722ac80 con 0x55bbc74554f0 2024-05-08T23:15:12.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.339+0000 7ff92effd700 1 -- 172.21.15.135:0/1186303067 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9400a8080 con 0x55bbc74554f0 2024-05-08T23:15:12.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.339+0000 7ff92effd700 1 -- 172.21.15.135:0/1186303067 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff940098e90 con 0x55bbc74554f0 2024-05-08T23:15:12.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.339+0000 7ff961a47b80 10 client.15063 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:12.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.339+0000 7ff961a47b80 10 client.15063 resolve_mds: resolved name 'l' to daemon mds.l 2024-05-08T23:15:12.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.339+0000 7ff961a47b80 20 client.15063 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:12.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.339+0000 7ff961a47b80 1 --2- 172.21.15.135:0/1186303067 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55bbc7469460 0x55bbc74c13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.339+0000 7ff961a47b80 4 client.15063 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T23:15:12.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.339+0000 7ff961a47b80 1 -- 172.21.15.135:0/1186303067 --> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bbc739de70 con 0x55bbc7469460 2024-05-08T23:15:12.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.339+0000 7ff94e7fc700 1 --2- 172.21.15.135:0/1186303067 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55bbc7469460 0x55bbc74c13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff92effd700 10 client.15063 ms_handle_connect on v2:172.21.15.195:6832/2264761272 2024-05-08T23:15:12.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff94e7fc700 1 --2- 172.21.15.135:0/1186303067 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55bbc7469460 0x55bbc74c13c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7a548aa19f62be8e server_cookie=846a949dd0dde165 in_seq=0 out_seq=0 2024-05-08T23:15:12.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff92effd700 1 -- 172.21.15.135:0/1186303067 <== mds.3 v2:172.21.15.195:6832/2264761272 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55bbc739de70 con 0x55bbc7469460 2024-05-08T23:15:12.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff92effd700 10 client.15063 handle_command_reply: tid=0 2024-05-08T23:15:12.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff961a47b80 1 client.15063 shutdown 2024-05-08T23:15:12.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff961a47b80 1 -- 172.21.15.135:0/1186303067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 msgr2=0x55bbc744ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff961a47b80 1 --2- 172.21.15.135:0/1186303067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc744ef10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff9400a1e80 tx=0x7ff94009de10 comp rx=0 tx=0).stop 2024-05-08T23:15:12.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff961a47b80 1 -- 172.21.15.135:0/1186303067 shutdown_connections 2024-05-08T23:15:12.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff961a47b80 1 --2- 172.21.15.135:0/1186303067 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55bbc7469460 0x55bbc74c13c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff961a47b80 1 --2- 172.21.15.135:0/1186303067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bbc7456810 0x55bbc74651d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff92effd700 0 client.15063 ms_handle_reset on v2:172.21.15.195:6832/2264761272 2024-05-08T23:15:12.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff961a47b80 1 --2- 172.21.15.135:0/1186303067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bbc74554f0 0x55bbc744ef10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff961a47b80 1 --2- 172.21.15.135:0/1186303067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbc7455e50 0x55bbc744f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff961a47b80 1 -- 172.21.15.135:0/1186303067 >> 172.21.15.135:0/1186303067 conn(0x55bbc73b31c0 msgr2=0x55bbc745e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff961a47b80 1 -- 172.21.15.135:0/1186303067 shutdown_connections 2024-05-08T23:15:12.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff961a47b80 1 -- 172.21.15.135:0/1186303067 wait complete. 2024-05-08T23:15:12.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.340+0000 7ff961a47b80 20 client.15063 trim_cache size 0 max 16384 2024-05-08T23:15:12.346 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:15:12.347 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "c804a50a-0d8f-11ef-bc97-c7b262605968", 2024-05-08T23:15:12.347 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 3, 2024-05-08T23:15:12.347 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24439, 2024-05-08T23:15:12.347 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-08T23:15:12.347 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-08T23:15:12.347 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-08T23:15:12.347 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 46.005272943000001, 2024-05-08T23:15:12.347 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 27, 2024-05-08T23:15:12.347 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 83, 2024-05-08T23:15:12.347 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 83, 2024-05-08T23:15:12.347 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 75.874650807999998 2024-05-08T23:15:12.347 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:15:12.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.341+0000 7ff95588d700 1 -- 172.21.15.135:0/1715767007 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff9380a1230 msgr2=0x7ff9380a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.341+0000 7ff95588d700 1 --2- 172.21.15.135:0/1715767007 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff9380a1230 0x7ff9380a36f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff94400b2e0 tx=0x7ff944005e80 comp rx=0 tx=0).stop 2024-05-08T23:15:12.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.341+0000 7ff95588d700 1 -- 172.21.15.135:0/1715767007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9500ff250 msgr2=0x7ff950196f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.341+0000 7ff95588d700 1 --2- 172.21.15.135:0/1715767007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9500ff250 0x7ff950196f10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e970 tx=0x7ff94000ec80 comp rx=0 tx=0).stop 2024-05-08T23:15:12.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.341+0000 7ff95588d700 1 -- 172.21.15.135:0/1715767007 shutdown_connections 2024-05-08T23:15:12.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.341+0000 7ff95588d700 1 --2- 172.21.15.135:0/1715767007 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff9380a1230 0x7ff9380a36f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.341+0000 7ff95588d700 1 --2- 172.21.15.135:0/1715767007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff950102bc0 0x7ff95019e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.341+0000 7ff95588d700 1 --2- 172.21.15.135:0/1715767007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9500ff250 0x7ff950196f10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.341+0000 7ff95588d700 1 --2- 172.21.15.135:0/1715767007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff950102220 0x7ff950197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.341+0000 7ff95588d700 1 -- 172.21.15.135:0/1715767007 >> 172.21.15.135:0/1715767007 conn(0x7ff9500fab80 msgr2=0x7ff9501055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.341+0000 7ff95588d700 1 -- 172.21.15.135:0/1715767007 shutdown_connections 2024-05-08T23:15:12.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.341+0000 7ff95588d700 1 -- 172.21.15.135:0/1715767007 wait complete. 2024-05-08T23:15:12.352 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-08T23:15:12.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.476+0000 7f66f9d92700 1 -- 172.21.15.135:0/855705038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66f41043b0 msgr2=0x7f66f41067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.476+0000 7f66f9d92700 1 --2- 172.21.15.135:0/855705038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66f41043b0 0x7f66f41067a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009990 tx=0x7f66e8009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.476+0000 7f66f9d92700 1 -- 172.21.15.135:0/855705038 shutdown_connections 2024-05-08T23:15:12.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.476+0000 7f66f9d92700 1 --2- 172.21.15.135:0/855705038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f4101a80 0x7f66f4103e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.476+0000 7f66f9d92700 1 --2- 172.21.15.135:0/855705038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66f4106ce0 0x7f66f41090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.476+0000 7f66f9d92700 1 --2- 172.21.15.135:0/855705038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66f41043b0 0x7f66f41067a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.476+0000 7f66f9d92700 1 -- 172.21.15.135:0/855705038 >> 172.21.15.135:0/855705038 conn(0x7f66f40fb3f0 msgr2=0x7f66f40fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.476+0000 7f66f9d92700 1 -- 172.21.15.135:0/855705038 shutdown_connections 2024-05-08T23:15:12.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.476+0000 7f66f9d92700 1 -- 172.21.15.135:0/855705038 wait complete. 2024-05-08T23:15:12.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.477+0000 7f66f9d92700 1 Processor -- start 2024-05-08T23:15:12.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.477+0000 7f66f9d92700 1 -- start start 2024-05-08T23:15:12.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.477+0000 7f66f9d92700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f4101a80 0x7f66f41013a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.477+0000 7f66f9d92700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66f41043b0 0x7f66f40ffa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.477+0000 7f66f9d92700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66f4106ce0 0x7f66f40fff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.477+0000 7f66f9d92700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4100710 con 0x7f66f4106ce0 2024-05-08T23:15:12.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.477+0000 7f66f9d92700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4100880 con 0x7f66f41043b0 2024-05-08T23:15:12.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.477+0000 7f66f9d92700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41a0f20 con 0x7f66f4101a80 2024-05-08T23:15:12.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66f4106ce0 0x7f66f40fff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66f4106ce0 0x7f66f40fff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36836/0 (socket says 172.21.15.135:36836) 2024-05-08T23:15:12.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f3fff700 1 -- 172.21.15.135:0/3018427045 learned_addr learned my addr 172.21.15.135:0/3018427045 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f2ffd700 1 --2- 172.21.15.135:0/3018427045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66f41043b0 0x7f66f40ffa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f37fe700 1 --2- 172.21.15.135:0/3018427045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f4101a80 0x7f66f41013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f3fff700 1 -- 172.21.15.135:0/3018427045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f4101a80 msgr2=0x7f66f41013a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f3fff700 1 --2- 172.21.15.135:0/3018427045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f4101a80 0x7f66f41013a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f3fff700 1 -- 172.21.15.135:0/3018427045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66f41043b0 msgr2=0x7f66f40ffa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f3fff700 1 --2- 172.21.15.135:0/3018427045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66f41043b0 0x7f66f40ffa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f3fff700 1 -- 172.21.15.135:0/3018427045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e80095f0 con 0x7f66f4106ce0 2024-05-08T23:15:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f3fff700 1 --2- 172.21.15.135:0/3018427045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66f4106ce0 0x7f66f40fff70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f66ec007ee0 tx=0x7f66ec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f0ff9700 1 -- 172.21.15.135:0/3018427045 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00dcc0 con 0x7f66f4106ce0 2024-05-08T23:15:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f0ff9700 1 -- 172.21.15.135:0/3018427045 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66ec00f040 con 0x7f66f4106ce0 2024-05-08T23:15:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f9d92700 1 -- 172.21.15.135:0/3018427045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f41a11b0 con 0x7f66f4106ce0 2024-05-08T23:15:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f0ff9700 1 -- 172.21.15.135:0/3018427045 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec004830 con 0x7f66f4106ce0 2024-05-08T23:15:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.478+0000 7f66f9d92700 1 -- 172.21.15.135:0/3018427045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f41a1670 con 0x7f66f4106ce0 2024-05-08T23:15:12.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.480+0000 7f66f0ff9700 1 -- 172.21.15.135:0/3018427045 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f66ec003a00 con 0x7f66f4106ce0 2024-05-08T23:15:12.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.481+0000 7f66f0ff9700 1 --2- 172.21.15.135:0/3018427045 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f66dc0a11b0 0x7f66dc0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.481+0000 7f66f37fe700 1 --2- 172.21.15.135:0/3018427045 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f66dc0a11b0 0x7f66dc0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.481+0000 7f66f0ff9700 1 -- 172.21.15.135:0/3018427045 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f66ec0cc150 con 0x7f66f4106ce0 2024-05-08T23:15:12.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.481+0000 7f66f37fe700 1 --2- 172.21.15.135:0/3018427045 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f66dc0a11b0 0x7f66dc0a3670 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f66e4005950 tx=0x7f66e400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f6705f4cb80 1 Processor -- start 2024-05-08T23:15:12.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f6705f4cb80 1 -- start start 2024-05-08T23:15:12.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f6705f4cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa4a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f6705f4cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4ae50 0x558a1aa4b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f6705f4cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa4bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f6705f4cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a1a9a1100 con 0x558a1aa4a4f0 2024-05-08T23:15:12.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f6705f4cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a1a99eac0 con 0x558a1aa4b810 2024-05-08T23:15:12.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f6705f4cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a1a99a3b0 con 0x558a1aa4ae50 2024-05-08T23:15:12.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa4a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa4a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36838/0 (socket says 172.21.15.135:36838) 2024-05-08T23:15:12.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f66f37fe700 1 -- 172.21.15.135:0/1545088568 learned_addr learned my addr 172.21.15.135:0/1545088568 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f66f3fff700 1 --2- 172.21.15.135:0/1545088568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa4bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f66f2ffd700 1 --2- 172.21.15.135:0/1545088568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4ae50 0x558a1aa4b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f66f37fe700 1 -- 172.21.15.135:0/1545088568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4ae50 msgr2=0x558a1aa4b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f66f37fe700 1 --2- 172.21.15.135:0/1545088568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4ae50 0x558a1aa4b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f66f37fe700 1 -- 172.21.15.135:0/1545088568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 msgr2=0x558a1aa4bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f66f37fe700 1 --2- 172.21.15.135:0/1545088568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa4bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f66f37fe700 1 -- 172.21.15.135:0/1545088568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a1a81b360 con 0x558a1aa4a4f0 2024-05-08T23:15:12.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.482+0000 7f66f37fe700 1 --2- 172.21.15.135:0/1545088568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa4a910 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f66e4010fa0 tx=0x7f66e4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80684a2ffc1e0f7c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.483+0000 7f66d9ffb700 1 -- 172.21.15.135:0/1545088568 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e401e620 con 0x558a1aa4a4f0 2024-05-08T23:15:12.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.483+0000 7f66d9ffb700 1 -- 172.21.15.135:0/1545088568 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66e4015070 con 0x558a1aa4a4f0 2024-05-08T23:15:12.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.483+0000 7f66d9ffb700 1 -- 172.21.15.135:0/1545088568 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e401c9c0 con 0x558a1aa4a4f0 2024-05-08T23:15:12.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.483+0000 7f6705f4cb80 1 -- 172.21.15.135:0/1545088568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 msgr2=0x558a1aa4a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.483+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/1545088568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa4a910 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f66e4010fa0 tx=0x7f66e4013000 comp rx=0 tx=0).stop 2024-05-08T23:15:12.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.483+0000 7f6705f4cb80 1 -- 172.21.15.135:0/1545088568 shutdown_connections 2024-05-08T23:15:12.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.483+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/1545088568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa4bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.483+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/1545088568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa4a910 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.483+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/1545088568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4ae50 0x558a1aa4b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.483+0000 7f6705f4cb80 1 -- 172.21.15.135:0/1545088568 >> 172.21.15.135:0/1545088568 conn(0x558a1a9a81c0 msgr2=0x558a1aa44d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.483+0000 7f6705f4cb80 1 -- 172.21.15.135:0/1545088568 shutdown_connections 2024-05-08T23:15:12.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.483+0000 7f6705f4cb80 1 -- 172.21.15.135:0/1545088568 wait complete. 2024-05-08T23:15:12.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.484+0000 7f6705f4cb80 1 -- start start 2024-05-08T23:15:12.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.484+0000 7f6705f4cb80 1 Processor -- start 2024-05-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.484+0000 7f6705f4cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4a4f0 0x558a1aa53d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.484+0000 7f6705f4cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4ae50 0x558a1aa542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.484+0000 7f6705f4cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa5b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.484+0000 7f6705f4cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a1a936510 con 0x558a1aa4ae50 2024-05-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.484+0000 7f6705f4cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a1a9361b0 con 0x558a1aa4b810 2024-05-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.484+0000 7f6705f4cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a1a81d650 con 0x558a1aa4a4f0 2024-05-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.484+0000 7f6705f4cb80 10 client.0 _ll_register_callbacks cb 0x558a1a93fae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.484+0000 7f66f2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4ae50 0x558a1aa542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.484+0000 7f66f2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4ae50 0x558a1aa542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36844/0 (socket says 172.21.15.135:36844) 2024-05-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.484+0000 7f66f2ffd700 1 -- 172.21.15.135:0/4004949829 learned_addr learned my addr 172.21.15.135:0/4004949829 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.484+0000 7f66f3fff700 1 --2- 172.21.15.135:0/4004949829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa5b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f66f2ffd700 1 -- 172.21.15.135:0/4004949829 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4a4f0 msgr2=0x558a1aa53d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f66f2ffd700 1 --2- 172.21.15.135:0/4004949829 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4a4f0 0x558a1aa53d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f66f2ffd700 1 -- 172.21.15.135:0/4004949829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 msgr2=0x558a1aa5b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f66f2ffd700 1 --2- 172.21.15.135:0/4004949829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa5b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f66f2ffd700 1 -- 172.21.15.135:0/4004949829 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e4010c50 con 0x558a1aa4ae50 2024-05-08T23:15:12.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f66f3fff700 1 --2- 172.21.15.135:0/4004949829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa5b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:12.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f66f2ffd700 1 --2- 172.21.15.135:0/4004949829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4ae50 0x558a1aa542c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009990 tx=0x7f66e8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68f2cc7295022af server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f66d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:12.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f66d2ffd700 1 -- 172.21.15.135:0/4004949829 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8003ca0 con 0x558a1aa4ae50 2024-05-08T23:15:12.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f66d2ffd700 1 -- 172.21.15.135:0/4004949829 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f66e8003e00 con 0x558a1aa4ae50 2024-05-08T23:15:12.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f6705f4cb80 1 -- 172.21.15.135:0/4004949829 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a1a8f3220 con 0x558a1aa4ae50 2024-05-08T23:15:12.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f66d2ffd700 1 -- 172.21.15.135:0/4004949829 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66e8005070 con 0x558a1aa4ae50 2024-05-08T23:15:12.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f6705f4cb80 10 client.15075 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:12.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f6705f4cb80 1 -- 172.21.15.135:0/4004949829 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558a1a7c7b10 con 0x558a1aa4ae50 2024-05-08T23:15:12.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f66d2ffd700 1 -- 172.21.15.135:0/4004949829 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558a1a8f3220 con 0x558a1aa4ae50 2024-05-08T23:15:12.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f66d2ffd700 1 -- 172.21.15.135:0/4004949829 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f66e800fa30 con 0x558a1aa4ae50 2024-05-08T23:15:12.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f6705f4cb80 10 client.15075 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:12.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f6705f4cb80 10 client.15075 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T23:15:12.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f6705f4cb80 20 client.15075 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:12.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/4004949829 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x558a1aa5e990 0x558a1aa64280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f6705f4cb80 4 client.15075 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:15:12.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.485+0000 7f6705f4cb80 1 -- 172.21.15.135:0/4004949829 --> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a1aa197c0 con 0x558a1aa5e990 2024-05-08T23:15:12.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.486+0000 7f66f37fe700 1 --2- 172.21.15.135:0/4004949829 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x558a1aa5e990 0x558a1aa64280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.486+0000 7f66d2ffd700 10 client.15075 ms_handle_connect on v2:172.21.15.195:6836/2390721751 2024-05-08T23:15:12.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.486+0000 7f66f37fe700 1 --2- 172.21.15.135:0/4004949829 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x558a1aa5e990 0x558a1aa64280 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=35bca360902255d0 server_cookie=15cc334e4b485834 in_seq=0 out_seq=0 2024-05-08T23:15:12.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.487+0000 7f66d2ffd700 1 -- 172.21.15.135:0/4004949829 <== mds.2 v2:172.21.15.195:6836/2390721751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558a1aa197c0 con 0x558a1aa5e990 2024-05-08T23:15:12.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.487+0000 7f66d2ffd700 10 client.15075 handle_command_reply: tid=0 2024-05-08T23:15:12.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.487+0000 7f6705f4cb80 1 client.15075 shutdown 2024-05-08T23:15:12.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.487+0000 7f6705f4cb80 1 -- 172.21.15.135:0/4004949829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4ae50 msgr2=0x558a1aa542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.487+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/4004949829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4ae50 0x558a1aa542c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009990 tx=0x7f66e8005ef0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.487+0000 7f6705f4cb80 1 -- 172.21.15.135:0/4004949829 shutdown_connections 2024-05-08T23:15:12.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.487+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/4004949829 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4a4f0 0x558a1aa53d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.487+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/4004949829 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x558a1aa5e990 0x558a1aa64280 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.487+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/4004949829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa5b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.487+0000 7f66d2ffd700 0 client.15075 ms_handle_reset on v2:172.21.15.195:6836/2390721751 2024-05-08T23:15:12.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.487+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/4004949829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4ae50 0x558a1aa542c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.487+0000 7f6705f4cb80 1 -- 172.21.15.135:0/4004949829 >> 172.21.15.135:0/4004949829 conn(0x558a1a9a81c0 msgr2=0x558a1aa44550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.487+0000 7f6705f4cb80 1 -- 172.21.15.135:0/4004949829 shutdown_connections 2024-05-08T23:15:12.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.487+0000 7f6705f4cb80 1 -- 172.21.15.135:0/4004949829 wait complete. 2024-05-08T23:15:12.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.487+0000 7f6705f4cb80 20 client.15075 trim_cache size 0 max 16384 2024-05-08T23:15:12.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f6705f4cb80 1 Processor -- start 2024-05-08T23:15:12.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f6705f4cb80 1 -- start start 2024-05-08T23:15:12.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f6705f4cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa4a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f6705f4cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4ae50 0x558a1aa5b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f6705f4cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa54a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f6705f4cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a1a993150 con 0x558a1aa4a4f0 2024-05-08T23:15:12.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f6705f4cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a1a997010 con 0x558a1aa4b810 2024-05-08T23:15:12.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f6705f4cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a1a9395a0 con 0x558a1aa4ae50 2024-05-08T23:15:12.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa4a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa4a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36854/0 (socket says 172.21.15.135:36854) 2024-05-08T23:15:12.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f66f37fe700 1 -- 172.21.15.135:0/4067477789 learned_addr learned my addr 172.21.15.135:0/4067477789 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f66f3fff700 1 --2- 172.21.15.135:0/4067477789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa54a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f66f37fe700 1 -- 172.21.15.135:0/4067477789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4ae50 msgr2=0x558a1aa5b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f66f37fe700 1 --2- 172.21.15.135:0/4067477789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4ae50 0x558a1aa5b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f66f37fe700 1 -- 172.21.15.135:0/4067477789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 msgr2=0x558a1aa54a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f66f37fe700 1 --2- 172.21.15.135:0/4067477789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa54a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f66f37fe700 1 -- 172.21.15.135:0/4067477789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a1a960510 con 0x558a1aa4a4f0 2024-05-08T23:15:12.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f66f37fe700 1 --2- 172.21.15.135:0/4067477789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa4a8d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f66e4021040 tx=0x7f66e400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88dcf934a39fa2b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f66da7fc700 1 -- 172.21.15.135:0/4067477789 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e402d040 con 0x558a1aa4a4f0 2024-05-08T23:15:12.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f66da7fc700 1 -- 172.21.15.135:0/4067477789 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66e4005120 con 0x558a1aa4a4f0 2024-05-08T23:15:12.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.505+0000 7f66da7fc700 1 -- 172.21.15.135:0/4067477789 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4031a90 con 0x558a1aa4a4f0 2024-05-08T23:15:12.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.506+0000 7f6705f4cb80 1 -- 172.21.15.135:0/4067477789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 msgr2=0x558a1aa4a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.506+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/4067477789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa4a8d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f66e4021040 tx=0x7f66e400b480 comp rx=0 tx=0).stop 2024-05-08T23:15:12.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.506+0000 7f6705f4cb80 1 -- 172.21.15.135:0/4067477789 shutdown_connections 2024-05-08T23:15:12.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.506+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/4067477789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa54a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.506+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/4067477789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa4a8d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.506+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/4067477789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4ae50 0x558a1aa5b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.506+0000 7f6705f4cb80 1 -- 172.21.15.135:0/4067477789 >> 172.21.15.135:0/4067477789 conn(0x558a1a9a81c0 msgr2=0x558a1aa4bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.506+0000 7f6705f4cb80 1 -- 172.21.15.135:0/4067477789 shutdown_connections 2024-05-08T23:15:12.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.506+0000 7f6705f4cb80 1 -- 172.21.15.135:0/4067477789 wait complete. 2024-05-08T23:15:12.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.506+0000 7f6705f4cb80 1 -- start start 2024-05-08T23:15:12.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f6705f4cb80 1 Processor -- start 2024-05-08T23:15:12.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f6705f4cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa55910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f6705f4cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4ae50 0x558a1aa55e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f6705f4cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa5ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f6705f4cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a1aa5b240 con 0x558a1aa4a4f0 2024-05-08T23:15:12.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f6705f4cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a1aa5b3b0 con 0x558a1aa4b810 2024-05-08T23:15:12.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f6705f4cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a1aa5b570 con 0x558a1aa4ae50 2024-05-08T23:15:12.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f6705f4cb80 10 client.0 _ll_register_callbacks cb 0x558a1a93fae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:12.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa55910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa55910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36862/0 (socket says 172.21.15.135:36862) 2024-05-08T23:15:12.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f66f37fe700 1 -- 172.21.15.135:0/2076246964 learned_addr learned my addr 172.21.15.135:0/2076246964 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f66f3fff700 1 --2- 172.21.15.135:0/2076246964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa5ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f66f2ffd700 1 --2- 172.21.15.135:0/2076246964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4ae50 0x558a1aa55e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f66f37fe700 1 -- 172.21.15.135:0/2076246964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4ae50 msgr2=0x558a1aa55e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f66f37fe700 1 --2- 172.21.15.135:0/2076246964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4ae50 0x558a1aa55e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f66f37fe700 1 -- 172.21.15.135:0/2076246964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 msgr2=0x558a1aa5ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f66f37fe700 1 --2- 172.21.15.135:0/2076246964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa5ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f66f37fe700 1 -- 172.21.15.135:0/2076246964 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a1a81b360 con 0x558a1aa4a4f0 2024-05-08T23:15:12.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f66f37fe700 1 --2- 172.21.15.135:0/2076246964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa55910 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f66e4010ba0 tx=0x7f66e4005340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a3d2704c0e95a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f66d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:12.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f66d2ffd700 1 -- 172.21.15.135:0/2076246964 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e402d040 con 0x558a1aa4a4f0 2024-05-08T23:15:12.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f66d2ffd700 1 -- 172.21.15.135:0/2076246964 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f66e4017070 con 0x558a1aa4a4f0 2024-05-08T23:15:12.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.507+0000 7f6705f4cb80 1 -- 172.21.15.135:0/2076246964 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66e4015070 con 0x558a1aa4a4f0 2024-05-08T23:15:12.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.508+0000 7f66d2ffd700 1 -- 172.21.15.135:0/2076246964 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66e4031530 con 0x558a1aa4a4f0 2024-05-08T23:15:12.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.508+0000 7f6705f4cb80 10 client.15081 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:12.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.508+0000 7f6705f4cb80 1 -- 172.21.15.135:0/2076246964 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558a1a81fc80 con 0x558a1aa4a4f0 2024-05-08T23:15:12.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.508+0000 7f66d2ffd700 1 -- 172.21.15.135:0/2076246964 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66e404a020 con 0x558a1aa4a4f0 2024-05-08T23:15:12.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.508+0000 7f66d2ffd700 1 -- 172.21.15.135:0/2076246964 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f66e401c620 con 0x558a1aa4a4f0 2024-05-08T23:15:12.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.508+0000 7f6705f4cb80 10 client.15081 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:12.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.508+0000 7f6705f4cb80 10 client.15081 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T23:15:12.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.508+0000 7f6705f4cb80 20 client.15081 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:12.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.508+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/2076246964 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x558a1aaba4f0 0x558a1aab6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.508+0000 7f6705f4cb80 4 client.15081 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T23:15:12.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.508+0000 7f6705f4cb80 1 -- 172.21.15.135:0/2076246964 --> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558a1a992e70 con 0x558a1aaba4f0 2024-05-08T23:15:12.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.508+0000 7f66f2ffd700 1 --2- 172.21.15.135:0/2076246964 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x558a1aaba4f0 0x558a1aab6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.508+0000 7f66d2ffd700 10 client.15081 ms_handle_connect on v2:172.21.15.195:6836/2390721751 2024-05-08T23:15:12.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.508+0000 7f66f2ffd700 1 --2- 172.21.15.135:0/2076246964 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x558a1aaba4f0 0x558a1aab6e80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dd5257521c7fe8dc server_cookie=8a81ffce8f7cf6cf in_seq=0 out_seq=0 2024-05-08T23:15:12.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f66d2ffd700 1 -- 172.21.15.135:0/2076246964 <== mds.2 v2:172.21.15.195:6836/2390721751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x558a1a992e70 con 0x558a1aaba4f0 2024-05-08T23:15:12.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f66d2ffd700 10 client.15081 handle_command_reply: tid=0 2024-05-08T23:15:12.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f6705f4cb80 1 client.15081 shutdown 2024-05-08T23:15:12.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f6705f4cb80 1 -- 172.21.15.135:0/2076246964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 msgr2=0x558a1aa55910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/2076246964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa55910 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f66e4010ba0 tx=0x7f66e4005340 comp rx=0 tx=0).stop 2024-05-08T23:15:12.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f6705f4cb80 1 -- 172.21.15.135:0/2076246964 shutdown_connections 2024-05-08T23:15:12.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/2076246964 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x558a1aaba4f0 0x558a1aab6e80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/2076246964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558a1aa4b810 0x558a1aa5ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f66d2ffd700 0 client.15081 ms_handle_reset on v2:172.21.15.195:6836/2390721751 2024-05-08T23:15:12.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/2076246964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a1aa4a4f0 0x558a1aa55910 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f6705f4cb80 1 --2- 172.21.15.135:0/2076246964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a1aa4ae50 0x558a1aa55e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f6705f4cb80 1 -- 172.21.15.135:0/2076246964 >> 172.21.15.135:0/2076246964 conn(0x558a1a9a81c0 msgr2=0x558a1aa54a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f6705f4cb80 1 -- 172.21.15.135:0/2076246964 shutdown_connections 2024-05-08T23:15:12.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f6705f4cb80 1 -- 172.21.15.135:0/2076246964 wait complete. 2024-05-08T23:15:12.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f6705f4cb80 20 client.15081 trim_cache size 0 max 16384 2024-05-08T23:15:12.516 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:15:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "c804a50a-0d8f-11ef-bc97-c7b262605968", 2024-05-08T23:15:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 2, 2024-05-08T23:15:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24484, 2024-05-08T23:15:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-08T23:15:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-08T23:15:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-08T23:15:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 46.557660558000002, 2024-05-08T23:15:12.516 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 27, 2024-05-08T23:15:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 83, 2024-05-08T23:15:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 83, 2024-05-08T23:15:12.517 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 64.970300178000002 2024-05-08T23:15:12.517 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:15:12.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f66f9d92700 1 -- 172.21.15.135:0/3018427045 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f66dc0a11b0 msgr2=0x7f66dc0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f66f9d92700 1 --2- 172.21.15.135:0/3018427045 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f66dc0a11b0 0x7f66dc0a3670 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f66e4005950 tx=0x7f66e400b410 comp rx=0 tx=0).stop 2024-05-08T23:15:12.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f66f9d92700 1 -- 172.21.15.135:0/3018427045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66f4106ce0 msgr2=0x7f66f40fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.509+0000 7f66f9d92700 1 --2- 172.21.15.135:0/3018427045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66f4106ce0 0x7f66f40fff70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f66ec007ee0 tx=0x7f66ec00d3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.510+0000 7f66f9d92700 1 -- 172.21.15.135:0/3018427045 shutdown_connections 2024-05-08T23:15:12.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.510+0000 7f66f9d92700 1 --2- 172.21.15.135:0/3018427045 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f66dc0a11b0 0x7f66dc0a3670 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.510+0000 7f66f9d92700 1 --2- 172.21.15.135:0/3018427045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f4101a80 0x7f66f41013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.510+0000 7f66f9d92700 1 --2- 172.21.15.135:0/3018427045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66f4106ce0 0x7f66f40fff70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.510+0000 7f66f9d92700 1 --2- 172.21.15.135:0/3018427045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66f41043b0 0x7f66f40ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.510+0000 7f66f9d92700 1 -- 172.21.15.135:0/3018427045 >> 172.21.15.135:0/3018427045 conn(0x7f66f40fb3f0 msgr2=0x7f66f4103910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.510+0000 7f66f9d92700 1 -- 172.21.15.135:0/3018427045 shutdown_connections 2024-05-08T23:15:12.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.510+0000 7f66f9d92700 1 -- 172.21.15.135:0/3018427045 wait complete. 2024-05-08T23:15:12.522 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-08T23:15:12.546 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:12 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1348442918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:12.547 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:12 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/833127920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:15:12.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:12 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1348442918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:12.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:12 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/833127920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:15:12.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:12 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1348442918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:12.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:12 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/833127920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:15:12.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 -- 172.21.15.135:0/3862632779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c1c0ffe60 msgr2=0x7f2c1c100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 --2- 172.21.15.135:0/3862632779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c1c0ffe60 0x7f2c1c100280 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009990 tx=0x7f2c18009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 -- 172.21.15.135:0/3862632779 shutdown_connections 2024-05-08T23:15:12.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 --2- 172.21.15.135:0/3862632779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c1c101970 0x7f2c1c108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 --2- 172.21.15.135:0/3862632779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c1c0ffe60 0x7f2c1c100280 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 --2- 172.21.15.135:0/3862632779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c1c100fb0 0x7f2c1c101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 -- 172.21.15.135:0/3862632779 >> 172.21.15.135:0/3862632779 conn(0x7f2c1c0fb3f0 msgr2=0x7f2c1c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 -- 172.21.15.135:0/3862632779 shutdown_connections 2024-05-08T23:15:12.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 -- 172.21.15.135:0/3862632779 wait complete. 2024-05-08T23:15:12.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 Processor -- start 2024-05-08T23:15:12.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 -- start start 2024-05-08T23:15:12.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c1c0ffe60 0x7f2c1c195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c1c100fb0 0x7f2c1c196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c1c101970 0x7f2c1c19d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c19d8f0 con 0x7f2c1c100fb0 2024-05-08T23:15:12.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c19da60 con 0x7f2c1c101970 2024-05-08T23:15:12.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.647+0000 7f2c23308700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c19dc20 con 0x7f2c1c0ffe60 2024-05-08T23:15:12.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c208a3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c1c100fb0 0x7f2c1c196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c208a3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c1c100fb0 0x7f2c1c196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36872/0 (socket says 172.21.15.135:36872) 2024-05-08T23:15:12.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c208a3700 1 -- 172.21.15.135:0/875542882 learned_addr learned my addr 172.21.15.135:0/875542882 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c210a4700 1 --2- 172.21.15.135:0/875542882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c1c0ffe60 0x7f2c1c195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c218a5700 1 --2- 172.21.15.135:0/875542882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c1c101970 0x7f2c1c19d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c208a3700 1 -- 172.21.15.135:0/875542882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c1c0ffe60 msgr2=0x7f2c1c195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c208a3700 1 --2- 172.21.15.135:0/875542882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c1c0ffe60 0x7f2c1c195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c208a3700 1 -- 172.21.15.135:0/875542882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c1c101970 msgr2=0x7f2c1c19d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c208a3700 1 --2- 172.21.15.135:0/875542882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c1c101970 0x7f2c1c19d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c208a3700 1 -- 172.21.15.135:0/875542882 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c180095f0 con 0x7f2c1c100fb0 2024-05-08T23:15:12.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c208a3700 1 --2- 172.21.15.135:0/875542882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c1c100fb0 0x7f2c1c196340 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00d980 tx=0x7f2c0c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c127fc700 1 -- 172.21.15.135:0/875542882 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c004220 con 0x7f2c1c100fb0 2024-05-08T23:15:12.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c127fc700 1 -- 172.21.15.135:0/875542882 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c0c007640 con 0x7f2c1c100fb0 2024-05-08T23:15:12.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c23308700 1 -- 172.21.15.135:0/875542882 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1c19df00 con 0x7f2c1c100fb0 2024-05-08T23:15:12.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c127fc700 1 -- 172.21.15.135:0/875542882 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c005690 con 0x7f2c1c100fb0 2024-05-08T23:15:12.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.648+0000 7f2c23308700 1 -- 172.21.15.135:0/875542882 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1c19e320 con 0x7f2c1c100fb0 2024-05-08T23:15:12.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.651+0000 7f2c127fc700 1 -- 172.21.15.135:0/875542882 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f2c0c004750 con 0x7f2c1c100fb0 2024-05-08T23:15:12.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.651+0000 7f2c127fc700 1 --2- 172.21.15.135:0/875542882 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c080a11b0 0x7f2c080a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.652+0000 7f2c127fc700 1 -- 172.21.15.135:0/875542882 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2c0c0cc7d0 con 0x7f2c1c100fb0 2024-05-08T23:15:12.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.652+0000 7f2c210a4700 1 --2- 172.21.15.135:0/875542882 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c080a11b0 0x7f2c080a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.652+0000 7f2c210a4700 1 --2- 172.21.15.135:0/875542882 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c080a11b0 0x7f2c080a3670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800b5c0 tx=0x7f2c18003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.652+0000 7f2c2f4c2b80 1 Processor -- start 2024-05-08T23:15:12.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.652+0000 7f2c2f4c2b80 1 -- start start 2024-05-08T23:15:12.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.652+0000 7f2c2f4c2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50db4f0 0x557fd50db910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c2f4c2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50dbe50 0x557fd50dc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c2f4c2b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dc810 0x557fd50dcc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c2f4c2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd5032100 con 0x557fd50db4f0 2024-05-08T23:15:12.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c2f4c2b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd502fac0 con 0x557fd50dc810 2024-05-08T23:15:12.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c2f4c2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd502b3b0 con 0x557fd50dbe50 2024-05-08T23:15:12.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c210a4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50db4f0 0x557fd50db910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c210a4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50db4f0 0x557fd50db910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36876/0 (socket says 172.21.15.135:36876) 2024-05-08T23:15:12.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c210a4700 1 -- 172.21.15.135:0/3218852984 learned_addr learned my addr 172.21.15.135:0/3218852984 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c208a3700 1 --2- 172.21.15.135:0/3218852984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50dbe50 0x557fd50dc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c218a5700 1 --2- 172.21.15.135:0/3218852984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dc810 0x557fd50dcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c210a4700 1 -- 172.21.15.135:0/3218852984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50dbe50 msgr2=0x557fd50dc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c210a4700 1 --2- 172.21.15.135:0/3218852984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50dbe50 0x557fd50dc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c210a4700 1 -- 172.21.15.135:0/3218852984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dc810 msgr2=0x557fd50dcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c210a4700 1 --2- 172.21.15.135:0/3218852984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dc810 0x557fd50dcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c210a4700 1 -- 172.21.15.135:0/3218852984 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557fd4eac360 con 0x557fd50db4f0 2024-05-08T23:15:12.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c210a4700 1 --2- 172.21.15.135:0/3218852984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50db4f0 0x557fd50db910 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800b770 tx=0x7f2c18020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261c1260e1855bc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c077fe700 1 -- 172.21.15.135:0/3218852984 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1802b070 con 0x557fd50db4f0 2024-05-08T23:15:12.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c077fe700 1 -- 172.21.15.135:0/3218852984 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c1801e040 con 0x557fd50db4f0 2024-05-08T23:15:12.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.653+0000 7f2c077fe700 1 -- 172.21.15.135:0/3218852984 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1800f840 con 0x557fd50db4f0 2024-05-08T23:15:12.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.654+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/3218852984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50db4f0 msgr2=0x557fd50db910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.654+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/3218852984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50db4f0 0x557fd50db910 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800b770 tx=0x7f2c18020000 comp rx=0 tx=0).stop 2024-05-08T23:15:12.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.654+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/3218852984 shutdown_connections 2024-05-08T23:15:12.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.654+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/3218852984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dc810 0x557fd50dcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.654+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/3218852984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50db4f0 0x557fd50db910 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.654+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/3218852984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50dbe50 0x557fd50dc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.654+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/3218852984 >> 172.21.15.135:0/3218852984 conn(0x557fd50391c0 msgr2=0x557fd50d5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.654+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/3218852984 shutdown_connections 2024-05-08T23:15:12.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.654+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/3218852984 wait complete. 2024-05-08T23:15:12.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.654+0000 7f2c2f4c2b80 1 -- start start 2024-05-08T23:15:12.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.654+0000 7f2c2f4c2b80 1 Processor -- start 2024-05-08T23:15:12.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c2f4c2b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50db4f0 0x557fd50e4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c2f4c2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dbe50 0x557fd50e5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c2f4c2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50dc810 0x557fd50ec240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c2f4c2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd4fc7510 con 0x557fd50dbe50 2024-05-08T23:15:12.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c2f4c2b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd4fc71b0 con 0x557fd50db4f0 2024-05-08T23:15:12.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c2f4c2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd4eae650 con 0x557fd50dc810 2024-05-08T23:15:12.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c2f4c2b80 10 client.0 _ll_register_callbacks cb 0x557fd4fd0ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:12.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c208a3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dbe50 0x557fd50e5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c208a3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dbe50 0x557fd50e5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36886/0 (socket says 172.21.15.135:36886) 2024-05-08T23:15:12.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c208a3700 1 -- 172.21.15.135:0/1684758643 learned_addr learned my addr 172.21.15.135:0/1684758643 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c218a5700 1 --2- 172.21.15.135:0/1684758643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50dc810 0x557fd50ec240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c210a4700 1 --2- 172.21.15.135:0/1684758643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50db4f0 0x557fd50e4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c208a3700 1 -- 172.21.15.135:0/1684758643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50dc810 msgr2=0x557fd50ec240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c208a3700 1 --2- 172.21.15.135:0/1684758643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50dc810 0x557fd50ec240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c208a3700 1 -- 172.21.15.135:0/1684758643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50db4f0 msgr2=0x557fd50e4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c208a3700 1 --2- 172.21.15.135:0/1684758643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50db4f0 0x557fd50e4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c208a3700 1 -- 172.21.15.135:0/1684758643 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1c108bc0 con 0x557fd50dbe50 2024-05-08T23:15:12.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c210a4700 1 --2- 172.21.15.135:0/1684758643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50db4f0 0x557fd50e4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:12.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c208a3700 1 --2- 172.21.15.135:0/1684758643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dbe50 0x557fd50e5200 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c007e80 tx=0x7f2c0c099c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7f0c8956255049 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.655+0000 7f2c04ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:12.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.656+0000 7f2c04ff9700 1 -- 172.21.15.135:0/1684758643 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0a1ff0 con 0x557fd50dbe50 2024-05-08T23:15:12.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.656+0000 7f2c04ff9700 1 -- 172.21.15.135:0/1684758643 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2c0c099060 con 0x557fd50dbe50 2024-05-08T23:15:12.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.656+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/1684758643 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557fd4f84220 con 0x557fd50dbe50 2024-05-08T23:15:12.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.656+0000 7f2c04ff9700 1 -- 172.21.15.135:0/1684758643 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c0c099220 con 0x557fd50dbe50 2024-05-08T23:15:12.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.656+0000 7f2c2f4c2b80 10 client.15093 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:12.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.656+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/1684758643 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557fd4e58b10 con 0x557fd50dbe50 2024-05-08T23:15:12.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.656+0000 7f2c04ff9700 1 -- 172.21.15.135:0/1684758643 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557fd4f84220 con 0x557fd50dbe50 2024-05-08T23:15:12.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.656+0000 7f2c04ff9700 1 -- 172.21.15.135:0/1684758643 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2c0c09abf0 con 0x557fd50dbe50 2024-05-08T23:15:12.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.656+0000 7f2c2f4c2b80 10 client.15093 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:12.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.656+0000 7f2c2f4c2b80 10 client.15093 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T23:15:12.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.656+0000 7f2c2f4c2b80 20 client.15093 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:12.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.656+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/1684758643 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x557fd50efea0 0x557fd50f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.656+0000 7f2c2f4c2b80 4 client.15093 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:15:12.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.656+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/1684758643 --> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557fd50aa7c0 con 0x557fd50efea0 2024-05-08T23:15:12.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.656+0000 7f2c210a4700 1 --2- 172.21.15.135:0/1684758643 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x557fd50efea0 0x557fd50f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.657+0000 7f2c210a4700 1 --2- 172.21.15.135:0/1684758643 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x557fd50efea0 0x557fd50f51a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=60940fbdaedc3096 server_cookie=21508fec5af003b0 in_seq=0 out_seq=0 2024-05-08T23:15:12.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.657+0000 7f2c04ff9700 10 client.15093 ms_handle_connect on v2:172.21.15.179:6838/1135239419 2024-05-08T23:15:12.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.657+0000 7f2c04ff9700 1 -- 172.21.15.135:0/1684758643 <== mds.1 v2:172.21.15.179:6838/1135239419 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557fd50aa7c0 con 0x557fd50efea0 2024-05-08T23:15:12.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.657+0000 7f2c04ff9700 10 client.15093 handle_command_reply: tid=0 2024-05-08T23:15:12.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.657+0000 7f2c2f4c2b80 1 client.15093 shutdown 2024-05-08T23:15:12.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.658+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/1684758643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dbe50 msgr2=0x557fd50e5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.658+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/1684758643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dbe50 0x557fd50e5200 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c007e80 tx=0x7f2c0c099c20 comp rx=0 tx=0).stop 2024-05-08T23:15:12.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.658+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/1684758643 shutdown_connections 2024-05-08T23:15:12.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.658+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/1684758643 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x557fd50efea0 0x557fd50f51a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.658+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/1684758643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50dc810 0x557fd50ec240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.658+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/1684758643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50db4f0 0x557fd50e4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.658+0000 7f2c04ff9700 0 client.15093 ms_handle_reset on v2:172.21.15.179:6838/1135239419 2024-05-08T23:15:12.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.658+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/1684758643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dbe50 0x557fd50e5200 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.658+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/1684758643 >> 172.21.15.135:0/1684758643 conn(0x557fd50391c0 msgr2=0x557fd50d5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.658+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/1684758643 shutdown_connections 2024-05-08T23:15:12.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.658+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/1684758643 wait complete. 2024-05-08T23:15:12.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.658+0000 7f2c2f4c2b80 20 client.15093 trim_cache size 0 max 16384 2024-05-08T23:15:12.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c2f4c2b80 1 Processor -- start 2024-05-08T23:15:12.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c2f4c2b80 1 -- start start 2024-05-08T23:15:12.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c2f4c2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50db4f0 0x557fd50ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c2f4c2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dbe50 0x557fd50ec200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c2f4c2b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dc810 0x557fd50e2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c2f4c2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd4f84220 con 0x557fd50dbe50 2024-05-08T23:15:12.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c2f4c2b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd50edfd0 con 0x557fd50dc810 2024-05-08T23:15:12.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c2f4c2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd4fe92b0 con 0x557fd50db4f0 2024-05-08T23:15:12.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c208a3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dbe50 0x557fd50ec200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c208a3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dbe50 0x557fd50ec200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36900/0 (socket says 172.21.15.135:36900) 2024-05-08T23:15:12.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c208a3700 1 -- 172.21.15.135:0/3765980483 learned_addr learned my addr 172.21.15.135:0/3765980483 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c210a4700 1 --2- 172.21.15.135:0/3765980483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50db4f0 0x557fd50ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c218a5700 1 --2- 172.21.15.135:0/3765980483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dc810 0x557fd50e2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c208a3700 1 -- 172.21.15.135:0/3765980483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50db4f0 msgr2=0x557fd50ec8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c208a3700 1 --2- 172.21.15.135:0/3765980483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50db4f0 0x557fd50ec8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c208a3700 1 -- 172.21.15.135:0/3765980483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dc810 msgr2=0x557fd50e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c208a3700 1 --2- 172.21.15.135:0/3765980483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dc810 0x557fd50e2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c208a3700 1 -- 172.21.15.135:0/3765980483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557fd4ff1510 con 0x557fd50dbe50 2024-05-08T23:15:12.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c210a4700 1 --2- 172.21.15.135:0/3765980483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50db4f0 0x557fd50ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:12.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c218a5700 1 --2- 172.21.15.135:0/3765980483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dc810 0x557fd50e2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:12.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.676+0000 7f2c208a3700 1 --2- 172.21.15.135:0/3765980483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dbe50 0x557fd50ec200 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c007fd0 tx=0x7f2c0c0050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd6db93fe7ae1e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.677+0000 7f2c07fff700 1 -- 172.21.15.135:0/3765980483 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0a1ff0 con 0x557fd50dbe50 2024-05-08T23:15:12.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.677+0000 7f2c07fff700 1 -- 172.21.15.135:0/3765980483 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c0c0b2410 con 0x557fd50dbe50 2024-05-08T23:15:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.677+0000 7f2c07fff700 1 -- 172.21.15.135:0/3765980483 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0a1b60 con 0x557fd50dbe50 2024-05-08T23:15:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.677+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/3765980483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dbe50 msgr2=0x557fd50ec200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.677+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/3765980483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dbe50 0x557fd50ec200 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c007fd0 tx=0x7f2c0c0050b0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.677+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/3765980483 shutdown_connections 2024-05-08T23:15:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.677+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/3765980483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50db4f0 0x557fd50ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.677+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/3765980483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dc810 0x557fd50e2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.677+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/3765980483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dbe50 0x557fd50ec200 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.677+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/3765980483 >> 172.21.15.135:0/3765980483 conn(0x557fd50391c0 msgr2=0x557fd50dcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.677+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/3765980483 shutdown_connections 2024-05-08T23:15:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.677+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/3765980483 wait complete. 2024-05-08T23:15:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.677+0000 7f2c2f4c2b80 1 -- start start 2024-05-08T23:15:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c2f4c2b80 1 Processor -- start 2024-05-08T23:15:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c2f4c2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50db4f0 0x557fd50e63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c2f4c2b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dbe50 0x557fd50e6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c2f4c2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dc810 0x557fd50eb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c2f4c2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd50ebd80 con 0x557fd50dc810 2024-05-08T23:15:12.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c2f4c2b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd50ebef0 con 0x557fd50dbe50 2024-05-08T23:15:12.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c2f4c2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd50ec0b0 con 0x557fd50db4f0 2024-05-08T23:15:12.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c2f4c2b80 10 client.0 _ll_register_callbacks cb 0x557fd4fd0ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:12.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c218a5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dc810 0x557fd50eb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c218a5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dc810 0x557fd50eb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36902/0 (socket says 172.21.15.135:36902) 2024-05-08T23:15:12.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c218a5700 1 -- 172.21.15.135:0/413560850 learned_addr learned my addr 172.21.15.135:0/413560850 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c208a3700 1 --2- 172.21.15.135:0/413560850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dbe50 0x557fd50e6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c210a4700 1 --2- 172.21.15.135:0/413560850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50db4f0 0x557fd50e63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c218a5700 1 -- 172.21.15.135:0/413560850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50db4f0 msgr2=0x557fd50e63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c218a5700 1 --2- 172.21.15.135:0/413560850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50db4f0 0x557fd50e63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c218a5700 1 -- 172.21.15.135:0/413560850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dbe50 msgr2=0x557fd50e6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c218a5700 1 --2- 172.21.15.135:0/413560850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dbe50 0x557fd50e6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c218a5700 1 -- 172.21.15.135:0/413560850 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557fd4e58b10 con 0x557fd50dc810 2024-05-08T23:15:12.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c210a4700 1 --2- 172.21.15.135:0/413560850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50db4f0 0x557fd50e63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:12.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c208a3700 1 --2- 172.21.15.135:0/413560850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dbe50 0x557fd50e6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:12.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c218a5700 1 --2- 172.21.15.135:0/413560850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dc810 0x557fd50eb840 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2c140040c0 tx=0x7f2c14004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3395998ef6d3488c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.678+0000 7f2c04ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:12.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.679+0000 7f2c04ff9700 1 -- 172.21.15.135:0/413560850 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140076b0 con 0x557fd50dc810 2024-05-08T23:15:12.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.679+0000 7f2c04ff9700 1 -- 172.21.15.135:0/413560850 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2c14007810 con 0x557fd50dc810 2024-05-08T23:15:12.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.679+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/413560850 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c1801e040 con 0x557fd50dc810 2024-05-08T23:15:12.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.679+0000 7f2c04ff9700 1 -- 172.21.15.135:0/413560850 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c140079d0 con 0x557fd50dc810 2024-05-08T23:15:12.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.679+0000 7f2c2f4c2b80 10 client.15099 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:12.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.679+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/413560850 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557fd4eb0c80 con 0x557fd50dc810 2024-05-08T23:15:12.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.679+0000 7f2c04ff9700 1 -- 172.21.15.135:0/413560850 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c14028020 con 0x557fd50dc810 2024-05-08T23:15:12.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.679+0000 7f2c04ff9700 1 -- 172.21.15.135:0/413560850 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2c14017470 con 0x557fd50dc810 2024-05-08T23:15:12.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.679+0000 7f2c2f4c2b80 10 client.15099 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:12.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.679+0000 7f2c2f4c2b80 10 client.15099 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T23:15:12.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.679+0000 7f2c2f4c2b80 20 client.15099 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:12.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.679+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/413560850 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x557fd514b630 0x557fd5147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.679+0000 7f2c2f4c2b80 4 client.15099 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T23:15:12.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.679+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/413560850 --> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557fd5023e70 con 0x557fd514b630 2024-05-08T23:15:12.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.679+0000 7f2c210a4700 1 --2- 172.21.15.135:0/413560850 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x557fd514b630 0x557fd5147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c04ff9700 10 client.15099 ms_handle_connect on v2:172.21.15.179:6838/1135239419 2024-05-08T23:15:12.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c210a4700 1 --2- 172.21.15.135:0/413560850 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x557fd514b630 0x557fd5147fa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e34ffba2a2e69fc6 server_cookie=399475ff9d4cda5d in_seq=0 out_seq=0 2024-05-08T23:15:12.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c04ff9700 1 -- 172.21.15.135:0/413560850 <== mds.1 v2:172.21.15.179:6838/1135239419 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x557fd5023e70 con 0x557fd514b630 2024-05-08T23:15:12.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c04ff9700 10 client.15099 handle_command_reply: tid=0 2024-05-08T23:15:12.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c2f4c2b80 1 client.15099 shutdown 2024-05-08T23:15:12.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/413560850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dc810 msgr2=0x557fd50eb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/413560850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dc810 0x557fd50eb840 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2c140040c0 tx=0x7f2c14004480 comp rx=0 tx=0).stop 2024-05-08T23:15:12.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/413560850 shutdown_connections 2024-05-08T23:15:12.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/413560850 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x557fd514b630 0x557fd5147fa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/413560850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557fd50db4f0 0x557fd50e63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/413560850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557fd50dc810 0x557fd50eb840 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c04ff9700 0 client.15099 ms_handle_reset on v2:172.21.15.179:6838/1135239419 2024-05-08T23:15:12.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c2f4c2b80 1 --2- 172.21.15.135:0/413560850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557fd50dbe50 0x557fd50e6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/413560850 >> 172.21.15.135:0/413560850 conn(0x557fd50391c0 msgr2=0x557fd50df740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/413560850 shutdown_connections 2024-05-08T23:15:12.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c2f4c2b80 1 -- 172.21.15.135:0/413560850 wait complete. 2024-05-08T23:15:12.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.680+0000 7f2c2f4c2b80 20 client.15099 trim_cache size 0 max 16384 2024-05-08T23:15:12.687 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:15:12.687 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "c804a50a-0d8f-11ef-bc97-c7b262605968", 2024-05-08T23:15:12.687 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 1, 2024-05-08T23:15:12.687 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24500, 2024-05-08T23:15:12.688 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-08T23:15:12.688 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-08T23:15:12.688 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-08T23:15:12.688 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 47.736409942999998, 2024-05-08T23:15:12.688 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 27, 2024-05-08T23:15:12.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 83, 2024-05-08T23:15:12.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 83, 2024-05-08T23:15:12.688 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 56.262686496999997 2024-05-08T23:15:12.688 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:15:12.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.681+0000 7f2c23308700 1 -- 172.21.15.135:0/875542882 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c080a11b0 msgr2=0x7f2c080a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.681+0000 7f2c23308700 1 --2- 172.21.15.135:0/875542882 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c080a11b0 0x7f2c080a3670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800b5c0 tx=0x7f2c18003790 comp rx=0 tx=0).stop 2024-05-08T23:15:12.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.681+0000 7f2c23308700 1 -- 172.21.15.135:0/875542882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c1c100fb0 msgr2=0x7f2c1c196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.681+0000 7f2c23308700 1 --2- 172.21.15.135:0/875542882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c1c100fb0 0x7f2c1c196340 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00d980 tx=0x7f2c0c00dc90 comp rx=0 tx=0).stop 2024-05-08T23:15:12.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.681+0000 7f2c23308700 1 -- 172.21.15.135:0/875542882 shutdown_connections 2024-05-08T23:15:12.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.681+0000 7f2c23308700 1 --2- 172.21.15.135:0/875542882 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c080a11b0 0x7f2c080a3670 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.681+0000 7f2c23308700 1 --2- 172.21.15.135:0/875542882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c1c0ffe60 0x7f2c1c195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.681+0000 7f2c23308700 1 --2- 172.21.15.135:0/875542882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c1c101970 0x7f2c1c19d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.681+0000 7f2c23308700 1 --2- 172.21.15.135:0/875542882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c1c100fb0 0x7f2c1c196340 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.681+0000 7f2c23308700 1 -- 172.21.15.135:0/875542882 >> 172.21.15.135:0/875542882 conn(0x7f2c1c0fb3f0 msgr2=0x7f2c1c104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.681+0000 7f2c23308700 1 -- 172.21.15.135:0/875542882 shutdown_connections 2024-05-08T23:15:12.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.681+0000 7f2c23308700 1 -- 172.21.15.135:0/875542882 wait complete. 2024-05-08T23:15:12.692 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-05-08T23:15:12.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.856+0000 7f4b92aa4700 1 -- 172.21.15.135:0/161673068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c0ffe80 msgr2=0x7f4b8c1002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.856+0000 7f4b92aa4700 1 --2- 172.21.15.135:0/161673068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c0ffe80 0x7f4b8c1002a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009990 tx=0x7f4b80009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.856+0000 7f4b92aa4700 1 -- 172.21.15.135:0/161673068 shutdown_connections 2024-05-08T23:15:12.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.856+0000 7f4b92aa4700 1 --2- 172.21.15.135:0/161673068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b8c101990 0x7f4b8c1082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.856+0000 7f4b92aa4700 1 --2- 172.21.15.135:0/161673068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c0ffe80 0x7f4b8c1002a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.856+0000 7f4b92aa4700 1 --2- 172.21.15.135:0/161673068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b8c100fd0 0x7f4b8c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.856+0000 7f4b92aa4700 1 -- 172.21.15.135:0/161673068 >> 172.21.15.135:0/161673068 conn(0x7f4b8c0fb3f0 msgr2=0x7f4b8c0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.856+0000 7f4b92aa4700 1 -- 172.21.15.135:0/161673068 shutdown_connections 2024-05-08T23:15:12.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.856+0000 7f4b92aa4700 1 -- 172.21.15.135:0/161673068 wait complete. 2024-05-08T23:15:12.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b92aa4700 1 Processor -- start 2024-05-08T23:15:12.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b92aa4700 1 -- start start 2024-05-08T23:15:12.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b92aa4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b8c0ffe80 0x7f4b8c196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b92aa4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b8c100fd0 0x7f4b8c197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b92aa4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c101990 0x7f4b8c19e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b92aa4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c19ea20 con 0x7f4b8c101990 2024-05-08T23:15:12.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b92aa4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c19eb60 con 0x7f4b8c100fd0 2024-05-08T23:15:12.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b92aa4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c19ecf0 con 0x7f4b8c0ffe80 2024-05-08T23:15:12.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b91041700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c101990 0x7f4b8c19e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b91041700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c101990 0x7f4b8c19e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36920/0 (socket says 172.21.15.135:36920) 2024-05-08T23:15:12.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b91041700 1 -- 172.21.15.135:0/2885291301 learned_addr learned my addr 172.21.15.135:0/2885291301 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b90840700 1 --2- 172.21.15.135:0/2885291301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b8c0ffe80 0x7f4b8c196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b8bfff700 1 --2- 172.21.15.135:0/2885291301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b8c100fd0 0x7f4b8c197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b91041700 1 -- 172.21.15.135:0/2885291301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b8c0ffe80 msgr2=0x7f4b8c196ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b91041700 1 --2- 172.21.15.135:0/2885291301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b8c0ffe80 0x7f4b8c196ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b91041700 1 -- 172.21.15.135:0/2885291301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b8c100fd0 msgr2=0x7f4b8c197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b91041700 1 --2- 172.21.15.135:0/2885291301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b8c100fd0 0x7f4b8c197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.857+0000 7f4b91041700 1 -- 172.21.15.135:0/2885291301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800095f0 con 0x7f4b8c101990 2024-05-08T23:15:12.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.858+0000 7f4b91041700 1 --2- 172.21.15.135:0/2885291301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c101990 0x7f4b8c19e450 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400ada0 tx=0x7f4b8400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.858+0000 7f4b89ffb700 1 -- 172.21.15.135:0/2885291301 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8400f070 con 0x7f4b8c101990 2024-05-08T23:15:12.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.858+0000 7f4b89ffb700 1 -- 172.21.15.135:0/2885291301 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b84007b30 con 0x7f4b8c101990 2024-05-08T23:15:12.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.858+0000 7f4b92aa4700 1 -- 172.21.15.135:0/2885291301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8c19efd0 con 0x7f4b8c101990 2024-05-08T23:15:12.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.858+0000 7f4b89ffb700 1 -- 172.21.15.135:0/2885291301 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b84005440 con 0x7f4b8c101990 2024-05-08T23:15:12.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.858+0000 7f4b92aa4700 1 -- 172.21.15.135:0/2885291301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8c19f450 con 0x7f4b8c101990 2024-05-08T23:15:12.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.860+0000 7f4b89ffb700 1 -- 172.21.15.135:0/2885291301 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f4b84004ad0 con 0x7f4b8c101990 2024-05-08T23:15:12.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.860+0000 7f4b89ffb700 1 --2- 172.21.15.135:0/2885291301 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4b7c0a1230 0x7f4b7c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.860+0000 7f4b89ffb700 1 -- 172.21.15.135:0/2885291301 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4b840cbf10 con 0x7f4b8c101990 2024-05-08T23:15:12.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.860+0000 7f4b90840700 1 --2- 172.21.15.135:0/2885291301 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4b7c0a1230 0x7f4b7c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.861+0000 7f4b90840700 1 --2- 172.21.15.135:0/2885291301 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4b7c0a1230 0x7f4b7c0a36f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000b5c0 tx=0x7f4b80005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.861+0000 7f4b9ec5eb80 1 Processor -- start 2024-05-08T23:15:12.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.861+0000 7f4b9ec5eb80 1 -- start start 2024-05-08T23:15:12.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b9ec5eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda09f4f0 0x555dda09f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b9ec5eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b9ec5eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda0a0810 0x555dda0a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b9ec5eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd9ff6100 con 0x555dda09fe50 2024-05-08T23:15:12.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b9ec5eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd9ff3ac0 con 0x555dda09f4f0 2024-05-08T23:15:12.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b9ec5eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd9fef3b0 con 0x555dda0a0810 2024-05-08T23:15:12.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b8bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b8bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0a02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36932/0 (socket says 172.21.15.135:36932) 2024-05-08T23:15:12.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b8bfff700 1 -- 172.21.15.135:0/1728998866 learned_addr learned my addr 172.21.15.135:0/1728998866 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b90840700 1 --2- 172.21.15.135:0/1728998866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda09f4f0 0x555dda09f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b91041700 1 --2- 172.21.15.135:0/1728998866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda0a0810 0x555dda0a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b8bfff700 1 -- 172.21.15.135:0/1728998866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda0a0810 msgr2=0x555dda0a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b8bfff700 1 --2- 172.21.15.135:0/1728998866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda0a0810 0x555dda0a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b8bfff700 1 -- 172.21.15.135:0/1728998866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda09f4f0 msgr2=0x555dda09f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b8bfff700 1 --2- 172.21.15.135:0/1728998866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda09f4f0 0x555dda09f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b8bfff700 1 -- 172.21.15.135:0/1728998866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dd9e70360 con 0x555dda09fe50 2024-05-08T23:15:12.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b90840700 1 --2- 172.21.15.135:0/1728998866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda09f4f0 0x555dda09f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:12.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b8bfff700 1 --2- 172.21.15.135:0/1728998866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0a02d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800bd70 tx=0x7f4b7800f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac2245bf4bbf078 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b76ffd700 1 -- 172.21.15.135:0/1728998866 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800fe50 con 0x555dda09fe50 2024-05-08T23:15:12.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b76ffd700 1 -- 172.21.15.135:0/1728998866 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b7801a920 con 0x555dda09fe50 2024-05-08T23:15:12.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.862+0000 7f4b76ffd700 1 -- 172.21.15.135:0/1728998866 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780118d0 con 0x555dda09fe50 2024-05-08T23:15:12.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.863+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/1728998866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 msgr2=0x555dda0a02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.863+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/1728998866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0a02d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800bd70 tx=0x7f4b7800f640 comp rx=0 tx=0).stop 2024-05-08T23:15:12.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.863+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/1728998866 shutdown_connections 2024-05-08T23:15:12.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.863+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/1728998866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda0a0810 0x555dda0a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.863+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/1728998866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda09f4f0 0x555dda09f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.863+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/1728998866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0a02d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.863+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/1728998866 >> 172.21.15.135:0/1728998866 conn(0x555dd9ffd1c0 msgr2=0x555dda099d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.863+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/1728998866 shutdown_connections 2024-05-08T23:15:12.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.863+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/1728998866 wait complete. 2024-05-08T23:15:12.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.863+0000 7f4b9ec5eb80 1 -- start start 2024-05-08T23:15:12.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.863+0000 7f4b9ec5eb80 1 Processor -- start 2024-05-08T23:15:12.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b9ec5eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda09f4f0 0x555dda0a8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b9ec5eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0a92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b9ec5eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda0a0810 0x555dda0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b9ec5eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd9f8b510 con 0x555dda09fe50 2024-05-08T23:15:12.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b9ec5eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd9f8b1b0 con 0x555dda0a0810 2024-05-08T23:15:12.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b9ec5eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd9e72650 con 0x555dda09f4f0 2024-05-08T23:15:12.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b9ec5eb80 10 client.0 _ll_register_callbacks cb 0x555dd9f94ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:12.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b8bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0a92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b8bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0a92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36936/0 (socket says 172.21.15.135:36936) 2024-05-08T23:15:12.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b8bfff700 1 -- 172.21.15.135:0/3618821649 learned_addr learned my addr 172.21.15.135:0/3618821649 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b91041700 1 --2- 172.21.15.135:0/3618821649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda0a0810 0x555dda0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b8bfff700 1 -- 172.21.15.135:0/3618821649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda09f4f0 msgr2=0x555dda0a8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b8bfff700 1 --2- 172.21.15.135:0/3618821649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda09f4f0 0x555dda0a8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b8bfff700 1 -- 172.21.15.135:0/3618821649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda0a0810 msgr2=0x555dda0b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b8bfff700 1 --2- 172.21.15.135:0/3618821649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda0a0810 0x555dda0b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b8bfff700 1 -- 172.21.15.135:0/3618821649 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7800b9a0 con 0x555dda09fe50 2024-05-08T23:15:12.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b8bfff700 1 --2- 172.21.15.135:0/3618821649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0a92d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4b78005c50 tx=0x7f4b7801a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a544a3d165ae0420 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.864+0000 7f4b6bfff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:12.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.865+0000 7f4b6bfff700 1 -- 172.21.15.135:0/3618821649 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78020070 con 0x555dda09fe50 2024-05-08T23:15:12.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.865+0000 7f4b6bfff700 1 -- 172.21.15.135:0/3618821649 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4b7801aca0 con 0x555dda09fe50 2024-05-08T23:15:12.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.865+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/3618821649 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555dd9f48220 con 0x555dda09fe50 2024-05-08T23:15:12.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.865+0000 7f4b6bfff700 1 -- 172.21.15.135:0/3618821649 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b7801a7a0 con 0x555dda09fe50 2024-05-08T23:15:12.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.865+0000 7f4b9ec5eb80 10 client.15111 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:12.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.865+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/3618821649 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x555dd9e1cb10 con 0x555dda09fe50 2024-05-08T23:15:12.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.865+0000 7f4b6bfff700 1 -- 172.21.15.135:0/3618821649 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555dd9f48220 con 0x555dda09fe50 2024-05-08T23:15:12.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.865+0000 7f4b6bfff700 1 -- 172.21.15.135:0/3618821649 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4b78004b00 con 0x555dda09fe50 2024-05-08T23:15:12.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.865+0000 7f4b9ec5eb80 10 client.15111 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:12.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.865+0000 7f4b9ec5eb80 10 client.15111 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-08T23:15:12.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.865+0000 7f4b9ec5eb80 20 client.15111 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:12.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.865+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/3618821649 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x555dda0b38c0 0x555dda0b91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.865+0000 7f4b9ec5eb80 4 client.15111 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:15:12.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.865+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/3618821649 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555dda06e7c0 con 0x555dda0b38c0 2024-05-08T23:15:12.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.865+0000 7f4b90840700 1 --2- 172.21.15.135:0/3618821649 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x555dda0b38c0 0x555dda0b91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.866+0000 7f4b6bfff700 10 client.15111 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:15:12.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.866+0000 7f4b90840700 1 --2- 172.21.15.135:0/3618821649 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x555dda0b38c0 0x555dda0b91d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a217e9209737b85a server_cookie=de782cae4d9daaa1 in_seq=0 out_seq=0 2024-05-08T23:15:12.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.866+0000 7f4b6bfff700 1 -- 172.21.15.135:0/3618821649 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555dda06e7c0 con 0x555dda0b38c0 2024-05-08T23:15:12.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.866+0000 7f4b6bfff700 10 client.15111 handle_command_reply: tid=0 2024-05-08T23:15:12.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.866+0000 7f4b9ec5eb80 1 client.15111 shutdown 2024-05-08T23:15:12.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.867+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/3618821649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 msgr2=0x555dda0a92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.867+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/3618821649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0a92d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4b78005c50 tx=0x7f4b7801a510 comp rx=0 tx=0).stop 2024-05-08T23:15:12.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.867+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/3618821649 shutdown_connections 2024-05-08T23:15:12.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.867+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/3618821649 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x555dda0b38c0 0x555dda0b91d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.867+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/3618821649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda09f4f0 0x555dda0a8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.867+0000 7f4b6bfff700 0 client.15111 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:15:12.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.867+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/3618821649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda0a0810 0x555dda0b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.867+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/3618821649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0a92d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.867+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/3618821649 >> 172.21.15.135:0/3618821649 conn(0x555dd9ffd1c0 msgr2=0x555dda099550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.867+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/3618821649 shutdown_connections 2024-05-08T23:15:12.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.867+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/3618821649 wait complete. 2024-05-08T23:15:12.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.867+0000 7f4b9ec5eb80 20 client.15111 trim_cache size 0 max 16384 2024-05-08T23:15:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.884+0000 7f4b9ec5eb80 1 Processor -- start 2024-05-08T23:15:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b9ec5eb80 1 -- start start 2024-05-08T23:15:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b9ec5eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda09f4f0 0x555dda09a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b9ec5eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda09fe50 0x555dda0b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b9ec5eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda0a0810 0x555dda0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b9ec5eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd9fec010 con 0x555dda0a0810 2024-05-08T23:15:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b9ec5eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd9f8e5a0 con 0x555dda09f4f0 2024-05-08T23:15:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b9ec5eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dda0a76c0 con 0x555dda09fe50 2024-05-08T23:15:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b91041700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda0a0810 0x555dda0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b91041700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda0a0810 0x555dda0b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36938/0 (socket says 172.21.15.135:36938) 2024-05-08T23:15:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b91041700 1 -- 172.21.15.135:0/3349100052 learned_addr learned my addr 172.21.15.135:0/3349100052 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b8bfff700 1 --2- 172.21.15.135:0/3349100052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda09fe50 0x555dda0b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b90840700 1 --2- 172.21.15.135:0/3349100052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda09f4f0 0x555dda09a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b91041700 1 -- 172.21.15.135:0/3349100052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda09fe50 msgr2=0x555dda0b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b91041700 1 --2- 172.21.15.135:0/3349100052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda09fe50 0x555dda0b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b91041700 1 -- 172.21.15.135:0/3349100052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda09f4f0 msgr2=0x555dda09a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b91041700 1 --2- 172.21.15.135:0/3349100052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda09f4f0 0x555dda09a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b91041700 1 -- 172.21.15.135:0/3349100052 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dd9fb5510 con 0x555dda0a0810 2024-05-08T23:15:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b91041700 1 --2- 172.21.15.135:0/3349100052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda0a0810 0x555dda0b09c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400ad70 tx=0x7f4b84099290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121c0ea5179afeec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b777fe700 1 -- 172.21.15.135:0/3349100052 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b84099b40 con 0x555dda0a0810 2024-05-08T23:15:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b777fe700 1 -- 172.21.15.135:0/3349100052 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b84099440 con 0x555dda0a0810 2024-05-08T23:15:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.885+0000 7f4b777fe700 1 -- 172.21.15.135:0/3349100052 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b84098930 con 0x555dda0a0810 2024-05-08T23:15:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.886+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/3349100052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda0a0810 msgr2=0x555dda0b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.886+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/3349100052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda0a0810 0x555dda0b09c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400ad70 tx=0x7f4b84099290 comp rx=0 tx=0).stop 2024-05-08T23:15:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.886+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/3349100052 shutdown_connections 2024-05-08T23:15:12.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.886+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/3349100052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda0a0810 0x555dda0b09c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.886+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/3349100052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda09f4f0 0x555dda09a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.886+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/3349100052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda09fe50 0x555dda0b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.886+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/3349100052 >> 172.21.15.135:0/3349100052 conn(0x555dd9ffd1c0 msgr2=0x555dda0a0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.886+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/3349100052 shutdown_connections 2024-05-08T23:15:12.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.886+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/3349100052 wait complete. 2024-05-08T23:15:12.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.886+0000 7f4b9ec5eb80 1 -- start start 2024-05-08T23:15:12.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.886+0000 7f4b9ec5eb80 1 Processor -- start 2024-05-08T23:15:12.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b9ec5eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda09f4f0 0x555dda098cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b9ec5eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b9ec5eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda0a0810 0x555dda099220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b9ec5eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dda099930 con 0x555dda09fe50 2024-05-08T23:15:12.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b9ec5eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dda099aa0 con 0x555dda0a0810 2024-05-08T23:15:12.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b9ec5eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dda10ae90 con 0x555dda09f4f0 2024-05-08T23:15:12.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b9ec5eb80 10 client.0 _ll_register_callbacks cb 0x555dd9f94ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:12.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b8bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b8bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36950/0 (socket says 172.21.15.135:36950) 2024-05-08T23:15:12.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b8bfff700 1 -- 172.21.15.135:0/2421900778 learned_addr learned my addr 172.21.15.135:0/2421900778 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:12.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b90840700 1 --2- 172.21.15.135:0/2421900778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda09f4f0 0x555dda098cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b8bfff700 1 -- 172.21.15.135:0/2421900778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda09f4f0 msgr2=0x555dda098cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b8bfff700 1 --2- 172.21.15.135:0/2421900778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda09f4f0 0x555dda098cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b8bfff700 1 -- 172.21.15.135:0/2421900778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda0a0810 msgr2=0x555dda099220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:12.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b91041700 1 --2- 172.21.15.135:0/2421900778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda0a0810 0x555dda099220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b8bfff700 1 --2- 172.21.15.135:0/2421900778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda0a0810 0x555dda099220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b8bfff700 1 -- 172.21.15.135:0/2421900778 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8c19f450 con 0x555dda09fe50 2024-05-08T23:15:12.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b8bfff700 1 --2- 172.21.15.135:0/2421900778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0b02d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4b78004ee0 tx=0x7f4b78005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2230dd0ce5a087 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:12.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b6bfff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:12.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b6bfff700 1 -- 172.21.15.135:0/2421900778 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78020040 con 0x555dda09fe50 2024-05-08T23:15:12.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b6bfff700 1 -- 172.21.15.135:0/2421900778 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4b78018570 con 0x555dda09fe50 2024-05-08T23:15:12.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/2421900778 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b7801a920 con 0x555dda09fe50 2024-05-08T23:15:12.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.887+0000 7f4b6bfff700 1 -- 172.21.15.135:0/2421900778 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b7801a7a0 con 0x555dda09fe50 2024-05-08T23:15:12.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.888+0000 7f4b9ec5eb80 10 client.15117 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:12.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.888+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/2421900778 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x555dd9e74c80 con 0x555dda09fe50 2024-05-08T23:15:12.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.888+0000 7f4b6bfff700 1 -- 172.21.15.135:0/2421900778 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b7803f070 con 0x555dda09fe50 2024-05-08T23:15:12.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.888+0000 7f4b6bfff700 1 -- 172.21.15.135:0/2421900778 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4b780041b0 con 0x555dda09fe50 2024-05-08T23:15:12.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.888+0000 7f4b9ec5eb80 10 client.15117 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:12.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.888+0000 7f4b9ec5eb80 10 client.15117 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-08T23:15:12.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.888+0000 7f4b9ec5eb80 20 client.15117 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:12.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.888+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/2421900778 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x555dda10f9c0 0x555dda10c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:12.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.888+0000 7f4b9ec5eb80 4 client.15117 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T23:15:12.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.888+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/2421900778 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555dd9fe7e70 con 0x555dda10f9c0 2024-05-08T23:15:12.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.888+0000 7f4b90840700 1 --2- 172.21.15.135:0/2421900778 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x555dda10f9c0 0x555dda10c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:12.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b90840700 1 --2- 172.21.15.135:0/2421900778 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x555dda10f9c0 0x555dda10c2d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7b2dde90146a38 server_cookie=be505be422434df5 in_seq=0 out_seq=0 2024-05-08T23:15:12.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b6bfff700 10 client.15117 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:15:12.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b6bfff700 1 -- 172.21.15.135:0/2421900778 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x555dd9fe7e70 con 0x555dda10f9c0 2024-05-08T23:15:12.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b6bfff700 10 client.15117 handle_command_reply: tid=0 2024-05-08T23:15:12.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b9ec5eb80 1 client.15117 shutdown 2024-05-08T23:15:12.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/2421900778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 msgr2=0x555dda0b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/2421900778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0b02d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4b78004ee0 tx=0x7f4b78005d50 comp rx=0 tx=0).stop 2024-05-08T23:15:12.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/2421900778 shutdown_connections 2024-05-08T23:15:12.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/2421900778 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x555dda10f9c0 0x555dda10c2d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/2421900778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dda09f4f0 0x555dda098cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b6bfff700 0 client.15117 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:15:12.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/2421900778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555dda0a0810 0x555dda099220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b9ec5eb80 1 --2- 172.21.15.135:0/2421900778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555dda09fe50 0x555dda0b02d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/2421900778 >> 172.21.15.135:0/2421900778 conn(0x555dd9ffd1c0 msgr2=0x555dda0b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/2421900778 shutdown_connections 2024-05-08T23:15:12.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b9ec5eb80 1 -- 172.21.15.135:0/2421900778 wait complete. 2024-05-08T23:15:12.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.889+0000 7f4b9ec5eb80 20 client.15117 trim_cache size 0 max 16384 2024-05-08T23:15:12.896 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:15:12.896 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "c804a50a-0d8f-11ef-bc97-c7b262605968", 2024-05-08T23:15:12.896 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 0, 2024-05-08T23:15:12.897 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24508, 2024-05-08T23:15:12.897 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-08T23:15:12.897 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-08T23:15:12.897 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-08T23:15:12.897 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 50.963569757999998, 2024-05-08T23:15:12.897 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 27, 2024-05-08T23:15:12.897 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 83, 2024-05-08T23:15:12.897 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 83, 2024-05-08T23:15:12.897 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 61.725212083999999 2024-05-08T23:15:12.897 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:15:12.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.890+0000 7f4b92aa4700 1 -- 172.21.15.135:0/2885291301 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4b7c0a1230 msgr2=0x7f4b7c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.890+0000 7f4b92aa4700 1 --2- 172.21.15.135:0/2885291301 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4b7c0a1230 0x7f4b7c0a36f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000b5c0 tx=0x7f4b80005fb0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.890+0000 7f4b92aa4700 1 -- 172.21.15.135:0/2885291301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c101990 msgr2=0x7f4b8c19e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:12.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.890+0000 7f4b92aa4700 1 --2- 172.21.15.135:0/2885291301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c101990 0x7f4b8c19e450 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400ada0 tx=0x7f4b8400c330 comp rx=0 tx=0).stop 2024-05-08T23:15:12.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.890+0000 7f4b92aa4700 1 -- 172.21.15.135:0/2885291301 shutdown_connections 2024-05-08T23:15:12.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.890+0000 7f4b92aa4700 1 --2- 172.21.15.135:0/2885291301 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4b7c0a1230 0x7f4b7c0a36f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.890+0000 7f4b92aa4700 1 --2- 172.21.15.135:0/2885291301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b8c0ffe80 0x7f4b8c196ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.890+0000 7f4b92aa4700 1 --2- 172.21.15.135:0/2885291301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c101990 0x7f4b8c19e450 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.890+0000 7f4b92aa4700 1 --2- 172.21.15.135:0/2885291301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b8c100fd0 0x7f4b8c197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:12.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.890+0000 7f4b92aa4700 1 -- 172.21.15.135:0/2885291301 >> 172.21.15.135:0/2885291301 conn(0x7f4b8c0fb3f0 msgr2=0x7f4b8c104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:12.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.890+0000 7f4b92aa4700 1 -- 172.21.15.135:0/2885291301 shutdown_connections 2024-05-08T23:15:12.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:12.890+0000 7f4b92aa4700 1 -- 172.21.15.135:0/2885291301 wait complete. 2024-05-08T23:15:12.902 INFO:tasks.cephadm:Setup complete, yielding 2024-05-08T23:15:12.902 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-08T23:15:12.912 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T23:15:12.913 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-08T23:15:13.136 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:15:13.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:13 smithi179 ceph-mon[46314]: pgmap v249: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-08T23:15:13.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:13 smithi195 ceph-mon[46516]: pgmap v249: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-08T23:15:13.655 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:13 smithi135 ceph-mon[42440]: pgmap v249: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-08T23:15:14.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.174+0000 7fe9b918e700 1 -- 172.21.15.135:0/2534122081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b40fff00 msgr2=0x7fe9b4100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.174+0000 7fe9b918e700 1 --2- 172.21.15.135:0/2534122081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b40fff00 0x7fe9b4100320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009990 tx=0x7fe99c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.174+0000 7fe9b918e700 1 -- 172.21.15.135:0/2534122081 shutdown_connections 2024-05-08T23:15:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.174+0000 7fe9b918e700 1 --2- 172.21.15.135:0/2534122081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9b4101a20 0x7fe9b4108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.174+0000 7fe9b918e700 1 --2- 172.21.15.135:0/2534122081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b40fff00 0x7fe9b4100320 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.174+0000 7fe9b918e700 1 --2- 172.21.15.135:0/2534122081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9b4101060 0x7fe9b41014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.174+0000 7fe9b918e700 1 -- 172.21.15.135:0/2534122081 >> 172.21.15.135:0/2534122081 conn(0x7fe9b40fb4a0 msgr2=0x7fe9b40fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.174+0000 7fe9b918e700 1 -- 172.21.15.135:0/2534122081 shutdown_connections 2024-05-08T23:15:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.174+0000 7fe9b918e700 1 -- 172.21.15.135:0/2534122081 wait complete. 2024-05-08T23:15:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b918e700 1 Processor -- start 2024-05-08T23:15:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b918e700 1 -- start start 2024-05-08T23:15:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b918e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9b40fff00 0x7fe9b4196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b918e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b4101060 0x7fe9b41974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b918e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9b4101a20 0x7fe9b419e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b918e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b419ea40 con 0x7fe9b4101060 2024-05-08T23:15:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b918e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b419eb80 con 0x7fe9b4101a20 2024-05-08T23:15:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b918e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b419ed10 con 0x7fe9b40fff00 2024-05-08T23:15:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b4101060 0x7fe9b41974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b4101060 0x7fe9b41974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36964/0 (socket says 172.21.15.135:36964) 2024-05-08T23:15:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b259c700 1 -- 172.21.15.135:0/4116894902 learned_addr learned my addr 172.21.15.135:0/4116894902 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b2d9d700 1 --2- 172.21.15.135:0/4116894902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9b40fff00 0x7fe9b4196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b259c700 1 -- 172.21.15.135:0/4116894902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9b40fff00 msgr2=0x7fe9b4196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b359e700 1 --2- 172.21.15.135:0/4116894902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9b4101a20 0x7fe9b419e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b259c700 1 --2- 172.21.15.135:0/4116894902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9b40fff00 0x7fe9b4196fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:14.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.175+0000 7fe9b259c700 1 -- 172.21.15.135:0/4116894902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9b4101a20 msgr2=0x7fe9b419e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:14.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.176+0000 7fe9b259c700 1 --2- 172.21.15.135:0/4116894902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9b4101a20 0x7fe9b419e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:14.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.176+0000 7fe9b259c700 1 -- 172.21.15.135:0/4116894902 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c0095f0 con 0x7fe9b4101060 2024-05-08T23:15:14.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.176+0000 7fe9b259c700 1 --2- 172.21.15.135:0/4116894902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b4101060 0x7fe9b41974e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400c950 tx=0x7fe9a400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:14.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.176+0000 7fe9abfff700 1 -- 172.21.15.135:0/4116894902 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a400cea0 con 0x7fe9b4101060 2024-05-08T23:15:14.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.176+0000 7fe9b918e700 1 -- 172.21.15.135:0/4116894902 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b419eff0 con 0x7fe9b4101060 2024-05-08T23:15:14.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.176+0000 7fe9abfff700 1 -- 172.21.15.135:0/4116894902 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe9a4004830 con 0x7fe9b4101060 2024-05-08T23:15:14.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.176+0000 7fe9abfff700 1 -- 172.21.15.135:0/4116894902 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4005460 con 0x7fe9b4101060 2024-05-08T23:15:14.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.176+0000 7fe9b918e700 1 -- 172.21.15.135:0/4116894902 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b419f4b0 con 0x7fe9b4101060 2024-05-08T23:15:14.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.177+0000 7fe9b918e700 1 -- 172.21.15.135:0/4116894902 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b404ec60 con 0x7fe9b4101060 2024-05-08T23:15:14.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.179+0000 7fe9abfff700 1 -- 172.21.15.135:0/4116894902 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fe9a4007ac0 con 0x7fe9b4101060 2024-05-08T23:15:14.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.180+0000 7fe9abfff700 1 --2- 172.21.15.135:0/4116894902 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe9a00a11b0 0x7fe9a00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:14.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.180+0000 7fe9b2d9d700 1 --2- 172.21.15.135:0/4116894902 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe9a00a11b0 0x7fe9a00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:14.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.180+0000 7fe9abfff700 1 -- 172.21.15.135:0/4116894902 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe9a40cc890 con 0x7fe9b4101060 2024-05-08T23:15:14.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.180+0000 7fe9b2d9d700 1 --2- 172.21.15.135:0/4116894902 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe9a00a11b0 0x7fe9a00a3670 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00b5c0 tx=0x7fe99c003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:14.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.183+0000 7fe9abfff700 1 -- 172.21.15.135:0/4116894902 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe9a4096070 con 0x7fe9b4101060 2024-05-08T23:15:14.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.395+0000 7fe9b918e700 1 -- 172.21.15.135:0/4116894902 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9b4069cf0 con 0x7fe9a00a11b0 2024-05-08T23:15:14.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.396+0000 7fe9abfff700 1 -- 172.21.15.135:0/4116894902 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe9b4069cf0 con 0x7fe9a00a11b0 2024-05-08T23:15:14.395 INFO:teuthology.orchestra.run.smithi135.stdout:Backend: cephadm 2024-05-08T23:15:14.395 INFO:teuthology.orchestra.run.smithi135.stdout:Available: Yes 2024-05-08T23:15:14.395 INFO:teuthology.orchestra.run.smithi135.stdout:Paused: No 2024-05-08T23:15:14.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.398+0000 7fe9b918e700 1 -- 172.21.15.135:0/4116894902 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe9a00a11b0 msgr2=0x7fe9a00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:14.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.398+0000 7fe9b918e700 1 --2- 172.21.15.135:0/4116894902 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe9a00a11b0 0x7fe9a00a3670 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00b5c0 tx=0x7fe99c003790 comp rx=0 tx=0).stop 2024-05-08T23:15:14.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.398+0000 7fe9b918e700 1 -- 172.21.15.135:0/4116894902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b4101060 msgr2=0x7fe9b41974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:14.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.398+0000 7fe9b918e700 1 --2- 172.21.15.135:0/4116894902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b4101060 0x7fe9b41974e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400c950 tx=0x7fe9a400cc60 comp rx=0 tx=0).stop 2024-05-08T23:15:14.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.398+0000 7fe9b918e700 1 -- 172.21.15.135:0/4116894902 shutdown_connections 2024-05-08T23:15:14.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.398+0000 7fe9b918e700 1 --2- 172.21.15.135:0/4116894902 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe9a00a11b0 0x7fe9a00a3670 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:14.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.398+0000 7fe9b918e700 1 --2- 172.21.15.135:0/4116894902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9b40fff00 0x7fe9b4196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:14.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.398+0000 7fe9b918e700 1 --2- 172.21.15.135:0/4116894902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9b4101a20 0x7fe9b419e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:14.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.398+0000 7fe9b918e700 1 --2- 172.21.15.135:0/4116894902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b4101060 0x7fe9b41974e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:14.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.398+0000 7fe9b918e700 1 -- 172.21.15.135:0/4116894902 >> 172.21.15.135:0/4116894902 conn(0x7fe9b40fb4a0 msgr2=0x7fe9b40695e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:14.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.398+0000 7fe9b918e700 1 -- 172.21.15.135:0/4116894902 shutdown_connections 2024-05-08T23:15:14.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:14.398+0000 7fe9b918e700 1 -- 172.21.15.135:0/4116894902 wait complete. 2024-05-08T23:15:14.785 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-08T23:15:15.010 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:15:16.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.014+0000 7f97372b2700 1 -- 172.21.15.135:0/692291079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9730101a20 msgr2=0x7f9730108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:16.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.014+0000 7f97372b2700 1 --2- 172.21.15.135:0/692291079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9730101a20 0x7f9730108340 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f972800b0a0 tx=0x7f972800b3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:16.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.014+0000 7f97372b2700 1 -- 172.21.15.135:0/692291079 shutdown_connections 2024-05-08T23:15:16.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.014+0000 7f97372b2700 1 --2- 172.21.15.135:0/692291079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97300fff00 0x7f9730100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:16.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.014+0000 7f97372b2700 1 --2- 172.21.15.135:0/692291079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9730101a20 0x7f9730108340 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:16.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.014+0000 7f97372b2700 1 --2- 172.21.15.135:0/692291079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9730101060 0x7f97301014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:16.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.014+0000 7f97372b2700 1 -- 172.21.15.135:0/692291079 >> 172.21.15.135:0/692291079 conn(0x7f97300fb4a0 msgr2=0x7f97300fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:16.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.014+0000 7f97372b2700 1 -- 172.21.15.135:0/692291079 shutdown_connections 2024-05-08T23:15:16.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.014+0000 7f97372b2700 1 -- 172.21.15.135:0/692291079 wait complete. 2024-05-08T23:15:16.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.014+0000 7f97372b2700 1 Processor -- start 2024-05-08T23:15:16.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.014+0000 7f97372b2700 1 -- start start 2024-05-08T23:15:16.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f97372b2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97300fff00 0x7f9730195f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:16.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f97372b2700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9730101060 0x7f9730196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:16.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f97372b2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9730101a20 0x7f973019d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:16.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f97372b2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973019da30 con 0x7f97300fff00 2024-05-08T23:15:16.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f97372b2700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973019db70 con 0x7f9730101060 2024-05-08T23:15:16.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f97372b2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973019dd00 con 0x7f9730101a20 2024-05-08T23:15:16.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f973504e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97300fff00 0x7f9730195f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:16.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f973504e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97300fff00 0x7f9730195f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36980/0 (socket says 172.21.15.135:36980) 2024-05-08T23:15:16.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f973504e700 1 -- 172.21.15.135:0/3197353308 learned_addr learned my addr 172.21.15.135:0/3197353308 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:16.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f973584f700 1 --2- 172.21.15.135:0/3197353308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9730101a20 0x7f973019d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:16.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f973484d700 1 --2- 172.21.15.135:0/3197353308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9730101060 0x7f9730196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:16.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f973504e700 1 -- 172.21.15.135:0/3197353308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9730101a20 msgr2=0x7f973019d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:16.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f973504e700 1 --2- 172.21.15.135:0/3197353308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9730101a20 0x7f973019d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:16.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f973504e700 1 -- 172.21.15.135:0/3197353308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9730101060 msgr2=0x7f9730196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:16.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f973504e700 1 --2- 172.21.15.135:0/3197353308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9730101060 0x7f9730196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:16.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f973504e700 1 -- 172.21.15.135:0/3197353308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9728009d00 con 0x7f97300fff00 2024-05-08T23:15:16.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f973504e700 1 --2- 172.21.15.135:0/3197353308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97300fff00 0x7f9730195f40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f972c00d980 tx=0x7f972c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:16.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f97267fc700 1 -- 172.21.15.135:0/3197353308 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0098d0 con 0x7f97300fff00 2024-05-08T23:15:16.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f97267fc700 1 -- 172.21.15.135:0/3197353308 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f972c010460 con 0x7f97300fff00 2024-05-08T23:15:16.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f97267fc700 1 -- 172.21.15.135:0/3197353308 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c00f620 con 0x7f97300fff00 2024-05-08T23:15:16.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.015+0000 7f97372b2700 1 -- 172.21.15.135:0/3197353308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973019dfe0 con 0x7f97300fff00 2024-05-08T23:15:16.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.016+0000 7f97372b2700 1 -- 172.21.15.135:0/3197353308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973019e390 con 0x7f97300fff00 2024-05-08T23:15:16.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.017+0000 7f97372b2700 1 -- 172.21.15.135:0/3197353308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97301072b0 con 0x7f97300fff00 2024-05-08T23:15:16.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.018+0000 7f97267fc700 1 -- 172.21.15.135:0/3197353308 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f972c010860 con 0x7f97300fff00 2024-05-08T23:15:16.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.019+0000 7f97267fc700 1 --2- 172.21.15.135:0/3197353308 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f971c0a11b0 0x7f971c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:16.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.019+0000 7f973484d700 1 --2- 172.21.15.135:0/3197353308 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f971c0a11b0 0x7f971c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:16.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.019+0000 7f97267fc700 1 -- 172.21.15.135:0/3197353308 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f972c0cc630 con 0x7f97300fff00 2024-05-08T23:15:16.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.019+0000 7f973484d700 1 --2- 172.21.15.135:0/3197353308 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f971c0a11b0 0x7f971c0a3670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9720005950 tx=0x7f972000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:16.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.022+0000 7f97267fc700 1 -- 172.21.15.135:0/3197353308 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f972c095e10 con 0x7f97300fff00 2024-05-08T23:15:16.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.229+0000 7f97372b2700 1 -- 172.21.15.135:0/3197353308 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f973002cee0 con 0x7f971c0a11b0 2024-05-08T23:15:16.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.242+0000 7f97267fc700 1 -- 172.21.15.135:0/3197353308 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f973002cee0 con 0x7f971c0a11b0 2024-05-08T23:15:16.241 INFO:teuthology.orchestra.run.smithi135.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-08T23:15:16.242 INFO:teuthology.orchestra.run.smithi135.stdout:mds.a smithi135 running (61s) 56s ago 61s 14.3M - 18.2.2-1322-gd21e4f96 af23193ff691 ace262159b0c 2024-05-08T23:15:16.242 INFO:teuthology.orchestra.run.smithi135.stdout:mds.b smithi179 running (60s) 56s ago 59s 13.4M - 18.2.2-1322-gd21e4f96 af23193ff691 00f89ddc6799 2024-05-08T23:15:16.242 INFO:teuthology.orchestra.run.smithi135.stdout:mds.c smithi195 running (69s) 56s ago 68s 17.1M - 18.2.2-1322-gd21e4f96 af23193ff691 9e7c1086bc57 2024-05-08T23:15:16.242 INFO:teuthology.orchestra.run.smithi135.stdout:mds.d smithi135 running (74s) 56s ago 74s 15.6M - 18.2.2-1322-gd21e4f96 af23193ff691 68f454290ede 2024-05-08T23:15:16.242 INFO:teuthology.orchestra.run.smithi135.stdout:mds.e smithi179 running (73s) 56s ago 72s 16.5M - 18.2.2-1322-gd21e4f96 af23193ff691 8da23a755cd3 2024-05-08T23:15:16.242 INFO:teuthology.orchestra.run.smithi135.stdout:mds.f smithi195 running (71s) 56s ago 70s 14.2M - 18.2.2-1322-gd21e4f96 af23193ff691 5a89a31f3216 2024-05-08T23:15:16.242 INFO:teuthology.orchestra.run.smithi135.stdout:mds.g smithi135 running (63s) 56s ago 63s 16.0M - 18.2.2-1322-gd21e4f96 af23193ff691 fc5b4d9c065a 2024-05-08T23:15:16.242 INFO:teuthology.orchestra.run.smithi135.stdout:mds.h smithi179 running (67s) 56s ago 66s 15.7M - 18.2.2-1322-gd21e4f96 af23193ff691 e24105bf00de 2024-05-08T23:15:16.242 INFO:teuthology.orchestra.run.smithi135.stdout:mds.i smithi195 running (65s) 56s ago 65s 15.6M - 18.2.2-1322-gd21e4f96 af23193ff691 a967ae849d92 2024-05-08T23:15:16.242 INFO:teuthology.orchestra.run.smithi135.stdout:mds.j smithi135 running (76s) 56s ago 76s 14.0M - 18.2.2-1322-gd21e4f96 af23193ff691 c3502239fff3 2024-05-08T23:15:16.242 INFO:teuthology.orchestra.run.smithi135.stdout:mds.k smithi179 running (78s) 56s ago 77s 14.0M - 18.2.2-1322-gd21e4f96 af23193ff691 87c1835e9a88 2024-05-08T23:15:16.242 INFO:teuthology.orchestra.run.smithi135.stdout:mds.l smithi195 running (80s) 56s ago 79s 16.7M - 18.2.2-1322-gd21e4f96 af23193ff691 1d1e8b03ecb8 2024-05-08T23:15:16.242 INFO:teuthology.orchestra.run.smithi135.stdout:mgr.x smithi135 *:9283,8765 running (6m) 56s ago 6m 524M - 18.2.2-1322-gd21e4f96 af23193ff691 bcb3ccb041d6 2024-05-08T23:15:16.243 INFO:teuthology.orchestra.run.smithi135.stdout:mgr.y smithi179 *:8443,8765 running (5m) 56s ago 5m 458M - 18.2.2-1322-gd21e4f96 af23193ff691 c966649f60bf 2024-05-08T23:15:16.243 INFO:teuthology.orchestra.run.smithi135.stdout:mgr.z smithi195 *:8443,8765 running (5m) 56s ago 5m 459M - 18.2.2-1322-gd21e4f96 af23193ff691 5f066666071b 2024-05-08T23:15:16.243 INFO:teuthology.orchestra.run.smithi135.stdout:mon.a smithi135 running (6m) 56s ago 6m 79.2M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 28170a0ea9f3 2024-05-08T23:15:16.243 INFO:teuthology.orchestra.run.smithi135.stdout:mon.b smithi179 running (5m) 56s ago 5m 53.4M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 ef602f1c2127 2024-05-08T23:15:16.243 INFO:teuthology.orchestra.run.smithi135.stdout:mon.c smithi195 running (5m) 56s ago 5m 54.3M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 469fb922a144 2024-05-08T23:15:16.243 INFO:teuthology.orchestra.run.smithi135.stdout:osd.0 smithi135 running (4m) 56s ago 4m 55.6M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 0aad1dd262f4 2024-05-08T23:15:16.243 INFO:teuthology.orchestra.run.smithi135.stdout:osd.1 smithi179 running (4m) 56s ago 4m 61.9M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 79e3024bd495 2024-05-08T23:15:16.243 INFO:teuthology.orchestra.run.smithi135.stdout:osd.2 smithi195 running (4m) 56s ago 4m 56.2M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 28548f456bb2 2024-05-08T23:15:16.243 INFO:teuthology.orchestra.run.smithi135.stdout:osd.3 smithi135 running (3m) 56s ago 3m 119M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 6bf608344c84 2024-05-08T23:15:16.243 INFO:teuthology.orchestra.run.smithi135.stdout:osd.4 smithi179 running (3m) 56s ago 3m 120M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 a456311989dc 2024-05-08T23:15:16.243 INFO:teuthology.orchestra.run.smithi135.stdout:osd.5 smithi195 running (3m) 56s ago 3m 53.4M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 f4bc3e1bc18b 2024-05-08T23:15:16.243 INFO:teuthology.orchestra.run.smithi135.stdout:osd.6 smithi135 running (3m) 56s ago 3m 119M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 f11ac471d1dc 2024-05-08T23:15:16.244 INFO:teuthology.orchestra.run.smithi135.stdout:osd.7 smithi179 running (2m) 56s ago 2m 50.5M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 ea40176c1ffc 2024-05-08T23:15:16.244 INFO:teuthology.orchestra.run.smithi135.stdout:osd.8 smithi195 running (2m) 56s ago 2m 50.7M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 e80716615f4b 2024-05-08T23:15:16.244 INFO:teuthology.orchestra.run.smithi135.stdout:osd.9 smithi135 running (2m) 56s ago 2m 116M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 d755e226dadc 2024-05-08T23:15:16.244 INFO:teuthology.orchestra.run.smithi135.stdout:osd.10 smithi179 running (112s) 56s ago 111s 114M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 4f2744633e42 2024-05-08T23:15:16.244 INFO:teuthology.orchestra.run.smithi135.stdout:osd.11 smithi195 running (94s) 56s ago 94s 116M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 d1d1ac217257 2024-05-08T23:15:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.244+0000 7f97372b2700 1 -- 172.21.15.135:0/3197353308 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f971c0a11b0 msgr2=0x7f971c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.244+0000 7f97372b2700 1 --2- 172.21.15.135:0/3197353308 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f971c0a11b0 0x7f971c0a3670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9720005950 tx=0x7f972000a300 comp rx=0 tx=0).stop 2024-05-08T23:15:16.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.244+0000 7f97372b2700 1 -- 172.21.15.135:0/3197353308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97300fff00 msgr2=0x7f9730195f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:16.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.244+0000 7f97372b2700 1 --2- 172.21.15.135:0/3197353308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97300fff00 0x7f9730195f40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f972c00d980 tx=0x7f972c00dc90 comp rx=0 tx=0).stop 2024-05-08T23:15:16.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.244+0000 7f97372b2700 1 -- 172.21.15.135:0/3197353308 shutdown_connections 2024-05-08T23:15:16.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.244+0000 7f97372b2700 1 --2- 172.21.15.135:0/3197353308 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f971c0a11b0 0x7f971c0a3670 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:16.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.244+0000 7f97372b2700 1 --2- 172.21.15.135:0/3197353308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9730101a20 0x7f973019d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:16.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.244+0000 7f97372b2700 1 --2- 172.21.15.135:0/3197353308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97300fff00 0x7f9730195f40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:16.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.244+0000 7f97372b2700 1 --2- 172.21.15.135:0/3197353308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9730101060 0x7f9730196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:16.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.244+0000 7f97372b2700 1 -- 172.21.15.135:0/3197353308 >> 172.21.15.135:0/3197353308 conn(0x7f97300fb4a0 msgr2=0x7f97301043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:16.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.244+0000 7f97372b2700 1 -- 172.21.15.135:0/3197353308 shutdown_connections 2024-05-08T23:15:16.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:16.244+0000 7f97372b2700 1 -- 172.21.15.135:0/3197353308 wait complete. 2024-05-08T23:15:16.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:16 smithi179 ceph-mon[46314]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:16.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:16 smithi179 ceph-mon[46314]: pgmap v250: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T23:15:16.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:16 smithi195 ceph-mon[46516]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:16.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:16 smithi195 ceph-mon[46516]: pgmap v250: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T23:15:16.396 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:16 smithi135 ceph-mon[42440]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:16.396 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:16 smithi135 ceph-mon[42440]: pgmap v250: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T23:15:16.626 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-08T23:15:16.852 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:15:17.271 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:17 smithi135 ceph-mon[42440]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:17.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:17 smithi195 ceph-mon[46516]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:17.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:17 smithi179 ceph-mon[46314]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:17.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.832+0000 7f5c5e826700 1 -- 172.21.15.135:0/429383277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c58101a20 msgr2=0x7f5c58108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:17.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.832+0000 7f5c5e826700 1 --2- 172.21.15.135:0/429383277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c58101a20 0x7f5c58108340 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000b0a0 tx=0x7f5c5000b3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:17.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.832+0000 7f5c5e826700 1 -- 172.21.15.135:0/429383277 shutdown_connections 2024-05-08T23:15:17.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.832+0000 7f5c5e826700 1 --2- 172.21.15.135:0/429383277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c580fff00 0x7f5c58100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:17.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.832+0000 7f5c5e826700 1 --2- 172.21.15.135:0/429383277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c58101a20 0x7f5c58108340 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:17.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.832+0000 7f5c5e826700 1 --2- 172.21.15.135:0/429383277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c58101060 0x7f5c581014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:17.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.832+0000 7f5c5e826700 1 -- 172.21.15.135:0/429383277 >> 172.21.15.135:0/429383277 conn(0x7f5c580fb4c0 msgr2=0x7f5c580fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:17.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.832+0000 7f5c5e826700 1 -- 172.21.15.135:0/429383277 shutdown_connections 2024-05-08T23:15:17.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.832+0000 7f5c5e826700 1 -- 172.21.15.135:0/429383277 wait complete. 2024-05-08T23:15:17.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.833+0000 7f5c5e826700 1 Processor -- start 2024-05-08T23:15:17.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.833+0000 7f5c5e826700 1 -- start start 2024-05-08T23:15:17.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.833+0000 7f5c5e826700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c580fff00 0x7f5c58103e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:17.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.833+0000 7f5c5e826700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c58101060 0x7f5c581024d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:17.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.833+0000 7f5c5e826700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c58101a20 0x7f5c58102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:17.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.833+0000 7f5c5e826700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c581031b0 con 0x7f5c580fff00 2024-05-08T23:15:17.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.833+0000 7f5c5e826700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c58103320 con 0x7f5c58101a20 2024-05-08T23:15:17.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.833+0000 7f5c5e826700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c581a1120 con 0x7f5c58101060 2024-05-08T23:15:17.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.833+0000 7f5c57fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c580fff00 0x7f5c58103e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:17.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.833+0000 7f5c57fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c580fff00 0x7f5c58103e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37012/0 (socket says 172.21.15.135:37012) 2024-05-08T23:15:17.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.833+0000 7f5c57fff700 1 -- 172.21.15.135:0/3355005760 learned_addr learned my addr 172.21.15.135:0/3355005760 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:17.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.834+0000 7f5c5cdc3700 1 --2- 172.21.15.135:0/3355005760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c58101a20 0x7f5c58102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:17.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.834+0000 7f5c577fe700 1 --2- 172.21.15.135:0/3355005760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c58101060 0x7f5c581024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:17.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.834+0000 7f5c57fff700 1 -- 172.21.15.135:0/3355005760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c58101060 msgr2=0x7f5c581024d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:17.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.834+0000 7f5c57fff700 1 --2- 172.21.15.135:0/3355005760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c58101060 0x7f5c581024d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:17.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.834+0000 7f5c57fff700 1 -- 172.21.15.135:0/3355005760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c58101a20 msgr2=0x7f5c58102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:17.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.834+0000 7f5c57fff700 1 --2- 172.21.15.135:0/3355005760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c58101a20 0x7f5c58102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:17.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.834+0000 7f5c57fff700 1 -- 172.21.15.135:0/3355005760 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c50009d00 con 0x7f5c580fff00 2024-05-08T23:15:17.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.834+0000 7f5c57fff700 1 --2- 172.21.15.135:0/3355005760 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c580fff00 0x7f5c58103e30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5c4800c920 tx=0x7f5c4800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:17.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.834+0000 7f5c557fa700 1 -- 172.21.15.135:0/3355005760 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c48007b00 con 0x7f5c580fff00 2024-05-08T23:15:17.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.834+0000 7f5c557fa700 1 -- 172.21.15.135:0/3355005760 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c48004cf0 con 0x7f5c580fff00 2024-05-08T23:15:17.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.834+0000 7f5c557fa700 1 -- 172.21.15.135:0/3355005760 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c48005610 con 0x7f5c580fff00 2024-05-08T23:15:17.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.834+0000 7f5c5e826700 1 -- 172.21.15.135:0/3355005760 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c581a13b0 con 0x7f5c580fff00 2024-05-08T23:15:17.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.834+0000 7f5c5e826700 1 -- 172.21.15.135:0/3355005760 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c581a1860 con 0x7f5c580fff00 2024-05-08T23:15:17.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.835+0000 7f5c5e826700 1 -- 172.21.15.135:0/3355005760 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5804ec60 con 0x7f5c580fff00 2024-05-08T23:15:17.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.836+0000 7f5c557fa700 1 -- 172.21.15.135:0/3355005760 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f5c48004750 con 0x7f5c580fff00 2024-05-08T23:15:17.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.836+0000 7f5c557fa700 1 --2- 172.21.15.135:0/3355005760 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5c440a1230 0x7f5c440a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:17.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.837+0000 7f5c577fe700 1 --2- 172.21.15.135:0/3355005760 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5c440a1230 0x7f5c440a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:17.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.837+0000 7f5c557fa700 1 -- 172.21.15.135:0/3355005760 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5c480cc9d0 con 0x7f5c580fff00 2024-05-08T23:15:17.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.837+0000 7f5c577fe700 1 --2- 172.21.15.135:0/3355005760 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5c440a1230 0x7f5c440a36f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5c40005950 tx=0x7f5c40005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:17.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:17.840+0000 7f5c557fa700 1 -- 172.21.15.135:0/3355005760 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5c480960b0 con 0x7f5c580fff00 2024-05-08T23:15:18.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:18.046+0000 7f5c5e826700 1 -- 172.21.15.135:0/3355005760 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c580fd6a0 con 0x7f5c440a1230 2024-05-08T23:15:18.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:18.052+0000 7f5c557fa700 1 -- 172.21.15.135:0/3355005760 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f5c580fd6a0 con 0x7f5c440a1230 2024-05-08T23:15:18.051 INFO:teuthology.orchestra.run.smithi135.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-08T23:15:18.051 INFO:teuthology.orchestra.run.smithi135.stdout:mds.all 12/12 58s ago 83s smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2024-05-08T23:15:18.051 INFO:teuthology.orchestra.run.smithi135.stdout:mgr 3/3 58s ago 5m smithi135=x;smithi179=y;smithi195=z;count:3 2024-05-08T23:15:18.051 INFO:teuthology.orchestra.run.smithi135.stdout:mon 3/3 58s ago 5m smithi135:172.21.15.135=a;smithi179:172.21.15.179=b;smithi195:172.21.15.195=c;count:3 2024-05-08T23:15:18.051 INFO:teuthology.orchestra.run.smithi135.stdout:osd 12 58s ago - 2024-05-08T23:15:18.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:18.054+0000 7f5c5e826700 1 -- 172.21.15.135:0/3355005760 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5c440a1230 msgr2=0x7f5c440a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:18.054+0000 7f5c5e826700 1 --2- 172.21.15.135:0/3355005760 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5c440a1230 0x7f5c440a36f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5c40005950 tx=0x7f5c40005cf0 comp rx=0 tx=0).stop 2024-05-08T23:15:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:18.054+0000 7f5c5e826700 1 -- 172.21.15.135:0/3355005760 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c580fff00 msgr2=0x7f5c58103e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:18.054+0000 7f5c5e826700 1 --2- 172.21.15.135:0/3355005760 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c580fff00 0x7f5c58103e30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5c4800c920 tx=0x7f5c4800cce0 comp rx=0 tx=0).stop 2024-05-08T23:15:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:18.054+0000 7f5c5e826700 1 -- 172.21.15.135:0/3355005760 shutdown_connections 2024-05-08T23:15:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:18.054+0000 7f5c5e826700 1 --2- 172.21.15.135:0/3355005760 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5c440a1230 0x7f5c440a36f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:18.054+0000 7f5c5e826700 1 --2- 172.21.15.135:0/3355005760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c58101a20 0x7f5c58102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:18.054+0000 7f5c5e826700 1 --2- 172.21.15.135:0/3355005760 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c580fff00 0x7f5c58103e30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:18.054+0000 7f5c5e826700 1 --2- 172.21.15.135:0/3355005760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c58101060 0x7f5c581024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:18.054+0000 7f5c5e826700 1 -- 172.21.15.135:0/3355005760 >> 172.21.15.135:0/3355005760 conn(0x7f5c580fb4c0 msgr2=0x7f5c580fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:18.054+0000 7f5c5e826700 1 -- 172.21.15.135:0/3355005760 shutdown_connections 2024-05-08T23:15:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:18.054+0000 7f5c5e826700 1 -- 172.21.15.135:0/3355005760 wait complete. 2024-05-08T23:15:18.349 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:18 smithi135 ceph-mon[42440]: pgmap v251: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T23:15:18.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:18 smithi195 ceph-mon[46516]: pgmap v251: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T23:15:18.426 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-08T23:15:18.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:18 smithi179 ceph-mon[46314]: pgmap v251: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T23:15:18.651 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:15:19.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:19 smithi195 ceph-mon[46516]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:19.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:19 smithi135 ceph-mon[42440]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:19.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:19 smithi179 ceph-mon[46314]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:19.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.633+0000 7f2acc62b700 1 -- 172.21.15.135:0/1734260929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac4101a90 msgr2=0x7f2ac4103e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:19.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.633+0000 7f2acc62b700 1 --2- 172.21.15.135:0/1734260929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac4101a90 0x7f2ac4103e80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4009990 tx=0x7f2ab4009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:19.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.633+0000 7f2acc62b700 1 -- 172.21.15.135:0/1734260929 shutdown_connections 2024-05-08T23:15:19.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.633+0000 7f2acc62b700 1 --2- 172.21.15.135:0/1734260929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ac4106cf0 0x7f2ac4109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:19.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.633+0000 7f2acc62b700 1 --2- 172.21.15.135:0/1734260929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac4101a90 0x7f2ac4103e80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:19.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.633+0000 7f2acc62b700 1 --2- 172.21.15.135:0/1734260929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ac41043c0 0x7f2ac41067b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:19.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.633+0000 7f2acc62b700 1 -- 172.21.15.135:0/1734260929 >> 172.21.15.135:0/1734260929 conn(0x7f2ac40fb4a0 msgr2=0x7f2ac40fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:19.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.633+0000 7f2acc62b700 1 -- 172.21.15.135:0/1734260929 shutdown_connections 2024-05-08T23:15:19.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.633+0000 7f2acc62b700 1 -- 172.21.15.135:0/1734260929 wait complete. 2024-05-08T23:15:19.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2acc62b700 1 Processor -- start 2024-05-08T23:15:19.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2acc62b700 1 -- start start 2024-05-08T23:15:19.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2acc62b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac4101a90 0x7f2ac4196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:19.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2acc62b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ac41043c0 0x7f2ac4197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:19.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2acc62b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ac4106cf0 0x7f2ac419e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:19.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2acc62b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac419e9d0 con 0x7f2ac4101a90 2024-05-08T23:15:19.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2acc62b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac419eb10 con 0x7f2ac41043c0 2024-05-08T23:15:19.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2acc62b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac419eca0 con 0x7f2ac4106cf0 2024-05-08T23:15:19.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2aca3c7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac4101a90 0x7f2ac4196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:19.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2aca3c7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac4101a90 0x7f2ac4196ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59602/0 (socket says 172.21.15.135:59602) 2024-05-08T23:15:19.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2aca3c7700 1 -- 172.21.15.135:0/4077188240 learned_addr learned my addr 172.21.15.135:0/4077188240 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:19.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2ac9bc6700 1 --2- 172.21.15.135:0/4077188240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ac41043c0 0x7f2ac4197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:19.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2acabc8700 1 --2- 172.21.15.135:0/4077188240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ac4106cf0 0x7f2ac419e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:19.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2aca3c7700 1 -- 172.21.15.135:0/4077188240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ac4106cf0 msgr2=0x7f2ac419e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:19.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2aca3c7700 1 --2- 172.21.15.135:0/4077188240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ac4106cf0 0x7f2ac419e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:19.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2aca3c7700 1 -- 172.21.15.135:0/4077188240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ac41043c0 msgr2=0x7f2ac4197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:19.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2aca3c7700 1 --2- 172.21.15.135:0/4077188240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ac41043c0 0x7f2ac4197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:19.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2aca3c7700 1 -- 172.21.15.135:0/4077188240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab40095f0 con 0x7f2ac4101a90 2024-05-08T23:15:19.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2acabc8700 1 --2- 172.21.15.135:0/4077188240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ac4106cf0 0x7f2ac419e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:19.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.634+0000 7f2aca3c7700 1 --2- 172.21.15.135:0/4077188240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac4101a90 0x7f2ac4196ee0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4000c00 tx=0x7f2ab400f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:19.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.635+0000 7f2abb7fe700 1 -- 172.21.15.135:0/4077188240 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab401d070 con 0x7f2ac4101a90 2024-05-08T23:15:19.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.635+0000 7f2abb7fe700 1 -- 172.21.15.135:0/4077188240 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ab400fbb0 con 0x7f2ac4101a90 2024-05-08T23:15:19.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.635+0000 7f2acc62b700 1 -- 172.21.15.135:0/4077188240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac419ef20 con 0x7f2ac4101a90 2024-05-08T23:15:19.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.635+0000 7f2abb7fe700 1 -- 172.21.15.135:0/4077188240 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4017650 con 0x7f2ac4101a90 2024-05-08T23:15:19.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.635+0000 7f2acc62b700 1 -- 172.21.15.135:0/4077188240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac419f2d0 con 0x7f2ac4101a90 2024-05-08T23:15:19.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.635+0000 7f2acc62b700 1 -- 172.21.15.135:0/4077188240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac40fd020 con 0x7f2ac4101a90 2024-05-08T23:15:19.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.637+0000 7f2abb7fe700 1 -- 172.21.15.135:0/4077188240 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f2ab400fd20 con 0x7f2ac4101a90 2024-05-08T23:15:19.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.637+0000 7f2abb7fe700 1 --2- 172.21.15.135:0/4077188240 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2ab00a1230 0x7f2ab00a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:19.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.637+0000 7f2ac9bc6700 1 --2- 172.21.15.135:0/4077188240 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2ab00a1230 0x7f2ab00a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:19.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.637+0000 7f2abb7fe700 1 -- 172.21.15.135:0/4077188240 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2ab40cdd50 con 0x7f2ac4101a90 2024-05-08T23:15:19.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.638+0000 7f2ac9bc6700 1 --2- 172.21.15.135:0/4077188240 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2ab00a1230 0x7f2ab00a36f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0005950 tx=0x7f2ac000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:19.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.641+0000 7f2abb7fe700 1 -- 172.21.15.135:0/4077188240 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2ab40975c0 con 0x7f2ac4101a90 2024-05-08T23:15:19.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.841+0000 7f2acc62b700 1 -- 172.21.15.135:0/4077188240 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ac402ceb0 con 0x7f2ab00a1230 2024-05-08T23:15:19.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.843+0000 7f2abb7fe700 1 -- 172.21.15.135:0/4077188240 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f2ac402ceb0 con 0x7f2ab00a1230 2024-05-08T23:15:19.842 INFO:teuthology.orchestra.run.smithi135.stdout:HOST ADDR LABELS STATUS 2024-05-08T23:15:19.842 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135 172.21.15.135 2024-05-08T23:15:19.842 INFO:teuthology.orchestra.run.smithi135.stdout:smithi179 172.21.15.179 2024-05-08T23:15:19.842 INFO:teuthology.orchestra.run.smithi135.stdout:smithi195 172.21.15.195 2024-05-08T23:15:19.842 INFO:teuthology.orchestra.run.smithi135.stdout:3 hosts in cluster 2024-05-08T23:15:19.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.845+0000 7f2acc62b700 1 -- 172.21.15.135:0/4077188240 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2ab00a1230 msgr2=0x7f2ab00a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:19.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.845+0000 7f2acc62b700 1 --2- 172.21.15.135:0/4077188240 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2ab00a1230 0x7f2ab00a36f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0005950 tx=0x7f2ac000a300 comp rx=0 tx=0).stop 2024-05-08T23:15:19.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.845+0000 7f2acc62b700 1 -- 172.21.15.135:0/4077188240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac4101a90 msgr2=0x7f2ac4196ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.845+0000 7f2acc62b700 1 --2- 172.21.15.135:0/4077188240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac4101a90 0x7f2ac4196ee0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4000c00 tx=0x7f2ab400f700 comp rx=0 tx=0).stop 2024-05-08T23:15:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.845+0000 7f2acc62b700 1 -- 172.21.15.135:0/4077188240 shutdown_connections 2024-05-08T23:15:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.845+0000 7f2acc62b700 1 --2- 172.21.15.135:0/4077188240 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2ab00a1230 0x7f2ab00a36f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.845+0000 7f2acc62b700 1 --2- 172.21.15.135:0/4077188240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ac4106cf0 0x7f2ac419e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.845+0000 7f2acc62b700 1 --2- 172.21.15.135:0/4077188240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac4101a90 0x7f2ac4196ee0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.845+0000 7f2acc62b700 1 --2- 172.21.15.135:0/4077188240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ac41043c0 0x7f2ac4197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.845+0000 7f2acc62b700 1 -- 172.21.15.135:0/4077188240 >> 172.21.15.135:0/4077188240 conn(0x7f2ac40fb4a0 msgr2=0x7f2ac4102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.845+0000 7f2acc62b700 1 -- 172.21.15.135:0/4077188240 shutdown_connections 2024-05-08T23:15:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:19.845+0000 7f2acc62b700 1 -- 172.21.15.135:0/4077188240 wait complete. 2024-05-08T23:15:20.124 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:20 smithi135 ceph-mon[42440]: pgmap v252: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-08T23:15:20.124 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:20 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:15:20.232 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-08T23:15:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:20 smithi195 ceph-mon[46516]: pgmap v252: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-08T23:15:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:20 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:15:20.505 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:15:20.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:20 smithi179 ceph-mon[46314]: pgmap v252: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-08T23:15:20.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:20 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:15:21.128 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:21 smithi135 ceph-mon[42440]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:21.128 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-05-08T23:15:21.128 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-05-08T23:15:21.128 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-05-08T23:15:21.128 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-05-08T23:15:21.129 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-05-08T23:15:21.129 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-05-08T23:15:21.129 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-05-08T23:15:21.129 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]: dispatch 2024-05-08T23:15:21.129 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [5, 6]}]: dispatch 2024-05-08T23:15:21.129 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-05-08T23:15:21.129 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:21.129 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:21.129 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:21.129 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:21 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:21.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:21 smithi195 ceph-mon[46516]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:21.439 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-05-08T23:15:21.439 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-05-08T23:15:21.439 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-05-08T23:15:21.439 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-05-08T23:15:21.440 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-05-08T23:15:21.440 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-05-08T23:15:21.440 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-05-08T23:15:21.440 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]: dispatch 2024-05-08T23:15:21.440 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [5, 6]}]: dispatch 2024-05-08T23:15:21.440 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-05-08T23:15:21.440 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:21.440 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:21.440 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:21.440 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:21 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:21.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:21 smithi179 ceph-mon[46314]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:21.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-05-08T23:15:21.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-05-08T23:15:21.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-05-08T23:15:21.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-05-08T23:15:21.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-05-08T23:15:21.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-05-08T23:15:21.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-05-08T23:15:21.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]: dispatch 2024-05-08T23:15:21.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [5, 6]}]: dispatch 2024-05-08T23:15:21.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-05-08T23:15:21.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:21.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:21.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:21.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:21 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:21.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.611+0000 7fbbc6f88700 1 -- 172.21.15.135:0/2097395980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc0106db0 msgr2=0x7fbbc01091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:21.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.611+0000 7fbbc6f88700 1 --2- 172.21.15.135:0/2097395980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc0106db0 0x7fbbc01091a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800b0a0 tx=0x7fbbb800b3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:21.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.611+0000 7fbbc6f88700 1 -- 172.21.15.135:0/2097395980 shutdown_connections 2024-05-08T23:15:21.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.611+0000 7fbbc6f88700 1 --2- 172.21.15.135:0/2097395980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc0101b50 0x7fbbc0103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:21.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.611+0000 7fbbc6f88700 1 --2- 172.21.15.135:0/2097395980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc0106db0 0x7fbbc01091a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:21.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.611+0000 7fbbc6f88700 1 --2- 172.21.15.135:0/2097395980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc0104480 0x7fbbc0106870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:21.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.611+0000 7fbbc6f88700 1 -- 172.21.15.135:0/2097395980 >> 172.21.15.135:0/2097395980 conn(0x7fbbc00fb4a0 msgr2=0x7fbbc00fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:21.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.612+0000 7fbbc6f88700 1 -- 172.21.15.135:0/2097395980 shutdown_connections 2024-05-08T23:15:21.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.612+0000 7fbbc6f88700 1 -- 172.21.15.135:0/2097395980 wait complete. 2024-05-08T23:15:21.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.612+0000 7fbbc6f88700 1 Processor -- start 2024-05-08T23:15:21.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.612+0000 7fbbc6f88700 1 -- start start 2024-05-08T23:15:21.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc6f88700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc0101b50 0x7fbbc0101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:21.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc6f88700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc0104480 0x7fbbc00ffb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:21.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc6f88700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc0106db0 0x7fbbc0100040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:21.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc6f88700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc01007e0 con 0x7fbbc0101b50 2024-05-08T23:15:21.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc6f88700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc0100950 con 0x7fbbc0104480 2024-05-08T23:15:21.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc6f88700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc01a1050 con 0x7fbbc0106db0 2024-05-08T23:15:21.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc4d24700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc0101b50 0x7fbbc0101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:21.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc4d24700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc0101b50 0x7fbbc0101460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59622/0 (socket says 172.21.15.135:59622) 2024-05-08T23:15:21.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc4d24700 1 -- 172.21.15.135:0/1942157665 learned_addr learned my addr 172.21.15.135:0/1942157665 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:21.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbbffff700 1 --2- 172.21.15.135:0/1942157665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc0104480 0x7fbbc00ffb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:21.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc5525700 1 --2- 172.21.15.135:0/1942157665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc0106db0 0x7fbbc0100040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:21.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc4d24700 1 -- 172.21.15.135:0/1942157665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc0106db0 msgr2=0x7fbbc0100040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:21.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc4d24700 1 --2- 172.21.15.135:0/1942157665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc0106db0 0x7fbbc0100040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:21.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc4d24700 1 -- 172.21.15.135:0/1942157665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc0104480 msgr2=0x7fbbc00ffb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:21.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc4d24700 1 --2- 172.21.15.135:0/1942157665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc0104480 0x7fbbc00ffb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:21.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc4d24700 1 -- 172.21.15.135:0/1942157665 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb4009520 con 0x7fbbc0101b50 2024-05-08T23:15:21.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc4d24700 1 --2- 172.21.15.135:0/1942157665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc0101b50 0x7fbbc0101460 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400eb30 tx=0x7fbbb400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:21.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbbdffb700 1 -- 172.21.15.135:0/1942157665 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4009880 con 0x7fbbc0101b50 2024-05-08T23:15:21.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbc6f88700 1 -- 172.21.15.135:0/1942157665 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbac009520 con 0x7fbbc0101b50 2024-05-08T23:15:21.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbbdffb700 1 -- 172.21.15.135:0/1942157665 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbbb40044e0 con 0x7fbbc0101b50 2024-05-08T23:15:21.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.613+0000 7fbbbdffb700 1 -- 172.21.15.135:0/1942157665 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4010430 con 0x7fbbc0101b50 2024-05-08T23:15:21.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.614+0000 7fbbc6f88700 1 -- 172.21.15.135:0/1942157665 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb8009d00 con 0x7fbbc0101b50 2024-05-08T23:15:21.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.615+0000 7fbbc6f88700 1 -- 172.21.15.135:0/1942157665 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc00fd020 con 0x7fbbc0101b50 2024-05-08T23:15:21.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.616+0000 7fbbbdffb700 1 -- 172.21.15.135:0/1942157665 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fbbb4003ee0 con 0x7fbbc0101b50 2024-05-08T23:15:21.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.616+0000 7fbbbdffb700 1 --2- 172.21.15.135:0/1942157665 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fbbb00a11b0 0x7fbbb00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:21.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.616+0000 7fbbbdffb700 1 -- 172.21.15.135:0/1942157665 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fbbb4014070 con 0x7fbbc0101b50 2024-05-08T23:15:21.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.616+0000 7fbbbffff700 1 --2- 172.21.15.135:0/1942157665 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fbbb00a11b0 0x7fbbb00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:21.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.617+0000 7fbbbffff700 1 --2- 172.21.15.135:0/1942157665 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fbbb00a11b0 0x7fbbb00a3670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009d80 tx=0x7fbbac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:21.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.621+0000 7fbbbdffb700 1 -- 172.21.15.135:0/1942157665 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbbb40965b0 con 0x7fbbc0101b50 2024-05-08T23:15:21.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.868+0000 7fbbc6f88700 1 -- 172.21.15.135:0/1942157665 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbc00613e0 con 0x7fbbb00a11b0 2024-05-08T23:15:21.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.870+0000 7fbbbdffb700 1 -- 172.21.15.135:0/1942157665 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7fbbc00613e0 con 0x7fbbb00a11b0 2024-05-08T23:15:21.870 INFO:teuthology.orchestra.run.smithi135.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-08T23:15:21.870 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620401BA400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-05-08T23:15:21.870 INFO:teuthology.orchestra.run.smithi135.stdout:smithi179 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303009J400BGN 372G No 112s ago Has a FileSystem, LVM detected 2024-05-08T23:15:21.870 INFO:teuthology.orchestra.run.smithi135.stdout:smithi195 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300FS480DGN 447G No 94s ago Has a FileSystem, LVM detected 2024-05-08T23:15:21.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.872+0000 7fbbc6f88700 1 -- 172.21.15.135:0/1942157665 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fbbb00a11b0 msgr2=0x7fbbb00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:21.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.872+0000 7fbbc6f88700 1 --2- 172.21.15.135:0/1942157665 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fbbb00a11b0 0x7fbbb00a3670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009d80 tx=0x7fbbac009260 comp rx=0 tx=0).stop 2024-05-08T23:15:21.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.872+0000 7fbbc6f88700 1 -- 172.21.15.135:0/1942157665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc0101b50 msgr2=0x7fbbc0101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:21.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.872+0000 7fbbc6f88700 1 --2- 172.21.15.135:0/1942157665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc0101b50 0x7fbbc0101460 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400eb30 tx=0x7fbbb400eef0 comp rx=0 tx=0).stop 2024-05-08T23:15:21.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.873+0000 7fbbc6f88700 1 -- 172.21.15.135:0/1942157665 shutdown_connections 2024-05-08T23:15:21.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.873+0000 7fbbc6f88700 1 --2- 172.21.15.135:0/1942157665 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fbbb00a11b0 0x7fbbb00a3670 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:21.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.873+0000 7fbbc6f88700 1 --2- 172.21.15.135:0/1942157665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc0106db0 0x7fbbc0100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:21.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.873+0000 7fbbc6f88700 1 --2- 172.21.15.135:0/1942157665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc0101b50 0x7fbbc0101460 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:21.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.873+0000 7fbbc6f88700 1 --2- 172.21.15.135:0/1942157665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbc0104480 0x7fbbc00ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:21.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.873+0000 7fbbc6f88700 1 -- 172.21.15.135:0/1942157665 >> 172.21.15.135:0/1942157665 conn(0x7fbbc00fb4a0 msgr2=0x7fbbc01025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:21.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.873+0000 7fbbc6f88700 1 -- 172.21.15.135:0/1942157665 shutdown_connections 2024-05-08T23:15:21.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:21.873+0000 7fbbc6f88700 1 -- 172.21.15.135:0/1942157665 wait complete. 2024-05-08T23:15:22.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: pgmap v253: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-08T23:15:22.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-05-08T23:15:22.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-05-08T23:15:22.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-05-08T23:15:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-05-08T23:15:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-05-08T23:15:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-05-08T23:15:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-05-08T23:15:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2024-05-08T23:15:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [5, 6]}]': finished 2024-05-08T23:15:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-05-08T23:15:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: osdmap e84: 12 total, 12 up, 12 in 2024-05-08T23:15:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:15:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:15:22.204 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:22.242 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-08T23:15:22.252 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T23:15:22.252 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-08T23:15:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: pgmap v253: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-08T23:15:22.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-05-08T23:15:22.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-05-08T23:15:22.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-05-08T23:15:22.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-05-08T23:15:22.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-05-08T23:15:22.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-05-08T23:15:22.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-05-08T23:15:22.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2024-05-08T23:15:22.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [5, 6]}]': finished 2024-05-08T23:15:22.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-05-08T23:15:22.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: osdmap e84: 12 total, 12 up, 12 in 2024-05-08T23:15:22.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:22.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:22.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:15:22.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:15:22.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:22.478 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:15:22.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: pgmap v253: 97 pgs: 97 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-08T23:15:22.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-05-08T23:15:22.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-05-08T23:15:22.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-05-08T23:15:22.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-05-08T23:15:22.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-05-08T23:15:22.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-05-08T23:15:22.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-05-08T23:15:22.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2024-05-08T23:15:22.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [5, 6]}]': finished 2024-05-08T23:15:22.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-05-08T23:15:22.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: osdmap e84: 12 total, 12 up, 12 in 2024-05-08T23:15:22.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:22.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:22.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:15:22.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:15:22.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:15:23.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:23 smithi135 ceph-mon[42440]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:23.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:23 smithi135 ceph-mon[42440]: osdmap e85: 12 total, 12 up, 12 in 2024-05-08T23:15:23.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.455+0000 7f405393f700 1 -- 172.21.15.135:0/3273187365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f404c0fff00 msgr2=0x7f404c100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.455+0000 7f405393f700 1 --2- 172.21.15.135:0/3273187365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f404c0fff00 0x7f404c100320 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4048009990 tx=0x7f4048009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.456+0000 7f405393f700 1 -- 172.21.15.135:0/3273187365 shutdown_connections 2024-05-08T23:15:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.456+0000 7f405393f700 1 --2- 172.21.15.135:0/3273187365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f404c101a20 0x7f404c108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.456+0000 7f405393f700 1 --2- 172.21.15.135:0/3273187365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f404c0fff00 0x7f404c100320 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.456+0000 7f405393f700 1 --2- 172.21.15.135:0/3273187365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f404c101060 0x7f404c1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.456+0000 7f405393f700 1 -- 172.21.15.135:0/3273187365 >> 172.21.15.135:0/3273187365 conn(0x7f404c0fb4a0 msgr2=0x7f404c0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.456+0000 7f405393f700 1 -- 172.21.15.135:0/3273187365 shutdown_connections 2024-05-08T23:15:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.456+0000 7f405393f700 1 -- 172.21.15.135:0/3273187365 wait complete. 2024-05-08T23:15:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.456+0000 7f405393f700 1 Processor -- start 2024-05-08T23:15:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.456+0000 7f405393f700 1 -- start start 2024-05-08T23:15:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.456+0000 7f405393f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f404c0fff00 0x7f404c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.456+0000 7f405393f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f404c101060 0x7f404c19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.456+0000 7f405393f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f404c101a20 0x7f404c19e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.456+0000 7f405393f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c19eab0 con 0x7f404c101060 2024-05-08T23:15:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.456+0000 7f405393f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c19ec20 con 0x7f404c101a20 2024-05-08T23:15:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.456+0000 7f405393f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c19ede0 con 0x7f404c0fff00 2024-05-08T23:15:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f4050eda700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f404c101060 0x7f404c19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f4050eda700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f404c101060 0x7f404c19bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59646/0 (socket says 172.21.15.135:59646) 2024-05-08T23:15:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f4050eda700 1 -- 172.21.15.135:0/3249390884 learned_addr learned my addr 172.21.15.135:0/3249390884 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f40516db700 1 --2- 172.21.15.135:0/3249390884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f404c0fff00 0x7f404c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f4051edc700 1 --2- 172.21.15.135:0/3249390884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f404c101a20 0x7f404c19e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f4050eda700 1 -- 172.21.15.135:0/3249390884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f404c0fff00 msgr2=0x7f404c069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f4050eda700 1 --2- 172.21.15.135:0/3249390884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f404c0fff00 0x7f404c069460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f4050eda700 1 -- 172.21.15.135:0/3249390884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f404c101a20 msgr2=0x7f404c19e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f4050eda700 1 --2- 172.21.15.135:0/3249390884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f404c101a20 0x7f404c19e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f4050eda700 1 -- 172.21.15.135:0/3249390884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40480095f0 con 0x7f404c101060 2024-05-08T23:15:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f4050eda700 1 --2- 172.21.15.135:0/3249390884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f404c101060 0x7f404c19bd40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f403c00b530 tx=0x7f403c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f40427fc700 1 -- 172.21.15.135:0/3249390884 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c011830 con 0x7f404c101060 2024-05-08T23:15:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f40427fc700 1 -- 172.21.15.135:0/3249390884 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f403c011e50 con 0x7f404c101060 2024-05-08T23:15:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f405393f700 1 -- 172.21.15.135:0/3249390884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404c19f0c0 con 0x7f404c101060 2024-05-08T23:15:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f40427fc700 1 -- 172.21.15.135:0/3249390884 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c00f2e0 con 0x7f404c101060 2024-05-08T23:15:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.457+0000 7f405393f700 1 -- 172.21.15.135:0/3249390884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404c19f640 con 0x7f404c101060 2024-05-08T23:15:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.458+0000 7f405393f700 1 -- 172.21.15.135:0/3249390884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404c107380 con 0x7f404c101060 2024-05-08T23:15:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.459+0000 7f40427fc700 1 -- 172.21.15.135:0/3249390884 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f403c010380 con 0x7f404c101060 2024-05-08T23:15:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.460+0000 7f40427fc700 1 --2- 172.21.15.135:0/3249390884 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f40380a11b0 0x7f40380a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.460+0000 7f40516db700 1 --2- 172.21.15.135:0/3249390884 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f40380a11b0 0x7f40380a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.460+0000 7f40427fc700 1 -- 172.21.15.135:0/3249390884 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f403c0ccab0 con 0x7f404c101060 2024-05-08T23:15:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.460+0000 7f40516db700 1 --2- 172.21.15.135:0/3249390884 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f40380a11b0 0x7f40380a3670 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f404800b5c0 tx=0x7f4048003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:23.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.464+0000 7f40427fc700 1 -- 172.21.15.135:0/3249390884 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f403c0961d0 con 0x7f404c101060 2024-05-08T23:15:23.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:23 smithi179 ceph-mon[46314]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:23.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:23 smithi179 ceph-mon[46314]: osdmap e85: 12 total, 12 up, 12 in 2024-05-08T23:15:23.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:23 smithi195 ceph-mon[46516]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:23.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:23 smithi195 ceph-mon[46516]: osdmap e85: 12 total, 12 up, 12 in 2024-05-08T23:15:23.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.699+0000 7f405393f700 1 -- 172.21.15.135:0/3249390884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f404c04ec60 con 0x7f404c101060 2024-05-08T23:15:23.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.700+0000 7f40427fc700 1 -- 172.21.15.135:0/3249390884 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+2933 (secure 0 0 0) 0x7f403c015b90 con 0x7f404c101060 2024-05-08T23:15:23.699 INFO:teuthology.orchestra.run.smithi135.stdout:e27 2024-05-08T23:15:23.700 INFO:teuthology.orchestra.run.smithi135.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T23:15:23.700 INFO:teuthology.orchestra.run.smithi135.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-08T23:15:23.700 INFO:teuthology.orchestra.run.smithi135.stdout:legacy client fscid: 1 2024-05-08T23:15:23.700 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:23.700 INFO:teuthology.orchestra.run.smithi135.stdout:Filesystem 'cephfs' (1) 2024-05-08T23:15:23.700 INFO:teuthology.orchestra.run.smithi135.stdout:fs_name cephfs 2024-05-08T23:15:23.700 INFO:teuthology.orchestra.run.smithi135.stdout:epoch 27 2024-05-08T23:15:23.700 INFO:teuthology.orchestra.run.smithi135.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-08T23:15:23.700 INFO:teuthology.orchestra.run.smithi135.stdout:created 2024-05-08T23:14:21.921303+0000 2024-05-08T23:15:23.700 INFO:teuthology.orchestra.run.smithi135.stdout:modified 2024-05-08T23:14:28.351004+0000 2024-05-08T23:15:23.700 INFO:teuthology.orchestra.run.smithi135.stdout:tableserver 0 2024-05-08T23:15:23.700 INFO:teuthology.orchestra.run.smithi135.stdout:root 0 2024-05-08T23:15:23.700 INFO:teuthology.orchestra.run.smithi135.stdout:session_timeout 300 2024-05-08T23:15:23.700 INFO:teuthology.orchestra.run.smithi135.stdout:session_autoclose 300 2024-05-08T23:15:23.700 INFO:teuthology.orchestra.run.smithi135.stdout:max_file_size 1099511627776 2024-05-08T23:15:23.701 INFO:teuthology.orchestra.run.smithi135.stdout:max_xattr_size 65536 2024-05-08T23:15:23.701 INFO:teuthology.orchestra.run.smithi135.stdout:required_client_features {} 2024-05-08T23:15:23.701 INFO:teuthology.orchestra.run.smithi135.stdout:last_failure 0 2024-05-08T23:15:23.701 INFO:teuthology.orchestra.run.smithi135.stdout:last_failure_osd_epoch 0 2024-05-08T23:15:23.701 INFO:teuthology.orchestra.run.smithi135.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-08T23:15:23.701 INFO:teuthology.orchestra.run.smithi135.stdout:max_mds 5 2024-05-08T23:15:23.701 INFO:teuthology.orchestra.run.smithi135.stdout:in 0,1,2,3,4 2024-05-08T23:15:23.701 INFO:teuthology.orchestra.run.smithi135.stdout:up {0=24508,1=24500,2=24484,3=24439,4=24419} 2024-05-08T23:15:23.701 INFO:teuthology.orchestra.run.smithi135.stdout:failed 2024-05-08T23:15:23.701 INFO:teuthology.orchestra.run.smithi135.stdout:damaged 2024-05-08T23:15:23.701 INFO:teuthology.orchestra.run.smithi135.stdout:stopped 2024-05-08T23:15:23.701 INFO:teuthology.orchestra.run.smithi135.stdout:data_pools [3] 2024-05-08T23:15:23.701 INFO:teuthology.orchestra.run.smithi135.stdout:metadata_pool 2 2024-05-08T23:15:23.702 INFO:teuthology.orchestra.run.smithi135.stdout:inline_data disabled 2024-05-08T23:15:23.702 INFO:teuthology.orchestra.run.smithi135.stdout:balancer 2024-05-08T23:15:23.702 INFO:teuthology.orchestra.run.smithi135.stdout:bal_rank_mask -1 2024-05-08T23:15:23.702 INFO:teuthology.orchestra.run.smithi135.stdout:standby_count_wanted 0 2024-05-08T23:15:23.702 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.i{0:24508} state up:active seq 4 addr [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T23:15:23.702 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.f{0:24472} state up:standby-replay seq 1 addr [v2:172.21.15.195:6834/4199708510,v1:172.21.15.195:6835/4199708510] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T23:15:23.702 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b{1:24500} state up:active seq 4 addr [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T23:15:23.702 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.h{1:24470} state up:standby-replay seq 1 addr [v2:172.21.15.179:6836/2957410160,v1:172.21.15.179:6837/2957410160] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T23:15:23.702 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c{2:24484} state up:active seq 6 addr [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T23:15:23.702 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.e{2:24443} state up:standby-replay seq 1 addr [v2:172.21.15.179:6834/1024532,v1:172.21.15.179:6835/1024532] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T23:15:23.702 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.l{3:24439} state up:active seq 9 addr [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T23:15:23.702 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a{3:14622} state up:standby-replay seq 1 addr [v2:172.21.15.135:6840/1831266531,v1:172.21.15.135:6841/1831266531] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T23:15:23.702 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.k{4:24419} state up:active seq 9 addr [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T23:15:23.702 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.g{4:14616} state up:standby-replay seq 1 addr [v2:172.21.15.135:6838/360966092,v1:172.21.15.135:6839/360966092] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T23:15:23.702 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:23.703 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:23.703 INFO:teuthology.orchestra.run.smithi135.stdout:Standby daemons: 2024-05-08T23:15:23.703 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:23.703 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.j{-1:14553} state up:standby seq 1 addr [v2:172.21.15.135:6834/2842983323,v1:172.21.15.135:6835/2842983323] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T23:15:23.703 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d{-1:14565} state up:standby seq 1 addr [v2:172.21.15.135:6836/2432614311,v1:172.21.15.135:6837/2432614311] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T23:15:23.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.702+0000 7f405393f700 1 -- 172.21.15.135:0/3249390884 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f40380a11b0 msgr2=0x7f40380a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:23.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.702+0000 7f405393f700 1 --2- 172.21.15.135:0/3249390884 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f40380a11b0 0x7f40380a3670 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f404800b5c0 tx=0x7f4048003790 comp rx=0 tx=0).stop 2024-05-08T23:15:23.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.702+0000 7f405393f700 1 -- 172.21.15.135:0/3249390884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f404c101060 msgr2=0x7f404c19bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:23.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.702+0000 7f405393f700 1 --2- 172.21.15.135:0/3249390884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f404c101060 0x7f404c19bd40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f403c00b530 tx=0x7f403c00b840 comp rx=0 tx=0).stop 2024-05-08T23:15:23.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.702+0000 7f405393f700 1 -- 172.21.15.135:0/3249390884 shutdown_connections 2024-05-08T23:15:23.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.702+0000 7f405393f700 1 --2- 172.21.15.135:0/3249390884 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f40380a11b0 0x7f40380a3670 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:23.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.702+0000 7f405393f700 1 --2- 172.21.15.135:0/3249390884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f404c0fff00 0x7f404c069460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:23.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.702+0000 7f405393f700 1 --2- 172.21.15.135:0/3249390884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f404c101a20 0x7f404c19e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:23.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.702+0000 7f405393f700 1 --2- 172.21.15.135:0/3249390884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f404c101060 0x7f404c19bd40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:23.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.702+0000 7f405393f700 1 -- 172.21.15.135:0/3249390884 >> 172.21.15.135:0/3249390884 conn(0x7f404c0fb4a0 msgr2=0x7f404c1044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:23.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.702+0000 7f405393f700 1 -- 172.21.15.135:0/3249390884 shutdown_connections 2024-05-08T23:15:23.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:23.702+0000 7f405393f700 1 -- 172.21.15.135:0/3249390884 wait complete. 2024-05-08T23:15:23.704 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 27 2024-05-08T23:15:24.066 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-08T23:15:24.291 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:15:24.402 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:24 smithi135 ceph-mon[42440]: pgmap v256: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-05-08T23:15:24.402 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:24 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3249390884' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-08T23:15:24.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:24 smithi179 ceph-mon[46314]: pgmap v256: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-05-08T23:15:24.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:24 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3249390884' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-08T23:15:24.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:24 smithi195 ceph-mon[46516]: pgmap v256: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-05-08T23:15:24.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:24 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3249390884' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-08T23:15:25.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.240+0000 7f0510202700 1 -- 172.21.15.135:0/505158393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508100b60 msgr2=0x7f0508108400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:25.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.240+0000 7f0510202700 1 --2- 172.21.15.135:0/505158393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508100b60 0x7f0508108400 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f050000b0a0 tx=0x7f050000b3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:25.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.241+0000 7f0510202700 1 -- 172.21.15.135:0/505158393 shutdown_connections 2024-05-08T23:15:25.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.241+0000 7f0510202700 1 --2- 172.21.15.135:0/505158393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508100b60 0x7f0508108400 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:25.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.241+0000 7f0510202700 1 --2- 172.21.15.135:0/505158393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0508101540 0x7f0508101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:25.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.241+0000 7f0510202700 1 --2- 172.21.15.135:0/505158393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05081001a0 0x7f0508100620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:25.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.241+0000 7f0510202700 1 -- 172.21.15.135:0/505158393 >> 172.21.15.135:0/505158393 conn(0x7f05080facb0 msgr2=0x7f05080fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:25.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.241+0000 7f0510202700 1 -- 172.21.15.135:0/505158393 shutdown_connections 2024-05-08T23:15:25.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.241+0000 7f0510202700 1 -- 172.21.15.135:0/505158393 wait complete. 2024-05-08T23:15:25.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.241+0000 7f0510202700 1 Processor -- start 2024-05-08T23:15:25.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.241+0000 7f0510202700 1 -- start start 2024-05-08T23:15:25.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f0510202700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05081001a0 0x7f05080ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:25.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f0510202700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508100b60 0x7f050819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:25.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f0510202700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0508101540 0x7f050819e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:25.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f0510202700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050819eab0 con 0x7f0508100b60 2024-05-08T23:15:25.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f0510202700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050819ec20 con 0x7f0508101540 2024-05-08T23:15:25.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f0510202700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050819ede0 con 0x7f05081001a0 2024-05-08T23:15:25.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f050d79d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508100b60 0x7f050819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:25.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f050d79d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508100b60 0x7f050819bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59674/0 (socket says 172.21.15.135:59674) 2024-05-08T23:15:25.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f050d79d700 1 -- 172.21.15.135:0/2127365321 learned_addr learned my addr 172.21.15.135:0/2127365321 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:25.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f050df9e700 1 --2- 172.21.15.135:0/2127365321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05081001a0 0x7f05080ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:25.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f050e79f700 1 --2- 172.21.15.135:0/2127365321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0508101540 0x7f050819e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:25.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f050d79d700 1 -- 172.21.15.135:0/2127365321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05081001a0 msgr2=0x7f05080ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:25.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f050d79d700 1 --2- 172.21.15.135:0/2127365321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05081001a0 0x7f05080ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:25.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f050d79d700 1 -- 172.21.15.135:0/2127365321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0508101540 msgr2=0x7f050819e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:25.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f050d79d700 1 --2- 172.21.15.135:0/2127365321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0508101540 0x7f050819e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:25.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f050d79d700 1 -- 172.21.15.135:0/2127365321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0500009d00 con 0x7f0508100b60 2024-05-08T23:15:25.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f050d79d700 1 --2- 172.21.15.135:0/2127365321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508100b60 0x7f050819bd20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f04f800b530 tx=0x7f04f800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:25.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.242+0000 7f04feffd700 1 -- 172.21.15.135:0/2127365321 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8011830 con 0x7f0508100b60 2024-05-08T23:15:25.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.243+0000 7f0510202700 1 -- 172.21.15.135:0/2127365321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050819f0c0 con 0x7f0508100b60 2024-05-08T23:15:25.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.243+0000 7f04feffd700 1 -- 172.21.15.135:0/2127365321 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04f8011e50 con 0x7f0508100b60 2024-05-08T23:15:25.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.243+0000 7f04feffd700 1 -- 172.21.15.135:0/2127365321 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f800f2e0 con 0x7f0508100b60 2024-05-08T23:15:25.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.243+0000 7f0510202700 1 -- 172.21.15.135:0/2127365321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050819f5c0 con 0x7f0508100b60 2024-05-08T23:15:25.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.243+0000 7f0510202700 1 -- 172.21.15.135:0/2127365321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0508107370 con 0x7f0508100b60 2024-05-08T23:15:25.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.245+0000 7f04feffd700 1 -- 172.21.15.135:0/2127365321 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f04f8010580 con 0x7f0508100b60 2024-05-08T23:15:25.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.245+0000 7f04feffd700 1 --2- 172.21.15.135:0/2127365321 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f04f40a11b0 0x7f04f40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:25.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.245+0000 7f050df9e700 1 --2- 172.21.15.135:0/2127365321 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f04f40a11b0 0x7f04f40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:25.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.245+0000 7f04feffd700 1 -- 172.21.15.135:0/2127365321 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f04f80cca20 con 0x7f0508100b60 2024-05-08T23:15:25.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.246+0000 7f050df9e700 1 --2- 172.21.15.135:0/2127365321 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f04f40a11b0 0x7f04f40a3670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0504005ea0 tx=0x7f0504005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:25.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.249+0000 7f04feffd700 1 -- 172.21.15.135:0/2127365321 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f04f8096140 con 0x7f0508100b60 2024-05-08T23:15:25.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.442+0000 7f0510202700 1 -- 172.21.15.135:0/2127365321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f050804ec60 con 0x7f0508100b60 2024-05-08T23:15:25.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.443+0000 7f04feffd700 1 -- 172.21.15.135:0/2127365321 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v85) v1 ==== 56+0+5358 (secure 0 0 0) 0x7f04f8099760 con 0x7f0508100b60 2024-05-08T23:15:25.442 INFO:teuthology.orchestra.run.smithi135.stdout:epoch 85 2024-05-08T23:15:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:fsid c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:15:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:created 2024-05-08T23:08:30.944912+0000 2024-05-08T23:15:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:modified 2024-05-08T23:15:22.121685+0000 2024-05-08T23:15:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-08T23:15:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:crush_version 26 2024-05-08T23:15:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:full_ratio 0.95 2024-05-08T23:15:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:backfillfull_ratio 0.9 2024-05-08T23:15:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:nearfull_ratio 0.85 2024-05-08T23:15:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:require_min_compat_client luminous 2024-05-08T23:15:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:min_compat_client luminous 2024-05-08T23:15:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:require_osd_release reef 2024-05-08T23:15:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:stretch_mode_enabled false 2024-05-08T23:15:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-08T23:15:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-05-08T23:15:25.444 INFO:teuthology.orchestra.run.smithi135.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-05-08T23:15:25.444 INFO:teuthology.orchestra.run.smithi135.stdout:max_osd 12 2024-05-08T23:15:25.444 INFO:teuthology.orchestra.run.smithi135.stdout:osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6802/2658342982,v1:172.21.15.135:6803/2658342982] [v2:172.21.15.135:6804/2658342982,v1:172.21.15.135:6805/2658342982] exists,up 2aafc0bf-d99a-4981-b7c4-a0e26072aab4 2024-05-08T23:15:25.444 INFO:teuthology.orchestra.run.smithi135.stdout:osd.1 up in weight 1 up_from 13 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6800/3883295152,v1:172.21.15.179:6801/3883295152] [v2:172.21.15.179:6802/3883295152,v1:172.21.15.179:6803/3883295152] exists,up 23d196fd-2c00-40a3-84d4-fa1acbf73426 2024-05-08T23:15:25.444 INFO:teuthology.orchestra.run.smithi135.stdout:osd.2 up in weight 1 up_from 18 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6800/1615315232,v1:172.21.15.195:6801/1615315232] [v2:172.21.15.195:6802/1615315232,v1:172.21.15.195:6803/1615315232] exists,up fb61be11-dbcf-45c7-b436-a00694480bbf 2024-05-08T23:15:25.444 INFO:teuthology.orchestra.run.smithi135.stdout:osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6810/1328709817,v1:172.21.15.135:6811/1328709817] [v2:172.21.15.135:6812/1328709817,v1:172.21.15.135:6813/1328709817] exists,up 6b31fd07-08f3-491b-b0ef-e898a7f4a2fb 2024-05-08T23:15:25.444 INFO:teuthology.orchestra.run.smithi135.stdout:osd.4 up in weight 1 up_from 33 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6808/1955171342,v1:172.21.15.179:6809/1955171342] [v2:172.21.15.179:6810/1955171342,v1:172.21.15.179:6811/1955171342] exists,up b40ae169-2262-417d-958e-8903b16e89ab 2024-05-08T23:15:25.444 INFO:teuthology.orchestra.run.smithi135.stdout:osd.5 up in weight 1 up_from 38 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6808/1466056626,v1:172.21.15.195:6809/1466056626] [v2:172.21.15.195:6810/1466056626,v1:172.21.15.195:6811/1466056626] exists,up 26b4c6d5-5a0f-49e2-87cc-08618c3fd833 2024-05-08T23:15:25.444 INFO:teuthology.orchestra.run.smithi135.stdout:osd.6 up in weight 1 up_from 45 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6818/2493102578,v1:172.21.15.135:6819/2493102578] [v2:172.21.15.135:6820/2493102578,v1:172.21.15.135:6821/2493102578] exists,up e506e541-e401-4795-af36-65ef8f53c6a5 2024-05-08T23:15:25.444 INFO:teuthology.orchestra.run.smithi135.stdout:osd.7 up in weight 1 up_from 50 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6816/43006625,v1:172.21.15.179:6817/43006625] [v2:172.21.15.179:6818/43006625,v1:172.21.15.179:6819/43006625] exists,up 9cfe5c66-7d48-4a48-93c6-29781ad96581 2024-05-08T23:15:25.444 INFO:teuthology.orchestra.run.smithi135.stdout:osd.8 up in weight 1 up_from 57 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6816/431240376,v1:172.21.15.195:6817/431240376] [v2:172.21.15.195:6818/431240376,v1:172.21.15.195:6819/431240376] exists,up 807e90e4-2d33-4038-952b-97d5203ce08d 2024-05-08T23:15:25.444 INFO:teuthology.orchestra.run.smithi135.stdout:osd.9 up in weight 1 up_from 65 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6826/2141009951,v1:172.21.15.135:6827/2141009951] [v2:172.21.15.135:6828/2141009951,v1:172.21.15.135:6829/2141009951] exists,up 6d499d4b-5921-4bbb-8179-549ec18bbf21 2024-05-08T23:15:25.444 INFO:teuthology.orchestra.run.smithi135.stdout:osd.10 up in weight 1 up_from 70 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6824/1119841864,v1:172.21.15.179:6825/1119841864] [v2:172.21.15.179:6826/1119841864,v1:172.21.15.179:6827/1119841864] exists,up a22f21ea-57b8-4b21-8cd5-e06007c87c4e 2024-05-08T23:15:25.444 INFO:teuthology.orchestra.run.smithi135.stdout:osd.11 up in weight 1 up_from 78 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6824/3939527459,v1:172.21.15.195:6825/3939527459] [v2:172.21.15.195:6826/3939527459,v1:172.21.15.195:6827/3939527459] exists,up 1cf992e4-6fcd-4c77-a726-4f111d2b9368 2024-05-08T23:15:25.444 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 2.4 [2,11] 2024-05-08T23:15:25.445 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 2.5 [8,11] 2024-05-08T23:15:25.445 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 2.e [2,4] 2024-05-08T23:15:25.445 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 2.1f [8,1] 2024-05-08T23:15:25.445 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.2 [3,9] 2024-05-08T23:15:25.445 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.13 [4,9] 2024-05-08T23:15:25.445 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.17 [4,8] 2024-05-08T23:15:25.445 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.1b [4,7] 2024-05-08T23:15:25.445 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.1e [5,6] 2024-05-08T23:15:25.445 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.33 [5,9] 2024-05-08T23:15:25.445 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/3516579563 expires 2024-05-09T23:09:20.971548+0000 2024-05-08T23:15:25.445 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:6801/3165594440 expires 2024-05-09T23:09:20.971548+0000 2024-05-08T23:15:25.445 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:6800/3165594440 expires 2024-05-09T23:09:20.971548+0000 2024-05-08T23:15:25.445 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:6800/104127578 expires 2024-05-09T23:08:58.407759+0000 2024-05-08T23:15:25.445 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/804131600 expires 2024-05-09T23:08:58.407759+0000 2024-05-08T23:15:25.446 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/2321849564 expires 2024-05-09T23:08:58.407759+0000 2024-05-08T23:15:25.446 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:6801/104127578 expires 2024-05-09T23:08:58.407759+0000 2024-05-08T23:15:25.446 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/3418179245 expires 2024-05-09T23:09:20.971548+0000 2024-05-08T23:15:25.446 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/1935141086 expires 2024-05-09T23:08:58.407759+0000 2024-05-08T23:15:25.446 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/1985087492 expires 2024-05-09T23:09:20.971548+0000 2024-05-08T23:15:25.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.445+0000 7f0510202700 1 -- 172.21.15.135:0/2127365321 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f04f40a11b0 msgr2=0x7f04f40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:25.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.445+0000 7f0510202700 1 --2- 172.21.15.135:0/2127365321 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f04f40a11b0 0x7f04f40a3670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0504005ea0 tx=0x7f0504005e30 comp rx=0 tx=0).stop 2024-05-08T23:15:25.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.445+0000 7f0510202700 1 -- 172.21.15.135:0/2127365321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508100b60 msgr2=0x7f050819bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:25.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.445+0000 7f0510202700 1 --2- 172.21.15.135:0/2127365321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508100b60 0x7f050819bd20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f04f800b530 tx=0x7f04f800b8f0 comp rx=0 tx=0).stop 2024-05-08T23:15:25.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.445+0000 7f0510202700 1 -- 172.21.15.135:0/2127365321 shutdown_connections 2024-05-08T23:15:25.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.445+0000 7f0510202700 1 --2- 172.21.15.135:0/2127365321 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f04f40a11b0 0x7f04f40a3670 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:25.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.445+0000 7f0510202700 1 --2- 172.21.15.135:0/2127365321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05081001a0 0x7f05080ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:25.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.445+0000 7f0510202700 1 --2- 172.21.15.135:0/2127365321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0508101540 0x7f050819e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:25.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.445+0000 7f0510202700 1 --2- 172.21.15.135:0/2127365321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508100b60 0x7f050819bd20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:25.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.445+0000 7f0510202700 1 -- 172.21.15.135:0/2127365321 >> 172.21.15.135:0/2127365321 conn(0x7f05080facb0 msgr2=0x7f05081044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:25.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.445+0000 7f0510202700 1 -- 172.21.15.135:0/2127365321 shutdown_connections 2024-05-08T23:15:25.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:25.445+0000 7f0510202700 1 -- 172.21.15.135:0/2127365321 wait complete. 2024-05-08T23:15:25.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:25 smithi135 ceph-mon[42440]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-08T23:15:25.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:25 smithi179 ceph-mon[46314]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-08T23:15:25.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:25 smithi195 ceph-mon[46516]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-08T23:15:25.876 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-08T23:15:25.891 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T23:15:26.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.021+0000 7f74a42a7700 1 -- 172.21.15.135:0/1016404812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c101910 msgr2=0x7f749c103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:26.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.021+0000 7f74a42a7700 1 --2- 172.21.15.135:0/1016404812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c101910 0x7f749c103d00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f748c009990 tx=0x7f748c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.021+0000 7f74a42a7700 1 -- 172.21.15.135:0/1016404812 shutdown_connections 2024-05-08T23:15:26.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.021+0000 7f74a42a7700 1 --2- 172.21.15.135:0/1016404812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f749c106b70 0x7f749c108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.021+0000 7f74a42a7700 1 --2- 172.21.15.135:0/1016404812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c101910 0x7f749c103d00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.021+0000 7f74a42a7700 1 --2- 172.21.15.135:0/1016404812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f749c104240 0x7f749c106630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.021+0000 7f74a42a7700 1 -- 172.21.15.135:0/1016404812 >> 172.21.15.135:0/1016404812 conn(0x7f749c0fb320 msgr2=0x7f749c0fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:26.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.021+0000 7f74a42a7700 1 -- 172.21.15.135:0/1016404812 shutdown_connections 2024-05-08T23:15:26.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.021+0000 7f74a42a7700 1 -- 172.21.15.135:0/1016404812 wait complete. 2024-05-08T23:15:26.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.022+0000 7f74a42a7700 1 Processor -- start 2024-05-08T23:15:26.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.022+0000 7f74a42a7700 1 -- start start 2024-05-08T23:15:26.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.022+0000 7f74a42a7700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f749c101910 0x7f749c196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:26.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.022+0000 7f74a42a7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c104240 0x7f749c197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:26.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.022+0000 7f74a42a7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f749c106b70 0x7f749c19e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:26.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.022+0000 7f74a42a7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c19e8e0 con 0x7f749c104240 2024-05-08T23:15:26.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.022+0000 7f74a42a7700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c19ea50 con 0x7f749c101910 2024-05-08T23:15:26.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.022+0000 7f74a42a7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c19ec10 con 0x7f749c106b70 2024-05-08T23:15:26.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74a1842700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c104240 0x7f749c197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:26.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74a1842700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c104240 0x7f749c197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59696/0 (socket says 172.21.15.135:59696) 2024-05-08T23:15:26.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74a1842700 1 -- 172.21.15.135:0/1495157265 learned_addr learned my addr 172.21.15.135:0/1495157265 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:26.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74a2043700 1 --2- 172.21.15.135:0/1495157265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f749c101910 0x7f749c196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:26.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74a2844700 1 --2- 172.21.15.135:0/1495157265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f749c106b70 0x7f749c19e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:26.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74a1842700 1 -- 172.21.15.135:0/1495157265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f749c106b70 msgr2=0x7f749c19e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:26.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74a1842700 1 --2- 172.21.15.135:0/1495157265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f749c106b70 0x7f749c19e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74a1842700 1 -- 172.21.15.135:0/1495157265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f749c101910 msgr2=0x7f749c196df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:26.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74a1842700 1 --2- 172.21.15.135:0/1495157265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f749c101910 0x7f749c196df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74a1842700 1 -- 172.21.15.135:0/1495157265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c0095f0 con 0x7f749c104240 2024-05-08T23:15:26.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74a2844700 1 --2- 172.21.15.135:0/1495157265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f749c106b70 0x7f749c19e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:26.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74a1842700 1 --2- 172.21.15.135:0/1495157265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c104240 0x7f749c197330 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f749800c920 tx=0x7f749800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:26.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74937fe700 1 -- 172.21.15.135:0/1495157265 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498007b00 con 0x7f749c104240 2024-05-08T23:15:26.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74937fe700 1 -- 172.21.15.135:0/1495157265 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f749800ce70 con 0x7f749c104240 2024-05-08T23:15:26.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74a42a7700 1 -- 172.21.15.135:0/1495157265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749c19eef0 con 0x7f749c104240 2024-05-08T23:15:26.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74937fe700 1 -- 172.21.15.135:0/1495157265 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74980054e0 con 0x7f749c104240 2024-05-08T23:15:26.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.023+0000 7f74a42a7700 1 -- 172.21.15.135:0/1495157265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749c19f310 con 0x7f749c104240 2024-05-08T23:15:26.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.024+0000 7f74a42a7700 1 -- 172.21.15.135:0/1495157265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749c0fcea0 con 0x7f749c104240 2024-05-08T23:15:26.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.026+0000 7f74937fe700 1 -- 172.21.15.135:0/1495157265 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f7498004750 con 0x7f749c104240 2024-05-08T23:15:26.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.027+0000 7f74937fe700 1 --2- 172.21.15.135:0/1495157265 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f74880a11b0 0x7f74880a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:26.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.027+0000 7f74a2043700 1 --2- 172.21.15.135:0/1495157265 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f74880a11b0 0x7f74880a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:26.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.027+0000 7f74937fe700 1 -- 172.21.15.135:0/1495157265 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f74980cca80 con 0x7f749c104240 2024-05-08T23:15:26.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.027+0000 7f74a2043700 1 --2- 172.21.15.135:0/1495157265 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f74880a11b0 0x7f74880a3670 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f748c00b5c0 tx=0x7f748c003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:26.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.030+0000 7f74937fe700 1 -- 172.21.15.135:0/1495157265 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7498096030 con 0x7f749c104240 2024-05-08T23:15:26.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.235+0000 7f74a42a7700 1 -- 172.21.15.135:0/1495157265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f749c10c670 con 0x7f749c104240 2024-05-08T23:15:26.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.236+0000 7f74937fe700 1 -- 172.21.15.135:0/1495157265 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22702 (secure 0 0 0) 0x7f749801d020 con 0x7f749c104240 2024-05-08T23:15:26.236 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:26.236 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":85,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:15:22.121685+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T23:14:19.726838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T23:14:21.097732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:15:26.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.238+0000 7f74a42a7700 1 -- 172.21.15.135:0/1495157265 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f74880a11b0 msgr2=0x7f74880a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:26.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.238+0000 7f74a42a7700 1 --2- 172.21.15.135:0/1495157265 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f74880a11b0 0x7f74880a3670 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f748c00b5c0 tx=0x7f748c003790 comp rx=0 tx=0).stop 2024-05-08T23:15:26.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.238+0000 7f74a42a7700 1 -- 172.21.15.135:0/1495157265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c104240 msgr2=0x7f749c197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:26.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.238+0000 7f74a42a7700 1 --2- 172.21.15.135:0/1495157265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c104240 0x7f749c197330 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f749800c920 tx=0x7f749800cc30 comp rx=0 tx=0).stop 2024-05-08T23:15:26.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.238+0000 7f74a42a7700 1 -- 172.21.15.135:0/1495157265 shutdown_connections 2024-05-08T23:15:26.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.238+0000 7f74a42a7700 1 --2- 172.21.15.135:0/1495157265 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f74880a11b0 0x7f74880a3670 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.238+0000 7f74a42a7700 1 --2- 172.21.15.135:0/1495157265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f749c106b70 0x7f749c19e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.238+0000 7f74a42a7700 1 --2- 172.21.15.135:0/1495157265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f749c101910 0x7f749c196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.238+0000 7f74a42a7700 1 --2- 172.21.15.135:0/1495157265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c104240 0x7f749c197330 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.238+0000 7f74a42a7700 1 -- 172.21.15.135:0/1495157265 >> 172.21.15.135:0/1495157265 conn(0x7f749c0fb320 msgr2=0x7f749c102370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:26.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.239+0000 7f74a42a7700 1 -- 172.21.15.135:0/1495157265 shutdown_connections 2024-05-08T23:15:26.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.239+0000 7f74a42a7700 1 -- 172.21.15.135:0/1495157265 wait complete. 2024-05-08T23:15:26.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:11:11.282550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T23:14:19.726838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T23:14:21.097732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T23:15:26.251 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T23:15:26.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.378+0000 7f0b60fbb700 1 -- 172.21.15.135:0/2618913439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c0ff220 msgr2=0x7f0b5c0ff640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:26.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.378+0000 7f0b60fbb700 1 --2- 172.21.15.135:0/2618913439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c0ff220 0x7f0b5c0ff640 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009990 tx=0x7f0b50009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.378+0000 7f0b60fbb700 1 -- 172.21.15.135:0/2618913439 shutdown_connections 2024-05-08T23:15:26.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.378+0000 7f0b60fbb700 1 --2- 172.21.15.135:0/2618913439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b5c102b90 0x7f0b5c109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.378+0000 7f0b60fbb700 1 --2- 172.21.15.135:0/2618913439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c0ff220 0x7f0b5c0ff640 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.378+0000 7f0b60fbb700 1 --2- 172.21.15.135:0/2618913439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b5c1021f0 0x7f0b5c102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.378+0000 7f0b60fbb700 1 -- 172.21.15.135:0/2618913439 >> 172.21.15.135:0/2618913439 conn(0x7f0b5c0fab50 msgr2=0x7f0b5c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:26.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.378+0000 7f0b60fbb700 1 -- 172.21.15.135:0/2618913439 shutdown_connections 2024-05-08T23:15:26.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.378+0000 7f0b60fbb700 1 -- 172.21.15.135:0/2618913439 wait complete. 2024-05-08T23:15:26.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b60fbb700 1 Processor -- start 2024-05-08T23:15:26.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b60fbb700 1 -- start start 2024-05-08T23:15:26.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b60fbb700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b5c0ff220 0x7f0b5c196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:26.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b60fbb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c1021f0 0x7f0b5c197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:26.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b60fbb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b5c102b90 0x7f0b5c19e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:26.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b60fbb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c19ea30 con 0x7f0b5c1021f0 2024-05-08T23:15:26.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b60fbb700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c19eb70 con 0x7f0b5c0ff220 2024-05-08T23:15:26.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b60fbb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c19ed00 con 0x7f0b5c102b90 2024-05-08T23:15:26.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b59d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c1021f0 0x7f0b5c197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:26.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b59d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c1021f0 0x7f0b5c197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59704/0 (socket says 172.21.15.135:59704) 2024-05-08T23:15:26.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b59d9b700 1 -- 172.21.15.135:0/784447557 learned_addr learned my addr 172.21.15.135:0/784447557 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:26.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b5a59c700 1 --2- 172.21.15.135:0/784447557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b5c0ff220 0x7f0b5c196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:26.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b59d9b700 1 -- 172.21.15.135:0/784447557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b5c102b90 msgr2=0x7f0b5c19e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:26.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b59d9b700 1 --2- 172.21.15.135:0/784447557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b5c102b90 0x7f0b5c19e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b59d9b700 1 -- 172.21.15.135:0/784447557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b5c0ff220 msgr2=0x7f0b5c196f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:26.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b59d9b700 1 --2- 172.21.15.135:0/784447557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b5c0ff220 0x7f0b5c196f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b59d9b700 1 -- 172.21.15.135:0/784447557 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b500095f0 con 0x7f0b5c1021f0 2024-05-08T23:15:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b59d9b700 1 --2- 172.21.15.135:0/784447557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c1021f0 0x7f0b5c197440 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00d980 tx=0x7f0b4c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b4b7fe700 1 -- 172.21.15.135:0/784447557 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c004a30 con 0x7f0b5c1021f0 2024-05-08T23:15:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b4b7fe700 1 -- 172.21.15.135:0/784447557 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b4c0054e0 con 0x7f0b5c1021f0 2024-05-08T23:15:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.379+0000 7f0b60fbb700 1 -- 172.21.15.135:0/784447557 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c19efe0 con 0x7f0b5c1021f0 2024-05-08T23:15:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.380+0000 7f0b4b7fe700 1 -- 172.21.15.135:0/784447557 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c009c90 con 0x7f0b5c1021f0 2024-05-08T23:15:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.380+0000 7f0b60fbb700 1 -- 172.21.15.135:0/784447557 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c19f460 con 0x7f0b5c1021f0 2024-05-08T23:15:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.380+0000 7f0b60fbb700 1 -- 172.21.15.135:0/784447557 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c1084d0 con 0x7f0b5c1021f0 2024-05-08T23:15:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.382+0000 7f0b4b7fe700 1 -- 172.21.15.135:0/784447557 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f0b4c004c20 con 0x7f0b5c1021f0 2024-05-08T23:15:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.382+0000 7f0b4b7fe700 1 --2- 172.21.15.135:0/784447557 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0b440a1230 0x7f0b440a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.382+0000 7f0b5a59c700 1 --2- 172.21.15.135:0/784447557 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0b440a1230 0x7f0b440a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.382+0000 7f0b4b7fe700 1 -- 172.21.15.135:0/784447557 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0b4c0cccb0 con 0x7f0b5c1021f0 2024-05-08T23:15:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.383+0000 7f0b5a59c700 1 --2- 172.21.15.135:0/784447557 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0b440a1230 0x7f0b440a36f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000b5c0 tx=0x7f0b50003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:26.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.386+0000 7f0b4b7fe700 1 -- 172.21.15.135:0/784447557 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0b4c096340 con 0x7f0b5c1021f0 2024-05-08T23:15:26.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:26 smithi135 ceph-mon[42440]: pgmap v257: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s; 97 B/s, 1 objects/s recovering 2024-05-08T23:15:26.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:26 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2127365321' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-08T23:15:26.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.583+0000 7f0b60fbb700 1 -- 172.21.15.135:0/784447557 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b5c10c780 con 0x7f0b5c1021f0 2024-05-08T23:15:26.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.583+0000 7f0b4b7fe700 1 -- 172.21.15.135:0/784447557 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b4c017030 con 0x7f0b5c1021f0 2024-05-08T23:15:26.583 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T23:15:26.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.585+0000 7f0b60fbb700 1 -- 172.21.15.135:0/784447557 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0b440a1230 msgr2=0x7f0b440a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:26.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.585+0000 7f0b60fbb700 1 --2- 172.21.15.135:0/784447557 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0b440a1230 0x7f0b440a36f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000b5c0 tx=0x7f0b50003790 comp rx=0 tx=0).stop 2024-05-08T23:15:26.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.585+0000 7f0b60fbb700 1 -- 172.21.15.135:0/784447557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c1021f0 msgr2=0x7f0b5c197440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:26.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.585+0000 7f0b60fbb700 1 --2- 172.21.15.135:0/784447557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c1021f0 0x7f0b5c197440 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00d980 tx=0x7f0b4c00dc90 comp rx=0 tx=0).stop 2024-05-08T23:15:26.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.585+0000 7f0b60fbb700 1 -- 172.21.15.135:0/784447557 shutdown_connections 2024-05-08T23:15:26.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.585+0000 7f0b60fbb700 1 --2- 172.21.15.135:0/784447557 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0b440a1230 0x7f0b440a36f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.585+0000 7f0b60fbb700 1 --2- 172.21.15.135:0/784447557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b5c102b90 0x7f0b5c19e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.585+0000 7f0b60fbb700 1 --2- 172.21.15.135:0/784447557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b5c0ff220 0x7f0b5c196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.585+0000 7f0b60fbb700 1 --2- 172.21.15.135:0/784447557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c1021f0 0x7f0b5c197440 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.585+0000 7f0b60fbb700 1 -- 172.21.15.135:0/784447557 >> 172.21.15.135:0/784447557 conn(0x7f0b5c0fab50 msgr2=0x7f0b5c105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:26.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.585+0000 7f0b60fbb700 1 -- 172.21.15.135:0/784447557 shutdown_connections 2024-05-08T23:15:26.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.585+0000 7f0b60fbb700 1 -- 172.21.15.135:0/784447557 wait complete. 2024-05-08T23:15:26.597 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T23:15:26.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:26 smithi179 ceph-mon[46314]: pgmap v257: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s; 97 B/s, 1 objects/s recovering 2024-05-08T23:15:26.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:26 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2127365321' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-08T23:15:26.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:26 smithi195 ceph-mon[46516]: pgmap v257: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s; 97 B/s, 1 objects/s recovering 2024-05-08T23:15:26.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:26 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2127365321' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-08T23:15:26.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.724+0000 7f0e494a6700 1 -- 172.21.15.135:0/580457285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e440ffe80 msgr2=0x7f0e441002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:26.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.724+0000 7f0e494a6700 1 --2- 172.21.15.135:0/580457285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e440ffe80 0x7f0e441002a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009990 tx=0x7f0e38009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.724+0000 7f0e494a6700 1 -- 172.21.15.135:0/580457285 shutdown_connections 2024-05-08T23:15:26.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.724+0000 7f0e494a6700 1 --2- 172.21.15.135:0/580457285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e44101990 0x7f0e441082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.724+0000 7f0e494a6700 1 --2- 172.21.15.135:0/580457285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e440ffe80 0x7f0e441002a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.724+0000 7f0e494a6700 1 --2- 172.21.15.135:0/580457285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e44100fd0 0x7f0e44101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.724+0000 7f0e494a6700 1 -- 172.21.15.135:0/580457285 >> 172.21.15.135:0/580457285 conn(0x7f0e440fb3f0 msgr2=0x7f0e440fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:26.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.724+0000 7f0e494a6700 1 -- 172.21.15.135:0/580457285 shutdown_connections 2024-05-08T23:15:26.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.724+0000 7f0e494a6700 1 -- 172.21.15.135:0/580457285 wait complete. 2024-05-08T23:15:26.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.724+0000 7f0e494a6700 1 Processor -- start 2024-05-08T23:15:26.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e494a6700 1 -- start start 2024-05-08T23:15:26.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e494a6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e440ffe80 0x7f0e44069f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:26.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e494a6700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e44100fd0 0x7f0e4419bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:26.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e494a6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e44101990 0x7f0e4419e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:26.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e494a6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4419ea40 con 0x7f0e440ffe80 2024-05-08T23:15:26.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e494a6700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4419ebb0 con 0x7f0e44100fd0 2024-05-08T23:15:26.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e494a6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4419ed70 con 0x7f0e44101990 2024-05-08T23:15:26.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e42ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e440ffe80 0x7f0e44069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:26.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e42ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e440ffe80 0x7f0e44069f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59710/0 (socket says 172.21.15.135:59710) 2024-05-08T23:15:26.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e42ffd700 1 -- 172.21.15.135:0/208894122 learned_addr learned my addr 172.21.15.135:0/208894122 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:26.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e427fc700 1 --2- 172.21.15.135:0/208894122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e44100fd0 0x7f0e4419bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:26.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e42ffd700 1 -- 172.21.15.135:0/208894122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e44101990 msgr2=0x7f0e4419e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:26.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e42ffd700 1 --2- 172.21.15.135:0/208894122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e44101990 0x7f0e4419e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e42ffd700 1 -- 172.21.15.135:0/208894122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e44100fd0 msgr2=0x7f0e4419bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:26.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e42ffd700 1 --2- 172.21.15.135:0/208894122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e44100fd0 0x7f0e4419bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e42ffd700 1 -- 172.21.15.135:0/208894122 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e380095f0 con 0x7f0e440ffe80 2024-05-08T23:15:26.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e427fc700 1 --2- 172.21.15.135:0/208894122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e44100fd0 0x7f0e4419bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:26.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e42ffd700 1 --2- 172.21.15.135:0/208894122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e440ffe80 0x7f0e44069f90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800b5c0 tx=0x7f0e38005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:26.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e2bfff700 1 -- 172.21.15.135:0/208894122 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3801d070 con 0x7f0e440ffe80 2024-05-08T23:15:26.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.725+0000 7f0e2bfff700 1 -- 172.21.15.135:0/208894122 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e38004060 con 0x7f0e440ffe80 2024-05-08T23:15:26.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.726+0000 7f0e494a6700 1 -- 172.21.15.135:0/208894122 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4419ef90 con 0x7f0e440ffe80 2024-05-08T23:15:26.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.726+0000 7f0e2bfff700 1 -- 172.21.15.135:0/208894122 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38022e10 con 0x7f0e440ffe80 2024-05-08T23:15:26.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.726+0000 7f0e494a6700 1 -- 172.21.15.135:0/208894122 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4419f300 con 0x7f0e440ffe80 2024-05-08T23:15:26.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.726+0000 7f0e494a6700 1 -- 172.21.15.135:0/208894122 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e441072f0 con 0x7f0e440ffe80 2024-05-08T23:15:26.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.728+0000 7f0e2bfff700 1 -- 172.21.15.135:0/208894122 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f0e38022570 con 0x7f0e440ffe80 2024-05-08T23:15:26.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.728+0000 7f0e2bfff700 1 --2- 172.21.15.135:0/208894122 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e2c0a11b0 0x7f0e2c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:26.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.728+0000 7f0e2bfff700 1 -- 172.21.15.135:0/208894122 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0e380ce290 con 0x7f0e440ffe80 2024-05-08T23:15:26.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.728+0000 7f0e427fc700 1 --2- 172.21.15.135:0/208894122 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e2c0a11b0 0x7f0e2c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:26.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.729+0000 7f0e427fc700 1 --2- 172.21.15.135:0/208894122 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e2c0a11b0 0x7f0e2c0a3670 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0e34005950 tx=0x7f0e340058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:26.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.732+0000 7f0e2bfff700 1 -- 172.21.15.135:0/208894122 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0e380979c0 con 0x7f0e440ffe80 2024-05-08T23:15:26.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.927+0000 7f0e494a6700 1 -- 172.21.15.135:0/208894122 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e4410b680 con 0x7f0e440ffe80 2024-05-08T23:15:26.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.927+0000 7f0e2bfff700 1 -- 172.21.15.135:0/208894122 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e3809afe0 con 0x7f0e440ffe80 2024-05-08T23:15:26.927 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T23:15:26.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.930+0000 7f0e494a6700 1 -- 172.21.15.135:0/208894122 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e2c0a11b0 msgr2=0x7f0e2c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:26.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.930+0000 7f0e494a6700 1 --2- 172.21.15.135:0/208894122 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e2c0a11b0 0x7f0e2c0a3670 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0e34005950 tx=0x7f0e340058e0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.930+0000 7f0e494a6700 1 -- 172.21.15.135:0/208894122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e440ffe80 msgr2=0x7f0e44069f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:26.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.930+0000 7f0e494a6700 1 --2- 172.21.15.135:0/208894122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e440ffe80 0x7f0e44069f90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800b5c0 tx=0x7f0e38005e80 comp rx=0 tx=0).stop 2024-05-08T23:15:26.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.930+0000 7f0e494a6700 1 -- 172.21.15.135:0/208894122 shutdown_connections 2024-05-08T23:15:26.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.930+0000 7f0e494a6700 1 --2- 172.21.15.135:0/208894122 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e2c0a11b0 0x7f0e2c0a3670 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.930+0000 7f0e494a6700 1 --2- 172.21.15.135:0/208894122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e44101990 0x7f0e4419e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.930+0000 7f0e494a6700 1 --2- 172.21.15.135:0/208894122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e440ffe80 0x7f0e44069f90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.930+0000 7f0e494a6700 1 --2- 172.21.15.135:0/208894122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e44100fd0 0x7f0e4419bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:26.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.930+0000 7f0e494a6700 1 -- 172.21.15.135:0/208894122 >> 172.21.15.135:0/208894122 conn(0x7f0e440fb3f0 msgr2=0x7f0e44104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:26.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.930+0000 7f0e494a6700 1 -- 172.21.15.135:0/208894122 shutdown_connections 2024-05-08T23:15:26.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:26.930+0000 7f0e494a6700 1 -- 172.21.15.135:0/208894122 wait complete. 2024-05-08T23:15:26.942 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T23:15:27.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.076+0000 7f8fd86eb700 1 -- 172.21.15.135:0/321263793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fd01009a0 msgr2=0x7f8fd01082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:27.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.076+0000 7f8fd86eb700 1 --2- 172.21.15.135:0/321263793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fd01009a0 0x7f8fd01082d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8fc800b0a0 tx=0x7f8fc800b3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.076+0000 7f8fd86eb700 1 -- 172.21.15.135:0/321263793 shutdown_connections 2024-05-08T23:15:27.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.076+0000 7f8fd86eb700 1 --2- 172.21.15.135:0/321263793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fd01009a0 0x7f8fd01082d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.076+0000 7f8fd86eb700 1 --2- 172.21.15.135:0/321263793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fd0101390 0x7f8fd01017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.076+0000 7f8fd86eb700 1 --2- 172.21.15.135:0/321263793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fd00fffe0 0x7f8fd0100460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.076+0000 7f8fd86eb700 1 -- 172.21.15.135:0/321263793 >> 172.21.15.135:0/321263793 conn(0x7f8fd00fab50 msgr2=0x7f8fd00fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:27.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.076+0000 7f8fd86eb700 1 -- 172.21.15.135:0/321263793 shutdown_connections 2024-05-08T23:15:27.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.076+0000 7f8fd86eb700 1 -- 172.21.15.135:0/321263793 wait complete. 2024-05-08T23:15:27.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd86eb700 1 Processor -- start 2024-05-08T23:15:27.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd86eb700 1 -- start start 2024-05-08T23:15:27.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd86eb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fd00fffe0 0x7f8fd0103f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:27.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd86eb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fd01009a0 0x7f8fd01025a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:27.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd86eb700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fd0101390 0x7f8fd0102ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:27.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd86eb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd0103280 con 0x7f8fd00fffe0 2024-05-08T23:15:27.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd86eb700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd01033f0 con 0x7f8fd0101390 2024-05-08T23:15:27.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd86eb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd01a1080 con 0x7f8fd01009a0 2024-05-08T23:15:27.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd6487700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fd00fffe0 0x7f8fd0103f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:27.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd6487700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fd00fffe0 0x7f8fd0103f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59728/0 (socket says 172.21.15.135:59728) 2024-05-08T23:15:27.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd6487700 1 -- 172.21.15.135:0/613603783 learned_addr learned my addr 172.21.15.135:0/613603783 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:27.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd5c86700 1 --2- 172.21.15.135:0/613603783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fd01009a0 0x7f8fd01025a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:27.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd6c88700 1 --2- 172.21.15.135:0/613603783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fd0101390 0x7f8fd0102ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:27.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd6487700 1 -- 172.21.15.135:0/613603783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fd01009a0 msgr2=0x7f8fd01025a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:27.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd6487700 1 --2- 172.21.15.135:0/613603783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fd01009a0 0x7f8fd01025a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd6487700 1 -- 172.21.15.135:0/613603783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fd0101390 msgr2=0x7f8fd0102ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:27.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd6487700 1 --2- 172.21.15.135:0/613603783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fd0101390 0x7f8fd0102ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd6487700 1 -- 172.21.15.135:0/613603783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc8009d00 con 0x7f8fd00fffe0 2024-05-08T23:15:27.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.077+0000 7f8fd6487700 1 --2- 172.21.15.135:0/613603783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fd00fffe0 0x7f8fd0103f10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000c970 tx=0x7f8fc000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:27.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.078+0000 7f8fc77fe700 1 -- 172.21.15.135:0/613603783 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0004220 con 0x7f8fd00fffe0 2024-05-08T23:15:27.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.078+0000 7f8fc77fe700 1 -- 172.21.15.135:0/613603783 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fc0004380 con 0x7f8fd00fffe0 2024-05-08T23:15:27.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.078+0000 7f8fd86eb700 1 -- 172.21.15.135:0/613603783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd01a1310 con 0x7f8fd00fffe0 2024-05-08T23:15:27.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.078+0000 7f8fc77fe700 1 -- 172.21.15.135:0/613603783 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc000eb60 con 0x7f8fd00fffe0 2024-05-08T23:15:27.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.078+0000 7f8fd86eb700 1 -- 172.21.15.135:0/613603783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd01a1820 con 0x7f8fd00fffe0 2024-05-08T23:15:27.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.079+0000 7f8fd86eb700 1 -- 172.21.15.135:0/613603783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd0067460 con 0x7f8fd00fffe0 2024-05-08T23:15:27.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.080+0000 7f8fc77fe700 1 -- 172.21.15.135:0/613603783 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f8fc000ecc0 con 0x7f8fd00fffe0 2024-05-08T23:15:27.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.080+0000 7f8fc77fe700 1 --2- 172.21.15.135:0/613603783 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8fbc0a11b0 0x7f8fbc0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:27.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.080+0000 7f8fd5c86700 1 --2- 172.21.15.135:0/613603783 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8fbc0a11b0 0x7f8fbc0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:27.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.080+0000 7f8fc77fe700 1 -- 172.21.15.135:0/613603783 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8fc00cc9a0 con 0x7f8fd00fffe0 2024-05-08T23:15:27.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.081+0000 7f8fd5c86700 1 --2- 172.21.15.135:0/613603783 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8fbc0a11b0 0x7f8fbc0a3670 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8fd01010b0 tx=0x7f8fcc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:27.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.084+0000 7f8fc77fe700 1 -- 172.21.15.135:0/613603783 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8fc0095fb0 con 0x7f8fd00fffe0 2024-05-08T23:15:27.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:27 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1495157265' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:27.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:27 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/784447557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:15:27.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:27 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/208894122' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:15:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.284+0000 7f8fd86eb700 1 -- 172.21.15.135:0/613603783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8fd01a1ba0 con 0x7f8fd00fffe0 2024-05-08T23:15:27.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.285+0000 7f8fc77fe700 1 -- 172.21.15.135:0/613603783 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8fc001d0a0 con 0x7f8fd00fffe0 2024-05-08T23:15:27.284 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-08T23:15:27.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.287+0000 7f8fd86eb700 1 -- 172.21.15.135:0/613603783 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8fbc0a11b0 msgr2=0x7f8fbc0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:27.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.287+0000 7f8fd86eb700 1 --2- 172.21.15.135:0/613603783 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8fbc0a11b0 0x7f8fbc0a3670 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8fd01010b0 tx=0x7f8fcc00b410 comp rx=0 tx=0).stop 2024-05-08T23:15:27.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.287+0000 7f8fd86eb700 1 -- 172.21.15.135:0/613603783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fd00fffe0 msgr2=0x7f8fd0103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:27.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.287+0000 7f8fd86eb700 1 --2- 172.21.15.135:0/613603783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fd00fffe0 0x7f8fd0103f10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000c970 tx=0x7f8fc000cc80 comp rx=0 tx=0).stop 2024-05-08T23:15:27.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.287+0000 7f8fd86eb700 1 -- 172.21.15.135:0/613603783 shutdown_connections 2024-05-08T23:15:27.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.287+0000 7f8fd86eb700 1 --2- 172.21.15.135:0/613603783 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8fbc0a11b0 0x7f8fbc0a3670 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.287+0000 7f8fd86eb700 1 --2- 172.21.15.135:0/613603783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fd0101390 0x7f8fd0102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.287+0000 7f8fd86eb700 1 --2- 172.21.15.135:0/613603783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fd00fffe0 0x7f8fd0103f10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.287+0000 7f8fd86eb700 1 --2- 172.21.15.135:0/613603783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fd01009a0 0x7f8fd01025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.287+0000 7f8fd86eb700 1 -- 172.21.15.135:0/613603783 >> 172.21.15.135:0/613603783 conn(0x7f8fd00fab50 msgr2=0x7f8fd00feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:27.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.287+0000 7f8fd86eb700 1 -- 172.21.15.135:0/613603783 shutdown_connections 2024-05-08T23:15:27.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.287+0000 7f8fd86eb700 1 -- 172.21.15.135:0/613603783 wait complete. 2024-05-08T23:15:27.299 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:15:27.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.422+0000 7f821808f700 1 -- 172.21.15.135:0/1992292465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8210104240 msgr2=0x7f8210106630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:27.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.422+0000 7f821808f700 1 --2- 172.21.15.135:0/1992292465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8210104240 0x7f8210106630 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8200009990 tx=0x7f8200009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.422+0000 7f821808f700 1 -- 172.21.15.135:0/1992292465 shutdown_connections 2024-05-08T23:15:27.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f821808f700 1 --2- 172.21.15.135:0/1992292465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8210106b70 0x7f8210108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f821808f700 1 --2- 172.21.15.135:0/1992292465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8210101910 0x7f8210103d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f821808f700 1 --2- 172.21.15.135:0/1992292465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8210104240 0x7f8210106630 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f821808f700 1 -- 172.21.15.135:0/1992292465 >> 172.21.15.135:0/1992292465 conn(0x7f82100fb300 msgr2=0x7f82100fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:27.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f821808f700 1 -- 172.21.15.135:0/1992292465 shutdown_connections 2024-05-08T23:15:27.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f821808f700 1 -- 172.21.15.135:0/1992292465 wait complete. 2024-05-08T23:15:27.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f821808f700 1 Processor -- start 2024-05-08T23:15:27.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f821808f700 1 -- start start 2024-05-08T23:15:27.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f821808f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8210101910 0x7f8210196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:27.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f821808f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8210104240 0x7f82101972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:27.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f821808f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8210106b70 0x7f821019e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:27.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f821808f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821019e870 con 0x7f8210101910 2024-05-08T23:15:27.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f821808f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821019e9e0 con 0x7f8210106b70 2024-05-08T23:15:27.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f821808f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821019eba0 con 0x7f8210104240 2024-05-08T23:15:27.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f8215e2b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8210101910 0x7f8210196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:27.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f8215e2b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8210101910 0x7f8210196d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59738/0 (socket says 172.21.15.135:59738) 2024-05-08T23:15:27.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.423+0000 7f8215e2b700 1 -- 172.21.15.135:0/1264829493 learned_addr learned my addr 172.21.15.135:0/1264829493 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:27.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.424+0000 7f821662c700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8210106b70 0x7f821019e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:27.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.424+0000 7f8215e2b700 1 -- 172.21.15.135:0/1264829493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8210104240 msgr2=0x7f82101972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:27.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.424+0000 7f821562a700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8210104240 0x7f82101972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:27.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.424+0000 7f8215e2b700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8210104240 0x7f82101972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.424+0000 7f8215e2b700 1 -- 172.21.15.135:0/1264829493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8210106b70 msgr2=0x7f821019e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:27.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.424+0000 7f8215e2b700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8210106b70 0x7f821019e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.424+0000 7f8215e2b700 1 -- 172.21.15.135:0/1264829493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82000095f0 con 0x7f8210101910 2024-05-08T23:15:27.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.424+0000 7f821662c700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8210106b70 0x7f821019e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:27.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.424+0000 7f821562a700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8210104240 0x7f82101972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:27.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.424+0000 7f8215e2b700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8210101910 0x7f8210196d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c920 tx=0x7f820c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:27.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.424+0000 7f8206ffd700 1 -- 172.21.15.135:0/1264829493 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c007b00 con 0x7f8210101910 2024-05-08T23:15:27.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.424+0000 7f8206ffd700 1 -- 172.21.15.135:0/1264829493 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f820c004cf0 con 0x7f8210101910 2024-05-08T23:15:27.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.424+0000 7f821808f700 1 -- 172.21.15.135:0/1264829493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821019ee80 con 0x7f8210101910 2024-05-08T23:15:27.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.424+0000 7f8206ffd700 1 -- 172.21.15.135:0/1264829493 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c005610 con 0x7f8210101910 2024-05-08T23:15:27.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.424+0000 7f821808f700 1 -- 172.21.15.135:0/1264829493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821019f2b0 con 0x7f8210101910 2024-05-08T23:15:27.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.425+0000 7f821808f700 1 -- 172.21.15.135:0/1264829493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82100fce80 con 0x7f8210101910 2024-05-08T23:15:27.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.426+0000 7f8206ffd700 1 -- 172.21.15.135:0/1264829493 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f820c004750 con 0x7f8210101910 2024-05-08T23:15:27.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.427+0000 7f8206ffd700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f81fc0a12b0 0x7f81fc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:27.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.427+0000 7f821562a700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f81fc0a12b0 0x7f81fc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:27.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.427+0000 7f8206ffd700 1 -- 172.21.15.135:0/1264829493 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f820c0cca30 con 0x7f8210101910 2024-05-08T23:15:27.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.427+0000 7f821562a700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f81fc0a12b0 0x7f81fc0a3770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f820000b5c0 tx=0x7f8200005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:27.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.430+0000 7f8206ffd700 1 -- 172.21.15.135:0/1264829493 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f820c096060 con 0x7f8210101910 2024-05-08T23:15:27.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:27 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1495157265' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:27.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:27 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/784447557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:15:27.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:27 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/208894122' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:15:27.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:27 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1495157265' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:27.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:27 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/784447557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:15:27.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:27 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/208894122' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:15:27.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.675+0000 7f821808f700 1 -- 172.21.15.135:0/1264829493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8210068060 con 0x7f8210101910 2024-05-08T23:15:27.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.676+0000 7f8206ffd700 1 -- 172.21.15.135:0/1264829493 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10927 (secure 0 0 0) 0x7f820c01d070 con 0x7f8210101910 2024-05-08T23:15:27.675 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:27.675 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2432614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2432614311},{"type":"v1","addr":"172.21.15.135:6837","nonce":2432614311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T23:14:21.921303+0000","modified":"2024-05-08T23:14:28.351004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24500,"mds_2":24484,"mds_3":24439,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/360966092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":360966092},{"type":"v1","addr":"172.21.15.135:6839","nonce":360966092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6841/1831266531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":1831266531},{"type":"v1","addr":"172.21.15.135:6841","nonce":1831266531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1024532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1024532},{"type":"v1","addr":"172.21.15.179:6835","nonce":1024532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/2957410160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2957410160},{"type":"v1","addr":"172.21.15.179:6837","nonce":2957410160}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/4199708510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":4199708510},{"type":"v1","addr":"172.21.15.195:6835","nonce":4199708510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6837/2390721751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2390721751},{"type":"v1","addr":"172.21.15.195:6837","nonce":2390721751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.179:6839/1135239419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":1135239419},{"type":"v1","addr":"172.21.15.179:6839","nonce":1135239419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6839/1730571841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1730571841},{"type":"v1","addr":"172.21.15.195:6839","nonce":1730571841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T23:15:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.678+0000 7f821808f700 1 -- 172.21.15.135:0/1264829493 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f81fc0a12b0 msgr2=0x7f81fc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.678+0000 7f821808f700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f81fc0a12b0 0x7f81fc0a3770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f820000b5c0 tx=0x7f8200005fb0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.678+0000 7f821808f700 1 -- 172.21.15.135:0/1264829493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8210101910 msgr2=0x7f8210196d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.678+0000 7f821808f700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8210101910 0x7f8210196d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c920 tx=0x7f820c00cce0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.678+0000 7f821808f700 1 -- 172.21.15.135:0/1264829493 shutdown_connections 2024-05-08T23:15:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.678+0000 7f821808f700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f81fc0a12b0 0x7f81fc0a3770 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.678+0000 7f821808f700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8210106b70 0x7f821019e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.678+0000 7f821808f700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8210101910 0x7f8210196d80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.678+0000 7f821808f700 1 --2- 172.21.15.135:0/1264829493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8210104240 0x7f82101972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.678+0000 7f821808f700 1 -- 172.21.15.135:0/1264829493 >> 172.21.15.135:0/1264829493 conn(0x7f82100fb300 msgr2=0x7f8210102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.678+0000 7f821808f700 1 -- 172.21.15.135:0/1264829493 shutdown_connections 2024-05-08T23:15:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.678+0000 7f821808f700 1 -- 172.21.15.135:0/1264829493 wait complete. 2024-05-08T23:15:27.678 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 27 2024-05-08T23:15:27.690 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T23:15:27.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.812+0000 7f7d669d8700 1 -- 172.21.15.135:0/1005717785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d60106c00 msgr2=0x7f7d60108ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:27.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.812+0000 7f7d669d8700 1 --2- 172.21.15.135:0/1005717785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d60106c00 0x7f7d60108ff0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800b0a0 tx=0x7f7d5800b3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.812+0000 7f7d669d8700 1 -- 172.21.15.135:0/1005717785 shutdown_connections 2024-05-08T23:15:27.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.812+0000 7f7d669d8700 1 --2- 172.21.15.135:0/1005717785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d601019a0 0x7f7d60103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.812+0000 7f7d669d8700 1 --2- 172.21.15.135:0/1005717785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d60106c00 0x7f7d60108ff0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.812+0000 7f7d669d8700 1 --2- 172.21.15.135:0/1005717785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d601042d0 0x7f7d601066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.812+0000 7f7d669d8700 1 -- 172.21.15.135:0/1005717785 >> 172.21.15.135:0/1005717785 conn(0x7f7d600fb2f0 msgr2=0x7f7d600fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:27.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.812+0000 7f7d669d8700 1 -- 172.21.15.135:0/1005717785 shutdown_connections 2024-05-08T23:15:27.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.812+0000 7f7d669d8700 1 -- 172.21.15.135:0/1005717785 wait complete. 2024-05-08T23:15:27.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.813+0000 7f7d669d8700 1 Processor -- start 2024-05-08T23:15:27.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.813+0000 7f7d669d8700 1 -- start start 2024-05-08T23:15:27.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.813+0000 7f7d669d8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d601019a0 0x7f7d601012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:27.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.813+0000 7f7d669d8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d601042d0 0x7f7d600ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:27.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.813+0000 7f7d669d8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d60106c00 0x7f7d600ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:27.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.813+0000 7f7d669d8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d60100630 con 0x7f7d601042d0 2024-05-08T23:15:27.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.813+0000 7f7d669d8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d601007a0 con 0x7f7d601019a0 2024-05-08T23:15:27.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.813+0000 7f7d669d8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d601a0fa0 con 0x7f7d60106c00 2024-05-08T23:15:27.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.813+0000 7f7d5f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d601042d0 0x7f7d600ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:27.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.813+0000 7f7d5f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d601042d0 0x7f7d600ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59748/0 (socket says 172.21.15.135:59748) 2024-05-08T23:15:27.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.814+0000 7f7d5f7fe700 1 -- 172.21.15.135:0/2468169463 learned_addr learned my addr 172.21.15.135:0/2468169463 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:27.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.814+0000 7f7d5ffff700 1 --2- 172.21.15.135:0/2468169463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d601019a0 0x7f7d601012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:27.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.814+0000 7f7d64f75700 1 --2- 172.21.15.135:0/2468169463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d60106c00 0x7f7d600ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:27.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.814+0000 7f7d5f7fe700 1 -- 172.21.15.135:0/2468169463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d60106c00 msgr2=0x7f7d600ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:27.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.814+0000 7f7d5f7fe700 1 --2- 172.21.15.135:0/2468169463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d60106c00 0x7f7d600ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.814+0000 7f7d5f7fe700 1 -- 172.21.15.135:0/2468169463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d601019a0 msgr2=0x7f7d601012c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:27.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.814+0000 7f7d5f7fe700 1 --2- 172.21.15.135:0/2468169463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d601019a0 0x7f7d601012c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:27.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.814+0000 7f7d5f7fe700 1 -- 172.21.15.135:0/2468169463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d58009d00 con 0x7f7d601042d0 2024-05-08T23:15:27.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.814+0000 7f7d64f75700 1 --2- 172.21.15.135:0/2468169463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d60106c00 0x7f7d600ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:27.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.814+0000 7f7d5f7fe700 1 --2- 172.21.15.135:0/2468169463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d601042d0 0x7f7d600ff950 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400d950 tx=0x7f7d5400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:27.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.814+0000 7f7d5d7fa700 1 -- 172.21.15.135:0/2468169463 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d540098e0 con 0x7f7d601042d0 2024-05-08T23:15:27.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.814+0000 7f7d5d7fa700 1 -- 172.21.15.135:0/2468169463 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d54010460 con 0x7f7d601042d0 2024-05-08T23:15:27.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.814+0000 7f7d5d7fa700 1 -- 172.21.15.135:0/2468169463 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5400f620 con 0x7f7d601042d0 2024-05-08T23:15:27.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.814+0000 7f7d669d8700 1 -- 172.21.15.135:0/2468169463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d601a1230 con 0x7f7d601042d0 2024-05-08T23:15:27.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.814+0000 7f7d669d8700 1 -- 172.21.15.135:0/2468169463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d601a17c0 con 0x7f7d601042d0 2024-05-08T23:15:27.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.815+0000 7f7d669d8700 1 -- 172.21.15.135:0/2468169463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d600fce70 con 0x7f7d601042d0 2024-05-08T23:15:27.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.816+0000 7f7d5d7fa700 1 -- 172.21.15.135:0/2468169463 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f7d540108d0 con 0x7f7d601042d0 2024-05-08T23:15:27.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.817+0000 7f7d5d7fa700 1 --2- 172.21.15.135:0/2468169463 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7d480a1230 0x7f7d480a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:27.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.817+0000 7f7d5ffff700 1 --2- 172.21.15.135:0/2468169463 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7d480a1230 0x7f7d480a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:27.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.817+0000 7f7d5d7fa700 1 -- 172.21.15.135:0/2468169463 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7d540cc890 con 0x7f7d601042d0 2024-05-08T23:15:27.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.817+0000 7f7d5ffff700 1 --2- 172.21.15.135:0/2468169463 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7d480a1230 0x7f7d480a36f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009a10 tx=0x7f7d50009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:27.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:27.820+0000 7f7d5d7fa700 1 -- 172.21.15.135:0/2468169463 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7d54095e40 con 0x7f7d601042d0 2024-05-08T23:15:28.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.019+0000 7f7d669d8700 1 -- 172.21.15.135:0/2468169463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d60067c10 con 0x7f7d601042d0 2024-05-08T23:15:28.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.021+0000 7f7d5d7fa700 1 -- 172.21.15.135:0/2468169463 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22702 (secure 0 0 0) 0x7f7d54020090 con 0x7f7d601042d0 2024-05-08T23:15:28.022 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:28.022 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":85,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:15:22.121685+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T23:14:19.726838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T23:14:21.097732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:15:28.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.023+0000 7f7d669d8700 1 -- 172.21.15.135:0/2468169463 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7d480a1230 msgr2=0x7f7d480a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:28.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.023+0000 7f7d669d8700 1 --2- 172.21.15.135:0/2468169463 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7d480a1230 0x7f7d480a36f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009a10 tx=0x7f7d50009190 comp rx=0 tx=0).stop 2024-05-08T23:15:28.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.023+0000 7f7d669d8700 1 -- 172.21.15.135:0/2468169463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d601042d0 msgr2=0x7f7d600ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:28.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.023+0000 7f7d669d8700 1 --2- 172.21.15.135:0/2468169463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d601042d0 0x7f7d600ff950 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400d950 tx=0x7f7d5400dc60 comp rx=0 tx=0).stop 2024-05-08T23:15:28.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.023+0000 7f7d669d8700 1 -- 172.21.15.135:0/2468169463 shutdown_connections 2024-05-08T23:15:28.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.023+0000 7f7d669d8700 1 --2- 172.21.15.135:0/2468169463 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f7d480a1230 0x7f7d480a36f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.023+0000 7f7d669d8700 1 --2- 172.21.15.135:0/2468169463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d60106c00 0x7f7d600ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.023+0000 7f7d669d8700 1 --2- 172.21.15.135:0/2468169463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d601019a0 0x7f7d601012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.023+0000 7f7d669d8700 1 --2- 172.21.15.135:0/2468169463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d601042d0 0x7f7d600ff950 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.023+0000 7f7d669d8700 1 -- 172.21.15.135:0/2468169463 >> 172.21.15.135:0/2468169463 conn(0x7f7d600fb2f0 msgr2=0x7f7d60102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:28.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.023+0000 7f7d669d8700 1 -- 172.21.15.135:0/2468169463 shutdown_connections 2024-05-08T23:15:28.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.023+0000 7f7d669d8700 1 -- 172.21.15.135:0/2468169463 wait complete. 2024-05-08T23:15:28.037 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:11:11.282550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T23:14:19.726838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T23:14:21.097732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T23:15:28.037 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T23:15:28.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.162+0000 7f359b636700 1 -- 172.21.15.135:0/1572106927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3594101970 msgr2=0x7f3594108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:28.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.162+0000 7f359b636700 1 --2- 172.21.15.135:0/1572106927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3594101970 0x7f3594108290 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f358c00b0a0 tx=0x7f358c00b3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.162+0000 7f359b636700 1 -- 172.21.15.135:0/1572106927 shutdown_connections 2024-05-08T23:15:28.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.162+0000 7f359b636700 1 --2- 172.21.15.135:0/1572106927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3594101970 0x7f3594108290 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.162+0000 7f359b636700 1 --2- 172.21.15.135:0/1572106927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35940ffe60 0x7f3594100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.162+0000 7f359b636700 1 --2- 172.21.15.135:0/1572106927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3594100fb0 0x7f3594101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.162+0000 7f359b636700 1 -- 172.21.15.135:0/1572106927 >> 172.21.15.135:0/1572106927 conn(0x7f35940fb3f0 msgr2=0x7f35940fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:28.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.162+0000 7f359b636700 1 -- 172.21.15.135:0/1572106927 shutdown_connections 2024-05-08T23:15:28.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.162+0000 7f359b636700 1 -- 172.21.15.135:0/1572106927 wait complete. 2024-05-08T23:15:28.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f359b636700 1 Processor -- start 2024-05-08T23:15:28.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f359b636700 1 -- start start 2024-05-08T23:15:28.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f359b636700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35940ffe60 0x7f3594103d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:28.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f359b636700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3594100fb0 0x7f3594102420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:28.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f359b636700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3594101970 0x7f3594102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:28.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f359b636700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3594103100 con 0x7f35940ffe60 2024-05-08T23:15:28.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f359b636700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3594103270 con 0x7f3594101970 2024-05-08T23:15:28.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f359b636700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35941a0fa0 con 0x7f3594100fb0 2024-05-08T23:15:28.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f35993d2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35940ffe60 0x7f3594103d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:28.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f35993d2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35940ffe60 0x7f3594103d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59772/0 (socket says 172.21.15.135:59772) 2024-05-08T23:15:28.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f35993d2700 1 -- 172.21.15.135:0/597020634 learned_addr learned my addr 172.21.15.135:0/597020634 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:28.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f3599bd3700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3594101970 0x7f3594102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:28.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f3598bd1700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3594100fb0 0x7f3594102420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:28.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f35993d2700 1 -- 172.21.15.135:0/597020634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3594100fb0 msgr2=0x7f3594102420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:28.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f35993d2700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3594100fb0 0x7f3594102420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f35993d2700 1 -- 172.21.15.135:0/597020634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3594101970 msgr2=0x7f3594102960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:28.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f35993d2700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3594101970 0x7f3594102960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f35993d2700 1 -- 172.21.15.135:0/597020634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c009d00 con 0x7f35940ffe60 2024-05-08T23:15:28.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f3598bd1700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3594100fb0 0x7f3594102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:28.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.163+0000 7f3599bd3700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3594101970 0x7f3594102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:15:28.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.164+0000 7f35993d2700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35940ffe60 0x7f3594103d90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f359000c9b0 tx=0x7f359000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:28.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.164+0000 7f358a7fc700 1 -- 172.21.15.135:0/597020634 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590007aa0 con 0x7f35940ffe60 2024-05-08T23:15:28.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.164+0000 7f358a7fc700 1 -- 172.21.15.135:0/597020634 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3590007c00 con 0x7f35940ffe60 2024-05-08T23:15:28.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.164+0000 7f359b636700 1 -- 172.21.15.135:0/597020634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35941a1230 con 0x7f35940ffe60 2024-05-08T23:15:28.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.164+0000 7f358a7fc700 1 -- 172.21.15.135:0/597020634 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590018660 con 0x7f35940ffe60 2024-05-08T23:15:28.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.164+0000 7f359b636700 1 -- 172.21.15.135:0/597020634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35941a1740 con 0x7f35940ffe60 2024-05-08T23:15:28.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.165+0000 7f359b636700 1 -- 172.21.15.135:0/597020634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3594068140 con 0x7f35940ffe60 2024-05-08T23:15:28.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.166+0000 7f358a7fc700 1 -- 172.21.15.135:0/597020634 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f359000f450 con 0x7f35940ffe60 2024-05-08T23:15:28.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.166+0000 7f358a7fc700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f35800a11b0 0x7f35800a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:28.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.166+0000 7f3598bd1700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f35800a11b0 0x7f35800a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:28.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.166+0000 7f358a7fc700 1 -- 172.21.15.135:0/597020634 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f35900ccc80 con 0x7f35940ffe60 2024-05-08T23:15:28.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.167+0000 7f3598bd1700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f35800a11b0 0x7f35800a3670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3584005fd0 tx=0x7f3584005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:28.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.170+0000 7f358a7fc700 1 -- 172.21.15.135:0/597020634 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3590096320 con 0x7f35940ffe60 2024-05-08T23:15:28.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.367+0000 7f359b636700 1 -- 172.21.15.135:0/597020634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35941a1ac0 con 0x7f35940ffe60 2024-05-08T23:15:28.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.368+0000 7f358a7fc700 1 -- 172.21.15.135:0/597020634 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3590099940 con 0x7f35940ffe60 2024-05-08T23:15:28.369 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T23:15:28.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.370+0000 7f359b636700 1 -- 172.21.15.135:0/597020634 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f35800a11b0 msgr2=0x7f35800a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:28.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.370+0000 7f359b636700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f35800a11b0 0x7f35800a3670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3584005fd0 tx=0x7f3584005dc0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.370+0000 7f359b636700 1 -- 172.21.15.135:0/597020634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35940ffe60 msgr2=0x7f3594103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:28.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.370+0000 7f359b636700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35940ffe60 0x7f3594103d90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f359000c9b0 tx=0x7f359000ccc0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.370+0000 7f359b636700 1 -- 172.21.15.135:0/597020634 shutdown_connections 2024-05-08T23:15:28.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.370+0000 7f359b636700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f35800a11b0 0x7f35800a3670 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.370+0000 7f359b636700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3594101970 0x7f3594102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.370+0000 7f359b636700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35940ffe60 0x7f3594103d90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.370+0000 7f359b636700 1 --2- 172.21.15.135:0/597020634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3594100fb0 0x7f3594102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.370+0000 7f359b636700 1 -- 172.21.15.135:0/597020634 >> 172.21.15.135:0/597020634 conn(0x7f35940fb3f0 msgr2=0x7f35940fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:28.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.370+0000 7f359b636700 1 -- 172.21.15.135:0/597020634 shutdown_connections 2024-05-08T23:15:28.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.370+0000 7f359b636700 1 -- 172.21.15.135:0/597020634 wait complete. 2024-05-08T23:15:28.382 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:28 smithi135 ceph-mon[42440]: pgmap v258: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s; 97 B/s, 1 objects/s recovering 2024-05-08T23:15:28.382 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:28 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/613603783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:15:28.382 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:28 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1264829493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:15:28.382 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:28 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2468169463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:28.383 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T23:15:28.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 -- 172.21.15.135:0/1378049033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd754101a60 msgr2=0x7fd754103e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:28.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 --2- 172.21.15.135:0/1378049033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd754101a60 0x7fd754103e50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd748009990 tx=0x7fd748009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 -- 172.21.15.135:0/1378049033 shutdown_connections 2024-05-08T23:15:28.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 --2- 172.21.15.135:0/1378049033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd754106cc0 0x7fd7541090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 --2- 172.21.15.135:0/1378049033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd754101a60 0x7fd754103e50 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 --2- 172.21.15.135:0/1378049033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd754104390 0x7fd754106780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 -- 172.21.15.135:0/1378049033 >> 172.21.15.135:0/1378049033 conn(0x7fd7540fb3f0 msgr2=0x7fd7540fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:28.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 -- 172.21.15.135:0/1378049033 shutdown_connections 2024-05-08T23:15:28.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 -- 172.21.15.135:0/1378049033 wait complete. 2024-05-08T23:15:28.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 Processor -- start 2024-05-08T23:15:28.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 -- start start 2024-05-08T23:15:28.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd754101a60 0x7fd754196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:28.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd754104390 0x7fd754197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:28.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd754106cc0 0x7fd75419e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:28.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75419ea20 con 0x7fd754101a60 2024-05-08T23:15:28.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75419eb60 con 0x7fd754106cc0 2024-05-08T23:15:28.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.508+0000 7fd75affa700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75419ecf0 con 0x7fd754104390 2024-05-08T23:15:28.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd758d96700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd754101a60 0x7fd754196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd758d96700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd754101a60 0x7fd754196ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48870/0 (socket says 172.21.15.135:48870) 2024-05-08T23:15:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd758d96700 1 -- 172.21.15.135:0/1675189895 learned_addr learned my addr 172.21.15.135:0/1675189895 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd753fff700 1 --2- 172.21.15.135:0/1675189895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd754104390 0x7fd754197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd758d96700 1 -- 172.21.15.135:0/1675189895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd754104390 msgr2=0x7fd754197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd759597700 1 --2- 172.21.15.135:0/1675189895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd754106cc0 0x7fd75419e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd758d96700 1 --2- 172.21.15.135:0/1675189895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd754104390 0x7fd754197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd758d96700 1 -- 172.21.15.135:0/1675189895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd754106cc0 msgr2=0x7fd75419e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd758d96700 1 --2- 172.21.15.135:0/1675189895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd754106cc0 0x7fd75419e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd758d96700 1 -- 172.21.15.135:0/1675189895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7480095f0 con 0x7fd754101a60 2024-05-08T23:15:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd758d96700 1 --2- 172.21.15.135:0/1675189895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd754101a60 0x7fd754196ef0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd7480098e0 tx=0x7fd74800f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd751ffb700 1 -- 172.21.15.135:0/1675189895 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74801d070 con 0x7fd754101a60 2024-05-08T23:15:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd751ffb700 1 -- 172.21.15.135:0/1675189895 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd74800fca0 con 0x7fd754101a60 2024-05-08T23:15:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd75affa700 1 -- 172.21.15.135:0/1675189895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75419ef70 con 0x7fd754101a60 2024-05-08T23:15:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd751ffb700 1 -- 172.21.15.135:0/1675189895 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748017810 con 0x7fd754101a60 2024-05-08T23:15:28.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.509+0000 7fd75affa700 1 -- 172.21.15.135:0/1675189895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75419f2e0 con 0x7fd754101a60 2024-05-08T23:15:28.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.510+0000 7fd75affa700 1 -- 172.21.15.135:0/1675189895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7540fcf70 con 0x7fd754101a60 2024-05-08T23:15:28.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.511+0000 7fd751ffb700 1 -- 172.21.15.135:0/1675189895 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fd748022ac0 con 0x7fd754101a60 2024-05-08T23:15:28.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.512+0000 7fd751ffb700 1 --2- 172.21.15.135:0/1675189895 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd7440a11b0 0x7fd7440a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:28.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.512+0000 7fd753fff700 1 --2- 172.21.15.135:0/1675189895 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd7440a11b0 0x7fd7440a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:28.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.512+0000 7fd751ffb700 1 -- 172.21.15.135:0/1675189895 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd7480ce540 con 0x7fd754101a60 2024-05-08T23:15:28.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.513+0000 7fd753fff700 1 --2- 172.21.15.135:0/1675189895 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd7440a11b0 0x7fd7440a3670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd740006fd0 tx=0x7fd740008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:28.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.516+0000 7fd751ffb700 1 -- 172.21.15.135:0/1675189895 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd748097b80 con 0x7fd754101a60 2024-05-08T23:15:28.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:28 smithi179 ceph-mon[46314]: pgmap v258: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s; 97 B/s, 1 objects/s recovering 2024-05-08T23:15:28.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:28 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/613603783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:15:28.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:28 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1264829493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:15:28.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:28 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2468169463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:28.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:28 smithi195 ceph-mon[46516]: pgmap v258: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s; 97 B/s, 1 objects/s recovering 2024-05-08T23:15:28.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:28 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/613603783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:15:28.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:28 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1264829493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:15:28.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:28 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2468169463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:28.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.715+0000 7fd75affa700 1 -- 172.21.15.135:0/1675189895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd75410c7c0 con 0x7fd754101a60 2024-05-08T23:15:28.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.716+0000 7fd751ffb700 1 -- 172.21.15.135:0/1675189895 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd74809b1a0 con 0x7fd754101a60 2024-05-08T23:15:28.716 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T23:15:28.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.718+0000 7fd75affa700 1 -- 172.21.15.135:0/1675189895 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd7440a11b0 msgr2=0x7fd7440a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:28.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.718+0000 7fd75affa700 1 --2- 172.21.15.135:0/1675189895 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd7440a11b0 0x7fd7440a3670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd740006fd0 tx=0x7fd740008040 comp rx=0 tx=0).stop 2024-05-08T23:15:28.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.718+0000 7fd75affa700 1 -- 172.21.15.135:0/1675189895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd754101a60 msgr2=0x7fd754196ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:28.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.718+0000 7fd75affa700 1 --2- 172.21.15.135:0/1675189895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd754101a60 0x7fd754196ef0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd7480098e0 tx=0x7fd74800f7b0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.718+0000 7fd75affa700 1 -- 172.21.15.135:0/1675189895 shutdown_connections 2024-05-08T23:15:28.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.718+0000 7fd75affa700 1 --2- 172.21.15.135:0/1675189895 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd7440a11b0 0x7fd7440a3670 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.718+0000 7fd75affa700 1 --2- 172.21.15.135:0/1675189895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd754106cc0 0x7fd75419e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.718+0000 7fd75affa700 1 --2- 172.21.15.135:0/1675189895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd754101a60 0x7fd754196ef0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.718+0000 7fd75affa700 1 --2- 172.21.15.135:0/1675189895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd754104390 0x7fd754197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.718+0000 7fd75affa700 1 -- 172.21.15.135:0/1675189895 >> 172.21.15.135:0/1675189895 conn(0x7fd7540fb3f0 msgr2=0x7fd754102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:28.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.718+0000 7fd75affa700 1 -- 172.21.15.135:0/1675189895 shutdown_connections 2024-05-08T23:15:28.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.718+0000 7fd75affa700 1 -- 172.21.15.135:0/1675189895 wait complete. 2024-05-08T23:15:28.731 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T23:15:28.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.856+0000 7fa42f4f5700 1 -- 172.21.15.135:0/1072846962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa428100fb0 msgr2=0x7fa428101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:28.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.856+0000 7fa42f4f5700 1 --2- 172.21.15.135:0/1072846962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa428100fb0 0x7fa428101430 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa424009990 tx=0x7fa424009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.856+0000 7fa42f4f5700 1 -- 172.21.15.135:0/1072846962 shutdown_connections 2024-05-08T23:15:28.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.856+0000 7fa42f4f5700 1 --2- 172.21.15.135:0/1072846962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4280ffe60 0x7fa428100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.856+0000 7fa42f4f5700 1 --2- 172.21.15.135:0/1072846962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa428101970 0x7fa428108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.856+0000 7fa42f4f5700 1 --2- 172.21.15.135:0/1072846962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa428100fb0 0x7fa428101430 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.856+0000 7fa42f4f5700 1 -- 172.21.15.135:0/1072846962 >> 172.21.15.135:0/1072846962 conn(0x7fa4280fb3f0 msgr2=0x7fa4280fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:28.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.856+0000 7fa42f4f5700 1 -- 172.21.15.135:0/1072846962 shutdown_connections 2024-05-08T23:15:28.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.856+0000 7fa42f4f5700 1 -- 172.21.15.135:0/1072846962 wait complete. 2024-05-08T23:15:28.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.856+0000 7fa42f4f5700 1 Processor -- start 2024-05-08T23:15:28.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.856+0000 7fa42f4f5700 1 -- start start 2024-05-08T23:15:28.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42f4f5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4280ffe60 0x7fa428195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:28.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42f4f5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa428100fb0 0x7fa428196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:28.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42f4f5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa428101970 0x7fa42819d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:28.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42f4f5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42819d8f0 con 0x7fa428101970 2024-05-08T23:15:28.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42f4f5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42819da60 con 0x7fa4280ffe60 2024-05-08T23:15:28.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42f4f5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42819dc20 con 0x7fa428100fb0 2024-05-08T23:15:28.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42da92700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa428101970 0x7fa42819d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:28.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42da92700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa428101970 0x7fa42819d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48896/0 (socket says 172.21.15.135:48896) 2024-05-08T23:15:28.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42da92700 1 -- 172.21.15.135:0/2896835835 learned_addr learned my addr 172.21.15.135:0/2896835835 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:28.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42d291700 1 --2- 172.21.15.135:0/2896835835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4280ffe60 0x7fa428195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:28.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42ca90700 1 --2- 172.21.15.135:0/2896835835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa428100fb0 0x7fa428196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:28.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42da92700 1 -- 172.21.15.135:0/2896835835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa428100fb0 msgr2=0x7fa428196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:28.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42da92700 1 --2- 172.21.15.135:0/2896835835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa428100fb0 0x7fa428196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42da92700 1 -- 172.21.15.135:0/2896835835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4280ffe60 msgr2=0x7fa428195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:28.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42da92700 1 --2- 172.21.15.135:0/2896835835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4280ffe60 0x7fa428195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:28.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42da92700 1 -- 172.21.15.135:0/2896835835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4240095f0 con 0x7fa428101970 2024-05-08T23:15:28.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42da92700 1 --2- 172.21.15.135:0/2896835835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa428101970 0x7fa42819d320 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa420007ee0 tx=0x7fa42000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:28.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa41e7fc700 1 -- 172.21.15.135:0/2896835835 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42000ddd0 con 0x7fa428101970 2024-05-08T23:15:28.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa41e7fc700 1 -- 172.21.15.135:0/2896835835 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa42000f040 con 0x7fa428101970 2024-05-08T23:15:28.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42f4f5700 1 -- 172.21.15.135:0/2896835835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42819df00 con 0x7fa428101970 2024-05-08T23:15:28.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa41e7fc700 1 -- 172.21.15.135:0/2896835835 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4200048e0 con 0x7fa428101970 2024-05-08T23:15:28.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.857+0000 7fa42f4f5700 1 -- 172.21.15.135:0/2896835835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42819e2d0 con 0x7fa428101970 2024-05-08T23:15:28.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.858+0000 7fa42f4f5700 1 -- 172.21.15.135:0/2896835835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa428107320 con 0x7fa428101970 2024-05-08T23:15:28.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.859+0000 7fa41e7fc700 1 -- 172.21.15.135:0/2896835835 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fa420003a00 con 0x7fa428101970 2024-05-08T23:15:28.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.860+0000 7fa41e7fc700 1 --2- 172.21.15.135:0/2896835835 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa4140a11b0 0x7fa4140a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:28.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.860+0000 7fa42d291700 1 --2- 172.21.15.135:0/2896835835 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa4140a11b0 0x7fa4140a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:28.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.860+0000 7fa41e7fc700 1 -- 172.21.15.135:0/2896835835 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fa4200cc3a0 con 0x7fa428101970 2024-05-08T23:15:28.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.860+0000 7fa42d291700 1 --2- 172.21.15.135:0/2896835835 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa4140a11b0 0x7fa4140a3670 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa428197280 tx=0x7fa41800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:28.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:28.864+0000 7fa41e7fc700 1 -- 172.21.15.135:0/2896835835 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa4200959b0 con 0x7fa428101970 2024-05-08T23:15:29.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.062+0000 7fa42f4f5700 1 -- 172.21.15.135:0/2896835835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa42810b770 con 0x7fa428101970 2024-05-08T23:15:29.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.062+0000 7fa41e7fc700 1 -- 172.21.15.135:0/2896835835 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa420098fd0 con 0x7fa428101970 2024-05-08T23:15:29.063 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-08T23:15:29.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.064+0000 7fa42f4f5700 1 -- 172.21.15.135:0/2896835835 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa4140a11b0 msgr2=0x7fa4140a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.064+0000 7fa42f4f5700 1 --2- 172.21.15.135:0/2896835835 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa4140a11b0 0x7fa4140a3670 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa428197280 tx=0x7fa41800b410 comp rx=0 tx=0).stop 2024-05-08T23:15:29.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.064+0000 7fa42f4f5700 1 -- 172.21.15.135:0/2896835835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa428101970 msgr2=0x7fa42819d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.064+0000 7fa42f4f5700 1 --2- 172.21.15.135:0/2896835835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa428101970 0x7fa42819d320 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa420007ee0 tx=0x7fa42000d3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.064+0000 7fa42f4f5700 1 -- 172.21.15.135:0/2896835835 shutdown_connections 2024-05-08T23:15:29.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.064+0000 7fa42f4f5700 1 --2- 172.21.15.135:0/2896835835 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fa4140a11b0 0x7fa4140a3670 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.064+0000 7fa42f4f5700 1 --2- 172.21.15.135:0/2896835835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa428101970 0x7fa42819d320 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.064+0000 7fa42f4f5700 1 --2- 172.21.15.135:0/2896835835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4280ffe60 0x7fa428195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.064+0000 7fa42f4f5700 1 --2- 172.21.15.135:0/2896835835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa428100fb0 0x7fa428196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.064+0000 7fa42f4f5700 1 -- 172.21.15.135:0/2896835835 >> 172.21.15.135:0/2896835835 conn(0x7fa4280fb3f0 msgr2=0x7fa428104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:29.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.064+0000 7fa42f4f5700 1 -- 172.21.15.135:0/2896835835 shutdown_connections 2024-05-08T23:15:29.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.064+0000 7fa42f4f5700 1 -- 172.21.15.135:0/2896835835 wait complete. 2024-05-08T23:15:29.077 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:15:29.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.200+0000 7f98ff159700 1 -- 172.21.15.135:0/448650848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f81018f0 msgr2=0x7f98f81081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.200+0000 7f98ff159700 1 --2- 172.21.15.135:0/448650848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f81018f0 0x7f98f81081a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f98f000b0d0 tx=0x7f98f000b3e0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.200+0000 7f98ff159700 1 -- 172.21.15.135:0/448650848 shutdown_connections 2024-05-08T23:15:29.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.200+0000 7f98ff159700 1 --2- 172.21.15.135:0/448650848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98f80ffd60 0x7f98f8100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.200+0000 7f98ff159700 1 --2- 172.21.15.135:0/448650848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f81018f0 0x7f98f81081a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.200+0000 7f98ff159700 1 --2- 172.21.15.135:0/448650848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98f8100f50 0x7f98f81013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.200+0000 7f98ff159700 1 -- 172.21.15.135:0/448650848 >> 172.21.15.135:0/448650848 conn(0x7f98f80fb2f0 msgr2=0x7f98f80fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:29.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.200+0000 7f98ff159700 1 -- 172.21.15.135:0/448650848 shutdown_connections 2024-05-08T23:15:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.200+0000 7f98ff159700 1 -- 172.21.15.135:0/448650848 wait complete. 2024-05-08T23:15:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.200+0000 7f98ff159700 1 Processor -- start 2024-05-08T23:15:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.200+0000 7f98ff159700 1 -- start start 2024-05-08T23:15:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98ff159700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98f80ffd60 0x7f98f8196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98ff159700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f8100f50 0x7f98f81973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98ff159700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98f81018f0 0x7f98f819e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98ff159700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f819e9c0 con 0x7f98f8100f50 2024-05-08T23:15:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98ff159700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f819eb00 con 0x7f98f80ffd60 2024-05-08T23:15:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98ff159700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f819ec90 con 0x7f98f81018f0 2024-05-08T23:15:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98f7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f8100f50 0x7f98f81973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98f7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f8100f50 0x7f98f81973d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48920/0 (socket says 172.21.15.135:48920) 2024-05-08T23:15:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98f7fff700 1 -- 172.21.15.135:0/96431115 learned_addr learned my addr 172.21.15.135:0/96431115 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98fcef5700 1 --2- 172.21.15.135:0/96431115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98f80ffd60 0x7f98f8196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98fd6f6700 1 --2- 172.21.15.135:0/96431115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98f81018f0 0x7f98f819e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98f7fff700 1 -- 172.21.15.135:0/96431115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98f81018f0 msgr2=0x7f98f819e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98f7fff700 1 --2- 172.21.15.135:0/96431115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98f81018f0 0x7f98f819e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98f7fff700 1 -- 172.21.15.135:0/96431115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98f80ffd60 msgr2=0x7f98f8196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98f7fff700 1 --2- 172.21.15.135:0/96431115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98f80ffd60 0x7f98f8196e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98f7fff700 1 -- 172.21.15.135:0/96431115 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f0009d00 con 0x7f98f8100f50 2024-05-08T23:15:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98fd6f6700 1 --2- 172.21.15.135:0/96431115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98f81018f0 0x7f98f819e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98f7fff700 1 --2- 172.21.15.135:0/96431115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f8100f50 0x7f98f81973d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f98e400d980 tx=0x7f98e400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98f5ffb700 1 -- 172.21.15.135:0/96431115 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4004220 con 0x7f98f8100f50 2024-05-08T23:15:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98f5ffb700 1 -- 172.21.15.135:0/96431115 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98e4007640 con 0x7f98f8100f50 2024-05-08T23:15:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98ff159700 1 -- 172.21.15.135:0/96431115 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f819ef70 con 0x7f98f8100f50 2024-05-08T23:15:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.201+0000 7f98f5ffb700 1 -- 172.21.15.135:0/96431115 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4005610 con 0x7f98f8100f50 2024-05-08T23:15:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.202+0000 7f98ff159700 1 -- 172.21.15.135:0/96431115 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f819f440 con 0x7f98f8100f50 2024-05-08T23:15:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.203+0000 7f98ff159700 1 -- 172.21.15.135:0/96431115 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f8107110 con 0x7f98f8100f50 2024-05-08T23:15:29.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.204+0000 7f98f5ffb700 1 -- 172.21.15.135:0/96431115 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f98e4004750 con 0x7f98f8100f50 2024-05-08T23:15:29.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.204+0000 7f98f5ffb700 1 --2- 172.21.15.135:0/96431115 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f98e80a1230 0x7f98e80a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.204+0000 7f98f5ffb700 1 -- 172.21.15.135:0/96431115 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f98e40cc840 con 0x7f98f8100f50 2024-05-08T23:15:29.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.204+0000 7f98fcef5700 1 --2- 172.21.15.135:0/96431115 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f98e80a1230 0x7f98e80a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.205+0000 7f98fcef5700 1 --2- 172.21.15.135:0/96431115 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f98e80a1230 0x7f98e80a36f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f98f8100db0 tx=0x7f98ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:29.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.209+0000 7f98f5ffb700 1 -- 172.21.15.135:0/96431115 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f98e4095e50 con 0x7f98f8100f50 2024-05-08T23:15:29.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.452+0000 7f98ff159700 1 -- 172.21.15.135:0/96431115 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98f8067c10 con 0x7f98f8100f50 2024-05-08T23:15:29.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:29 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/597020634' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:15:29.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:29 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1675189895' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:15:29.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:29 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2896835835' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:15:29.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.453+0000 7f98f5ffb700 1 -- 172.21.15.135:0/96431115 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10927 (secure 0 0 0) 0x7f98e4016020 con 0x7f98f8100f50 2024-05-08T23:15:29.455 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:29.455 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2432614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2432614311},{"type":"v1","addr":"172.21.15.135:6837","nonce":2432614311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T23:14:21.921303+0000","modified":"2024-05-08T23:14:28.351004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24500,"mds_2":24484,"mds_3":24439,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/360966092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":360966092},{"type":"v1","addr":"172.21.15.135:6839","nonce":360966092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6841/1831266531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":1831266531},{"type":"v1","addr":"172.21.15.135:6841","nonce":1831266531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1024532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1024532},{"type":"v1","addr":"172.21.15.179:6835","nonce":1024532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/2957410160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2957410160},{"type":"v1","addr":"172.21.15.179:6837","nonce":2957410160}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/4199708510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":4199708510},{"type":"v1","addr":"172.21.15.195:6835","nonce":4199708510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6837/2390721751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2390721751},{"type":"v1","addr":"172.21.15.195:6837","nonce":2390721751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.179:6839/1135239419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":1135239419},{"type":"v1","addr":"172.21.15.179:6839","nonce":1135239419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6839/1730571841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1730571841},{"type":"v1","addr":"172.21.15.195:6839","nonce":1730571841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T23:15:29.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.455+0000 7f98ff159700 1 -- 172.21.15.135:0/96431115 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f98e80a1230 msgr2=0x7f98e80a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.455+0000 7f98ff159700 1 --2- 172.21.15.135:0/96431115 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f98e80a1230 0x7f98e80a36f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f98f8100db0 tx=0x7f98ec009260 comp rx=0 tx=0).stop 2024-05-08T23:15:29.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.455+0000 7f98ff159700 1 -- 172.21.15.135:0/96431115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f8100f50 msgr2=0x7f98f81973d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.455+0000 7f98ff159700 1 --2- 172.21.15.135:0/96431115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f8100f50 0x7f98f81973d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f98e400d980 tx=0x7f98e400dc90 comp rx=0 tx=0).stop 2024-05-08T23:15:29.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.455+0000 7f98ff159700 1 -- 172.21.15.135:0/96431115 shutdown_connections 2024-05-08T23:15:29.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.455+0000 7f98ff159700 1 --2- 172.21.15.135:0/96431115 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f98e80a1230 0x7f98e80a36f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.455+0000 7f98ff159700 1 --2- 172.21.15.135:0/96431115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98f81018f0 0x7f98f819e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.455+0000 7f98ff159700 1 --2- 172.21.15.135:0/96431115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98f80ffd60 0x7f98f8196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.455+0000 7f98ff159700 1 --2- 172.21.15.135:0/96431115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98f8100f50 0x7f98f81973d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.455+0000 7f98ff159700 1 -- 172.21.15.135:0/96431115 >> 172.21.15.135:0/96431115 conn(0x7f98f80fb2f0 msgr2=0x7f98f8104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:29.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.455+0000 7f98ff159700 1 -- 172.21.15.135:0/96431115 shutdown_connections 2024-05-08T23:15:29.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.455+0000 7f98ff159700 1 -- 172.21.15.135:0/96431115 wait complete. 2024-05-08T23:15:29.457 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 27 2024-05-08T23:15:29.468 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T23:15:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.590+0000 7f3071772700 1 -- 172.21.15.135:0/3521141855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f306c102130 msgr2=0x7f306c102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.590+0000 7f3071772700 1 --2- 172.21.15.135:0/3521141855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f306c102130 0x7f306c102590 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f305c009990 tx=0x7f305c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.590+0000 7f3071772700 1 -- 172.21.15.135:0/3521141855 shutdown_connections 2024-05-08T23:15:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.590+0000 7f3071772700 1 --2- 172.21.15.135:0/3521141855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f306c102ad0 0x7f306c109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.590+0000 7f3071772700 1 --2- 172.21.15.135:0/3521141855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f306c0ff160 0x7f306c0ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.590+0000 7f3071772700 1 --2- 172.21.15.135:0/3521141855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f306c102130 0x7f306c102590 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.590+0000 7f3071772700 1 -- 172.21.15.135:0/3521141855 >> 172.21.15.135:0/3521141855 conn(0x7f306c0faab0 msgr2=0x7f306c0fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.590+0000 7f3071772700 1 -- 172.21.15.135:0/3521141855 shutdown_connections 2024-05-08T23:15:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.590+0000 7f3071772700 1 -- 172.21.15.135:0/3521141855 wait complete. 2024-05-08T23:15:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f3071772700 1 Processor -- start 2024-05-08T23:15:29.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f3071772700 1 -- start start 2024-05-08T23:15:29.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f3071772700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f306c0ff160 0x7f306c196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f3071772700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f306c102130 0x7f306c197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f3071772700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f306c102ad0 0x7f306c19e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f3071772700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c19e940 con 0x7f306c0ff160 2024-05-08T23:15:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f3071772700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c19ea80 con 0x7f306c102130 2024-05-08T23:15:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f3071772700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c19ec10 con 0x7f306c102ad0 2024-05-08T23:15:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f306affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f306c0ff160 0x7f306c196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f306affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f306c0ff160 0x7f306c196e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48936/0 (socket says 172.21.15.135:48936) 2024-05-08T23:15:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f306affd700 1 -- 172.21.15.135:0/1186387479 learned_addr learned my addr 172.21.15.135:0/1186387479 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f306a7fc700 1 --2- 172.21.15.135:0/1186387479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f306c102130 0x7f306c197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f306affd700 1 -- 172.21.15.135:0/1186387479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f306c102ad0 msgr2=0x7f306c19e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f306b7fe700 1 --2- 172.21.15.135:0/1186387479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f306c102ad0 0x7f306c19e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f306affd700 1 --2- 172.21.15.135:0/1186387479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f306c102ad0 0x7f306c19e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.591+0000 7f306affd700 1 -- 172.21.15.135:0/1186387479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f306c102130 msgr2=0x7f306c197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.592+0000 7f306affd700 1 --2- 172.21.15.135:0/1186387479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f306c102130 0x7f306c197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.592+0000 7f306affd700 1 -- 172.21.15.135:0/1186387479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c0095f0 con 0x7f306c0ff160 2024-05-08T23:15:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.592+0000 7f306b7fe700 1 --2- 172.21.15.135:0/1186387479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f306c102ad0 0x7f306c19e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.592+0000 7f306affd700 1 --2- 172.21.15.135:0/1186387479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f306c0ff160 0x7f306c196e10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f306000d980 tx=0x7f306000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.592+0000 7f3053fff700 1 -- 172.21.15.135:0/1186387479 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306000b950 con 0x7f306c0ff160 2024-05-08T23:15:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.592+0000 7f3053fff700 1 -- 172.21.15.135:0/1186387479 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3060007620 con 0x7f306c0ff160 2024-05-08T23:15:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.592+0000 7f3071772700 1 -- 172.21.15.135:0/1186387479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306c19eef0 con 0x7f306c0ff160 2024-05-08T23:15:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.592+0000 7f3053fff700 1 -- 172.21.15.135:0/1186387479 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306000f3c0 con 0x7f306c0ff160 2024-05-08T23:15:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.592+0000 7f3071772700 1 -- 172.21.15.135:0/1186387479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c19f310 con 0x7f306c0ff160 2024-05-08T23:15:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.593+0000 7f3071772700 1 -- 172.21.15.135:0/1186387479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c0680d0 con 0x7f306c0ff160 2024-05-08T23:15:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.594+0000 7f3053fff700 1 -- 172.21.15.135:0/1186387479 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f3060010640 con 0x7f306c0ff160 2024-05-08T23:15:29.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.595+0000 7f3053fff700 1 --2- 172.21.15.135:0/1186387479 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f30540a1230 0x7f30540a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.595+0000 7f306a7fc700 1 --2- 172.21.15.135:0/1186387479 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f30540a1230 0x7f30540a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.595+0000 7f3053fff700 1 -- 172.21.15.135:0/1186387479 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f30600cc970 con 0x7f306c0ff160 2024-05-08T23:15:29.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.595+0000 7f306a7fc700 1 --2- 172.21.15.135:0/1186387479 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f30540a1230 0x7f30540a36f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f305c00b5c0 tx=0x7f305c003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:29.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:29 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/597020634' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:15:29.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:29 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1675189895' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:15:29.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:29 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2896835835' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:15:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.599+0000 7f3053fff700 1 -- 172.21.15.135:0/1186387479 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f306c0680d0 con 0x7f306c0ff160 2024-05-08T23:15:29.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:29 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/597020634' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:15:29.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:29 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1675189895' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:15:29.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:29 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2896835835' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:15:29.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.798+0000 7f3071772700 1 -- 172.21.15.135:0/1186387479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f306c1083c0 con 0x7f306c0ff160 2024-05-08T23:15:29.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.799+0000 7f3053fff700 1 -- 172.21.15.135:0/1186387479 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22702 (secure 0 0 0) 0x7f3060016090 con 0x7f306c0ff160 2024-05-08T23:15:29.800 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:15:29.800 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":85,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:15:22.121685+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T23:14:19.726838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T23:14:21.097732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:15:29.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.801+0000 7f3071772700 1 -- 172.21.15.135:0/1186387479 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f30540a1230 msgr2=0x7f30540a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.801+0000 7f3071772700 1 --2- 172.21.15.135:0/1186387479 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f30540a1230 0x7f30540a36f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f305c00b5c0 tx=0x7f305c003790 comp rx=0 tx=0).stop 2024-05-08T23:15:29.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.801+0000 7f3071772700 1 -- 172.21.15.135:0/1186387479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f306c0ff160 msgr2=0x7f306c196e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.801+0000 7f3071772700 1 --2- 172.21.15.135:0/1186387479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f306c0ff160 0x7f306c196e10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f306000d980 tx=0x7f306000dc90 comp rx=0 tx=0).stop 2024-05-08T23:15:29.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.801+0000 7f3071772700 1 -- 172.21.15.135:0/1186387479 shutdown_connections 2024-05-08T23:15:29.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.801+0000 7f3071772700 1 --2- 172.21.15.135:0/1186387479 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f30540a1230 0x7f30540a36f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.801+0000 7f3071772700 1 --2- 172.21.15.135:0/1186387479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f306c102ad0 0x7f306c19e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.801+0000 7f3071772700 1 --2- 172.21.15.135:0/1186387479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f306c0ff160 0x7f306c196e10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.801+0000 7f3071772700 1 --2- 172.21.15.135:0/1186387479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f306c102130 0x7f306c197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.801+0000 7f3071772700 1 -- 172.21.15.135:0/1186387479 >> 172.21.15.135:0/1186387479 conn(0x7f306c0faab0 msgr2=0x7f306c105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:29.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.801+0000 7f3071772700 1 -- 172.21.15.135:0/1186387479 shutdown_connections 2024-05-08T23:15:29.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.801+0000 7f3071772700 1 -- 172.21.15.135:0/1186387479 wait complete. 2024-05-08T23:15:29.815 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-08T23:14:21.921303+0000', 'modified': '2024-05-08T23:14:28.351004+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24508, 'mds_1': 24500, 'mds_2': 24484, 'mds_3': 24439, 'mds_4': 24419}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14616': {'gid': 14616, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6839/360966092', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 360966092}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 360966092}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14622': {'gid': 14622, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6841/1831266531', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6840', 'nonce': 1831266531}, {'type': 'v1', 'addr': '172.21.15.135:6841', 'nonce': 1831266531}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24419': {'gid': 24419, 'name': 'k', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.179:6833/3953517264', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6832', 'nonce': 3953517264}, {'type': 'v1', 'addr': '172.21.15.179:6833', 'nonce': 3953517264}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24439': {'gid': 24439, 'name': 'l', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.195:6833/2264761272', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6832', 'nonce': 2264761272}, {'type': 'v1', 'addr': '172.21.15.195:6833', 'nonce': 2264761272}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24443': {'gid': 24443, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6835/1024532', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 1024532}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 1024532}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6837/2957410160', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6836', 'nonce': 2957410160}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 2957410160}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24472': {'gid': 24472, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.195:6835/4199708510', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6834', 'nonce': 4199708510}, {'type': 'v1', 'addr': '172.21.15.195:6835', 'nonce': 4199708510}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24484': {'gid': 24484, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.195:6837/2390721751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6836', 'nonce': 2390721751}, {'type': 'v1', 'addr': '172.21.15.195:6837', 'nonce': 2390721751}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24500': {'gid': 24500, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.179:6839/1135239419', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6838', 'nonce': 1135239419}, {'type': 'v1', 'addr': '172.21.15.179:6839', 'nonce': 1135239419}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24508': {'gid': 24508, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.195:6839/1730571841', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6838', 'nonce': 1730571841}, {'type': 'v1', 'addr': '172.21.15.195:6839', 'nonce': 1730571841}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T23:15:29.816 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-08T23:15:29.816 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2024-05-08T23:15:29.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.939+0000 7f9403531700 1 -- 172.21.15.135:0/1480836730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0ffe80 msgr2=0x7f93fc1002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.939+0000 7f9403531700 1 --2- 172.21.15.135:0/1480836730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0ffe80 0x7f93fc1002a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009990 tx=0x7f93f0009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.939+0000 7f9403531700 1 -- 172.21.15.135:0/1480836730 shutdown_connections 2024-05-08T23:15:29.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.939+0000 7f9403531700 1 --2- 172.21.15.135:0/1480836730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93fc101990 0x7f93fc1082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.939+0000 7f9403531700 1 --2- 172.21.15.135:0/1480836730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0ffe80 0x7f93fc1002a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.939+0000 7f9403531700 1 --2- 172.21.15.135:0/1480836730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93fc100fd0 0x7f93fc101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.939+0000 7f9403531700 1 -- 172.21.15.135:0/1480836730 >> 172.21.15.135:0/1480836730 conn(0x7f93fc0fb3f0 msgr2=0x7f93fc0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:29.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.939+0000 7f9403531700 1 -- 172.21.15.135:0/1480836730 shutdown_connections 2024-05-08T23:15:29.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.939+0000 7f9403531700 1 -- 172.21.15.135:0/1480836730 wait complete. 2024-05-08T23:15:29.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.939+0000 7f9403531700 1 Processor -- start 2024-05-08T23:15:29.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f9403531700 1 -- start start 2024-05-08T23:15:29.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f9403531700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0ffe80 0x7f93fc195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f9403531700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93fc100fd0 0x7f93fc196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f9403531700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93fc101990 0x7f93fc19d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f9403531700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc19d8f0 con 0x7f93fc0ffe80 2024-05-08T23:15:29.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f9403531700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc19da60 con 0x7f93fc101990 2024-05-08T23:15:29.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f9403531700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc19dc20 con 0x7f93fc100fd0 2024-05-08T23:15:29.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f94012cd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0ffe80 0x7f93fc195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f94012cd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0ffe80 0x7f93fc195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48960/0 (socket says 172.21.15.135:48960) 2024-05-08T23:15:29.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f94012cd700 1 -- 172.21.15.135:0/3637355302 learned_addr learned my addr 172.21.15.135:0/3637355302 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:29.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f9400acc700 1 --2- 172.21.15.135:0/3637355302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93fc100fd0 0x7f93fc196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f9401ace700 1 --2- 172.21.15.135:0/3637355302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93fc101990 0x7f93fc19d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f94012cd700 1 -- 172.21.15.135:0/3637355302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93fc100fd0 msgr2=0x7f93fc196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f94012cd700 1 --2- 172.21.15.135:0/3637355302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93fc100fd0 0x7f93fc196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f94012cd700 1 -- 172.21.15.135:0/3637355302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93fc101990 msgr2=0x7f93fc19d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f94012cd700 1 --2- 172.21.15.135:0/3637355302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93fc101990 0x7f93fc19d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f94012cd700 1 -- 172.21.15.135:0/3637355302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00095f0 con 0x7f93fc0ffe80 2024-05-08T23:15:29.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f9401ace700 1 --2- 172.21.15.135:0/3637355302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93fc101990 0x7f93fc19d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:29.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f94012cd700 1 --2- 172.21.15.135:0/3637355302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0ffe80 0x7f93fc195e00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f93f000c010 tx=0x7f93f0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:29.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f93ee7fc700 1 -- 172.21.15.135:0/3637355302 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f001d070 con 0x7f93fc0ffe80 2024-05-08T23:15:29.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f93ee7fc700 1 -- 172.21.15.135:0/3637355302 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93f0004ca0 con 0x7f93fc0ffe80 2024-05-08T23:15:29.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f9403531700 1 -- 172.21.15.135:0/3637355302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93fc19dea0 con 0x7f93fc0ffe80 2024-05-08T23:15:29.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f93ee7fc700 1 -- 172.21.15.135:0/3637355302 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f0005610 con 0x7f93fc0ffe80 2024-05-08T23:15:29.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.940+0000 7f9403531700 1 -- 172.21.15.135:0/3637355302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93fc19e210 con 0x7f93fc0ffe80 2024-05-08T23:15:29.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.943+0000 7f93ee7fc700 1 -- 172.21.15.135:0/3637355302 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f93f000fc70 con 0x7f93fc0ffe80 2024-05-08T23:15:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.943+0000 7f93ee7fc700 1 --2- 172.21.15.135:0/3637355302 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f93e80a11b0 0x7f93e80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.943+0000 7f9400acc700 1 --2- 172.21.15.135:0/3637355302 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f93e80a11b0 0x7f93e80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.943+0000 7f93ee7fc700 1 -- 172.21.15.135:0/3637355302 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f93f00cde00 con 0x7f93fc0ffe80 2024-05-08T23:15:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.943+0000 7f9400acc700 1 --2- 172.21.15.135:0/3637355302 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f93e80a11b0 0x7f93e80a3670 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f93f8005950 tx=0x7f93f80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.944+0000 7f940f6ebb80 1 Processor -- start 2024-05-08T23:15:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.944+0000 7f940f6ebb80 1 -- start start 2024-05-08T23:15:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.944+0000 7f940f6ebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26d700 0x56063c26db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.944+0000 7f940f6ebb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26e060 0x56063c26e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.944+0000 7f940f6ebb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 0x56063c26eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.944+0000 7f940f6ebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063c1c2100 con 0x56063c26d700 2024-05-08T23:15:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.944+0000 7f940f6ebb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063c1bfac0 con 0x56063c26e060 2024-05-08T23:15:29.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.944+0000 7f940f6ebb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063c1bb3b0 con 0x56063c26ea20 2024-05-08T23:15:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.944+0000 7f94012cd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26d700 0x56063c26db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.944+0000 7f94012cd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26d700 0x56063c26db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48962/0 (socket says 172.21.15.135:48962) 2024-05-08T23:15:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.944+0000 7f94012cd700 1 -- 172.21.15.135:0/1182832605 learned_addr learned my addr 172.21.15.135:0/1182832605 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.945+0000 7f9401ace700 1 --2- 172.21.15.135:0/1182832605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 0x56063c26eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.945+0000 7f9400acc700 1 --2- 172.21.15.135:0/1182832605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26e060 0x56063c26e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.945+0000 7f94012cd700 1 -- 172.21.15.135:0/1182832605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 msgr2=0x56063c26eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.945+0000 7f94012cd700 1 --2- 172.21.15.135:0/1182832605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 0x56063c26eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.945+0000 7f94012cd700 1 -- 172.21.15.135:0/1182832605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26e060 msgr2=0x56063c26e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.945+0000 7f94012cd700 1 --2- 172.21.15.135:0/1182832605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26e060 0x56063c26e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.945+0000 7f94012cd700 1 -- 172.21.15.135:0/1182832605 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56063c03c360 con 0x56063c26d700 2024-05-08T23:15:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.945+0000 7f9401ace700 1 --2- 172.21.15.135:0/1182832605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 0x56063c26eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.945+0000 7f94012cd700 1 --2- 172.21.15.135:0/1182832605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26d700 0x56063c26db20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f93f0097bd0 tx=0x7f93f002a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f744346961e725 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.945+0000 7f93e77fe700 1 -- 172.21.15.135:0/1182832605 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f009ef90 con 0x56063c26d700 2024-05-08T23:15:29.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.945+0000 7f93e77fe700 1 -- 172.21.15.135:0/1182832605 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93f00a3550 con 0x56063c26d700 2024-05-08T23:15:29.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.945+0000 7f93e77fe700 1 -- 172.21.15.135:0/1182832605 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f009a650 con 0x56063c26d700 2024-05-08T23:15:29.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.946+0000 7f940f6ebb80 1 -- 172.21.15.135:0/1182832605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26d700 msgr2=0x56063c26db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.946+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/1182832605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26d700 0x56063c26db20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f93f0097bd0 tx=0x7f93f002a000 comp rx=0 tx=0).stop 2024-05-08T23:15:29.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.946+0000 7f940f6ebb80 1 -- 172.21.15.135:0/1182832605 shutdown_connections 2024-05-08T23:15:29.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.946+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/1182832605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 0x56063c26eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.946+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/1182832605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26d700 0x56063c26db20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.946+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/1182832605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26e060 0x56063c26e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.946+0000 7f940f6ebb80 1 -- 172.21.15.135:0/1182832605 >> 172.21.15.135:0/1182832605 conn(0x56063c1c91c0 msgr2=0x56063c265d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:29.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.946+0000 7f940f6ebb80 1 -- 172.21.15.135:0/1182832605 shutdown_connections 2024-05-08T23:15:29.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.946+0000 7f940f6ebb80 1 -- 172.21.15.135:0/1182832605 wait complete. 2024-05-08T23:15:29.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.946+0000 7f940f6ebb80 1 -- start start 2024-05-08T23:15:29.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.946+0000 7f940f6ebb80 1 Processor -- start 2024-05-08T23:15:29.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.946+0000 7f940f6ebb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26d700 0x56063c276c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.946+0000 7f940f6ebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c2771d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.946+0000 7f940f6ebb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 0x56063c27e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.946+0000 7f940f6ebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063c157510 con 0x56063c26e060 2024-05-08T23:15:29.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f940f6ebb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063c1571b0 con 0x56063c26d700 2024-05-08T23:15:29.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f940f6ebb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063c03e650 con 0x56063c26ea20 2024-05-08T23:15:29.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f940f6ebb80 10 client.0 _ll_register_callbacks cb 0x56063c160ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:29.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f9400acc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c2771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f9400acc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c2771d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48978/0 (socket says 172.21.15.135:48978) 2024-05-08T23:15:29.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f9400acc700 1 -- 172.21.15.135:0/2250052296 learned_addr learned my addr 172.21.15.135:0/2250052296 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:29.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f9401ace700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 0x56063c27e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f94012cd700 1 --2- 172.21.15.135:0/2250052296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26d700 0x56063c276c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f9400acc700 1 -- 172.21.15.135:0/2250052296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 msgr2=0x56063c27e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:29.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f9400acc700 1 --2- 172.21.15.135:0/2250052296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 0x56063c27e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f9400acc700 1 -- 172.21.15.135:0/2250052296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26d700 msgr2=0x56063c276c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:29.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f9400acc700 1 --2- 172.21.15.135:0/2250052296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26d700 0x56063c276c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f9400acc700 1 -- 172.21.15.135:0/2250052296 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93fc19e210 con 0x56063c26e060 2024-05-08T23:15:29.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f9401ace700 1 --2- 172.21.15.135:0/2250052296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 0x56063c27e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:15:29.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f94012cd700 1 --2- 172.21.15.135:0/2250052296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26d700 0x56063c276c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:15:29.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f9400acc700 1 --2- 172.21.15.135:0/2250052296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c2771d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f93f800fe70 tx=0x7f93f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8383790acaf3aefa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:29.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f93e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:29.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f93e4ff9700 1 -- 172.21.15.135:0/2250052296 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f800fea0 con 0x56063c26e060 2024-05-08T23:15:29.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f93e4ff9700 1 -- 172.21.15.135:0/2250052296 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f93f801f430 con 0x56063c26e060 2024-05-08T23:15:29.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f940f6ebb80 1 -- 172.21.15.135:0/2250052296 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56063c114220 con 0x56063c26e060 2024-05-08T23:15:29.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f93e4ff9700 1 -- 172.21.15.135:0/2250052296 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93f801f5f0 con 0x56063c26e060 2024-05-08T23:15:29.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f940f6ebb80 10 client.15237 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:29.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.947+0000 7f940f6ebb80 1 -- 172.21.15.135:0/2250052296 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56063bfe8b10 con 0x56063c26e060 2024-05-08T23:15:29.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.948+0000 7f93e4ff9700 1 -- 172.21.15.135:0/2250052296 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56063c114220 con 0x56063c26e060 2024-05-08T23:15:29.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.948+0000 7f93e4ff9700 1 -- 172.21.15.135:0/2250052296 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f93f8025020 con 0x56063c26e060 2024-05-08T23:15:29.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.948+0000 7f940f6ebb80 10 client.15237 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:29.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.948+0000 7f940f6ebb80 10 client.15237 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-08T23:15:29.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.948+0000 7f940f6ebb80 20 client.15237 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:29.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.948+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/2250052296 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x56063c281f00 0x56063c2871e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.948+0000 7f940f6ebb80 4 client.15237 mds_command: new command op to 24419 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:15:29.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.948+0000 7f940f6ebb80 1 -- 172.21.15.135:0/2250052296 --> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56063c23a7c0 con 0x56063c281f00 2024-05-08T23:15:29.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.948+0000 7f94012cd700 1 --2- 172.21.15.135:0/2250052296 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x56063c281f00 0x56063c2871e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.948+0000 7f93e4ff9700 10 client.15237 ms_handle_connect on v2:172.21.15.179:6832/3953517264 2024-05-08T23:15:29.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.948+0000 7f94012cd700 1 --2- 172.21.15.135:0/2250052296 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x56063c281f00 0x56063c2871e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=38bcc0827d132ab8 server_cookie=6ec35c40fcafa7a6 in_seq=0 out_seq=0 2024-05-08T23:15:29.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.949+0000 7f93e4ff9700 1 -- 172.21.15.135:0/2250052296 <== mds.4 v2:172.21.15.179:6832/3953517264 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56063c23a7c0 con 0x56063c281f00 2024-05-08T23:15:29.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.949+0000 7f93e4ff9700 10 client.15237 handle_command_reply: tid=0 2024-05-08T23:15:29.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.949+0000 7f940f6ebb80 1 client.15237 shutdown 2024-05-08T23:15:29.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.949+0000 7f940f6ebb80 1 -- 172.21.15.135:0/2250052296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 msgr2=0x56063c2771d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.949+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/2250052296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c2771d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f93f800fe70 tx=0x7f93f8004750 comp rx=0 tx=0).stop 2024-05-08T23:15:29.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.949+0000 7f940f6ebb80 1 -- 172.21.15.135:0/2250052296 shutdown_connections 2024-05-08T23:15:29.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.949+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/2250052296 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x56063c281f00 0x56063c2871e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.949+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/2250052296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 0x56063c27e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.949+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/2250052296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26d700 0x56063c276c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.949+0000 7f93e4ff9700 0 client.15237 ms_handle_reset on v2:172.21.15.179:6832/3953517264 2024-05-08T23:15:29.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.949+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/2250052296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c2771d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.949+0000 7f940f6ebb80 1 -- 172.21.15.135:0/2250052296 >> 172.21.15.135:0/2250052296 conn(0x56063c1c91c0 msgr2=0x56063c265550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:29.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.949+0000 7f940f6ebb80 1 -- 172.21.15.135:0/2250052296 shutdown_connections 2024-05-08T23:15:29.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.949+0000 7f940f6ebb80 1 -- 172.21.15.135:0/2250052296 wait complete. 2024-05-08T23:15:29.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.950+0000 7f940f6ebb80 20 client.15237 trim_cache size 0 max 16384 2024-05-08T23:15:29.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f940f6ebb80 1 Processor -- start 2024-05-08T23:15:29.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f940f6ebb80 1 -- start start 2024-05-08T23:15:29.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f940f6ebb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26d700 0x56063c26dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f940f6ebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c27e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f940f6ebb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 0x56063c276210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f940f6ebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063c114220 con 0x56063c26e060 2024-05-08T23:15:29.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f940f6ebb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063c266b80 con 0x56063c26d700 2024-05-08T23:15:29.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f940f6ebb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063c1b8010 con 0x56063c26ea20 2024-05-08T23:15:29.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f9400acc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c27e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f9400acc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c27e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48992/0 (socket says 172.21.15.135:48992) 2024-05-08T23:15:29.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f9400acc700 1 -- 172.21.15.135:0/1210200732 learned_addr learned my addr 172.21.15.135:0/1210200732 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:29.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f94012cd700 1 --2- 172.21.15.135:0/1210200732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26d700 0x56063c26dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f9400acc700 1 -- 172.21.15.135:0/1210200732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 msgr2=0x56063c276210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:29.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f9400acc700 1 --2- 172.21.15.135:0/1210200732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 0x56063c276210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f9400acc700 1 -- 172.21.15.135:0/1210200732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26d700 msgr2=0x56063c26dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:29.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f9400acc700 1 --2- 172.21.15.135:0/1210200732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26d700 0x56063c26dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f9400acc700 1 -- 172.21.15.135:0/1210200732 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56063c181510 con 0x56063c26e060 2024-05-08T23:15:29.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f9400acc700 1 --2- 172.21.15.135:0/1210200732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c27e1d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f93f8005a80 tx=0x7f93f8027f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2654609f41d5f593 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:29.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f93e7fff700 1 -- 172.21.15.135:0/1210200732 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f8027b50 con 0x56063c26e060 2024-05-08T23:15:29.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f93e7fff700 1 -- 172.21.15.135:0/1210200732 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93f8027cb0 con 0x56063c26e060 2024-05-08T23:15:29.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.968+0000 7f93e7fff700 1 -- 172.21.15.135:0/1210200732 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f8032ca0 con 0x56063c26e060 2024-05-08T23:15:29.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.969+0000 7f940f6ebb80 1 -- 172.21.15.135:0/1210200732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 msgr2=0x56063c27e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.969+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/1210200732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c27e1d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f93f8005a80 tx=0x7f93f8027f80 comp rx=0 tx=0).stop 2024-05-08T23:15:29.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.969+0000 7f940f6ebb80 1 -- 172.21.15.135:0/1210200732 shutdown_connections 2024-05-08T23:15:29.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.969+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/1210200732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26ea20 0x56063c276210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.969+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/1210200732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26d700 0x56063c26dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.969+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/1210200732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c27e1d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.969+0000 7f940f6ebb80 1 -- 172.21.15.135:0/1210200732 >> 172.21.15.135:0/1210200732 conn(0x56063c1c91c0 msgr2=0x56063c26ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:29.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.969+0000 7f940f6ebb80 1 -- 172.21.15.135:0/1210200732 shutdown_connections 2024-05-08T23:15:29.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.969+0000 7f940f6ebb80 1 -- 172.21.15.135:0/1210200732 wait complete. 2024-05-08T23:15:29.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.969+0000 7f940f6ebb80 1 -- start start 2024-05-08T23:15:29.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.969+0000 7f940f6ebb80 1 Processor -- start 2024-05-08T23:15:29.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f940f6ebb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26d700 0x56063c27dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f940f6ebb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c27e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f940f6ebb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26ea20 0x56063c27a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f940f6ebb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063c27af40 con 0x56063c26e060 2024-05-08T23:15:29.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f940f6ebb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063c27b0b0 con 0x56063c26ea20 2024-05-08T23:15:29.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f940f6ebb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063c27b270 con 0x56063c26d700 2024-05-08T23:15:29.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f940f6ebb80 10 client.0 _ll_register_callbacks cb 0x56063c160ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:29.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f9400acc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c27e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f9400acc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c27e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49006/0 (socket says 172.21.15.135:49006) 2024-05-08T23:15:29.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f9400acc700 1 -- 172.21.15.135:0/3199521126 learned_addr learned my addr 172.21.15.135:0/3199521126 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:29.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f9401ace700 1 --2- 172.21.15.135:0/3199521126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26ea20 0x56063c27a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f94012cd700 1 --2- 172.21.15.135:0/3199521126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26d700 0x56063c27dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f9400acc700 1 -- 172.21.15.135:0/3199521126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26d700 msgr2=0x56063c27dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:29.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f9400acc700 1 --2- 172.21.15.135:0/3199521126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26d700 0x56063c27dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f9400acc700 1 -- 172.21.15.135:0/3199521126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26ea20 msgr2=0x56063c27a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:29.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f9400acc700 1 --2- 172.21.15.135:0/3199521126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26ea20 0x56063c27a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f9400acc700 1 -- 172.21.15.135:0/3199521126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56063bfe8b10 con 0x56063c26e060 2024-05-08T23:15:29.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f94012cd700 1 --2- 172.21.15.135:0/3199521126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26d700 0x56063c27dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:29.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f9400acc700 1 --2- 172.21.15.135:0/3199521126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c27e210 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f93f80279b0 tx=0x7f93f8027c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842c59e0e6d43cc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:29.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.970+0000 7f93e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:29.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.971+0000 7f93e4ff9700 1 -- 172.21.15.135:0/3199521126 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f80329e0 con 0x56063c26e060 2024-05-08T23:15:29.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.971+0000 7f93e4ff9700 1 -- 172.21.15.135:0/3199521126 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f93f8032b40 con 0x56063c26e060 2024-05-08T23:15:29.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.971+0000 7f940f6ebb80 1 -- 172.21.15.135:0/3199521126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f93f00a3550 con 0x56063c26e060 2024-05-08T23:15:29.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.971+0000 7f93e4ff9700 1 -- 172.21.15.135:0/3199521126 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93f8032d40 con 0x56063c26e060 2024-05-08T23:15:29.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.971+0000 7f940f6ebb80 10 client.15243 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:29.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.971+0000 7f940f6ebb80 1 -- 172.21.15.135:0/3199521126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56063c040c80 con 0x56063c26e060 2024-05-08T23:15:29.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.971+0000 7f93e4ff9700 1 -- 172.21.15.135:0/3199521126 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93f00a3550 con 0x56063c26e060 2024-05-08T23:15:29.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.971+0000 7f93e4ff9700 1 -- 172.21.15.135:0/3199521126 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f93f8011440 con 0x56063c26e060 2024-05-08T23:15:29.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.971+0000 7f940f6ebb80 10 client.15243 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:29.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.971+0000 7f940f6ebb80 10 client.15243 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-08T23:15:29.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.971+0000 7f940f6ebb80 20 client.15243 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:29.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.971+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/3199521126 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x56063c2dd460 0x56063c2d9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:29.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.971+0000 7f940f6ebb80 4 client.15243 mds_command: new command op to 24419 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T23:15:29.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.971+0000 7f940f6ebb80 1 -- 172.21.15.135:0/3199521126 --> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56063c1b3e70 con 0x56063c2dd460 2024-05-08T23:15:29.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.971+0000 7f94012cd700 1 --2- 172.21.15.135:0/3199521126 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x56063c2dd460 0x56063c2d9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:29.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f94012cd700 1 --2- 172.21.15.135:0/3199521126 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x56063c2dd460 0x56063c2d9ed0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8237044f4b1dfcf2 server_cookie=fd88854325abe636 in_seq=0 out_seq=0 2024-05-08T23:15:29.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f93e4ff9700 10 client.15243 ms_handle_connect on v2:172.21.15.179:6832/3953517264 2024-05-08T23:15:29.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f93e4ff9700 1 -- 172.21.15.135:0/3199521126 <== mds.4 v2:172.21.15.179:6832/3953517264 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56063c1b3e70 con 0x56063c2dd460 2024-05-08T23:15:29.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f93e4ff9700 10 client.15243 handle_command_reply: tid=0 2024-05-08T23:15:29.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f940f6ebb80 1 client.15243 shutdown 2024-05-08T23:15:29.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f940f6ebb80 1 -- 172.21.15.135:0/3199521126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 msgr2=0x56063c27e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/3199521126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c27e210 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f93f80279b0 tx=0x7f93f8027c40 comp rx=0 tx=0).stop 2024-05-08T23:15:29.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f940f6ebb80 1 -- 172.21.15.135:0/3199521126 shutdown_connections 2024-05-08T23:15:29.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/3199521126 >> [v2:172.21.15.179:6832/3953517264,v1:172.21.15.179:6833/3953517264] conn(0x56063c2dd460 0x56063c2d9ed0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/3199521126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56063c26d700 0x56063c27dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/3199521126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56063c26ea20 0x56063c27a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f93e4ff9700 0 client.15243 ms_handle_reset on v2:172.21.15.179:6832/3953517264 2024-05-08T23:15:29.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f940f6ebb80 1 --2- 172.21.15.135:0/3199521126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56063c26e060 0x56063c27e210 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f940f6ebb80 1 -- 172.21.15.135:0/3199521126 >> 172.21.15.135:0/3199521126 conn(0x56063c1c91c0 msgr2=0x56063c276210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:29.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f940f6ebb80 1 -- 172.21.15.135:0/3199521126 shutdown_connections 2024-05-08T23:15:29.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f940f6ebb80 1 -- 172.21.15.135:0/3199521126 wait complete. 2024-05-08T23:15:29.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.972+0000 7f940f6ebb80 20 client.15243 trim_cache size 0 max 16384 2024-05-08T23:15:29.980 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:15:29.980 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "c804a50a-0d8f-11ef-bc97-c7b262605968", 2024-05-08T23:15:29.980 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 4, 2024-05-08T23:15:29.980 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24419, 2024-05-08T23:15:29.980 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-08T23:15:29.981 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-08T23:15:29.981 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-08T23:15:29.981 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 62.628288587999997, 2024-05-08T23:15:29.981 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 27, 2024-05-08T23:15:29.981 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 85, 2024-05-08T23:15:29.981 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 83, 2024-05-08T23:15:29.981 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 91.727509384000001 2024-05-08T23:15:29.981 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:15:29.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.973+0000 7f9403531700 1 -- 172.21.15.135:0/3637355302 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f93e80a11b0 msgr2=0x7f93e80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.973+0000 7f9403531700 1 --2- 172.21.15.135:0/3637355302 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f93e80a11b0 0x7f93e80a3670 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f93f8005950 tx=0x7f93f80058e0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.973+0000 7f9403531700 1 -- 172.21.15.135:0/3637355302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0ffe80 msgr2=0x7f93fc195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:29.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.973+0000 7f9403531700 1 --2- 172.21.15.135:0/3637355302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0ffe80 0x7f93fc195e00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f93f000c010 tx=0x7f93f0005e80 comp rx=0 tx=0).stop 2024-05-08T23:15:29.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.973+0000 7f9403531700 1 -- 172.21.15.135:0/3637355302 shutdown_connections 2024-05-08T23:15:29.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.973+0000 7f9403531700 1 --2- 172.21.15.135:0/3637355302 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f93e80a11b0 0x7f93e80a3670 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.973+0000 7f9403531700 1 --2- 172.21.15.135:0/3637355302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93fc101990 0x7f93fc19d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.973+0000 7f9403531700 1 --2- 172.21.15.135:0/3637355302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0ffe80 0x7f93fc195e00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.973+0000 7f9403531700 1 --2- 172.21.15.135:0/3637355302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93fc100fd0 0x7f93fc196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:29.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.973+0000 7f9403531700 1 -- 172.21.15.135:0/3637355302 >> 172.21.15.135:0/3637355302 conn(0x7f93fc0fb3f0 msgr2=0x7f93fc104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:29.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.973+0000 7f9403531700 1 -- 172.21.15.135:0/3637355302 shutdown_connections 2024-05-08T23:15:29.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:29.973+0000 7f9403531700 1 -- 172.21.15.135:0/3637355302 wait complete. 2024-05-08T23:15:29.985 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2024-05-08T23:15:30.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.108+0000 7fdac43bb700 1 -- 172.21.15.135:0/2164747632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdabc102ab0 msgr2=0x7fdabc1093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.108+0000 7fdac43bb700 1 --2- 172.21.15.135:0/2164747632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdabc102ab0 0x7fdabc1093d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdab400b0a0 tx=0x7fdab400b3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.108+0000 7fdac43bb700 1 -- 172.21.15.135:0/2164747632 shutdown_connections 2024-05-08T23:15:30.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.108+0000 7fdac43bb700 1 --2- 172.21.15.135:0/2164747632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdabc102ab0 0x7fdabc1093d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.108+0000 7fdac43bb700 1 --2- 172.21.15.135:0/2164747632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdabc100f20 0x7fdabc101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.108+0000 7fdac43bb700 1 --2- 172.21.15.135:0/2164747632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdabc1020f0 0x7fdabc102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.108+0000 7fdac43bb700 1 -- 172.21.15.135:0/2164747632 >> 172.21.15.135:0/2164747632 conn(0x7fdabc0fc4e0 msgr2=0x7fdabc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.108+0000 7fdac43bb700 1 -- 172.21.15.135:0/2164747632 shutdown_connections 2024-05-08T23:15:30.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.108+0000 7fdac43bb700 1 -- 172.21.15.135:0/2164747632 wait complete. 2024-05-08T23:15:30.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.109+0000 7fdac43bb700 1 Processor -- start 2024-05-08T23:15:30.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.109+0000 7fdac43bb700 1 -- start start 2024-05-08T23:15:30.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.109+0000 7fdac43bb700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdabc100f20 0x7fdabc196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.109+0000 7fdac43bb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdabc1020f0 0x7fdabc197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.109+0000 7fdac43bb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdabc102ab0 0x7fdabc19e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.109+0000 7fdac43bb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc19ea60 con 0x7fdabc102ab0 2024-05-08T23:15:30.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.109+0000 7fdac43bb700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc19eba0 con 0x7fdabc100f20 2024-05-08T23:15:30.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.109+0000 7fdac43bb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc19ed30 con 0x7fdabc1020f0 2024-05-08T23:15:30.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.109+0000 7fdac2958700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdabc102ab0 0x7fdabc19e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.109+0000 7fdac2958700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdabc102ab0 0x7fdabc19e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49022/0 (socket says 172.21.15.135:49022) 2024-05-08T23:15:30.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.109+0000 7fdac2958700 1 -- 172.21.15.135:0/1367166866 learned_addr learned my addr 172.21.15.135:0/1367166866 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.110+0000 7fdac2157700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdabc100f20 0x7fdabc196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.110+0000 7fdac1956700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdabc1020f0 0x7fdabc197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.110+0000 7fdac2958700 1 -- 172.21.15.135:0/1367166866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdabc1020f0 msgr2=0x7fdabc197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.110+0000 7fdac2958700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdabc1020f0 0x7fdabc197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.110+0000 7fdac2958700 1 -- 172.21.15.135:0/1367166866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdabc100f20 msgr2=0x7fdabc196f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.110+0000 7fdac2958700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdabc100f20 0x7fdabc196f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.110+0000 7fdac2958700 1 -- 172.21.15.135:0/1367166866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab4009d00 con 0x7fdabc102ab0 2024-05-08T23:15:30.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.110+0000 7fdac2157700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdabc100f20 0x7fdabc196f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:30.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.110+0000 7fdac1956700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdabc1020f0 0x7fdabc197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:30.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.110+0000 7fdac2958700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdabc102ab0 0x7fdabc19e490 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdab4006070 tx=0x7fdab400bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.110+0000 7fdab37fe700 1 -- 172.21.15.135:0/1367166866 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab400e040 con 0x7fdabc102ab0 2024-05-08T23:15:30.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.110+0000 7fdab37fe700 1 -- 172.21.15.135:0/1367166866 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdab4004e40 con 0x7fdabc102ab0 2024-05-08T23:15:30.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.110+0000 7fdac43bb700 1 -- 172.21.15.135:0/1367166866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdabc19efb0 con 0x7fdabc102ab0 2024-05-08T23:15:30.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.110+0000 7fdab37fe700 1 -- 172.21.15.135:0/1367166866 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab401b810 con 0x7fdabc102ab0 2024-05-08T23:15:30.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.110+0000 7fdac43bb700 1 -- 172.21.15.135:0/1367166866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdabc19f3d0 con 0x7fdabc102ab0 2024-05-08T23:15:30.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.112+0000 7fdab37fe700 1 -- 172.21.15.135:0/1367166866 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fdab401b970 con 0x7fdabc102ab0 2024-05-08T23:15:30.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.113+0000 7fdab37fe700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdaa80a11b0 0x7fdaa80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.113+0000 7fdac2157700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdaa80a11b0 0x7fdaa80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.113+0000 7fdab37fe700 1 -- 172.21.15.135:0/1367166866 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fdab40ce290 con 0x7fdabc102ab0 2024-05-08T23:15:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.113+0000 7fdac2157700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdaa80a11b0 0x7fdaa80a3670 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdabc100c40 tx=0x7fdaac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.113+0000 7fdad0575b80 1 Processor -- start 2024-05-08T23:15:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdad0575b80 1 -- start start 2024-05-08T23:15:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdad0575b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f6e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdad0575b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f6f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdad0575b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 0x55a2f6f6fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdad0575b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6ec5100 con 0x55a2f6f6ee50 2024-05-08T23:15:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdad0575b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6ec2ac0 con 0x55a2f6f6f810 2024-05-08T23:15:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdad0575b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6ebe3b0 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdac1956700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f6f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdac1956700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f6f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49026/0 (socket says 172.21.15.135:49026) 2024-05-08T23:15:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdac1956700 1 -- 172.21.15.135:0/4244288703 learned_addr learned my addr 172.21.15.135:0/4244288703 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdac2157700 1 --2- 172.21.15.135:0/4244288703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f6e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdac2958700 1 --2- 172.21.15.135:0/4244288703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 0x55a2f6f6fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdac1956700 1 -- 172.21.15.135:0/4244288703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6e4f0 msgr2=0x55a2f6f6e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdac1956700 1 --2- 172.21.15.135:0/4244288703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f6e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdac1956700 1 -- 172.21.15.135:0/4244288703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 msgr2=0x55a2f6f6fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdac1956700 1 --2- 172.21.15.135:0/4244288703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 0x55a2f6f6fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdac1956700 1 -- 172.21.15.135:0/4244288703 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2f6d3f360 con 0x55a2f6f6ee50 2024-05-08T23:15:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdac1956700 1 --2- 172.21.15.135:0/4244288703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f6f2d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdab800bca0 tx=0x7fdab800d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836ae13e2e2a2844 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdab0da4700 1 -- 172.21.15.135:0/4244288703 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab800ddd0 con 0x55a2f6f6ee50 2024-05-08T23:15:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdab0da4700 1 -- 172.21.15.135:0/4244288703 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdab80178e0 con 0x55a2f6f6ee50 2024-05-08T23:15:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.114+0000 7fdab0da4700 1 -- 172.21.15.135:0/4244288703 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab800fa70 con 0x55a2f6f6ee50 2024-05-08T23:15:30.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.115+0000 7fdad0575b80 1 -- 172.21.15.135:0/4244288703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6ee50 msgr2=0x55a2f6f6f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.115+0000 7fdad0575b80 1 --2- 172.21.15.135:0/4244288703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f6f2d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdab800bca0 tx=0x7fdab800d340 comp rx=0 tx=0).stop 2024-05-08T23:15:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.115+0000 7fdad0575b80 1 -- 172.21.15.135:0/4244288703 shutdown_connections 2024-05-08T23:15:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.115+0000 7fdad0575b80 1 --2- 172.21.15.135:0/4244288703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f6e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.115+0000 7fdad0575b80 1 --2- 172.21.15.135:0/4244288703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 0x55a2f6f6fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.115+0000 7fdad0575b80 1 --2- 172.21.15.135:0/4244288703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f6f2d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.115+0000 7fdad0575b80 1 -- 172.21.15.135:0/4244288703 >> 172.21.15.135:0/4244288703 conn(0x55a2f6ecc1c0 msgr2=0x55a2f6f68d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.115+0000 7fdad0575b80 1 -- 172.21.15.135:0/4244288703 shutdown_connections 2024-05-08T23:15:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.115+0000 7fdad0575b80 1 -- 172.21.15.135:0/4244288703 wait complete. 2024-05-08T23:15:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdad0575b80 1 -- start start 2024-05-08T23:15:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdad0575b80 1 Processor -- start 2024-05-08T23:15:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdad0575b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f77d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdad0575b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f782c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdad0575b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 0x55a2f6f7f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdad0575b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6e5a510 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdad0575b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6e5a1b0 con 0x55a2f6f6f810 2024-05-08T23:15:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdad0575b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6d41650 con 0x55a2f6f6ee50 2024-05-08T23:15:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdad0575b80 10 client.0 _ll_register_callbacks cb 0x55a2f6e63ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdac2157700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f77d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdac2157700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f77d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49032/0 (socket says 172.21.15.135:49032) 2024-05-08T23:15:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdac2157700 1 -- 172.21.15.135:0/1400671996 learned_addr learned my addr 172.21.15.135:0/1400671996 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdac2958700 1 --2- 172.21.15.135:0/1400671996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 0x55a2f6f7f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdac2157700 1 -- 172.21.15.135:0/1400671996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6ee50 msgr2=0x55a2f6f782c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdac2157700 1 --2- 172.21.15.135:0/1400671996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f782c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdac2157700 1 -- 172.21.15.135:0/1400671996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 msgr2=0x55a2f6f7f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdac2157700 1 --2- 172.21.15.135:0/1400671996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 0x55a2f6f7f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdac2157700 1 -- 172.21.15.135:0/1400671996 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab800b8d0 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdac2958700 1 --2- 172.21.15.135:0/1400671996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 0x55a2f6f7f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdac2157700 1 --2- 172.21.15.135:0/1400671996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f77d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0126d0 tx=0x7fdaac0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641f70ce07d1b47e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdaa5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.116+0000 7fdaa5ffb700 1 -- 172.21.15.135:0/1400671996 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac010ee0 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.117+0000 7fdaa5ffb700 1 -- 172.21.15.135:0/1400671996 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fdaac020840 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.117+0000 7fdad0575b80 1 -- 172.21.15.135:0/1400671996 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2f6e17220 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.117+0000 7fdaa5ffb700 1 -- 172.21.15.135:0/1400671996 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdaac010b50 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.117+0000 7fdad0575b80 10 client.15255 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.117+0000 7fdad0575b80 1 -- 172.21.15.135:0/1400671996 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a2f6cebb10 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.117+0000 7fdaa5ffb700 1 -- 172.21.15.135:0/1400671996 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a2f6e17220 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.117+0000 7fdaa5ffb700 1 -- 172.21.15.135:0/1400671996 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdaac032050 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.117+0000 7fdad0575b80 10 client.15255 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.117+0000 7fdad0575b80 10 client.15255 resolve_mds: resolved name 'l' to daemon mds.l 2024-05-08T23:15:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.117+0000 7fdad0575b80 20 client.15255 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.117+0000 7fdad0575b80 1 --2- 172.21.15.135:0/1400671996 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55a2f6f82a20 0x55a2f6f88350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.117+0000 7fdad0575b80 4 client.15255 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:15:30.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.117+0000 7fdad0575b80 1 -- 172.21.15.135:0/1400671996 --> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a2f6f3d7c0 con 0x55a2f6f82a20 2024-05-08T23:15:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.117+0000 7fdac1956700 1 --2- 172.21.15.135:0/1400671996 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55a2f6f82a20 0x55a2f6f88350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.118+0000 7fdaa5ffb700 10 client.15255 ms_handle_connect on v2:172.21.15.195:6832/2264761272 2024-05-08T23:15:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.118+0000 7fdac1956700 1 --2- 172.21.15.135:0/1400671996 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55a2f6f82a20 0x55a2f6f88350 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ae102fb6991aedfd server_cookie=dd591b1b94a49da2 in_seq=0 out_seq=0 2024-05-08T23:15:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.118+0000 7fdaa5ffb700 1 -- 172.21.15.135:0/1400671996 <== mds.3 v2:172.21.15.195:6832/2264761272 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a2f6f3d7c0 con 0x55a2f6f82a20 2024-05-08T23:15:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.118+0000 7fdaa5ffb700 10 client.15255 handle_command_reply: tid=0 2024-05-08T23:15:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.118+0000 7fdad0575b80 1 client.15255 shutdown 2024-05-08T23:15:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.119+0000 7fdad0575b80 1 -- 172.21.15.135:0/1400671996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6e4f0 msgr2=0x55a2f6f77d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.119+0000 7fdad0575b80 1 --2- 172.21.15.135:0/1400671996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f77d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0126d0 tx=0x7fdaac0047c0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.119+0000 7fdad0575b80 1 -- 172.21.15.135:0/1400671996 shutdown_connections 2024-05-08T23:15:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.119+0000 7fdad0575b80 1 --2- 172.21.15.135:0/1400671996 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55a2f6f82a20 0x55a2f6f88350 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.119+0000 7fdad0575b80 1 --2- 172.21.15.135:0/1400671996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 0x55a2f6f7f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.119+0000 7fdad0575b80 1 --2- 172.21.15.135:0/1400671996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f77d80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.119+0000 7fdad0575b80 1 --2- 172.21.15.135:0/1400671996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f782c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.119+0000 7fdaa5ffb700 0 client.15255 ms_handle_reset on v2:172.21.15.195:6832/2264761272 2024-05-08T23:15:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.119+0000 7fdad0575b80 1 -- 172.21.15.135:0/1400671996 >> 172.21.15.135:0/1400671996 conn(0x55a2f6ecc1c0 msgr2=0x55a2f6f68550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.119+0000 7fdad0575b80 1 -- 172.21.15.135:0/1400671996 shutdown_connections 2024-05-08T23:15:30.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.119+0000 7fdad0575b80 1 -- 172.21.15.135:0/1400671996 wait complete. 2024-05-08T23:15:30.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.119+0000 7fdad0575b80 20 client.15255 trim_cache size 0 max 16384 2024-05-08T23:15:30.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.137+0000 7fdad0575b80 1 Processor -- start 2024-05-08T23:15:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.137+0000 7fdad0575b80 1 -- start start 2024-05-08T23:15:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.137+0000 7fdad0575b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.137+0000 7fdad0575b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f72c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.137+0000 7fdad0575b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 0x55a2f6f7f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.137+0000 7fdad0575b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6eb7150 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.137+0000 7fdad0575b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6ebb010 con 0x55a2f6f6f810 2024-05-08T23:15:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.137+0000 7fdad0575b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6e5d5a0 con 0x55a2f6f6ee50 2024-05-08T23:15:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.138+0000 7fdac2157700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.138+0000 7fdac2157700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f726e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49042/0 (socket says 172.21.15.135:49042) 2024-05-08T23:15:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.138+0000 7fdac2157700 1 -- 172.21.15.135:0/630304414 learned_addr learned my addr 172.21.15.135:0/630304414 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.138+0000 7fdac1956700 1 --2- 172.21.15.135:0/630304414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f72c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.138+0000 7fdac2958700 1 --2- 172.21.15.135:0/630304414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 0x55a2f6f7f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.138+0000 7fdac2157700 1 -- 172.21.15.135:0/630304414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6ee50 msgr2=0x55a2f6f72c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.138+0000 7fdac2157700 1 --2- 172.21.15.135:0/630304414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f72c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.138+0000 7fdac2157700 1 -- 172.21.15.135:0/630304414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 msgr2=0x55a2f6f7f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.138+0000 7fdac2157700 1 --2- 172.21.15.135:0/630304414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 0x55a2f6f7f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.138+0000 7fdac2157700 1 -- 172.21.15.135:0/630304414 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2f6e84510 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.138+0000 7fdac2157700 1 --2- 172.21.15.135:0/630304414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f726e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdaac01fdf0 tx=0x7fdaac010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770ed2c70029da6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.138+0000 7fdab15a5700 1 -- 172.21.15.135:0/630304414 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac004830 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.138+0000 7fdab15a5700 1 -- 172.21.15.135:0/630304414 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdaac004e50 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.138+0000 7fdab15a5700 1 -- 172.21.15.135:0/630304414 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac01f690 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 -- 172.21.15.135:0/630304414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6e4f0 msgr2=0x55a2f6f726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 --2- 172.21.15.135:0/630304414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f726e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdaac01fdf0 tx=0x7fdaac010f40 comp rx=0 tx=0).stop 2024-05-08T23:15:30.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 -- 172.21.15.135:0/630304414 shutdown_connections 2024-05-08T23:15:30.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 --2- 172.21.15.135:0/630304414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6f810 0x55a2f6f7f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 --2- 172.21.15.135:0/630304414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f726e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 --2- 172.21.15.135:0/630304414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f72c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 -- 172.21.15.135:0/630304414 >> 172.21.15.135:0/630304414 conn(0x55a2f6ecc1c0 msgr2=0x55a2f6f651c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 -- 172.21.15.135:0/630304414 shutdown_connections 2024-05-08T23:15:30.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 -- 172.21.15.135:0/630304414 wait complete. 2024-05-08T23:15:30.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 -- start start 2024-05-08T23:15:30.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 Processor -- start 2024-05-08T23:15:30.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f79910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f79e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6f810 0x55a2f6f7ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6f7f260 con 0x55a2f6f6f810 2024-05-08T23:15:30.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6f7f3d0 con 0x55a2f6f6e4f0 2024-05-08T23:15:30.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6f7f590 con 0x55a2f6f6ee50 2024-05-08T23:15:30.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.139+0000 7fdad0575b80 10 client.0 _ll_register_callbacks cb 0x55a2f6e63ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:30.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdac2958700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6f810 0x55a2f6f7ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdac2958700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6f810 0x55a2f6f7ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49054/0 (socket says 172.21.15.135:49054) 2024-05-08T23:15:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdac2958700 1 -- 172.21.15.135:0/521724932 learned_addr learned my addr 172.21.15.135:0/521724932 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdac2157700 1 --2- 172.21.15.135:0/521724932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f79910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdac1956700 1 --2- 172.21.15.135:0/521724932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f79e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdac2958700 1 -- 172.21.15.135:0/521724932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6ee50 msgr2=0x55a2f6f79e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdac2958700 1 --2- 172.21.15.135:0/521724932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f79e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdac2958700 1 -- 172.21.15.135:0/521724932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6e4f0 msgr2=0x55a2f6f79910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdac2958700 1 --2- 172.21.15.135:0/521724932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f79910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdac2958700 1 -- 172.21.15.135:0/521724932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a2f6cebb10 con 0x55a2f6f6f810 2024-05-08T23:15:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdac2958700 1 --2- 172.21.15.135:0/521724932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6f810 0x55a2f6f7ecb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdab409b580 tx=0x7fdab400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f88539f406458c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdaa5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdaa5ffb700 1 -- 172.21.15.135:0/521724932 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab409b5f0 con 0x55a2f6f6f810 2024-05-08T23:15:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdaa5ffb700 1 -- 172.21.15.135:0/521724932 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fdab4084e40 con 0x55a2f6f6f810 2024-05-08T23:15:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdad0575b80 1 -- 172.21.15.135:0/521724932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdab80178e0 con 0x55a2f6f6f810 2024-05-08T23:15:30.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdaa5ffb700 1 -- 172.21.15.135:0/521724932 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdab409f420 con 0x55a2f6f6f810 2024-05-08T23:15:30.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdad0575b80 10 client.15261 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:30.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdad0575b80 1 -- 172.21.15.135:0/521724932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a2f6d43c80 con 0x55a2f6f6f810 2024-05-08T23:15:30.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.140+0000 7fdaa5ffb700 1 -- 172.21.15.135:0/521724932 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdab80178e0 con 0x55a2f6f6f810 2024-05-08T23:15:30.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.141+0000 7fdaa5ffb700 1 -- 172.21.15.135:0/521724932 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdab409b850 con 0x55a2f6f6f810 2024-05-08T23:15:30.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.141+0000 7fdad0575b80 10 client.15261 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:30.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.141+0000 7fdad0575b80 10 client.15261 resolve_mds: resolved name 'l' to daemon mds.l 2024-05-08T23:15:30.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.141+0000 7fdad0575b80 20 client.15261 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:30.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.141+0000 7fdad0575b80 1 --2- 172.21.15.135:0/521724932 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55a2f6fde880 0x55a2f6fdb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.141+0000 7fdad0575b80 4 client.15261 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T23:15:30.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.141+0000 7fdad0575b80 1 -- 172.21.15.135:0/521724932 --> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a2f6eb6e70 con 0x55a2f6fde880 2024-05-08T23:15:30.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.141+0000 7fdac2157700 1 --2- 172.21.15.135:0/521724932 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55a2f6fde880 0x55a2f6fdb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.141+0000 7fdaa5ffb700 10 client.15261 ms_handle_connect on v2:172.21.15.195:6832/2264761272 2024-05-08T23:15:30.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.141+0000 7fdac2157700 1 --2- 172.21.15.135:0/521724932 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55a2f6fde880 0x55a2f6fdb210 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b6e0b7075aa08772 server_cookie=ea999f976d166b12 in_seq=0 out_seq=0 2024-05-08T23:15:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdaa5ffb700 1 -- 172.21.15.135:0/521724932 <== mds.3 v2:172.21.15.195:6832/2264761272 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55a2f6eb6e70 con 0x55a2f6fde880 2024-05-08T23:15:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdaa5ffb700 10 client.15261 handle_command_reply: tid=0 2024-05-08T23:15:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdad0575b80 1 client.15261 shutdown 2024-05-08T23:15:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdad0575b80 1 -- 172.21.15.135:0/521724932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6f810 msgr2=0x55a2f6f7ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdad0575b80 1 --2- 172.21.15.135:0/521724932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6f810 0x55a2f6f7ecb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdab409b580 tx=0x7fdab400b3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdad0575b80 1 -- 172.21.15.135:0/521724932 shutdown_connections 2024-05-08T23:15:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdad0575b80 1 --2- 172.21.15.135:0/521724932 >> [v2:172.21.15.195:6832/2264761272,v1:172.21.15.195:6833/2264761272] conn(0x55a2f6fde880 0x55a2f6fdb210 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdad0575b80 1 --2- 172.21.15.135:0/521724932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2f6f6f810 0x55a2f6f7ecb0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdad0575b80 1 --2- 172.21.15.135:0/521724932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2f6f6e4f0 0x55a2f6f79910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdaa5ffb700 0 client.15261 ms_handle_reset on v2:172.21.15.195:6832/2264761272 2024-05-08T23:15:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdad0575b80 1 --2- 172.21.15.135:0/521724932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2f6f6ee50 0x55a2f6f79e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdad0575b80 1 -- 172.21.15.135:0/521724932 >> 172.21.15.135:0/521724932 conn(0x55a2f6ecc1c0 msgr2=0x55a2f6f76f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdad0575b80 1 -- 172.21.15.135:0/521724932 shutdown_connections 2024-05-08T23:15:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdad0575b80 1 -- 172.21.15.135:0/521724932 wait complete. 2024-05-08T23:15:30.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdad0575b80 20 client.15261 trim_cache size 0 max 16384 2024-05-08T23:15:30.150 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:15:30.150 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "c804a50a-0d8f-11ef-bc97-c7b262605968", 2024-05-08T23:15:30.150 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 3, 2024-05-08T23:15:30.150 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24439, 2024-05-08T23:15:30.150 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-08T23:15:30.150 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-08T23:15:30.150 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-08T23:15:30.150 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 63.807944161999998, 2024-05-08T23:15:30.150 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 27, 2024-05-08T23:15:30.151 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 85, 2024-05-08T23:15:30.151 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 83, 2024-05-08T23:15:30.151 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 93.677320795 2024-05-08T23:15:30.151 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:15:30.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdac43bb700 1 -- 172.21.15.135:0/1367166866 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdaa80a11b0 msgr2=0x7fdaa80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdac43bb700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdaa80a11b0 0x7fdaa80a3670 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdabc100c40 tx=0x7fdaac009260 comp rx=0 tx=0).stop 2024-05-08T23:15:30.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdac43bb700 1 -- 172.21.15.135:0/1367166866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdabc102ab0 msgr2=0x7fdabc19e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdac43bb700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdabc102ab0 0x7fdabc19e490 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdab4006070 tx=0x7fdab400bdb0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdac43bb700 1 -- 172.21.15.135:0/1367166866 shutdown_connections 2024-05-08T23:15:30.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdac43bb700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdaa80a11b0 0x7fdaa80a3670 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdac43bb700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdabc102ab0 0x7fdabc19e490 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdac43bb700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdabc100f20 0x7fdabc196f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdac43bb700 1 --2- 172.21.15.135:0/1367166866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdabc1020f0 0x7fdabc197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdac43bb700 1 -- 172.21.15.135:0/1367166866 >> 172.21.15.135:0/1367166866 conn(0x7fdabc0fc4e0 msgr2=0x7fdabc105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdac43bb700 1 -- 172.21.15.135:0/1367166866 shutdown_connections 2024-05-08T23:15:30.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.142+0000 7fdac43bb700 1 -- 172.21.15.135:0/1367166866 wait complete. 2024-05-08T23:15:30.155 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-08T23:15:30.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.279+0000 7fdbcf705700 1 -- 172.21.15.135:0/383449512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc80ff950 msgr2=0x7fdbc8109520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.279+0000 7fdbcf705700 1 --2- 172.21.15.135:0/383449512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc80ff950 0x7fdbc8109520 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000b0d0 tx=0x7fdbc000b3e0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.279+0000 7fdbcf705700 1 -- 172.21.15.135:0/383449512 shutdown_connections 2024-05-08T23:15:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.279+0000 7fdbcf705700 1 --2- 172.21.15.135:0/383449512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbc8102540 0x7fdbc8102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.279+0000 7fdbcf705700 1 --2- 172.21.15.135:0/383449512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc80ff950 0x7fdbc8109520 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.279+0000 7fdbcf705700 1 --2- 172.21.15.135:0/383449512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc80fefb0 0x7fdbc80ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.279+0000 7fdbcf705700 1 -- 172.21.15.135:0/383449512 >> 172.21.15.135:0/383449512 conn(0x7fdbc80fab50 msgr2=0x7fdbc80fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.279+0000 7fdbcf705700 1 -- 172.21.15.135:0/383449512 shutdown_connections 2024-05-08T23:15:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.279+0000 7fdbcf705700 1 -- 172.21.15.135:0/383449512 wait complete. 2024-05-08T23:15:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbcf705700 1 Processor -- start 2024-05-08T23:15:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbcf705700 1 -- start start 2024-05-08T23:15:30.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbcf705700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbc80fefb0 0x7fdbc8199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbcf705700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc80ff950 0x7fdbc81997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbcf705700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc8102540 0x7fdbc81a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbcf705700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc81a0da0 con 0x7fdbc80ff950 2024-05-08T23:15:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbcf705700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc81a0ee0 con 0x7fdbc8102540 2024-05-08T23:15:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbcf705700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc81a1070 con 0x7fdbc80fefb0 2024-05-08T23:15:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbccca0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc80ff950 0x7fdbc81997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbccca0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc80ff950 0x7fdbc81997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49070/0 (socket says 172.21.15.135:49070) 2024-05-08T23:15:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbccca0700 1 -- 172.21.15.135:0/654301636 learned_addr learned my addr 172.21.15.135:0/654301636 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbcdca2700 1 --2- 172.21.15.135:0/654301636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc8102540 0x7fdbc81a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbcd4a1700 1 --2- 172.21.15.135:0/654301636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbc80fefb0 0x7fdbc8199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbccca0700 1 -- 172.21.15.135:0/654301636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbc80fefb0 msgr2=0x7fdbc8199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbccca0700 1 --2- 172.21.15.135:0/654301636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbc80fefb0 0x7fdbc8199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbccca0700 1 -- 172.21.15.135:0/654301636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc8102540 msgr2=0x7fdbc81a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbccca0700 1 --2- 172.21.15.135:0/654301636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc8102540 0x7fdbc81a07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbccca0700 1 -- 172.21.15.135:0/654301636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc0009d00 con 0x7fdbc80ff950 2024-05-08T23:15:30.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbcd4a1700 1 --2- 172.21.15.135:0/654301636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbc80fefb0 0x7fdbc8199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:30.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbccca0700 1 --2- 172.21.15.135:0/654301636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc80ff950 0x7fdbc81997b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400d950 tx=0x7fdbc400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.280+0000 7fdbba7fc700 1 -- 172.21.15.135:0/654301636 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4009940 con 0x7fdbc80ff950 2024-05-08T23:15:30.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.281+0000 7fdbba7fc700 1 -- 172.21.15.135:0/654301636 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbc4010460 con 0x7fdbc80ff950 2024-05-08T23:15:30.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.281+0000 7fdbcf705700 1 -- 172.21.15.135:0/654301636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc81a1350 con 0x7fdbc80ff950 2024-05-08T23:15:30.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.281+0000 7fdbba7fc700 1 -- 172.21.15.135:0/654301636 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400f620 con 0x7fdbc80ff950 2024-05-08T23:15:30.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.281+0000 7fdbcf705700 1 -- 172.21.15.135:0/654301636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc81a1860 con 0x7fdbc80ff950 2024-05-08T23:15:30.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.283+0000 7fdbba7fc700 1 -- 172.21.15.135:0/654301636 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fdbc40108d0 con 0x7fdbc80ff950 2024-05-08T23:15:30.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.283+0000 7fdbba7fc700 1 --2- 172.21.15.135:0/654301636 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdbb40a11b0 0x7fdbb40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.283+0000 7fdbcd4a1700 1 --2- 172.21.15.135:0/654301636 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdbb40a11b0 0x7fdbb40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.283+0000 7fdbba7fc700 1 -- 172.21.15.135:0/654301636 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fdbc40cc930 con 0x7fdbc80ff950 2024-05-08T23:15:30.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.284+0000 7fdbcd4a1700 1 --2- 172.21.15.135:0/654301636 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdbb40a11b0 0x7fdbb40a3670 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8067d10 tx=0x7fdbbc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.284+0000 7fdbdb8bfb80 1 Processor -- start 2024-05-08T23:15:30.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.284+0000 7fdbdb8bfb80 1 -- start start 2024-05-08T23:15:30.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.284+0000 7fdbdb8bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee29994f0 0x557ee2999910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.284+0000 7fdbdb8bfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee299a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.284+0000 7fdbdb8bfb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee299a810 0x557ee299ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.284+0000 7fdbdb8bfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ee28f0100 con 0x557ee2999e50 2024-05-08T23:15:30.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.284+0000 7fdbdb8bfb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ee28edac0 con 0x557ee299a810 2024-05-08T23:15:30.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.284+0000 7fdbdb8bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ee28e93b0 con 0x557ee29994f0 2024-05-08T23:15:30.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.285+0000 7fdbccca0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee299a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.285+0000 7fdbccca0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee299a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49076/0 (socket says 172.21.15.135:49076) 2024-05-08T23:15:30.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.285+0000 7fdbccca0700 1 -- 172.21.15.135:0/1335163439 learned_addr learned my addr 172.21.15.135:0/1335163439 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.285+0000 7fdbcd4a1700 1 --2- 172.21.15.135:0/1335163439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee29994f0 0x557ee2999910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.285+0000 7fdbcdca2700 1 --2- 172.21.15.135:0/1335163439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee299a810 0x557ee299ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.285+0000 7fdbccca0700 1 -- 172.21.15.135:0/1335163439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee29994f0 msgr2=0x557ee2999910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.285+0000 7fdbccca0700 1 --2- 172.21.15.135:0/1335163439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee29994f0 0x557ee2999910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.285+0000 7fdbccca0700 1 -- 172.21.15.135:0/1335163439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee299a810 msgr2=0x557ee299ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.285+0000 7fdbccca0700 1 --2- 172.21.15.135:0/1335163439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee299a810 0x557ee299ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.285+0000 7fdbccca0700 1 -- 172.21.15.135:0/1335163439 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ee276a360 con 0x557ee2999e50 2024-05-08T23:15:30.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.285+0000 7fdbcdca2700 1 --2- 172.21.15.135:0/1335163439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee299a810 0x557ee299ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:30.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.285+0000 7fdbccca0700 1 --2- 172.21.15.135:0/1335163439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee299a2d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4096670 tx=0x7fdbc4099660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2233aa00566282 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.285+0000 7fdbb37fe700 1 -- 172.21.15.135:0/1335163439 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40a2080 con 0x557ee2999e50 2024-05-08T23:15:30.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.285+0000 7fdbb37fe700 1 -- 172.21.15.135:0/1335163439 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbc40ca510 con 0x557ee2999e50 2024-05-08T23:15:30.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.285+0000 7fdbb37fe700 1 -- 172.21.15.135:0/1335163439 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40a1bf0 con 0x557ee2999e50 2024-05-08T23:15:30.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.286+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/1335163439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 msgr2=0x557ee299a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.286+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/1335163439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee299a2d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4096670 tx=0x7fdbc4099660 comp rx=0 tx=0).stop 2024-05-08T23:15:30.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.286+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/1335163439 shutdown_connections 2024-05-08T23:15:30.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.286+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/1335163439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee29994f0 0x557ee2999910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.286+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/1335163439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee299a810 0x557ee299ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.286+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/1335163439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee299a2d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.286+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/1335163439 >> 172.21.15.135:0/1335163439 conn(0x557ee28f71c0 msgr2=0x557ee2993d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.286+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/1335163439 shutdown_connections 2024-05-08T23:15:30.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.286+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/1335163439 wait complete. 2024-05-08T23:15:30.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.286+0000 7fdbdb8bfb80 1 -- start start 2024-05-08T23:15:30.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.286+0000 7fdbdb8bfb80 1 Processor -- start 2024-05-08T23:15:30.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbdb8bfb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee29994f0 0x557ee29a2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbdb8bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee2999e50 0x557ee29a3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbdb8bfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee299a810 0x557ee29aa380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbdb8bfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ee2885510 con 0x557ee299a810 2024-05-08T23:15:30.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbdb8bfb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ee28851b0 con 0x557ee29994f0 2024-05-08T23:15:30.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbdb8bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ee276c650 con 0x557ee2999e50 2024-05-08T23:15:30.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbdb8bfb80 10 client.0 _ll_register_callbacks cb 0x557ee288eae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:30.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbcdca2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee299a810 0x557ee29aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbcdca2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee299a810 0x557ee29aa380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49080/0 (socket says 172.21.15.135:49080) 2024-05-08T23:15:30.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbcdca2700 1 -- 172.21.15.135:0/2045629303 learned_addr learned my addr 172.21.15.135:0/2045629303 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbccca0700 1 --2- 172.21.15.135:0/2045629303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee2999e50 0x557ee29a3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbcd4a1700 1 --2- 172.21.15.135:0/2045629303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee29994f0 0x557ee29a2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbcdca2700 1 -- 172.21.15.135:0/2045629303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee2999e50 msgr2=0x557ee29a3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbcdca2700 1 --2- 172.21.15.135:0/2045629303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee2999e50 0x557ee29a3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbcdca2700 1 -- 172.21.15.135:0/2045629303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee29994f0 msgr2=0x557ee29a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbcdca2700 1 --2- 172.21.15.135:0/2045629303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee29994f0 0x557ee29a2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbcdca2700 1 -- 172.21.15.135:0/2045629303 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc81a1860 con 0x557ee299a810 2024-05-08T23:15:30.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbcdca2700 1 --2- 172.21.15.135:0/2045629303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee299a810 0x557ee29aa380 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000b0d0 tx=0x7fdbc00093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d418789bd4e949e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbb0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:30.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbb0ff9700 1 -- 172.21.15.135:0/2045629303 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000e030 con 0x557ee299a810 2024-05-08T23:15:30.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbb0ff9700 1 -- 172.21.15.135:0/2045629303 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fdbc0005040 con 0x557ee299a810 2024-05-08T23:15:30.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/2045629303 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ee2842220 con 0x557ee299a810 2024-05-08T23:15:30.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbb0ff9700 1 -- 172.21.15.135:0/2045629303 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbc0003e90 con 0x557ee299a810 2024-05-08T23:15:30.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbdb8bfb80 10 client.15273 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:30.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.287+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/2045629303 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557ee2716b10 con 0x557ee299a810 2024-05-08T23:15:30.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.288+0000 7fdbb0ff9700 1 -- 172.21.15.135:0/2045629303 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557ee2842220 con 0x557ee299a810 2024-05-08T23:15:30.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.288+0000 7fdbb0ff9700 1 -- 172.21.15.135:0/2045629303 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdbc0023020 con 0x557ee299a810 2024-05-08T23:15:30.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.288+0000 7fdbdb8bfb80 10 client.15273 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:30.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.288+0000 7fdbdb8bfb80 10 client.15273 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T23:15:30.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.288+0000 7fdbdb8bfb80 20 client.15273 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:30.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.288+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/2045629303 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x557ee29ae010 0x557ee29b3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.288+0000 7fdbdb8bfb80 4 client.15273 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:15:30.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.288+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/2045629303 --> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ee29687c0 con 0x557ee29ae010 2024-05-08T23:15:30.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.288+0000 7fdbcd4a1700 1 --2- 172.21.15.135:0/2045629303 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x557ee29ae010 0x557ee29b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.288+0000 7fdbb0ff9700 10 client.15273 ms_handle_connect on v2:172.21.15.195:6836/2390721751 2024-05-08T23:15:30.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.288+0000 7fdbcd4a1700 1 --2- 172.21.15.135:0/2045629303 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x557ee29ae010 0x557ee29b3310 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba5f744e381e968e server_cookie=87d931c0e9407bae in_seq=0 out_seq=0 2024-05-08T23:15:30.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.289+0000 7fdbb0ff9700 1 -- 172.21.15.135:0/2045629303 <== mds.2 v2:172.21.15.195:6836/2390721751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557ee29687c0 con 0x557ee29ae010 2024-05-08T23:15:30.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.289+0000 7fdbb0ff9700 10 client.15273 handle_command_reply: tid=0 2024-05-08T23:15:30.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.289+0000 7fdbdb8bfb80 1 client.15273 shutdown 2024-05-08T23:15:30.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.289+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/2045629303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee299a810 msgr2=0x557ee29aa380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.289+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/2045629303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee299a810 0x557ee29aa380 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000b0d0 tx=0x7fdbc00093f0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.289+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/2045629303 shutdown_connections 2024-05-08T23:15:30.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.289+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/2045629303 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x557ee29ae010 0x557ee29b3310 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.289+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/2045629303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee299a810 0x557ee29aa380 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.289+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/2045629303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee29994f0 0x557ee29a2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.289+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/2045629303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee2999e50 0x557ee29a3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.289+0000 7fdbb0ff9700 0 client.15273 ms_handle_reset on v2:172.21.15.195:6836/2390721751 2024-05-08T23:15:30.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.289+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/2045629303 >> 172.21.15.135:0/2045629303 conn(0x557ee28f71c0 msgr2=0x557ee2993550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.289+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/2045629303 shutdown_connections 2024-05-08T23:15:30.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.289+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/2045629303 wait complete. 2024-05-08T23:15:30.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.290+0000 7fdbdb8bfb80 20 client.15273 trim_cache size 0 max 16384 2024-05-08T23:15:30.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.307+0000 7fdbdb8bfb80 1 Processor -- start 2024-05-08T23:15:30.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.307+0000 7fdbdb8bfb80 1 -- start start 2024-05-08T23:15:30.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.307+0000 7fdbdb8bfb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee29994f0 0x557ee29aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.307+0000 7fdbdb8bfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee29aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.307+0000 7fdbdb8bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee299a810 0x557ee29a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.307+0000 7fdbdb8bfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ee29ac110 con 0x557ee2999e50 2024-05-08T23:15:30.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.307+0000 7fdbdb8bfb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ee28e2150 con 0x557ee29994f0 2024-05-08T23:15:30.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.307+0000 7fdbdb8bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ee28885a0 con 0x557ee299a810 2024-05-08T23:15:30.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.308+0000 7fdbccca0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee29aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.308+0000 7fdbccca0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee29aa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49088/0 (socket says 172.21.15.135:49088) 2024-05-08T23:15:30.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.308+0000 7fdbccca0700 1 -- 172.21.15.135:0/431684755 learned_addr learned my addr 172.21.15.135:0/431684755 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.308+0000 7fdbccca0700 1 -- 172.21.15.135:0/431684755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee299a810 msgr2=0x557ee29a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.308+0000 7fdbcd4a1700 1 --2- 172.21.15.135:0/431684755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee29994f0 0x557ee29aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.308+0000 7fdbcdca2700 1 --2- 172.21.15.135:0/431684755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee299a810 0x557ee29a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.308+0000 7fdbccca0700 1 --2- 172.21.15.135:0/431684755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee299a810 0x557ee29a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.308+0000 7fdbccca0700 1 -- 172.21.15.135:0/431684755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee29994f0 msgr2=0x557ee29aaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.308+0000 7fdbccca0700 1 --2- 172.21.15.135:0/431684755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee29994f0 0x557ee29aaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.308+0000 7fdbccca0700 1 -- 172.21.15.135:0/431684755 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ee28af510 con 0x557ee2999e50 2024-05-08T23:15:30.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.308+0000 7fdbcd4a1700 1 --2- 172.21.15.135:0/431684755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee29994f0 0x557ee29aaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:30.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.308+0000 7fdbccca0700 1 --2- 172.21.15.135:0/431684755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee29aa2a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4097f50 tx=0x7fdbc4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09b138da7d875de server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.308+0000 7fdbb3fff700 1 -- 172.21.15.135:0/431684755 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40a2080 con 0x557ee2999e50 2024-05-08T23:15:30.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.308+0000 7fdbb3fff700 1 -- 172.21.15.135:0/431684755 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbc4099e60 con 0x557ee2999e50 2024-05-08T23:15:30.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.308+0000 7fdbb3fff700 1 -- 172.21.15.135:0/431684755 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40959f0 con 0x557ee2999e50 2024-05-08T23:15:30.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/431684755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 msgr2=0x557ee29aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/431684755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee29aa2a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4097f50 tx=0x7fdbc4000bc0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/431684755 shutdown_connections 2024-05-08T23:15:30.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/431684755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee299a810 0x557ee29a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/431684755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee29994f0 0x557ee29aaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/431684755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee29aa2a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/431684755 >> 172.21.15.135:0/431684755 conn(0x557ee28f71c0 msgr2=0x557ee29901c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/431684755 shutdown_connections 2024-05-08T23:15:30.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/431684755 wait complete. 2024-05-08T23:15:30.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 -- start start 2024-05-08T23:15:30.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 Processor -- start 2024-05-08T23:15:30.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee29994f0 0x557ee29a72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee29a9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee299a810 0x557ee29a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ee29aa2a0 con 0x557ee2999e50 2024-05-08T23:15:30.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ee29aa410 con 0x557ee299a810 2024-05-08T23:15:30.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ee29aa5d0 con 0x557ee29994f0 2024-05-08T23:15:30.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbdb8bfb80 10 client.0 _ll_register_callbacks cb 0x557ee288eae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:30.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbccca0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee29a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.309+0000 7fdbccca0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee29a9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49100/0 (socket says 172.21.15.135:49100) 2024-05-08T23:15:30.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbccca0700 1 -- 172.21.15.135:0/3886912054 learned_addr learned my addr 172.21.15.135:0/3886912054 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbcdca2700 1 --2- 172.21.15.135:0/3886912054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee299a810 0x557ee29a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbcd4a1700 1 --2- 172.21.15.135:0/3886912054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee29994f0 0x557ee29a72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbccca0700 1 -- 172.21.15.135:0/3886912054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee29994f0 msgr2=0x557ee29a72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbccca0700 1 --2- 172.21.15.135:0/3886912054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee29994f0 0x557ee29a72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbccca0700 1 -- 172.21.15.135:0/3886912054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee299a810 msgr2=0x557ee29a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbccca0700 1 --2- 172.21.15.135:0/3886912054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee299a810 0x557ee29a9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbccca0700 1 -- 172.21.15.135:0/3886912054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ee276a360 con 0x557ee2999e50 2024-05-08T23:15:30.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbccca0700 1 --2- 172.21.15.135:0/3886912054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee29a9820 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40ca840 tx=0x7fdbc409dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ee238a0108a691 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbb0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:30.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbb0ff9700 1 -- 172.21.15.135:0/3886912054 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40a1e60 con 0x557ee2999e50 2024-05-08T23:15:30.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbb0ff9700 1 -- 172.21.15.135:0/3886912054 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fdbc40a2080 con 0x557ee2999e50 2024-05-08T23:15:30.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/3886912054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdbc40ca510 con 0x557ee2999e50 2024-05-08T23:15:30.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbb0ff9700 1 -- 172.21.15.135:0/3886912054 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbc40b2290 con 0x557ee2999e50 2024-05-08T23:15:30.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbdb8bfb80 10 client.15279 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:30.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/3886912054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557ee276ec80 con 0x557ee2999e50 2024-05-08T23:15:30.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.310+0000 7fdbb0ff9700 1 -- 172.21.15.135:0/3886912054 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbc40ca510 con 0x557ee2999e50 2024-05-08T23:15:30.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.311+0000 7fdbb0ff9700 1 -- 172.21.15.135:0/3886912054 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdbc4098b60 con 0x557ee2999e50 2024-05-08T23:15:30.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.311+0000 7fdbdb8bfb80 10 client.15279 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:30.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.311+0000 7fdbdb8bfb80 10 client.15279 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T23:15:30.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.311+0000 7fdbdb8bfb80 20 client.15279 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:30.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.311+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/3886912054 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x557ee2a094a0 0x557ee2a05f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.311+0000 7fdbdb8bfb80 4 client.15279 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T23:15:30.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.311+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/3886912054 --> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557ee28e1e70 con 0x557ee2a094a0 2024-05-08T23:15:30.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.311+0000 7fdbcd4a1700 1 --2- 172.21.15.135:0/3886912054 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x557ee2a094a0 0x557ee2a05f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.311+0000 7fdbcd4a1700 1 --2- 172.21.15.135:0/3886912054 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x557ee2a094a0 0x557ee2a05f00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=40dd8f4fa062649d server_cookie=7ea88ad85bc6b63f in_seq=0 out_seq=0 2024-05-08T23:15:30.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.311+0000 7fdbb0ff9700 10 client.15279 ms_handle_connect on v2:172.21.15.195:6836/2390721751 2024-05-08T23:15:30.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.311+0000 7fdbb0ff9700 1 -- 172.21.15.135:0/3886912054 <== mds.2 v2:172.21.15.195:6836/2390721751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x557ee28e1e70 con 0x557ee2a094a0 2024-05-08T23:15:30.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.311+0000 7fdbb0ff9700 10 client.15279 handle_command_reply: tid=0 2024-05-08T23:15:30.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.311+0000 7fdbdb8bfb80 1 client.15279 shutdown 2024-05-08T23:15:30.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/3886912054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 msgr2=0x557ee29a9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/3886912054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee29a9820 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40ca840 tx=0x7fdbc409dbb0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/3886912054 shutdown_connections 2024-05-08T23:15:30.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/3886912054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ee29994f0 0x557ee29a72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/3886912054 >> [v2:172.21.15.195:6836/2390721751,v1:172.21.15.195:6837/2390721751] conn(0x557ee2a094a0 0x557ee2a05f00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/3886912054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ee299a810 0x557ee29a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbb0ff9700 0 client.15279 ms_handle_reset on v2:172.21.15.195:6836/2390721751 2024-05-08T23:15:30.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbdb8bfb80 1 --2- 172.21.15.135:0/3886912054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ee2999e50 0x557ee29a9820 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/3886912054 >> 172.21.15.135:0/3886912054 conn(0x557ee28f71c0 msgr2=0x557ee29a2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/3886912054 shutdown_connections 2024-05-08T23:15:30.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbdb8bfb80 1 -- 172.21.15.135:0/3886912054 wait complete. 2024-05-08T23:15:30.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbdb8bfb80 20 client.15279 trim_cache size 0 max 16384 2024-05-08T23:15:30.319 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:15:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "c804a50a-0d8f-11ef-bc97-c7b262605968", 2024-05-08T23:15:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 2, 2024-05-08T23:15:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24484, 2024-05-08T23:15:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-08T23:15:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-08T23:15:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-08T23:15:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 64.361389990000006, 2024-05-08T23:15:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 27, 2024-05-08T23:15:30.319 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 85, 2024-05-08T23:15:30.320 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 83, 2024-05-08T23:15:30.320 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 82.774037652000004 2024-05-08T23:15:30.320 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:15:30.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbcf705700 1 -- 172.21.15.135:0/654301636 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdbb40a11b0 msgr2=0x7fdbb40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbcf705700 1 --2- 172.21.15.135:0/654301636 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdbb40a11b0 0x7fdbb40a3670 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8067d10 tx=0x7fdbbc008040 comp rx=0 tx=0).stop 2024-05-08T23:15:30.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbcf705700 1 -- 172.21.15.135:0/654301636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc80ff950 msgr2=0x7fdbc81997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbcf705700 1 --2- 172.21.15.135:0/654301636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc80ff950 0x7fdbc81997b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400d950 tx=0x7fdbc400dc60 comp rx=0 tx=0).stop 2024-05-08T23:15:30.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbcf705700 1 -- 172.21.15.135:0/654301636 shutdown_connections 2024-05-08T23:15:30.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbcf705700 1 --2- 172.21.15.135:0/654301636 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdbb40a11b0 0x7fdbb40a3670 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbcf705700 1 --2- 172.21.15.135:0/654301636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbc80fefb0 0x7fdbc8199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbcf705700 1 --2- 172.21.15.135:0/654301636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc8102540 0x7fdbc81a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbcf705700 1 --2- 172.21.15.135:0/654301636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc80ff950 0x7fdbc81997b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbcf705700 1 -- 172.21.15.135:0/654301636 >> 172.21.15.135:0/654301636 conn(0x7fdbc80fab50 msgr2=0x7fdbc81000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbcf705700 1 -- 172.21.15.135:0/654301636 shutdown_connections 2024-05-08T23:15:30.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.312+0000 7fdbcf705700 1 -- 172.21.15.135:0/654301636 wait complete. 2024-05-08T23:15:30.325 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-08T23:15:30.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.449+0000 7f3162997700 1 -- 172.21.15.135:0/1665316540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315c106c40 msgr2=0x7f315c1090b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.449+0000 7f3162997700 1 --2- 172.21.15.135:0/1665316540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315c106c40 0x7f315c1090b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f315400b0a0 tx=0x7f315400b3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.449+0000 7f3162997700 1 -- 172.21.15.135:0/1665316540 shutdown_connections 2024-05-08T23:15:30.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.449+0000 7f3162997700 1 --2- 172.21.15.135:0/1665316540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315c106c40 0x7f315c1090b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.449+0000 7f3162997700 1 --2- 172.21.15.135:0/1665316540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f315c1019e0 0x7f315c103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.449+0000 7f3162997700 1 --2- 172.21.15.135:0/1665316540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f315c104310 0x7f315c106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.449+0000 7f3162997700 1 -- 172.21.15.135:0/1665316540 >> 172.21.15.135:0/1665316540 conn(0x7f315c0fb3f0 msgr2=0x7f315c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.449+0000 7f3162997700 1 -- 172.21.15.135:0/1665316540 shutdown_connections 2024-05-08T23:15:30.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.449+0000 7f3162997700 1 -- 172.21.15.135:0/1665316540 wait complete. 2024-05-08T23:15:30.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.450+0000 7f3162997700 1 Processor -- start 2024-05-08T23:15:30.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.450+0000 7f3162997700 1 -- start start 2024-05-08T23:15:30.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.450+0000 7f3162997700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315c1019e0 0x7f315c196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.450+0000 7f3162997700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f315c104310 0x7f315c197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.450+0000 7f3162997700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f315c106c40 0x7f315c19e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.450+0000 7f3162997700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c19eab0 con 0x7f315c1019e0 2024-05-08T23:15:30.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.450+0000 7f3162997700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c19ebf0 con 0x7f315c104310 2024-05-08T23:15:30.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.450+0000 7f3162997700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c19ed80 con 0x7f315c106c40 2024-05-08T23:15:30.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.450+0000 7f315bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315c1019e0 0x7f315c196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.450+0000 7f315bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315c1019e0 0x7f315c196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49120/0 (socket says 172.21.15.135:49120) 2024-05-08T23:15:30.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.450+0000 7f315bfff700 1 -- 172.21.15.135:0/493461704 learned_addr learned my addr 172.21.15.135:0/493461704 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.450+0000 7f315b7fe700 1 --2- 172.21.15.135:0/493461704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f315c104310 0x7f315c197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.451+0000 7f315bfff700 1 -- 172.21.15.135:0/493461704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f315c106c40 msgr2=0x7f315c19e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.451+0000 7f315bfff700 1 --2- 172.21.15.135:0/493461704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f315c106c40 0x7f315c19e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.451+0000 7f315bfff700 1 -- 172.21.15.135:0/493461704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f315c104310 msgr2=0x7f315c197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.451+0000 7f315bfff700 1 --2- 172.21.15.135:0/493461704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f315c104310 0x7f315c197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.451+0000 7f315bfff700 1 -- 172.21.15.135:0/493461704 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3154009d00 con 0x7f315c1019e0 2024-05-08T23:15:30.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.451+0000 7f315b7fe700 1 --2- 172.21.15.135:0/493461704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f315c104310 0x7f315c197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:30.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.451+0000 7f315bfff700 1 --2- 172.21.15.135:0/493461704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315c1019e0 0x7f315c196fd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f314c00d950 tx=0x7f314c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.451+0000 7f31597fa700 1 -- 172.21.15.135:0/493461704 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c009b40 con 0x7f315c1019e0 2024-05-08T23:15:30.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.451+0000 7f31597fa700 1 -- 172.21.15.135:0/493461704 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f314c009ca0 con 0x7f315c1019e0 2024-05-08T23:15:30.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.451+0000 7f3162997700 1 -- 172.21.15.135:0/493461704 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c19f060 con 0x7f315c1019e0 2024-05-08T23:15:30.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.451+0000 7f31597fa700 1 -- 172.21.15.135:0/493461704 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c00f620 con 0x7f315c1019e0 2024-05-08T23:15:30.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.451+0000 7f3162997700 1 -- 172.21.15.135:0/493461704 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c19f5c0 con 0x7f315c1019e0 2024-05-08T23:15:30.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:30 smithi135 ceph-mon[42440]: pgmap v259: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s; 97 B/s, 1 objects/s recovering 2024-05-08T23:15:30.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:30 smithi135 ceph-mon[42440]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-08T23:15:30.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:30 smithi135 ceph-mon[42440]: Cluster is now healthy 2024-05-08T23:15:30.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:30 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/96431115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:15:30.456 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:30 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1186387479' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:30.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.453+0000 7f31597fa700 1 -- 172.21.15.135:0/493461704 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f314c010460 con 0x7f315c1019e0 2024-05-08T23:15:30.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.454+0000 7f31597fa700 1 --2- 172.21.15.135:0/493461704 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f31440a1230 0x7f31440a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.454+0000 7f315b7fe700 1 --2- 172.21.15.135:0/493461704 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f31440a1230 0x7f31440a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.454+0000 7f31597fa700 1 -- 172.21.15.135:0/493461704 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f314c0ccdd0 con 0x7f315c1019e0 2024-05-08T23:15:30.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.454+0000 7f315b7fe700 1 --2- 172.21.15.135:0/493461704 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f31440a1230 0x7f31440a36f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3150005950 tx=0x7f31500058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f316eb51b80 1 Processor -- start 2024-05-08T23:15:30.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f316eb51b80 1 -- start start 2024-05-08T23:15:30.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f316eb51b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb763354f0 0x55cb76335910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f316eb51b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76335e50 0x55cb763362d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f316eb51b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb76336810 0x55cb76336c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f316eb51b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb7628c100 con 0x55cb76335e50 2024-05-08T23:15:30.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f316eb51b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb76289ac0 con 0x55cb76336810 2024-05-08T23:15:30.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f316eb51b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb762853b0 con 0x55cb763354f0 2024-05-08T23:15:30.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f315b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76335e50 0x55cb763362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f315b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76335e50 0x55cb763362d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49128/0 (socket says 172.21.15.135:49128) 2024-05-08T23:15:30.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f315b7fe700 1 -- 172.21.15.135:0/3517933557 learned_addr learned my addr 172.21.15.135:0/3517933557 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f3160f34700 1 --2- 172.21.15.135:0/3517933557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb76336810 0x55cb76336c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f315bfff700 1 --2- 172.21.15.135:0/3517933557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb763354f0 0x55cb76335910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f315b7fe700 1 -- 172.21.15.135:0/3517933557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb763354f0 msgr2=0x55cb76335910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f315b7fe700 1 --2- 172.21.15.135:0/3517933557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb763354f0 0x55cb76335910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f315b7fe700 1 -- 172.21.15.135:0/3517933557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb76336810 msgr2=0x55cb76336c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f315b7fe700 1 --2- 172.21.15.135:0/3517933557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb76336810 0x55cb76336c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f315b7fe700 1 -- 172.21.15.135:0/3517933557 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb76106360 con 0x55cb76335e50 2024-05-08T23:15:30.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f3160f34700 1 --2- 172.21.15.135:0/3517933557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb76336810 0x55cb76336c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:30.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f315b7fe700 1 --2- 172.21.15.135:0/3517933557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76335e50 0x55cb763362d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f315000ff00 tx=0x7f3150012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1cde57f222091f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.455+0000 7f31427fc700 1 -- 172.21.15.135:0/3517933557 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150017040 con 0x55cb76335e50 2024-05-08T23:15:30.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.456+0000 7f31427fc700 1 -- 172.21.15.135:0/3517933557 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3150003d40 con 0x55cb76335e50 2024-05-08T23:15:30.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.456+0000 7f31427fc700 1 -- 172.21.15.135:0/3517933557 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315001fd60 con 0x55cb76335e50 2024-05-08T23:15:30.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.456+0000 7f316eb51b80 1 -- 172.21.15.135:0/3517933557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76335e50 msgr2=0x55cb763362d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.456+0000 7f316eb51b80 1 --2- 172.21.15.135:0/3517933557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76335e50 0x55cb763362d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f315000ff00 tx=0x7f3150012000 comp rx=0 tx=0).stop 2024-05-08T23:15:30.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.456+0000 7f316eb51b80 1 -- 172.21.15.135:0/3517933557 shutdown_connections 2024-05-08T23:15:30.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.456+0000 7f316eb51b80 1 --2- 172.21.15.135:0/3517933557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb763354f0 0x55cb76335910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.456+0000 7f316eb51b80 1 --2- 172.21.15.135:0/3517933557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb76336810 0x55cb76336c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.456+0000 7f316eb51b80 1 --2- 172.21.15.135:0/3517933557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76335e50 0x55cb763362d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.456+0000 7f316eb51b80 1 -- 172.21.15.135:0/3517933557 >> 172.21.15.135:0/3517933557 conn(0x55cb762931c0 msgr2=0x55cb7632fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.456+0000 7f316eb51b80 1 -- 172.21.15.135:0/3517933557 shutdown_connections 2024-05-08T23:15:30.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.456+0000 7f316eb51b80 1 -- 172.21.15.135:0/3517933557 wait complete. 2024-05-08T23:15:30.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f316eb51b80 1 -- start start 2024-05-08T23:15:30.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f316eb51b80 1 Processor -- start 2024-05-08T23:15:30.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f316eb51b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb763354f0 0x55cb7633ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f316eb51b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76335e50 0x55cb7633f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f316eb51b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb76336810 0x55cb76346310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f316eb51b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb76221510 con 0x55cb76335e50 2024-05-08T23:15:30.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f316eb51b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb762211b0 con 0x55cb763354f0 2024-05-08T23:15:30.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f316eb51b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb76108650 con 0x55cb76336810 2024-05-08T23:15:30.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f316eb51b80 10 client.0 _ll_register_callbacks cb 0x55cb7622aae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:30.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f315b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76335e50 0x55cb7633f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f315b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76335e50 0x55cb7633f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49136/0 (socket says 172.21.15.135:49136) 2024-05-08T23:15:30.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f315b7fe700 1 -- 172.21.15.135:0/1226100169 learned_addr learned my addr 172.21.15.135:0/1226100169 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f315bfff700 1 --2- 172.21.15.135:0/1226100169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb763354f0 0x55cb7633ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f315b7fe700 1 -- 172.21.15.135:0/1226100169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb76336810 msgr2=0x55cb76346310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f315b7fe700 1 --2- 172.21.15.135:0/1226100169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb76336810 0x55cb76346310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f315b7fe700 1 -- 172.21.15.135:0/1226100169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb763354f0 msgr2=0x55cb7633ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f315b7fe700 1 --2- 172.21.15.135:0/1226100169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb763354f0 0x55cb7633ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f315b7fe700 1 -- 172.21.15.135:0/1226100169 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315000fbe0 con 0x55cb76335e50 2024-05-08T23:15:30.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.457+0000 7f315bfff700 1 --2- 172.21.15.135:0/1226100169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb763354f0 0x55cb7633ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:30.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f315b7fe700 1 --2- 172.21.15.135:0/1226100169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76335e50 0x55cb7633f2d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f315000bea0 tx=0x7f3150020db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74f7c9c89c0d38c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f313b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:30.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f313b7fe700 1 -- 172.21.15.135:0/1226100169 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150003a90 con 0x55cb76335e50 2024-05-08T23:15:30.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f313b7fe700 1 -- 172.21.15.135:0/1226100169 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3150034470 con 0x55cb76335e50 2024-05-08T23:15:30.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f316eb51b80 1 -- 172.21.15.135:0/1226100169 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb761de220 con 0x55cb76335e50 2024-05-08T23:15:30.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f313b7fe700 1 -- 172.21.15.135:0/1226100169 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f315001f460 con 0x55cb76335e50 2024-05-08T23:15:30.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f316eb51b80 10 client.15291 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:30.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f316eb51b80 1 -- 172.21.15.135:0/1226100169 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55cb760b2b10 con 0x55cb76335e50 2024-05-08T23:15:30.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f313b7fe700 1 -- 172.21.15.135:0/1226100169 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cb761de220 con 0x55cb76335e50 2024-05-08T23:15:30.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f313b7fe700 1 -- 172.21.15.135:0/1226100169 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f315001d040 con 0x55cb76335e50 2024-05-08T23:15:30.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f316eb51b80 10 client.15291 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:30.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f316eb51b80 10 client.15291 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T23:15:30.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f316eb51b80 20 client.15291 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:30.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f316eb51b80 1 --2- 172.21.15.135:0/1226100169 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x55cb76349f40 0x55cb7634f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f316eb51b80 4 client.15291 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:15:30.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.458+0000 7f316eb51b80 1 -- 172.21.15.135:0/1226100169 --> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb763047c0 con 0x55cb76349f40 2024-05-08T23:15:30.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.459+0000 7f315bfff700 1 --2- 172.21.15.135:0/1226100169 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x55cb76349f40 0x55cb7634f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.459+0000 7f315bfff700 1 --2- 172.21.15.135:0/1226100169 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x55cb76349f40 0x55cb7634f260 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e7c9f8c7dab3c00f server_cookie=7459ab58849b90ac in_seq=0 out_seq=0 2024-05-08T23:15:30.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.459+0000 7f313b7fe700 10 client.15291 ms_handle_connect on v2:172.21.15.179:6838/1135239419 2024-05-08T23:15:30.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.460+0000 7f313b7fe700 1 -- 172.21.15.135:0/1226100169 <== mds.1 v2:172.21.15.179:6838/1135239419 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cb763047c0 con 0x55cb76349f40 2024-05-08T23:15:30.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.460+0000 7f313b7fe700 10 client.15291 handle_command_reply: tid=0 2024-05-08T23:15:30.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.460+0000 7f316eb51b80 1 client.15291 shutdown 2024-05-08T23:15:30.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.460+0000 7f316eb51b80 1 -- 172.21.15.135:0/1226100169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76335e50 msgr2=0x55cb7633f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.460+0000 7f316eb51b80 1 --2- 172.21.15.135:0/1226100169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76335e50 0x55cb7633f2d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f315000bea0 tx=0x7f3150020db0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.460+0000 7f316eb51b80 1 -- 172.21.15.135:0/1226100169 shutdown_connections 2024-05-08T23:15:30.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.460+0000 7f316eb51b80 1 --2- 172.21.15.135:0/1226100169 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x55cb76349f40 0x55cb7634f260 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.460+0000 7f316eb51b80 1 --2- 172.21.15.135:0/1226100169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb76336810 0x55cb76346310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.460+0000 7f313b7fe700 0 client.15291 ms_handle_reset on v2:172.21.15.179:6838/1135239419 2024-05-08T23:15:30.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.460+0000 7f316eb51b80 1 --2- 172.21.15.135:0/1226100169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb763354f0 0x55cb7633ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.460+0000 7f316eb51b80 1 --2- 172.21.15.135:0/1226100169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76335e50 0x55cb7633f2d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.460+0000 7f316eb51b80 1 -- 172.21.15.135:0/1226100169 >> 172.21.15.135:0/1226100169 conn(0x55cb762931c0 msgr2=0x55cb7632f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.460+0000 7f316eb51b80 1 -- 172.21.15.135:0/1226100169 shutdown_connections 2024-05-08T23:15:30.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.460+0000 7f316eb51b80 1 -- 172.21.15.135:0/1226100169 wait complete. 2024-05-08T23:15:30.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.460+0000 7f316eb51b80 20 client.15291 trim_cache size 0 max 16384 2024-05-08T23:15:30.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f316eb51b80 1 Processor -- start 2024-05-08T23:15:30.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f316eb51b80 1 -- start start 2024-05-08T23:15:30.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f316eb51b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb763354f0 0x55cb763358d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f316eb51b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb76335e50 0x55cb76330580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f316eb51b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76336810 0x55cb7633e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f316eb51b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb76331520 con 0x55cb76336810 2024-05-08T23:15:30.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f316eb51b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb763047c0 con 0x55cb763354f0 2024-05-08T23:15:30.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f316eb51b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb761de220 con 0x55cb76335e50 2024-05-08T23:15:30.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f3160f34700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76336810 0x55cb7633e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f3160f34700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76336810 0x55cb7633e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49144/0 (socket says 172.21.15.135:49144) 2024-05-08T23:15:30.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f3160f34700 1 -- 172.21.15.135:0/2043099704 learned_addr learned my addr 172.21.15.135:0/2043099704 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f315bfff700 1 --2- 172.21.15.135:0/2043099704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb763354f0 0x55cb763358d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f3160f34700 1 -- 172.21.15.135:0/2043099704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb76335e50 msgr2=0x55cb76330580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f3160f34700 1 --2- 172.21.15.135:0/2043099704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb76335e50 0x55cb76330580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f3160f34700 1 -- 172.21.15.135:0/2043099704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb763354f0 msgr2=0x55cb763358d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f3160f34700 1 --2- 172.21.15.135:0/2043099704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb763354f0 0x55cb763358d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.478+0000 7f3160f34700 1 -- 172.21.15.135:0/2043099704 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb7624b510 con 0x55cb76336810 2024-05-08T23:15:30.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.479+0000 7f3160f34700 1 --2- 172.21.15.135:0/2043099704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76336810 0x55cb7633e2a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f315400b070 tx=0x7f3154009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6668e1e5c5eb6e21 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.479+0000 7f3142ffd700 1 -- 172.21.15.135:0/2043099704 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315400e050 con 0x55cb76336810 2024-05-08T23:15:30.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.479+0000 7f3142ffd700 1 -- 172.21.15.135:0/2043099704 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3154008f00 con 0x55cb76336810 2024-05-08T23:15:30.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.479+0000 7f3142ffd700 1 -- 172.21.15.135:0/2043099704 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31540052a0 con 0x55cb76336810 2024-05-08T23:15:30.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.479+0000 7f316eb51b80 1 -- 172.21.15.135:0/2043099704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76336810 msgr2=0x55cb7633e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.479+0000 7f316eb51b80 1 --2- 172.21.15.135:0/2043099704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76336810 0x55cb7633e2a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f315400b070 tx=0x7f3154009c00 comp rx=0 tx=0).stop 2024-05-08T23:15:30.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.479+0000 7f316eb51b80 1 -- 172.21.15.135:0/2043099704 shutdown_connections 2024-05-08T23:15:30.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.479+0000 7f316eb51b80 1 --2- 172.21.15.135:0/2043099704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb76336810 0x55cb7633e2a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.479+0000 7f316eb51b80 1 --2- 172.21.15.135:0/2043099704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb763354f0 0x55cb763358d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.479+0000 7f316eb51b80 1 --2- 172.21.15.135:0/2043099704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb76335e50 0x55cb76330580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.479+0000 7f316eb51b80 1 -- 172.21.15.135:0/2043099704 >> 172.21.15.135:0/2043099704 conn(0x55cb762931c0 msgr2=0x55cb76336bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.479+0000 7f316eb51b80 1 -- 172.21.15.135:0/2043099704 shutdown_connections 2024-05-08T23:15:30.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.479+0000 7f316eb51b80 1 -- 172.21.15.135:0/2043099704 wait complete. 2024-05-08T23:15:30.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f316eb51b80 1 -- start start 2024-05-08T23:15:30.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f316eb51b80 1 Processor -- start 2024-05-08T23:15:30.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f316eb51b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb763354f0 0x55cb7632f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f316eb51b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb76335e50 0x55cb7632f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f316eb51b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb76336810 0x55cb7632faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f316eb51b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb76330c40 con 0x55cb763354f0 2024-05-08T23:15:30.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f316eb51b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb763a4f40 con 0x55cb76335e50 2024-05-08T23:15:30.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f316eb51b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb763a50b0 con 0x55cb76336810 2024-05-08T23:15:30.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f316eb51b80 10 client.0 _ll_register_callbacks cb 0x55cb7622aae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:30.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f315bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb763354f0 0x55cb7632f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f315bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb763354f0 0x55cb7632f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49158/0 (socket says 172.21.15.135:49158) 2024-05-08T23:15:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f315bfff700 1 -- 172.21.15.135:0/705083316 learned_addr learned my addr 172.21.15.135:0/705083316 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f315b7fe700 1 --2- 172.21.15.135:0/705083316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb76335e50 0x55cb7632f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f3160f34700 1 --2- 172.21.15.135:0/705083316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb76336810 0x55cb7632faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f315bfff700 1 -- 172.21.15.135:0/705083316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb76336810 msgr2=0x55cb7632faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f315bfff700 1 --2- 172.21.15.135:0/705083316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb76336810 0x55cb7632faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f315bfff700 1 -- 172.21.15.135:0/705083316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb76335e50 msgr2=0x55cb7632f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f315bfff700 1 --2- 172.21.15.135:0/705083316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb76335e50 0x55cb7632f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f315bfff700 1 -- 172.21.15.135:0/705083316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c109ca0 con 0x55cb763354f0 2024-05-08T23:15:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f3160f34700 1 --2- 172.21.15.135:0/705083316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb76336810 0x55cb7632faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f315bfff700 1 --2- 172.21.15.135:0/705083316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb763354f0 0x55cb7632f070 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f314c000c00 tx=0x7f314c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87378a3681ca2d7f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.480+0000 7f313b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.481+0000 7f313b7fe700 1 -- 172.21.15.135:0/705083316 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c09ded0 con 0x55cb763354f0 2024-05-08T23:15:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.481+0000 7f313b7fe700 1 -- 172.21.15.135:0/705083316 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f314c0a2520 con 0x55cb763354f0 2024-05-08T23:15:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.481+0000 7f316eb51b80 1 -- 172.21.15.135:0/705083316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3150003d40 con 0x55cb763354f0 2024-05-08T23:15:30.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.481+0000 7f313b7fe700 1 -- 172.21.15.135:0/705083316 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f314c0ca9b0 con 0x55cb763354f0 2024-05-08T23:15:30.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.481+0000 7f316eb51b80 10 client.15297 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:30.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.481+0000 7f316eb51b80 1 -- 172.21.15.135:0/705083316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55cb7610ac80 con 0x55cb763354f0 2024-05-08T23:15:30.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.481+0000 7f313b7fe700 1 -- 172.21.15.135:0/705083316 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3150003d40 con 0x55cb763354f0 2024-05-08T23:15:30.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.481+0000 7f313b7fe700 1 -- 172.21.15.135:0/705083316 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f314c099590 con 0x55cb763354f0 2024-05-08T23:15:30.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.481+0000 7f316eb51b80 10 client.15297 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:30.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.481+0000 7f316eb51b80 10 client.15297 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T23:15:30.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.481+0000 7f316eb51b80 20 client.15297 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:30.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.481+0000 7f316eb51b80 1 --2- 172.21.15.135:0/705083316 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x55cb763a9d50 0x55cb763a66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.481+0000 7f316eb51b80 4 client.15297 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T23:15:30.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.481+0000 7f316eb51b80 1 -- 172.21.15.135:0/705083316 --> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cb7627de70 con 0x55cb763a9d50 2024-05-08T23:15:30.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.481+0000 7f315b7fe700 1 --2- 172.21.15.135:0/705083316 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x55cb763a9d50 0x55cb763a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f313b7fe700 10 client.15297 ms_handle_connect on v2:172.21.15.179:6838/1135239419 2024-05-08T23:15:30.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f315b7fe700 1 --2- 172.21.15.135:0/705083316 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x55cb763a9d50 0x55cb763a66e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=849f6355e5e9cacb server_cookie=551a99f5b67ac101 in_seq=0 out_seq=0 2024-05-08T23:15:30.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f313b7fe700 1 -- 172.21.15.135:0/705083316 <== mds.1 v2:172.21.15.179:6838/1135239419 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55cb7627de70 con 0x55cb763a9d50 2024-05-08T23:15:30.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f313b7fe700 10 client.15297 handle_command_reply: tid=0 2024-05-08T23:15:30.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f316eb51b80 1 client.15297 shutdown 2024-05-08T23:15:30.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f316eb51b80 1 -- 172.21.15.135:0/705083316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb763354f0 msgr2=0x55cb7632f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f316eb51b80 1 --2- 172.21.15.135:0/705083316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb763354f0 0x55cb7632f070 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f314c000c00 tx=0x7f314c005dc0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f316eb51b80 1 -- 172.21.15.135:0/705083316 shutdown_connections 2024-05-08T23:15:30.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f316eb51b80 1 --2- 172.21.15.135:0/705083316 >> [v2:172.21.15.179:6838/1135239419,v1:172.21.15.179:6839/1135239419] conn(0x55cb763a9d50 0x55cb763a66e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f316eb51b80 1 --2- 172.21.15.135:0/705083316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cb76336810 0x55cb7632faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f313b7fe700 0 client.15297 ms_handle_reset on v2:172.21.15.179:6838/1135239419 2024-05-08T23:15:30.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f316eb51b80 1 --2- 172.21.15.135:0/705083316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb763354f0 0x55cb7632f070 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f316eb51b80 1 --2- 172.21.15.135:0/705083316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cb76335e50 0x55cb7632f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f316eb51b80 1 -- 172.21.15.135:0/705083316 >> 172.21.15.135:0/705083316 conn(0x55cb762931c0 msgr2=0x55cb7633e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f316eb51b80 1 -- 172.21.15.135:0/705083316 shutdown_connections 2024-05-08T23:15:30.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f316eb51b80 1 -- 172.21.15.135:0/705083316 wait complete. 2024-05-08T23:15:30.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.482+0000 7f316eb51b80 20 client.15297 trim_cache size 0 max 16384 2024-05-08T23:15:30.491 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:15:30.491 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "c804a50a-0d8f-11ef-bc97-c7b262605968", 2024-05-08T23:15:30.491 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 1, 2024-05-08T23:15:30.491 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24500, 2024-05-08T23:15:30.491 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-08T23:15:30.491 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-08T23:15:30.491 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-08T23:15:30.491 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 65.539498347999995, 2024-05-08T23:15:30.491 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 27, 2024-05-08T23:15:30.492 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 85, 2024-05-08T23:15:30.492 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 83, 2024-05-08T23:15:30.492 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 74.065775019 2024-05-08T23:15:30.492 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:15:30.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.483+0000 7f3162997700 1 -- 172.21.15.135:0/493461704 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f31440a1230 msgr2=0x7f31440a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.483+0000 7f3162997700 1 --2- 172.21.15.135:0/493461704 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f31440a1230 0x7f31440a36f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3150005950 tx=0x7f31500058e0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.483+0000 7f3162997700 1 -- 172.21.15.135:0/493461704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315c1019e0 msgr2=0x7f315c196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.483+0000 7f3162997700 1 --2- 172.21.15.135:0/493461704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315c1019e0 0x7f315c196fd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f314c00d950 tx=0x7f314c00dd10 comp rx=0 tx=0).stop 2024-05-08T23:15:30.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.483+0000 7f3162997700 1 -- 172.21.15.135:0/493461704 shutdown_connections 2024-05-08T23:15:30.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.483+0000 7f3162997700 1 --2- 172.21.15.135:0/493461704 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f31440a1230 0x7f31440a36f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.483+0000 7f3162997700 1 --2- 172.21.15.135:0/493461704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f315c106c40 0x7f315c19e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.483+0000 7f3162997700 1 --2- 172.21.15.135:0/493461704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f315c1019e0 0x7f315c196fd0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.483+0000 7f3162997700 1 --2- 172.21.15.135:0/493461704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f315c104310 0x7f315c197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.483+0000 7f3162997700 1 -- 172.21.15.135:0/493461704 >> 172.21.15.135:0/493461704 conn(0x7f315c0fb3f0 msgr2=0x7f315c102440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.483+0000 7f3162997700 1 -- 172.21.15.135:0/493461704 shutdown_connections 2024-05-08T23:15:30.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.483+0000 7f3162997700 1 -- 172.21.15.135:0/493461704 wait complete. 2024-05-08T23:15:30.495 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-05-08T23:15:30.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:30 smithi179 ceph-mon[46314]: pgmap v259: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s; 97 B/s, 1 objects/s recovering 2024-05-08T23:15:30.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:30 smithi179 ceph-mon[46314]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-08T23:15:30.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:30 smithi179 ceph-mon[46314]: Cluster is now healthy 2024-05-08T23:15:30.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:30 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/96431115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:15:30.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:30 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1186387479' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:30.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.618+0000 7f556c6ca700 1 -- 172.21.15.135:0/4158862502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5564100fb0 msgr2=0x7f5564101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.618+0000 7f556c6ca700 1 --2- 172.21.15.135:0/4158862502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5564100fb0 0x7f5564101430 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5560009990 tx=0x7f5560009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.618+0000 7f556c6ca700 1 -- 172.21.15.135:0/4158862502 shutdown_connections 2024-05-08T23:15:30.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.618+0000 7f556c6ca700 1 --2- 172.21.15.135:0/4158862502 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5564101970 0x7f5564108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.618+0000 7f556c6ca700 1 --2- 172.21.15.135:0/4158862502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55640ffe60 0x7f5564100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.618+0000 7f556c6ca700 1 --2- 172.21.15.135:0/4158862502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5564100fb0 0x7f5564101430 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.618+0000 7f556c6ca700 1 -- 172.21.15.135:0/4158862502 >> 172.21.15.135:0/4158862502 conn(0x7f55640fb3f0 msgr2=0x7f55640fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.618+0000 7f556c6ca700 1 -- 172.21.15.135:0/4158862502 shutdown_connections 2024-05-08T23:15:30.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.618+0000 7f556c6ca700 1 -- 172.21.15.135:0/4158862502 wait complete. 2024-05-08T23:15:30.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f556c6ca700 1 Processor -- start 2024-05-08T23:15:30.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f556c6ca700 1 -- start start 2024-05-08T23:15:30.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f556c6ca700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55640ffe60 0x7f5564195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f556c6ca700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5564100fb0 0x7f5564196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f556c6ca700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5564101970 0x7f556419d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f556c6ca700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556419d950 con 0x7f5564100fb0 2024-05-08T23:15:30.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f556c6ca700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556419da90 con 0x7f55640ffe60 2024-05-08T23:15:30.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f556c6ca700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556419dc20 con 0x7f5564101970 2024-05-08T23:15:30.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f5569c65700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5564100fb0 0x7f5564196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f5569c65700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5564100fb0 0x7f5564196360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49176/0 (socket says 172.21.15.135:49176) 2024-05-08T23:15:30.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f5569c65700 1 -- 172.21.15.135:0/499287379 learned_addr learned my addr 172.21.15.135:0/499287379 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f5569c65700 1 -- 172.21.15.135:0/499287379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5564101970 msgr2=0x7f556419d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f5569c65700 1 --2- 172.21.15.135:0/499287379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5564101970 0x7f556419d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f556a466700 1 --2- 172.21.15.135:0/499287379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55640ffe60 0x7f5564195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f5569c65700 1 -- 172.21.15.135:0/499287379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55640ffe60 msgr2=0x7f5564195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f5569c65700 1 --2- 172.21.15.135:0/499287379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55640ffe60 0x7f5564195e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f5569c65700 1 -- 172.21.15.135:0/499287379 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600095f0 con 0x7f5564100fb0 2024-05-08T23:15:30.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f556a466700 1 --2- 172.21.15.135:0/499287379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55640ffe60 0x7f5564195e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:30.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f5569c65700 1 --2- 172.21.15.135:0/499287379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5564100fb0 0x7f5564196360 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5560005910 tx=0x7f5560009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f55577fe700 1 -- 172.21.15.135:0/499287379 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556001d070 con 0x7f5564100fb0 2024-05-08T23:15:30.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f55577fe700 1 -- 172.21.15.135:0/499287379 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5560003fe0 con 0x7f5564100fb0 2024-05-08T23:15:30.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f556c6ca700 1 -- 172.21.15.135:0/499287379 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f556419dea0 con 0x7f5564100fb0 2024-05-08T23:15:30.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.619+0000 7f55577fe700 1 -- 172.21.15.135:0/499287379 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5560022dd0 con 0x7f5564100fb0 2024-05-08T23:15:30.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.620+0000 7f556c6ca700 1 -- 172.21.15.135:0/499287379 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556419e2c0 con 0x7f5564100fb0 2024-05-08T23:15:30.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.621+0000 7f55577fe700 1 -- 172.21.15.135:0/499287379 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f5560022470 con 0x7f5564100fb0 2024-05-08T23:15:30.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.622+0000 7f55577fe700 1 --2- 172.21.15.135:0/499287379 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f55500a1230 0x7f55500a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.622+0000 7f55577fe700 1 -- 172.21.15.135:0/499287379 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f55600cdf10 con 0x7f5564100fb0 2024-05-08T23:15:30.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.622+0000 7f556a466700 1 --2- 172.21.15.135:0/499287379 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f55500a1230 0x7f55500a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.623+0000 7f556a466700 1 --2- 172.21.15.135:0/499287379 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f55500a1230 0x7f55500a36f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5558005d90 tx=0x7f5558005d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.623+0000 7f5578884b80 1 Processor -- start 2024-05-08T23:15:30.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.623+0000 7f5578884b80 1 -- start start 2024-05-08T23:15:30.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.623+0000 7f5578884b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 0x56374ecc5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.623+0000 7f5578884b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374ecc64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5578884b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 0x56374ecc6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5578884b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374ec1a100 con 0x56374ecc6060 2024-05-08T23:15:30.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5578884b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374ec17ac0 con 0x56374ecc6a20 2024-05-08T23:15:30.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5578884b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374ec133b0 con 0x56374ecc5700 2024-05-08T23:15:30.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5569c65700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374ecc64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5569c65700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374ecc64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49192/0 (socket says 172.21.15.135:49192) 2024-05-08T23:15:30.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5569c65700 1 -- 172.21.15.135:0/3331687555 learned_addr learned my addr 172.21.15.135:0/3331687555 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f556a466700 1 --2- 172.21.15.135:0/3331687555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 0x56374ecc5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5569c65700 1 -- 172.21.15.135:0/3331687555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 msgr2=0x56374ecc5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f556ac67700 1 --2- 172.21.15.135:0/3331687555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 0x56374ecc6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5569c65700 1 --2- 172.21.15.135:0/3331687555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 0x56374ecc5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5569c65700 1 -- 172.21.15.135:0/3331687555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 msgr2=0x56374ecc6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5569c65700 1 --2- 172.21.15.135:0/3331687555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 0x56374ecc6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5569c65700 1 -- 172.21.15.135:0/3331687555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56374ea94360 con 0x56374ecc6060 2024-05-08T23:15:30.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f556a466700 1 --2- 172.21.15.135:0/3331687555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 0x56374ecc5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:30.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5569c65700 1 --2- 172.21.15.135:0/3331687555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374ecc64e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5560097ce0 tx=0x7f55600041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afb522867b0d689 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5554ff9700 1 -- 172.21.15.135:0/3331687555 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556009f0a0 con 0x56374ecc6060 2024-05-08T23:15:30.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5554ff9700 1 -- 172.21.15.135:0/3331687555 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f55600a3660 con 0x56374ecc6060 2024-05-08T23:15:30.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.624+0000 7f5554ff9700 1 -- 172.21.15.135:0/3331687555 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55600a3430 con 0x56374ecc6060 2024-05-08T23:15:30.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.625+0000 7f5578884b80 1 -- 172.21.15.135:0/3331687555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 msgr2=0x56374ecc64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.625+0000 7f5578884b80 1 --2- 172.21.15.135:0/3331687555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374ecc64e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5560097ce0 tx=0x7f55600041d0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.625+0000 7f5578884b80 1 -- 172.21.15.135:0/3331687555 shutdown_connections 2024-05-08T23:15:30.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.625+0000 7f5578884b80 1 --2- 172.21.15.135:0/3331687555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 0x56374ecc5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.625+0000 7f5578884b80 1 --2- 172.21.15.135:0/3331687555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 0x56374ecc6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.625+0000 7f5578884b80 1 --2- 172.21.15.135:0/3331687555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374ecc64e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.625+0000 7f5578884b80 1 -- 172.21.15.135:0/3331687555 >> 172.21.15.135:0/3331687555 conn(0x56374ec211c0 msgr2=0x56374ecbdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.625+0000 7f5578884b80 1 -- 172.21.15.135:0/3331687555 shutdown_connections 2024-05-08T23:15:30.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.625+0000 7f5578884b80 1 -- 172.21.15.135:0/3331687555 wait complete. 2024-05-08T23:15:30.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.625+0000 7f5578884b80 1 -- start start 2024-05-08T23:15:30.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.625+0000 7f5578884b80 1 Processor -- start 2024-05-08T23:15:30.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5578884b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 0x56374eccec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5578884b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374eccf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5578884b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 0x56374ecd6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5578884b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374ebaf510 con 0x56374ecc6060 2024-05-08T23:15:30.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5578884b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374ebaf1b0 con 0x56374ecc6a20 2024-05-08T23:15:30.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5578884b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374ea96650 con 0x56374ecc5700 2024-05-08T23:15:30.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5578884b80 10 client.0 _ll_register_callbacks cb 0x56374ebb8ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:30.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5569c65700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374eccf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5569c65700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374eccf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49202/0 (socket says 172.21.15.135:49202) 2024-05-08T23:15:30.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5569c65700 1 -- 172.21.15.135:0/819680820 learned_addr learned my addr 172.21.15.135:0/819680820 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f556a466700 1 --2- 172.21.15.135:0/819680820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 0x56374eccec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f556ac67700 1 --2- 172.21.15.135:0/819680820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 0x56374ecd6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5569c65700 1 -- 172.21.15.135:0/819680820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 msgr2=0x56374eccec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5569c65700 1 --2- 172.21.15.135:0/819680820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 0x56374eccec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5569c65700 1 -- 172.21.15.135:0/819680820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 msgr2=0x56374ecd6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5569c65700 1 --2- 172.21.15.135:0/819680820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 0x56374ecd6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5569c65700 1 -- 172.21.15.135:0/819680820 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556419e2c0 con 0x56374ecc6060 2024-05-08T23:15:30.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5569c65700 1 --2- 172.21.15.135:0/819680820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374eccf140 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f55600a3130 tx=0x7f556009bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d85e6deadf124 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f554dffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:30.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f554dffb700 1 -- 172.21.15.135:0/819680820 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556009a9b0 con 0x56374ecc6060 2024-05-08T23:15:30.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f554dffb700 1 -- 172.21.15.135:0/819680820 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f556009f0a0 con 0x56374ecc6060 2024-05-08T23:15:30.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5578884b80 1 -- 172.21.15.135:0/819680820 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56374eb6c220 con 0x56374ecc6060 2024-05-08T23:15:30.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f554dffb700 1 -- 172.21.15.135:0/819680820 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5560099610 con 0x56374ecc6060 2024-05-08T23:15:30.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5578884b80 10 client.15309 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:30.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.626+0000 7f5578884b80 1 -- 172.21.15.135:0/819680820 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56374ea40b10 con 0x56374ecc6060 2024-05-08T23:15:30.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.627+0000 7f554dffb700 1 -- 172.21.15.135:0/819680820 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56374eb6c220 con 0x56374ecc6060 2024-05-08T23:15:30.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.627+0000 7f554dffb700 1 -- 172.21.15.135:0/819680820 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5560097060 con 0x56374ecc6060 2024-05-08T23:15:30.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.627+0000 7f5578884b80 10 client.15309 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:30.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.627+0000 7f5578884b80 10 client.15309 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-08T23:15:30.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.627+0000 7f5578884b80 20 client.15309 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:30.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.627+0000 7f5578884b80 1 --2- 172.21.15.135:0/819680820 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56374ecd9990 0x56374ecdec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.627+0000 7f5578884b80 4 client.15309 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:15:30.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.627+0000 7f5578884b80 1 -- 172.21.15.135:0/819680820 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56374ec927c0 con 0x56374ecd9990 2024-05-08T23:15:30.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.627+0000 7f556a466700 1 --2- 172.21.15.135:0/819680820 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56374ecd9990 0x56374ecdec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f554dffb700 10 client.15309 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:15:30.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f556a466700 1 --2- 172.21.15.135:0/819680820 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56374ecd9990 0x56374ecdec50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0af130c895d9920 server_cookie=42defae3eed83b73 in_seq=0 out_seq=0 2024-05-08T23:15:30.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f554dffb700 1 -- 172.21.15.135:0/819680820 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56374ec927c0 con 0x56374ecd9990 2024-05-08T23:15:30.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f554dffb700 10 client.15309 handle_command_reply: tid=0 2024-05-08T23:15:30.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f5578884b80 1 client.15309 shutdown 2024-05-08T23:15:30.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f5578884b80 1 -- 172.21.15.135:0/819680820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 msgr2=0x56374eccf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f5578884b80 1 --2- 172.21.15.135:0/819680820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374eccf140 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f55600a3130 tx=0x7f556009bab0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f5578884b80 1 -- 172.21.15.135:0/819680820 shutdown_connections 2024-05-08T23:15:30.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f5578884b80 1 --2- 172.21.15.135:0/819680820 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56374ecd9990 0x56374ecdec50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f5578884b80 1 --2- 172.21.15.135:0/819680820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 0x56374eccec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f554dffb700 0 client.15309 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:15:30.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f5578884b80 1 --2- 172.21.15.135:0/819680820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 0x56374ecd6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f5578884b80 1 --2- 172.21.15.135:0/819680820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374eccf140 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f5578884b80 1 -- 172.21.15.135:0/819680820 >> 172.21.15.135:0/819680820 conn(0x56374ec211c0 msgr2=0x56374ecbd550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f5578884b80 1 -- 172.21.15.135:0/819680820 shutdown_connections 2024-05-08T23:15:30.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.628+0000 7f5578884b80 1 -- 172.21.15.135:0/819680820 wait complete. 2024-05-08T23:15:30.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.629+0000 7f5578884b80 20 client.15309 trim_cache size 0 max 16384 2024-05-08T23:15:30.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:30 smithi195 ceph-mon[46516]: pgmap v259: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s; 97 B/s, 1 objects/s recovering 2024-05-08T23:15:30.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:30 smithi195 ceph-mon[46516]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-08T23:15:30.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:30 smithi195 ceph-mon[46516]: Cluster is now healthy 2024-05-08T23:15:30.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:30 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/96431115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:15:30.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:30 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1186387479' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:15:30.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.646+0000 7f5578884b80 1 Processor -- start 2024-05-08T23:15:30.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.646+0000 7f5578884b80 1 -- start start 2024-05-08T23:15:30.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f5578884b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 0x56374ecc5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f5578884b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374ecd6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f5578884b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 0x56374ecce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f5578884b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374ec133b0 con 0x56374ecc6060 2024-05-08T23:15:30.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f5578884b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374ecdb200 con 0x56374ecc6a20 2024-05-08T23:15:30.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f5578884b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374ec927f0 con 0x56374ecc5700 2024-05-08T23:15:30.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f5569c65700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374ecd6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f5569c65700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374ecd6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49216/0 (socket says 172.21.15.135:49216) 2024-05-08T23:15:30.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f5569c65700 1 -- 172.21.15.135:0/3252824687 learned_addr learned my addr 172.21.15.135:0/3252824687 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f556a466700 1 --2- 172.21.15.135:0/3252824687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 0x56374ecc5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f556ac67700 1 --2- 172.21.15.135:0/3252824687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 0x56374ecce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f5569c65700 1 -- 172.21.15.135:0/3252824687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 msgr2=0x56374ecc5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f5569c65700 1 --2- 172.21.15.135:0/3252824687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 0x56374ecc5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f5569c65700 1 -- 172.21.15.135:0/3252824687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 msgr2=0x56374ecce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f5569c65700 1 --2- 172.21.15.135:0/3252824687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 0x56374ecce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f5569c65700 1 -- 172.21.15.135:0/3252824687 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56374ebd9510 con 0x56374ecc6060 2024-05-08T23:15:30.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f556ac67700 1 --2- 172.21.15.135:0/3252824687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 0x56374ecce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:30.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f5569c65700 1 --2- 172.21.15.135:0/3252824687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374ecd6140 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f55600995c0 tx=0x7f5560009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c893aa230ac27559 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f55557fa700 1 -- 172.21.15.135:0/3252824687 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55600b9580 con 0x56374ecc6060 2024-05-08T23:15:30.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f55557fa700 1 -- 172.21.15.135:0/3252824687 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f556009f0a0 con 0x56374ecc6060 2024-05-08T23:15:30.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.647+0000 7f55557fa700 1 -- 172.21.15.135:0/3252824687 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556009a840 con 0x56374ecc6060 2024-05-08T23:15:30.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 -- 172.21.15.135:0/3252824687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 msgr2=0x56374ecd6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 --2- 172.21.15.135:0/3252824687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374ecd6140 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f55600995c0 tx=0x7f5560009310 comp rx=0 tx=0).stop 2024-05-08T23:15:30.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 -- 172.21.15.135:0/3252824687 shutdown_connections 2024-05-08T23:15:30.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 --2- 172.21.15.135:0/3252824687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc5700 0x56374ecc5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 --2- 172.21.15.135:0/3252824687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc6a20 0x56374ecce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 --2- 172.21.15.135:0/3252824687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6060 0x56374ecd6140 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 -- 172.21.15.135:0/3252824687 >> 172.21.15.135:0/3252824687 conn(0x56374ec211c0 msgr2=0x56374ecc6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 -- 172.21.15.135:0/3252824687 shutdown_connections 2024-05-08T23:15:30.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 -- 172.21.15.135:0/3252824687 wait complete. 2024-05-08T23:15:30.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 -- start start 2024-05-08T23:15:30.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 Processor -- start 2024-05-08T23:15:30.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc5700 0x56374ecbcf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc6060 0x56374ecbd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6a20 0x56374ecd56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374ecd5c20 con 0x56374ecc6a20 2024-05-08T23:15:30.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374ecd5d90 con 0x56374ecc5700 2024-05-08T23:15:30.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56374ecd5f50 con 0x56374ecc6060 2024-05-08T23:15:30.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f5578884b80 10 client.0 _ll_register_callbacks cb 0x56374ebb8ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:30.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.648+0000 7f556ac67700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6a20 0x56374ecd56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f556ac67700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6a20 0x56374ecd56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49220/0 (socket says 172.21.15.135:49220) 2024-05-08T23:15:30.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f556ac67700 1 -- 172.21.15.135:0/2857255516 learned_addr learned my addr 172.21.15.135:0/2857255516 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:30.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f556a466700 1 --2- 172.21.15.135:0/2857255516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc5700 0x56374ecbcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f5569c65700 1 --2- 172.21.15.135:0/2857255516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc6060 0x56374ecbd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f556ac67700 1 -- 172.21.15.135:0/2857255516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc6060 msgr2=0x56374ecbd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f556ac67700 1 --2- 172.21.15.135:0/2857255516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc6060 0x56374ecbd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f556ac67700 1 -- 172.21.15.135:0/2857255516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc5700 msgr2=0x56374ecbcf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:30.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f556ac67700 1 --2- 172.21.15.135:0/2857255516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc5700 0x56374ecbcf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f556ac67700 1 -- 172.21.15.135:0/2857255516 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56374ea40b10 con 0x56374ecc6a20 2024-05-08T23:15:30.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f556ac67700 1 --2- 172.21.15.135:0/2857255516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6a20 0x56374ecd56e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f555c007840 tx=0x7f555c007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a62c77eacaec9b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:30.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f554dffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:30.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f554dffb700 1 -- 172.21.15.135:0/2857255516 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c016870 con 0x56374ecc6a20 2024-05-08T23:15:30.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f5578884b80 1 -- 172.21.15.135:0/2857255516 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f55600a3660 con 0x56374ecc6a20 2024-05-08T23:15:30.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f554dffb700 1 -- 172.21.15.135:0/2857255516 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f555c0169d0 con 0x56374ecc6a20 2024-05-08T23:15:30.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f554dffb700 1 -- 172.21.15.135:0/2857255516 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f555c016b90 con 0x56374ecc6a20 2024-05-08T23:15:30.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f5578884b80 10 client.15315 fetch_fsmap learned FSMap version 27 2024-05-08T23:15:30.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f5578884b80 1 -- 172.21.15.135:0/2857255516 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56374ea98c80 con 0x56374ecc6a20 2024-05-08T23:15:30.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.649+0000 7f554dffb700 1 -- 172.21.15.135:0/2857255516 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f55600a3660 con 0x56374ecc6a20 2024-05-08T23:15:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.650+0000 7f554dffb700 1 -- 172.21.15.135:0/2857255516 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f555c01e3a0 con 0x56374ecc6a20 2024-05-08T23:15:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.650+0000 7f5578884b80 10 client.15315 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T23:15:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.650+0000 7f5578884b80 10 client.15315 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-08T23:15:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.650+0000 7f5578884b80 20 client.15315 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.650+0000 7f5578884b80 1 --2- 172.21.15.135:0/2857255516 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56374ed35040 0x56374ed31990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.650+0000 7f5578884b80 4 client.15315 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T23:15:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.650+0000 7f5578884b80 1 -- 172.21.15.135:0/2857255516 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56374ec0be70 con 0x56374ed35040 2024-05-08T23:15:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.650+0000 7f556a466700 1 --2- 172.21.15.135:0/2857255516 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56374ed35040 0x56374ed31990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.650+0000 7f554dffb700 10 client.15315 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:15:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.650+0000 7f556a466700 1 --2- 172.21.15.135:0/2857255516 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56374ed35040 0x56374ed31990 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=937a76724c063e1 server_cookie=5c2a8fcaebe3d6d1 in_seq=0 out_seq=0 2024-05-08T23:15:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.650+0000 7f554dffb700 1 -- 172.21.15.135:0/2857255516 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56374ec0be70 con 0x56374ed35040 2024-05-08T23:15:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.650+0000 7f554dffb700 10 client.15315 handle_command_reply: tid=0 2024-05-08T23:15:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.650+0000 7f5578884b80 1 client.15315 shutdown 2024-05-08T23:15:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f5578884b80 1 -- 172.21.15.135:0/2857255516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6a20 msgr2=0x56374ecd56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f5578884b80 1 --2- 172.21.15.135:0/2857255516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6a20 0x56374ecd56e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f555c007840 tx=0x7f555c007b50 comp rx=0 tx=0).stop 2024-05-08T23:15:30.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f5578884b80 1 -- 172.21.15.135:0/2857255516 shutdown_connections 2024-05-08T23:15:30.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f5578884b80 1 --2- 172.21.15.135:0/2857255516 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56374ed35040 0x56374ed31990 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f5578884b80 1 --2- 172.21.15.135:0/2857255516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56374ecc6a20 0x56374ecd56e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f554dffb700 0 client.15315 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:15:30.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f5578884b80 1 --2- 172.21.15.135:0/2857255516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56374ecc5700 0x56374ecbcf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f5578884b80 1 --2- 172.21.15.135:0/2857255516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56374ecc6060 0x56374ecbd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f5578884b80 1 -- 172.21.15.135:0/2857255516 >> 172.21.15.135:0/2857255516 conn(0x56374ec211c0 msgr2=0x56374ecce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f5578884b80 1 -- 172.21.15.135:0/2857255516 shutdown_connections 2024-05-08T23:15:30.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f5578884b80 1 -- 172.21.15.135:0/2857255516 wait complete. 2024-05-08T23:15:30.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f5578884b80 20 client.15315 trim_cache size 0 max 16384 2024-05-08T23:15:30.658 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:15:30.659 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "c804a50a-0d8f-11ef-bc97-c7b262605968", 2024-05-08T23:15:30.659 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 0, 2024-05-08T23:15:30.659 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24508, 2024-05-08T23:15:30.659 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-08T23:15:30.659 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-08T23:15:30.659 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-08T23:15:30.659 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 68.726234460000001, 2024-05-08T23:15:30.659 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 27, 2024-05-08T23:15:30.659 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 85, 2024-05-08T23:15:30.659 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 83, 2024-05-08T23:15:30.659 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 79.487877710999996 2024-05-08T23:15:30.659 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:15:30.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f556c6ca700 1 -- 172.21.15.135:0/499287379 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f55500a1230 msgr2=0x7f55500a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f556c6ca700 1 --2- 172.21.15.135:0/499287379 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f55500a1230 0x7f55500a36f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5558005d90 tx=0x7f5558005d20 comp rx=0 tx=0).stop 2024-05-08T23:15:30.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f556c6ca700 1 -- 172.21.15.135:0/499287379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5564100fb0 msgr2=0x7f5564196360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:30.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f556c6ca700 1 --2- 172.21.15.135:0/499287379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5564100fb0 0x7f5564196360 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5560005910 tx=0x7f5560009510 comp rx=0 tx=0).stop 2024-05-08T23:15:30.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f556c6ca700 1 -- 172.21.15.135:0/499287379 shutdown_connections 2024-05-08T23:15:30.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f556c6ca700 1 --2- 172.21.15.135:0/499287379 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f55500a1230 0x7f55500a36f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f556c6ca700 1 --2- 172.21.15.135:0/499287379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5564101970 0x7f556419d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f556c6ca700 1 --2- 172.21.15.135:0/499287379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55640ffe60 0x7f5564195e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f556c6ca700 1 --2- 172.21.15.135:0/499287379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5564100fb0 0x7f5564196360 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:30.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f556c6ca700 1 -- 172.21.15.135:0/499287379 >> 172.21.15.135:0/499287379 conn(0x7f55640fb3f0 msgr2=0x7f55641043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:30.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f556c6ca700 1 -- 172.21.15.135:0/499287379 shutdown_connections 2024-05-08T23:15:30.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:30.651+0000 7f556c6ca700 1 -- 172.21.15.135:0/499287379 wait complete. 2024-05-08T23:15:30.664 INFO:teuthology.run_tasks:Running task sequential... 2024-05-08T23:15:30.674 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-08T23:15:30.674 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-08T23:15:30.674 INFO:teuthology.task.print:Enabling mgr modules 2024-05-08T23:15:30.674 INFO:teuthology.run_tasks:Running task kclient... 2024-05-08T23:15:30.707 INFO:tasks.kclient:Mounting kernel clients... 2024-05-08T23:15:30.707 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-08T23:15:30.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:30.708 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-08T23:15:30.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:30.726 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-05-08T23:15:30.794 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2024-05-08T23:15:30.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:15:30.796 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-05-08T23:15:30.796 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T23:15:30.796 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T23:15:30.797 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-08T23:15:31.058 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:15:32.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.036+0000 7facb97be700 1 -- 172.21.15.135:0/2089631460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb4100bb0 msgr2=0x7facb410ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:32.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.036+0000 7facb97be700 1 --2- 172.21.15.135:0/2089631460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb4100bb0 0x7facb410ccc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7facac00b0a0 tx=0x7facac00b3b0 comp rx=0 tx=0).stop 2024-05-08T23:15:32.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.036+0000 7facb97be700 1 -- 172.21.15.135:0/2089631460 shutdown_connections 2024-05-08T23:15:32.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.036+0000 7facb97be700 1 --2- 172.21.15.135:0/2089631460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb4100bb0 0x7facb410ccc0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:32.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.036+0000 7facb97be700 1 --2- 172.21.15.135:0/2089631460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb4105ff0 0x7facb41063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:32.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.036+0000 7facb97be700 1 --2- 172.21.15.135:0/2089631460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb41001f0 0x7facb4100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:32.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.036+0000 7facb97be700 1 -- 172.21.15.135:0/2089631460 >> 172.21.15.135:0/2089631460 conn(0x7facb4075d10 msgr2=0x7facb4076120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:32.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.037+0000 7facb97be700 1 -- 172.21.15.135:0/2089631460 shutdown_connections 2024-05-08T23:15:32.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.037+0000 7facb97be700 1 -- 172.21.15.135:0/2089631460 wait complete. 2024-05-08T23:15:32.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.037+0000 7facb97be700 1 Processor -- start 2024-05-08T23:15:32.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.037+0000 7facb97be700 1 -- start start 2024-05-08T23:15:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb97be700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb41001f0 0x7facb4198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb97be700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb4100bb0 0x7facb4198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb97be700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb4105ff0 0x7facb41a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb97be700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb4199010 con 0x7facb4100bb0 2024-05-08T23:15:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb97be700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb41a37f0 con 0x7facb41001f0 2024-05-08T23:15:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb97be700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb41a3930 con 0x7facb4105ff0 2024-05-08T23:15:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb27fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb4100bb0 0x7facb4198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb27fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb4100bb0 0x7facb4198770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49236/0 (socket says 172.21.15.135:49236) 2024-05-08T23:15:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb27fc700 1 -- 172.21.15.135:0/99051536 learned_addr learned my addr 172.21.15.135:0/99051536 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb2ffd700 1 --2- 172.21.15.135:0/99051536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb41001f0 0x7facb4198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb37fe700 1 --2- 172.21.15.135:0/99051536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb4105ff0 0x7facb41a32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb27fc700 1 -- 172.21.15.135:0/99051536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb4105ff0 msgr2=0x7facb41a32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb27fc700 1 --2- 172.21.15.135:0/99051536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb4105ff0 0x7facb41a32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb27fc700 1 -- 172.21.15.135:0/99051536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb41001f0 msgr2=0x7facb4198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb27fc700 1 --2- 172.21.15.135:0/99051536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb41001f0 0x7facb4198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb27fc700 1 -- 172.21.15.135:0/99051536 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac009d00 con 0x7facb4100bb0 2024-05-08T23:15:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb27fc700 1 --2- 172.21.15.135:0/99051536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb4100bb0 0x7facb4198770 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faca400d980 tx=0x7faca400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7fac9bfff700 1 -- 172.21.15.135:0/99051536 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4009b40 con 0x7facb4100bb0 2024-05-08T23:15:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb97be700 1 -- 172.21.15.135:0/99051536 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb41a3be0 con 0x7facb4100bb0 2024-05-08T23:15:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7fac9bfff700 1 -- 172.21.15.135:0/99051536 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faca400b6e0 con 0x7facb4100bb0 2024-05-08T23:15:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7fac9bfff700 1 -- 172.21.15.135:0/99051536 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca400f620 con 0x7facb4100bb0 2024-05-08T23:15:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.038+0000 7facb97be700 1 -- 172.21.15.135:0/99051536 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb41a40e0 con 0x7facb4100bb0 2024-05-08T23:15:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.039+0000 7facb97be700 1 -- 172.21.15.135:0/99051536 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb41083a0 con 0x7facb4100bb0 2024-05-08T23:15:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.040+0000 7fac9bfff700 1 -- 172.21.15.135:0/99051536 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7faca4010460 con 0x7facb4100bb0 2024-05-08T23:15:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.041+0000 7fac9bfff700 1 --2- 172.21.15.135:0/99051536 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fac9c0a11b0 0x7fac9c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.041+0000 7facb2ffd700 1 --2- 172.21.15.135:0/99051536 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fac9c0a11b0 0x7fac9c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:32.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.041+0000 7fac9bfff700 1 -- 172.21.15.135:0/99051536 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7faca40ccd30 con 0x7facb4100bb0 2024-05-08T23:15:32.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.041+0000 7facb2ffd700 1 --2- 172.21.15.135:0/99051536 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fac9c0a11b0 0x7fac9c0a3670 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faca8005950 tx=0x7faca800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:32.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.045+0000 7fac9bfff700 1 -- 172.21.15.135:0/99051536 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7faca4096340 con 0x7facb4100bb0 2024-05-08T23:15:32.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.284+0000 7facb97be700 1 -- 172.21.15.135:0/99051536 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7facb41015a0 con 0x7facb4100bb0 2024-05-08T23:15:32.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.284+0000 7fac9bfff700 1 -- 172.21.15.135:0/99051536 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7faca4020060 con 0x7facb4100bb0 2024-05-08T23:15:32.285 INFO:teuthology.orchestra.run.smithi135.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T23:15:32.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.286+0000 7facb97be700 1 -- 172.21.15.135:0/99051536 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fac9c0a11b0 msgr2=0x7fac9c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:32.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.286+0000 7facb97be700 1 --2- 172.21.15.135:0/99051536 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fac9c0a11b0 0x7fac9c0a3670 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faca8005950 tx=0x7faca800b410 comp rx=0 tx=0).stop 2024-05-08T23:15:32.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.286+0000 7facb97be700 1 -- 172.21.15.135:0/99051536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb4100bb0 msgr2=0x7facb4198770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:32.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.286+0000 7facb97be700 1 --2- 172.21.15.135:0/99051536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb4100bb0 0x7facb4198770 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faca400d980 tx=0x7faca400dc90 comp rx=0 tx=0).stop 2024-05-08T23:15:32.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.287+0000 7facb97be700 1 -- 172.21.15.135:0/99051536 shutdown_connections 2024-05-08T23:15:32.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.287+0000 7facb97be700 1 --2- 172.21.15.135:0/99051536 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fac9c0a11b0 0x7fac9c0a3670 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:32.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.287+0000 7facb97be700 1 --2- 172.21.15.135:0/99051536 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb4105ff0 0x7facb41a32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:32.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.287+0000 7facb97be700 1 --2- 172.21.15.135:0/99051536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb41001f0 0x7facb4198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:32.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.287+0000 7facb97be700 1 --2- 172.21.15.135:0/99051536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb4100bb0 0x7facb4198770 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:32.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.287+0000 7facb97be700 1 -- 172.21.15.135:0/99051536 >> 172.21.15.135:0/99051536 conn(0x7facb4075d10 msgr2=0x7facb40fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:32.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.287+0000 7facb97be700 1 -- 172.21.15.135:0/99051536 shutdown_connections 2024-05-08T23:15:32.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:32.287+0000 7facb97be700 1 -- 172.21.15.135:0/99051536 wait complete. 2024-05-08T23:15:32.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:32 smithi135 ceph-mon[42440]: pgmap v260: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 78 B/s, 1 objects/s recovering 2024-05-08T23:15:32.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:32 smithi179 ceph-mon[46314]: pgmap v260: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 78 B/s, 1 objects/s recovering 2024-05-08T23:15:32.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:32 smithi195 ceph-mon[46516]: pgmap v260: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 78 B/s, 1 objects/s recovering 2024-05-08T23:15:32.657 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T23:15:32.657 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T23:15:32.657 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2024-05-08T23:15:32.657 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T23:15:32.657 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T23:15:32.657 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T23:15:32.657 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T23:15:32.657 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T23:15:32.657 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T23:15:32.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:32.658 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2024-05-08T23:15:32.676 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T23:15:32.676 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T23:15:32.676 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T23:15:32.676 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-08T23:15:32.676 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-05-08T23:15:32.676 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-08T23:15:32.676 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T23:15:32.677 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2024-05-08T23:15:32.677 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2024-05-08T23:15:32.677 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T23:15:32.677 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2024-05-08T23:15:32.677 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2024-05-08T23:15:32.677 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T23:15:32.677 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2024-05-08T23:15:32.677 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T23:15:32.677 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2024-05-08T23:15:32.677 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T23:15:32.677 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 41846sec preferred_lft 41846sec 2024-05-08T23:15:32.677 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::f5ee:27a9:fa5:c23b/64 scope link noprefixroute 2024-05-08T23:15:32.677 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-08T23:15:32.678 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T23:15:32.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:32.678 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-08T23:15:32.678 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-08T23:15:32.678 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2024-05-08T23:15:32.678 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2024-05-08T23:15:32.678 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2024-05-08T23:15:32.678 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T23:15:32.679 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-08T23:15:32.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:32.844 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T23:15:32.872 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-05-08T23:15:32.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:32.873 DEBUG:teuthology.orchestra.run.smithi135:> route 2024-05-08T23:15:32.945 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2024-05-08T23:15:32.946 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T23:15:32.946 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T23:15:32.946 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T23:15:32.946 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T23:15:32.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:32.946 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-08T23:15:32.946 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-08T23:15:32.947 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T23:15:32.947 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T23:15:32.947 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T23:15:32.947 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-08T23:15:33.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:33.197 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-08T23:15:33.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:33.214 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2024-05-08T23:15:33.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:33.271 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-08T23:15:33.271 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-08T23:15:33.271 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T23:15:33.272 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-08T23:15:33.272 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-08T23:15:33.351 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:33 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/99051536' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T23:15:33.368 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-08T23:15:33.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:33.368 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-08T23:15:33.368 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-08T23:15:33.368 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-08T23:15:33.368 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T23:15:33.368 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-08T23:15:33.368 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-08T23:15:33.368 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-08T23:15:33.368 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-08T23:15:33.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:33 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/99051536' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T23:15:33.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:33.616 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-08T23:15:33.616 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-08T23:15:33.616 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2024-05-08T23:15:33.616 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T23:15:33.616 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-08T23:15:33.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:33 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/99051536' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T23:15:33.714 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T23:15:33.714 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T23:15:33.731 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T23:15:33.731 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T23:15:33.731 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T23:15:33.788 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-05-08T23:15:33.788 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-05-08T23:15:33.788 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/e8d98d61-b0f4-4534-b54f-f33683085264 2024-05-08T23:15:33.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:33.788 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/e8d98d61-b0f4-4534-b54f-f33683085264 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-05-08T23:15:33.874 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-05-08T23:15:33.874 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-05-08T23:15:33.981 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-05-08T23:15:33.981 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-05-08T23:15:33.981 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.135:3300,172.21.15.179:3300,172.21.15.195:3300" 2024-05-08T23:15:33.981 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with new device syntax: 0@c804a50a-0d8f-11ef-bc97-c7b262605968.cephfs=/volumes/qa/sv_1/e8d98d61-b0f4-4534-b54f-f33683085264 2024-05-08T23:15:33.982 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mon_addr=172.21.15.135:3300/172.21.15.179:3300/172.21.15.195:3300" will pass to kernel 2024-05-08T23:15:33.982 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: v2 mount support check returned 2 2024-05-08T23:15:33.982 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: kernel does not support v2 syntax 2024-05-08T23:15:33.982 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.135:3300,172.21.15.179:3300,172.21.15.195:3300:/volumes/qa/sv_1/e8d98d61-b0f4-4534-b54f-f33683085264 2024-05-08T23:15:33.982 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mds_namespace=cephfs,fsid=c804a50a-0d8f-11ef-bc97-c7b262605968" will pass to kernel 2024-05-08T23:15:33.984 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T23:15:33.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:33.985 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T23:15:34.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:34.015 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T23:15:34.105 INFO:teuthology.orchestra.run.smithi135.stdout:client15324 2024-05-08T23:15:34.106 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:15:34.106 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T23:15:34.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:34.125 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T23:15:34.215 INFO:teuthology.orchestra.run.smithi135.stdout:client15324 2024-05-08T23:15:34.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:34.216 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T23:15:34.267 INFO:teuthology.orchestra.run.smithi135.stdout:client15324 2024-05-08T23:15:34.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:15:34.268 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968.client15324/status') 2024-05-08T23:15:34.323 INFO:teuthology.orchestra.run.smithi135.stdout:instance: client.15324 (3)192.168.0.1:0/3474975075 2024-05-08T23:15:34.323 INFO:teuthology.orchestra.run.smithi135.stdout:blocklisted: false 2024-05-08T23:15:34.324 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records in 2024-05-08T23:15:34.324 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records out 2024-05-08T23:15:34.324 INFO:teuthology.orchestra.run.smithi135.stderr:70 bytes copied, 2.0971e-05 s, 3.3 MB/s 2024-05-08T23:15:34.325 INFO:teuthology.run_tasks:Running task exec... 2024-05-08T23:15:34.338 INFO:teuthology.task.exec:Executing custom commands... 2024-05-08T23:15:34.338 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T23:15:34.338 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-05-08T23:15:34.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.462+0000 7f4e1c31d700 1 -- 172.21.15.135:0/79897217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e14100770 msgr2=0x7f4e14100bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:34.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.462+0000 7f4e1c31d700 1 --2- 172.21.15.135:0/79897217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e14100770 0x7f4e14100bd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4e040099c0 tx=0x7f4e04009cd0 comp rx=0 tx=0).stop 2024-05-08T23:15:34.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.462+0000 7f4e1c31d700 1 -- 172.21.15.135:0/79897217 shutdown_connections 2024-05-08T23:15:34.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.462+0000 7f4e1c31d700 1 --2- 172.21.15.135:0/79897217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e140ff580 0x7f4e140ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:34.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.462+0000 7f4e1c31d700 1 --2- 172.21.15.135:0/79897217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e14101110 0x7f4e141079c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:34.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.462+0000 7f4e1c31d700 1 --2- 172.21.15.135:0/79897217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e14100770 0x7f4e14100bd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:34.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.462+0000 7f4e1c31d700 1 -- 172.21.15.135:0/79897217 >> 172.21.15.135:0/79897217 conn(0x7f4e140faaf0 msgr2=0x7f4e140fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:34.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.462+0000 7f4e1c31d700 1 -- 172.21.15.135:0/79897217 shutdown_connections 2024-05-08T23:15:34.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.462+0000 7f4e1c31d700 1 -- 172.21.15.135:0/79897217 wait complete. 2024-05-08T23:15:34.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.462+0000 7f4e1c31d700 1 Processor -- start 2024-05-08T23:15:34.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.462+0000 7f4e1c31d700 1 -- start start 2024-05-08T23:15:34.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e1c31d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e140ff580 0x7f4e140fcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:34.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e1c31d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e14100770 0x7f4e1419bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:34.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e1c31d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e14101110 0x7f4e1419e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:34.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e1c31d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1419e9b0 con 0x7f4e14100770 2024-05-08T23:15:34.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e1c31d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1419eb20 con 0x7f4e140ff580 2024-05-08T23:15:34.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e1c31d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1419ece0 con 0x7f4e14101110 2024-05-08T23:15:34.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e198b8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e14100770 0x7f4e1419bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:34.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e198b8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e14100770 0x7f4e1419bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49258/0 (socket says 172.21.15.135:49258) 2024-05-08T23:15:34.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e198b8700 1 -- 172.21.15.135:0/3946469927 learned_addr learned my addr 172.21.15.135:0/3946469927 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:34.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e1a0b9700 1 --2- 172.21.15.135:0/3946469927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e140ff580 0x7f4e140fcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:34.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e1a8ba700 1 --2- 172.21.15.135:0/3946469927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e14101110 0x7f4e1419e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:34.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e198b8700 1 -- 172.21.15.135:0/3946469927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e14101110 msgr2=0x7f4e1419e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:34.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e198b8700 1 --2- 172.21.15.135:0/3946469927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e14101110 0x7f4e1419e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:34.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e198b8700 1 -- 172.21.15.135:0/3946469927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e140ff580 msgr2=0x7f4e140fcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:34.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e198b8700 1 --2- 172.21.15.135:0/3946469927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e140ff580 0x7f4e140fcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:34.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e198b8700 1 -- 172.21.15.135:0/3946469927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e040095f0 con 0x7f4e14100770 2024-05-08T23:15:34.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e198b8700 1 --2- 172.21.15.135:0/3946469927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e14100770 0x7f4e1419bc20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009f50 tx=0x7f4e04003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:34.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e0b7fe700 1 -- 172.21.15.135:0/3946469927 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0401d070 con 0x7f4e14100770 2024-05-08T23:15:34.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e0b7fe700 1 -- 172.21.15.135:0/3946469927 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e04022470 con 0x7f4e14100770 2024-05-08T23:15:34.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e1c31d700 1 -- 172.21.15.135:0/3946469927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1419ef60 con 0x7f4e14100770 2024-05-08T23:15:34.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e0b7fe700 1 -- 172.21.15.135:0/3946469927 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400f6c0 con 0x7f4e14100770 2024-05-08T23:15:34.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.463+0000 7f4e1c31d700 1 -- 172.21.15.135:0/3946469927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1419f320 con 0x7f4e14100770 2024-05-08T23:15:34.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.464+0000 7f4e1c31d700 1 -- 172.21.15.135:0/3946469927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e141071d0 con 0x7f4e14100770 2024-05-08T23:15:34.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.465+0000 7f4e0b7fe700 1 -- 172.21.15.135:0/3946469927 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f4e040225e0 con 0x7f4e14100770 2024-05-08T23:15:34.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.466+0000 7f4e0b7fe700 1 --2- 172.21.15.135:0/3946469927 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4e000a11b0 0x7f4e000a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:34.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.466+0000 7f4e0b7fe700 1 -- 172.21.15.135:0/3946469927 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4e040ce6a0 con 0x7f4e14100770 2024-05-08T23:15:34.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.466+0000 7f4e1a0b9700 1 --2- 172.21.15.135:0/3946469927 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4e000a11b0 0x7f4e000a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:34.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.466+0000 7f4e1a0b9700 1 --2- 172.21.15.135:0/3946469927 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4e000a11b0 0x7f4e000a3670 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4e10005fd0 tx=0x7f4e10005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:34.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.469+0000 7f4e0b7fe700 1 -- 172.21.15.135:0/3946469927 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4e04097dd0 con 0x7f4e14100770 2024-05-08T23:15:34.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:34 smithi179 ceph-mon[46314]: pgmap v261: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 71 B/s, 1 objects/s recovering 2024-05-08T23:15:34.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:34 smithi195 ceph-mon[46516]: pgmap v261: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 71 B/s, 1 objects/s recovering 2024-05-08T23:15:34.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:34 smithi135 ceph-mon[42440]: pgmap v261: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 71 B/s, 1 objects/s recovering 2024-05-08T23:15:34.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:34.716+0000 7f4e1c31d700 1 -- 172.21.15.135:0/3946469927 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) v1 -- 0x7f4e140675a0 con 0x7f4e14100770 2024-05-08T23:15:35.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.214+0000 7f4e0b7fe700 1 -- 172.21.15.135:0/3946469927 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v28) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4e0409b3f0 con 0x7f4e14100770 2024-05-08T23:15:35.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.217+0000 7f4e1c31d700 1 -- 172.21.15.135:0/3946469927 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4e000a11b0 msgr2=0x7f4e000a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:35.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.217+0000 7f4e1c31d700 1 --2- 172.21.15.135:0/3946469927 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4e000a11b0 0x7f4e000a3670 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4e10005fd0 tx=0x7f4e10005dd0 comp rx=0 tx=0).stop 2024-05-08T23:15:35.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.217+0000 7f4e1c31d700 1 -- 172.21.15.135:0/3946469927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e14100770 msgr2=0x7f4e1419bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:35.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.217+0000 7f4e1c31d700 1 --2- 172.21.15.135:0/3946469927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e14100770 0x7f4e1419bc20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009f50 tx=0x7f4e04003970 comp rx=0 tx=0).stop 2024-05-08T23:15:35.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.217+0000 7f4e1c31d700 1 -- 172.21.15.135:0/3946469927 shutdown_connections 2024-05-08T23:15:35.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.217+0000 7f4e1c31d700 1 --2- 172.21.15.135:0/3946469927 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4e000a11b0 0x7f4e000a3670 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:35.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.217+0000 7f4e1c31d700 1 --2- 172.21.15.135:0/3946469927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e14101110 0x7f4e1419e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:35.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.217+0000 7f4e1c31d700 1 --2- 172.21.15.135:0/3946469927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e140ff580 0x7f4e140fcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:35.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.217+0000 7f4e1c31d700 1 --2- 172.21.15.135:0/3946469927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e14100770 0x7f4e1419bc20 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:35.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.217+0000 7f4e1c31d700 1 -- 172.21.15.135:0/3946469927 >> 172.21.15.135:0/3946469927 conn(0x7f4e140faaf0 msgr2=0x7f4e14101e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:35.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.217+0000 7f4e1c31d700 1 -- 172.21.15.135:0/3946469927 shutdown_connections 2024-05-08T23:15:35.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.217+0000 7f4e1c31d700 1 -- 172.21.15.135:0/3946469927 wait complete. 2024-05-08T23:15:35.231 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-05-08T23:15:35.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.358+0000 7f3c6947f700 1 -- 172.21.15.135:0/2407022893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c640ff200 msgr2=0x7f3c640ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:35.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.358+0000 7f3c6947f700 1 --2- 172.21.15.135:0/2407022893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c640ff200 0x7f3c640ff620 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009990 tx=0x7f3c58009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:35.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.359+0000 7f3c6947f700 1 -- 172.21.15.135:0/2407022893 shutdown_connections 2024-05-08T23:15:35.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.359+0000 7f3c6947f700 1 --2- 172.21.15.135:0/2407022893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c64102b70 0x7f3c64109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:35.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.359+0000 7f3c6947f700 1 --2- 172.21.15.135:0/2407022893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c640ff200 0x7f3c640ff620 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:35.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.359+0000 7f3c6947f700 1 --2- 172.21.15.135:0/2407022893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c641021d0 0x7f3c64102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:35.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.359+0000 7f3c6947f700 1 -- 172.21.15.135:0/2407022893 >> 172.21.15.135:0/2407022893 conn(0x7f3c640fab30 msgr2=0x7f3c640fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:35.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.359+0000 7f3c6947f700 1 -- 172.21.15.135:0/2407022893 shutdown_connections 2024-05-08T23:15:35.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.359+0000 7f3c6947f700 1 -- 172.21.15.135:0/2407022893 wait complete. 2024-05-08T23:15:35.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.359+0000 7f3c6947f700 1 Processor -- start 2024-05-08T23:15:35.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.359+0000 7f3c6947f700 1 -- start start 2024-05-08T23:15:35.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.359+0000 7f3c6947f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c640ff200 0x7f3c64196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:35.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c6947f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c641021d0 0x7f3c64197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:35.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c6947f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c64102b70 0x7f3c6419e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:35.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c6947f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6419ea30 con 0x7f3c64102b70 2024-05-08T23:15:35.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c6947f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6419eb70 con 0x7f3c640ff200 2024-05-08T23:15:35.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c6947f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6419ed00 con 0x7f3c641021d0 2024-05-08T23:15:35.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c637fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c64102b70 0x7f3c6419e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:35.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c62ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c640ff200 0x7f3c64196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:35.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c637fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c64102b70 0x7f3c6419e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49282/0 (socket says 172.21.15.135:49282) 2024-05-08T23:15:35.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c637fe700 1 -- 172.21.15.135:0/2329752063 learned_addr learned my addr 172.21.15.135:0/2329752063 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:35.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c627fc700 1 --2- 172.21.15.135:0/2329752063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c641021d0 0x7f3c64197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:35.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c637fe700 1 -- 172.21.15.135:0/2329752063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c641021d0 msgr2=0x7f3c64197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:35.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c637fe700 1 --2- 172.21.15.135:0/2329752063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c641021d0 0x7f3c64197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:35.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c637fe700 1 -- 172.21.15.135:0/2329752063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c640ff200 msgr2=0x7f3c64196f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:35.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c637fe700 1 --2- 172.21.15.135:0/2329752063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c640ff200 0x7f3c64196f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:35.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c637fe700 1 -- 172.21.15.135:0/2329752063 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c580095f0 con 0x7f3c64102b70 2024-05-08T23:15:35.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c637fe700 1 --2- 172.21.15.135:0/2329752063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c64102b70 0x7f3c6419e460 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c007d70 tx=0x7f3c5c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:35.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c4bfff700 1 -- 172.21.15.135:0/2329752063 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c00ac90 con 0x7f3c64102b70 2024-05-08T23:15:35.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c4bfff700 1 -- 172.21.15.135:0/2329752063 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c5c00adf0 con 0x7f3c64102b70 2024-05-08T23:15:35.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c6947f700 1 -- 172.21.15.135:0/2329752063 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c6419efe0 con 0x7f3c64102b70 2024-05-08T23:15:35.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c4bfff700 1 -- 172.21.15.135:0/2329752063 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c0115e0 con 0x7f3c64102b70 2024-05-08T23:15:35.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.360+0000 7f3c6947f700 1 -- 172.21.15.135:0/2329752063 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6419f410 con 0x7f3c64102b70 2024-05-08T23:15:35.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.361+0000 7f3c6947f700 1 -- 172.21.15.135:0/2329752063 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c64108460 con 0x7f3c64102b70 2024-05-08T23:15:35.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.362+0000 7f3c4bfff700 1 -- 172.21.15.135:0/2329752063 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f3c5c012420 con 0x7f3c64102b70 2024-05-08T23:15:35.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.363+0000 7f3c4bfff700 1 --2- 172.21.15.135:0/2329752063 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c4c0a11b0 0x7f3c4c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:35.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.363+0000 7f3c4bfff700 1 -- 172.21.15.135:0/2329752063 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3c5c0ccbb0 con 0x7f3c64102b70 2024-05-08T23:15:35.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.363+0000 7f3c62ffd700 1 --2- 172.21.15.135:0/2329752063 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c4c0a11b0 0x7f3c4c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:35.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.363+0000 7f3c62ffd700 1 --2- 172.21.15.135:0/2329752063 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c4c0a11b0 0x7f3c4c0a3670 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800b5c0 tx=0x7f3c58003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:35.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.367+0000 7f3c4bfff700 1 -- 172.21.15.135:0/2329752063 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3c5c096270 con 0x7f3c64102b70 2024-05-08T23:15:35.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.599+0000 7f3c6947f700 1 -- 172.21.15.135:0/2329752063 --> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c6402ce10 con 0x7f3c4c0a11b0 2024-05-08T23:15:35.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:35 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3946469927' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T23:15:35.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.607+0000 7f3c4bfff700 1 -- 172.21.15.135:0/2329752063 <== mgr.14152 v2:172.21.15.135:6800/1743116941 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7f3c6402ce10 con 0x7f3c4c0a11b0 2024-05-08T23:15:35.607 INFO:teuthology.orchestra.run.smithi135.stdout:{} 2024-05-08T23:15:35.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.609+0000 7f3c6947f700 1 -- 172.21.15.135:0/2329752063 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c4c0a11b0 msgr2=0x7f3c4c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:35.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.609+0000 7f3c6947f700 1 --2- 172.21.15.135:0/2329752063 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c4c0a11b0 0x7f3c4c0a3670 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800b5c0 tx=0x7f3c58003790 comp rx=0 tx=0).stop 2024-05-08T23:15:35.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.609+0000 7f3c6947f700 1 -- 172.21.15.135:0/2329752063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c64102b70 msgr2=0x7f3c6419e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:35.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.609+0000 7f3c6947f700 1 --2- 172.21.15.135:0/2329752063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c64102b70 0x7f3c6419e460 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c007d70 tx=0x7f3c5c00a340 comp rx=0 tx=0).stop 2024-05-08T23:15:35.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.609+0000 7f3c6947f700 1 -- 172.21.15.135:0/2329752063 shutdown_connections 2024-05-08T23:15:35.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.609+0000 7f3c6947f700 1 --2- 172.21.15.135:0/2329752063 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c4c0a11b0 0x7f3c4c0a3670 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:35.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.609+0000 7f3c6947f700 1 --2- 172.21.15.135:0/2329752063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c64102b70 0x7f3c6419e460 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:35.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.609+0000 7f3c6947f700 1 --2- 172.21.15.135:0/2329752063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c640ff200 0x7f3c64196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:35.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.609+0000 7f3c6947f700 1 --2- 172.21.15.135:0/2329752063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c641021d0 0x7f3c64197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:35.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.609+0000 7f3c6947f700 1 -- 172.21.15.135:0/2329752063 >> 172.21.15.135:0/2329752063 conn(0x7f3c640fab30 msgr2=0x7f3c641055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:35.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.609+0000 7f3c6947f700 1 -- 172.21.15.135:0/2329752063 shutdown_connections 2024-05-08T23:15:35.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:15:35.609+0000 7f3c6947f700 1 -- 172.21.15.135:0/2329752063 wait complete. 2024-05-08T23:15:35.621 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:35 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3946469927' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T23:15:35.622 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-08T23:15:35.633 INFO:teuthology.run_tasks:Running task background_exec... 2024-05-08T23:15:35.683 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T23:15:35.683 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-05-08T23:15:35.684 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:35 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3946469927' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T23:15:35.686 INFO:teuthology.run_tasks:Running task workunit... 2024-05-08T23:15:35.699 INFO:tasks.workunit:Pulling workunits from ref d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:15:35.699 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-08T23:15:35.699 INFO:tasks.workunit:timeout=3h 2024-05-08T23:15:35.699 INFO:tasks.workunit:cleanup=True 2024-05-08T23:15:35.699 DEBUG:teuthology.orchestra.run.smithi135:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-08T23:15:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-08T23:15:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-08T23:15:35.721 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 7ch/124d Inode: 1099511628283 Links: 2 2024-05-08T23:15:35.721 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:15:35.721 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:cephfs_t:s0 2024-05-08T23:15:35.721 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-08 23:14:29.577626930 +0000 2024-05-08T23:15:35.721 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-08 23:14:29.577626930 +0000 2024-05-08T23:15:35.721 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-08 23:15:34.012869485 +0000 2024-05-08T23:15:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-05-08 23:14:29.577626930 +0000 2024-05-08T23:15:35.722 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-08T23:15:35.722 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-08T23:15:35.797 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:15:35.855 INFO:tasks.workunit.client.0.smithi135.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-08T23:15:36.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:36 smithi179 ceph-mon[46314]: pgmap v262: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 65 B/s, 0 objects/s recovering 2024-05-08T23:15:36.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:36 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3946469927' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-08T23:15:36.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:36 smithi179 ceph-mon[46314]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T23:15:36.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:36 smithi195 ceph-mon[46516]: pgmap v262: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 65 B/s, 0 objects/s recovering 2024-05-08T23:15:36.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:36 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3946469927' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-08T23:15:36.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:36 smithi195 ceph-mon[46516]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T23:15:36.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:36 smithi135 ceph-mon[42440]: pgmap v262: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 65 B/s, 0 objects/s recovering 2024-05-08T23:15:36.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:36 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3946469927' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-08T23:15:36.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:36 smithi135 ceph-mon[42440]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T23:15:37.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:37 smithi179 ceph-mon[46314]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:37.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:37 smithi195 ceph-mon[46516]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:37.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:37 smithi135 ceph-mon[42440]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:15:38.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:38 smithi179 ceph-mon[46314]: pgmap v263: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-05-08T23:15:38.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:38 smithi195 ceph-mon[46516]: pgmap v263: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-05-08T23:15:38.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:38 smithi135 ceph-mon[42440]: pgmap v263: 97 pgs: 97 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-05-08T23:15:40.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:40 smithi179 ceph-mon[46314]: pgmap v264: 97 pgs: 97 active+clean; 656 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-08T23:15:40.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:40 smithi195 ceph-mon[46516]: pgmap v264: 97 pgs: 97 active+clean; 656 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-08T23:15:40.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:40 smithi135 ceph-mon[42440]: pgmap v264: 97 pgs: 97 active+clean; 656 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-08T23:15:42.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:42 smithi179 ceph-mon[46314]: pgmap v265: 97 pgs: 97 active+clean; 656 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-08T23:15:42.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:42 smithi195 ceph-mon[46516]: pgmap v265: 97 pgs: 97 active+clean; 656 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-08T23:15:42.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:42 smithi135 ceph-mon[42440]: pgmap v265: 97 pgs: 97 active+clean; 656 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-08T23:15:44.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:44 smithi179 ceph-mon[46314]: pgmap v266: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-05-08T23:15:44.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:44 smithi195 ceph-mon[46516]: pgmap v266: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-05-08T23:15:44.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:44 smithi135 ceph-mon[42440]: pgmap v266: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-05-08T23:15:46.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:46 smithi179 ceph-mon[46314]: pgmap v267: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-05-08T23:15:46.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:46 smithi195 ceph-mon[46516]: pgmap v267: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-05-08T23:15:46.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:46 smithi135 ceph-mon[42440]: pgmap v267: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-05-08T23:15:48.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:48 smithi179 ceph-mon[46314]: pgmap v268: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-05-08T23:15:48.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:48 smithi195 ceph-mon[46516]: pgmap v268: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-05-08T23:15:48.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:48 smithi135 ceph-mon[42440]: pgmap v268: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-05-08T23:15:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.850+0000 7f309f6f8700 1 -- 172.21.15.135:0/217686009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3098101a00 msgr2=0x7f3098103df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.850+0000 7f309f6f8700 1 --2- 172.21.15.135:0/217686009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3098101a00 0x7f3098103df0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f308c009990 tx=0x7f308c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.850+0000 7f309f6f8700 1 -- 172.21.15.135:0/217686009 shutdown_connections 2024-05-08T23:15:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.850+0000 7f309f6f8700 1 --2- 172.21.15.135:0/217686009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3098106c60 0x7f3098109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.850+0000 7f309f6f8700 1 --2- 172.21.15.135:0/217686009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3098101a00 0x7f3098103df0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.850+0000 7f309f6f8700 1 --2- 172.21.15.135:0/217686009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3098104330 0x7f3098106720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.850+0000 7f309f6f8700 1 -- 172.21.15.135:0/217686009 >> 172.21.15.135:0/217686009 conn(0x7f30980fb390 msgr2=0x7f30980fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.850+0000 7f309f6f8700 1 -- 172.21.15.135:0/217686009 shutdown_connections 2024-05-08T23:15:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.850+0000 7f309f6f8700 1 -- 172.21.15.135:0/217686009 wait complete. 2024-05-08T23:15:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.851+0000 7f309f6f8700 1 Processor -- start 2024-05-08T23:15:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.851+0000 7f309f6f8700 1 -- start start 2024-05-08T23:15:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.851+0000 7f309f6f8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3098101a00 0x7f3098196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.851+0000 7f309f6f8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3098104330 0x7f3098197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.851+0000 7f309f6f8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3098106c60 0x7f309819e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.851+0000 7f309f6f8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309819e950 con 0x7f3098104330 2024-05-08T23:15:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.851+0000 7f309f6f8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309819ea90 con 0x7f3098101a00 2024-05-08T23:15:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.851+0000 7f309f6f8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309819ec20 con 0x7f3098106c60 2024-05-08T23:15:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.851+0000 7f309cc93700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3098104330 0x7f3098197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.851+0000 7f309cc93700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3098104330 0x7f3098197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41204/0 (socket says 172.21.15.135:41204) 2024-05-08T23:15:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.851+0000 7f309cc93700 1 -- 172.21.15.135:0/359377101 learned_addr learned my addr 172.21.15.135:0/359377101 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.851+0000 7f309d494700 1 --2- 172.21.15.135:0/359377101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3098101a00 0x7f3098196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.851+0000 7f309dc95700 1 --2- 172.21.15.135:0/359377101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3098106c60 0x7f309819e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.852+0000 7f309cc93700 1 -- 172.21.15.135:0/359377101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3098106c60 msgr2=0x7f309819e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.852+0000 7f309cc93700 1 --2- 172.21.15.135:0/359377101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3098106c60 0x7f309819e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.852+0000 7f309cc93700 1 -- 172.21.15.135:0/359377101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3098101a00 msgr2=0x7f3098196e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.852+0000 7f309cc93700 1 --2- 172.21.15.135:0/359377101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3098101a00 0x7f3098196e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.852+0000 7f309cc93700 1 -- 172.21.15.135:0/359377101 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308c0095f0 con 0x7f3098104330 2024-05-08T23:15:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.852+0000 7f309dc95700 1 --2- 172.21.15.135:0/359377101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3098106c60 0x7f309819e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.852+0000 7f309cc93700 1 --2- 172.21.15.135:0/359377101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3098104330 0x7f3098197360 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f309400d980 tx=0x7f309400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.852+0000 7f308a7fc700 1 -- 172.21.15.135:0/359377101 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094004220 con 0x7f3098104330 2024-05-08T23:15:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.852+0000 7f308a7fc700 1 -- 172.21.15.135:0/359377101 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3094007640 con 0x7f3098104330 2024-05-08T23:15:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.852+0000 7f308a7fc700 1 -- 172.21.15.135:0/359377101 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094005610 con 0x7f3098104330 2024-05-08T23:15:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.852+0000 7f309f6f8700 1 -- 172.21.15.135:0/359377101 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309819ef00 con 0x7f3098104330 2024-05-08T23:15:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.852+0000 7f309f6f8700 1 -- 172.21.15.135:0/359377101 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309819f2d0 con 0x7f3098104330 2024-05-08T23:15:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.854+0000 7f308a7fc700 1 -- 172.21.15.135:0/359377101 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f3094004750 con 0x7f3098104330 2024-05-08T23:15:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.855+0000 7f308a7fc700 1 --2- 172.21.15.135:0/359377101 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f30840a1230 0x7f30840a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.855+0000 7f309d494700 1 --2- 172.21.15.135:0/359377101 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f30840a1230 0x7f30840a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.855+0000 7f308a7fc700 1 -- 172.21.15.135:0/359377101 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f30940cc9d0 con 0x7f3098104330 2024-05-08T23:15:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.855+0000 7f309d494700 1 --2- 172.21.15.135:0/359377101 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f30840a1230 0x7f30840a36f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f308c00b5c0 tx=0x7f308c003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.856+0000 7f30ab8b2b80 1 Processor -- start 2024-05-08T23:15:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.856+0000 7f30ab8b2b80 1 -- start start 2024-05-08T23:15:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.856+0000 7f30ab8b2b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059aea80 0x5604059aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.856+0000 7f30ab8b2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 0x5604059afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.856+0000 7f30ab8b2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059b02d0 0x5604059b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.856+0000 7f30ab8b2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604059060f0 con 0x5604059b02d0 2024-05-08T23:15:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.856+0000 7f30ab8b2b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x560405903ab0 con 0x5604059aea80 2024-05-08T23:15:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.856+0000 7f30ab8b2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604058ff3a0 con 0x5604059af3e0 2024-05-08T23:15:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.856+0000 7f309dc95700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059b02d0 0x5604059b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.856+0000 7f309dc95700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059b02d0 0x5604059b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41210/0 (socket says 172.21.15.135:41210) 2024-05-08T23:15:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.856+0000 7f309dc95700 1 -- 172.21.15.135:0/1252432826 learned_addr learned my addr 172.21.15.135:0/1252432826 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.857+0000 7f309d494700 1 --2- 172.21.15.135:0/1252432826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059aea80 0x5604059aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.857+0000 7f309cc93700 1 --2- 172.21.15.135:0/1252432826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 0x5604059afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.857+0000 7f309dc95700 1 -- 172.21.15.135:0/1252432826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 msgr2=0x5604059afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.857+0000 7f309dc95700 1 --2- 172.21.15.135:0/1252432826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 0x5604059afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.857+0000 7f309dc95700 1 -- 172.21.15.135:0/1252432826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059aea80 msgr2=0x5604059aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.857+0000 7f309dc95700 1 --2- 172.21.15.135:0/1252432826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059aea80 0x5604059aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.857+0000 7f309dc95700 1 -- 172.21.15.135:0/1252432826 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560405780350 con 0x5604059b02d0 2024-05-08T23:15:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.857+0000 7f309cc93700 1 --2- 172.21.15.135:0/1252432826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 0x5604059afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.857+0000 7f309dc95700 1 --2- 172.21.15.135:0/1252432826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059b02d0 0x5604059b0750 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f30900085a0 tx=0x7f30900088b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1439a4e3d80aac4e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.857+0000 7f30837fe700 1 -- 172.21.15.135:0/1252432826 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090003c00 con 0x5604059b02d0 2024-05-08T23:15:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.857+0000 7f30837fe700 1 -- 172.21.15.135:0/1252432826 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3090010040 con 0x5604059b02d0 2024-05-08T23:15:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.857+0000 7f30837fe700 1 -- 172.21.15.135:0/1252432826 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090012760 con 0x5604059b02d0 2024-05-08T23:15:48.860 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.858+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/1252432826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059b02d0 msgr2=0x5604059b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.858+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/1252432826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059b02d0 0x5604059b0750 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f30900085a0 tx=0x7f30900088b0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.858+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/1252432826 shutdown_connections 2024-05-08T23:15:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.858+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/1252432826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059b02d0 0x5604059b0750 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.858+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/1252432826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059aea80 0x5604059aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.858+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/1252432826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 0x5604059afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.858+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/1252432826 >> 172.21.15.135:0/1252432826 conn(0x56040590d1b0 msgr2=0x5604059ab440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.858+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/1252432826 shutdown_connections 2024-05-08T23:15:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.858+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/1252432826 wait complete. 2024-05-08T23:15:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.858+0000 7f30ab8b2b80 1 -- start start 2024-05-08T23:15:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.858+0000 7f30ab8b2b80 1 Processor -- start 2024-05-08T23:15:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f30ab8b2b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059aea80 0x5604059b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f30ab8b2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059af3e0 0x5604059b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f30ab8b2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059b02d0 0x5604059bfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f30ab8b2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56040589b500 con 0x5604059af3e0 2024-05-08T23:15:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f30ab8b2b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56040589b1a0 con 0x5604059aea80 2024-05-08T23:15:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f30ab8b2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560405782640 con 0x5604059b02d0 2024-05-08T23:15:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f30ab8b2b80 10 client.0 _ll_register_callbacks cb 0x5604058a4ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f309cc93700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059af3e0 0x5604059b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f309cc93700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059af3e0 0x5604059b8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41212/0 (socket says 172.21.15.135:41212) 2024-05-08T23:15:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f309cc93700 1 -- 172.21.15.135:0/942512273 learned_addr learned my addr 172.21.15.135:0/942512273 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f309dc95700 1 --2- 172.21.15.135:0/942512273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059b02d0 0x5604059bfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f309d494700 1 --2- 172.21.15.135:0/942512273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059aea80 0x5604059b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f309cc93700 1 -- 172.21.15.135:0/942512273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059b02d0 msgr2=0x5604059bfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f309cc93700 1 --2- 172.21.15.135:0/942512273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059b02d0 0x5604059bfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f309cc93700 1 -- 172.21.15.135:0/942512273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059aea80 msgr2=0x5604059b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f309cc93700 1 --2- 172.21.15.135:0/942512273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059aea80 0x5604059b8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f309cc93700 1 -- 172.21.15.135:0/942512273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3090007dd0 con 0x5604059af3e0 2024-05-08T23:15:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f309dc95700 1 --2- 172.21.15.135:0/942512273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059b02d0 0x5604059bfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:15:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f309cc93700 1 --2- 172.21.15.135:0/942512273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059af3e0 0x5604059b8da0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f309400b540 tx=0x7f3094099d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a8507f2fdb9ae5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f3080ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f3080ff9700 1 -- 172.21.15.135:0/942512273 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094099ea0 con 0x5604059af3e0 2024-05-08T23:15:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.859+0000 7f3080ff9700 1 -- 172.21.15.135:0/942512273 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f309409a000 con 0x5604059af3e0 2024-05-08T23:15:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.860+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/942512273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560405858210 con 0x5604059af3e0 2024-05-08T23:15:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.860+0000 7f3080ff9700 1 -- 172.21.15.135:0/942512273 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3094099130 con 0x5604059af3e0 2024-05-08T23:15:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.860+0000 7f30ab8b2b80 10 client.15348 fetch_fsmap learned FSMap version 28 2024-05-08T23:15:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.860+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/942512273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56040572cb00 con 0x5604059af3e0 2024-05-08T23:15:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.860+0000 7f3080ff9700 1 -- 172.21.15.135:0/942512273 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3094063080 con 0x5604059af3e0 2024-05-08T23:15:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.860+0000 7f3080ff9700 1 -- 172.21.15.135:0/942512273 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f30940adb10 con 0x5604059af3e0 2024-05-08T23:15:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.860+0000 7f30ab8b2b80 10 client.15348 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:15:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.860+0000 7f30ab8b2b80 10 client.15348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:15:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.860+0000 7f30ab8b2b80 20 client.15348 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.860+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/942512273 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5604059c46c0 0x5604059c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.860+0000 7f30ab8b2b80 4 client.15348 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:15:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.860+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/942512273 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56040597e7b0 con 0x5604059c46c0 2024-05-08T23:15:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.860+0000 7f309d494700 1 --2- 172.21.15.135:0/942512273 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5604059c46c0 0x5604059c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.861+0000 7f3080ff9700 10 client.15348 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:15:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.861+0000 7f309d494700 1 --2- 172.21.15.135:0/942512273 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5604059c46c0 0x5604059c6ae0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=329d47149cd6c0a4 server_cookie=d303c1ceeb465bc6 in_seq=0 out_seq=0 2024-05-08T23:15:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.861+0000 7f3080ff9700 1 -- 172.21.15.135:0/942512273 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56040597e7b0 con 0x5604059c46c0 2024-05-08T23:15:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.861+0000 7f3080ff9700 10 client.15348 handle_command_reply: tid=0 2024-05-08T23:15:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.861+0000 7f30ab8b2b80 1 client.15348 shutdown 2024-05-08T23:15:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.861+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/942512273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059af3e0 msgr2=0x5604059b8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.861+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/942512273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059af3e0 0x5604059b8da0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f309400b540 tx=0x7f3094099d70 comp rx=0 tx=0).stop 2024-05-08T23:15:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.861+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/942512273 shutdown_connections 2024-05-08T23:15:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.861+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/942512273 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5604059c46c0 0x5604059c6ae0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.861+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/942512273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059b02d0 0x5604059bfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.861+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/942512273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059aea80 0x5604059b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.861+0000 7f3080ff9700 0 client.15348 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:15:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.861+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/942512273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059af3e0 0x5604059b8da0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.861+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/942512273 >> 172.21.15.135:0/942512273 conn(0x56040590d1b0 msgr2=0x5604059a9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.862+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/942512273 shutdown_connections 2024-05-08T23:15:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.862+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/942512273 wait complete. 2024-05-08T23:15:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.862+0000 7f30ab8b2b80 20 client.15348 trim_cache size 0 max 16384 2024-05-08T23:15:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f30ab8b2b80 1 Processor -- start 2024-05-08T23:15:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f30ab8b2b80 1 -- start start 2024-05-08T23:15:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f30ab8b2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059aea80 0x5604059c0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f30ab8b2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 0x5604059bfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f30ab8b2b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059b02d0 0x5604059b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f30ab8b2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604059af8c0 con 0x5604059aea80 2024-05-08T23:15:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f30ab8b2b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604059b77f0 con 0x5604059b02d0 2024-05-08T23:15:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f30ab8b2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604059b94e0 con 0x5604059af3e0 2024-05-08T23:15:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f309d494700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059aea80 0x5604059c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f309d494700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059aea80 0x5604059c0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41226/0 (socket says 172.21.15.135:41226) 2024-05-08T23:15:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f309d494700 1 -- 172.21.15.135:0/42078077 learned_addr learned my addr 172.21.15.135:0/42078077 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f309d494700 1 -- 172.21.15.135:0/42078077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 msgr2=0x5604059bfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f309cc93700 1 --2- 172.21.15.135:0/42078077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 0x5604059bfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f309d494700 1 --2- 172.21.15.135:0/42078077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 0x5604059bfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f309d494700 1 -- 172.21.15.135:0/42078077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059b02d0 msgr2=0x5604059b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f309d494700 1 --2- 172.21.15.135:0/42078077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059b02d0 0x5604059b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f309d494700 1 -- 172.21.15.135:0/42078077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604058c5500 con 0x5604059aea80 2024-05-08T23:15:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f309cc93700 1 --2- 172.21.15.135:0/42078077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 0x5604059bfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f309d494700 1 --2- 172.21.15.135:0/42078077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059aea80 0x5604059c0490 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f308c009990 tx=0x7f308c005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fdf5388de61d4d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.877+0000 7f3083fff700 1 -- 172.21.15.135:0/42078077 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c02a040 con 0x5604059aea80 2024-05-08T23:15:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.878+0000 7f3083fff700 1 -- 172.21.15.135:0/42078077 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f308c02b040 con 0x5604059aea80 2024-05-08T23:15:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.878+0000 7f3083fff700 1 -- 172.21.15.135:0/42078077 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c0236c0 con 0x5604059aea80 2024-05-08T23:15:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.878+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/42078077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059aea80 msgr2=0x5604059c0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.878+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/42078077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059aea80 0x5604059c0490 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f308c009990 tx=0x7f308c005000 comp rx=0 tx=0).stop 2024-05-08T23:15:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.878+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/42078077 shutdown_connections 2024-05-08T23:15:48.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.878+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/42078077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059b02d0 0x5604059b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.878+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/42078077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059aea80 0x5604059c0490 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.878+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/42078077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 0x5604059bfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.878+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/42078077 >> 172.21.15.135:0/42078077 conn(0x56040590d1b0 msgr2=0x5604059b8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.878+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/42078077 shutdown_connections 2024-05-08T23:15:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.878+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/42078077 wait complete. 2024-05-08T23:15:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.878+0000 7f30ab8b2b80 1 -- start start 2024-05-08T23:15:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f30ab8b2b80 1 Processor -- start 2024-05-08T23:15:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f30ab8b2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059aea80 0x5604059bf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f30ab8b2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 0x5604059bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f30ab8b2b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059b02d0 0x5604059bdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f30ab8b2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604059be1e0 con 0x5604059aea80 2024-05-08T23:15:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f30ab8b2b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604059be350 con 0x5604059b02d0 2024-05-08T23:15:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f30ab8b2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604059be4c0 con 0x5604059af3e0 2024-05-08T23:15:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f30ab8b2b80 10 client.0 _ll_register_callbacks cb 0x5604058a4ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:15:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f309d494700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059aea80 0x5604059bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f309d494700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059aea80 0x5604059bf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41228/0 (socket says 172.21.15.135:41228) 2024-05-08T23:15:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f309d494700 1 -- 172.21.15.135:0/227769059 learned_addr learned my addr 172.21.15.135:0/227769059 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:15:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f309cc93700 1 --2- 172.21.15.135:0/227769059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 0x5604059bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f309d494700 1 -- 172.21.15.135:0/227769059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 msgr2=0x5604059bfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f309dc95700 1 --2- 172.21.15.135:0/227769059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059b02d0 0x5604059bdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f309d494700 1 --2- 172.21.15.135:0/227769059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 0x5604059bfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f309d494700 1 -- 172.21.15.135:0/227769059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059b02d0 msgr2=0x5604059bdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:15:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f309d494700 1 --2- 172.21.15.135:0/227769059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059b02d0 0x5604059bdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.879+0000 7f309d494700 1 -- 172.21.15.135:0/227769059 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3098109c40 con 0x5604059aea80 2024-05-08T23:15:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f309cc93700 1 --2- 172.21.15.135:0/227769059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 0x5604059bfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f309dc95700 1 --2- 172.21.15.135:0/227769059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059b02d0 0x5604059bdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:15:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f309d494700 1 --2- 172.21.15.135:0/227769059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059aea80 0x5604059bf640 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f308c005d10 tx=0x7f308c005450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7a1b55754b05ee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:15:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f3080ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:15:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f3080ff9700 1 -- 172.21.15.135:0/227769059 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c02a050 con 0x5604059aea80 2024-05-08T23:15:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f3080ff9700 1 -- 172.21.15.135:0/227769059 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f308c033450 con 0x5604059aea80 2024-05-08T23:15:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/227769059 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3090010040 con 0x5604059aea80 2024-05-08T23:15:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f3080ff9700 1 -- 172.21.15.135:0/227769059 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f308c00f460 con 0x5604059aea80 2024-05-08T23:15:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f30ab8b2b80 10 client.15354 fetch_fsmap learned FSMap version 28 2024-05-08T23:15:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/227769059 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x560405784c70 con 0x5604059aea80 2024-05-08T23:15:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f3080ff9700 1 -- 172.21.15.135:0/227769059 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3090010040 con 0x5604059aea80 2024-05-08T23:15:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f3080ff9700 1 -- 172.21.15.135:0/227769059 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f308c046050 con 0x5604059aea80 2024-05-08T23:15:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f30ab8b2b80 10 client.15354 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:15:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f30ab8b2b80 10 client.15354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:15:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f30ab8b2b80 20 client.15354 populate_metadata read hostname 'smithi135' 2024-05-08T23:15:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/227769059 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x560405a1b900 0x560405a1dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:15:48.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f30ab8b2b80 4 client.15354 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T23:15:48.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.880+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/227769059 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5604058f7e60 con 0x560405a1b900 2024-05-08T23:15:48.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.881+0000 7f309cc93700 1 --2- 172.21.15.135:0/227769059 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x560405a1b900 0x560405a1dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:15:48.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.881+0000 7f3080ff9700 10 client.15354 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:15:48.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.881+0000 7f309cc93700 1 --2- 172.21.15.135:0/227769059 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x560405a1b900 0x560405a1dd20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce88a8b8a1da932c server_cookie=92675a61b5226666 in_seq=0 out_seq=0 2024-05-08T23:15:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.892+0000 7f3080ff9700 1 -- 172.21.15.135:0/227769059 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5604058f7e60 con 0x560405a1b900 2024-05-08T23:15:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.892+0000 7f3080ff9700 10 client.15354 handle_command_reply: tid=0 2024-05-08T23:15:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.892+0000 7f30ab8b2b80 1 client.15354 shutdown 2024-05-08T23:15:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.892+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/227769059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059aea80 msgr2=0x5604059bf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.892+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/227769059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059aea80 0x5604059bf640 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f308c005d10 tx=0x7f308c005450 comp rx=0 tx=0).stop 2024-05-08T23:15:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.892+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/227769059 shutdown_connections 2024-05-08T23:15:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.892+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/227769059 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x560405a1b900 0x560405a1dd20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.892+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/227769059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604059b02d0 0x5604059bdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.892+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/227769059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604059aea80 0x5604059bf640 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.892+0000 7f3080ff9700 0 client.15354 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:15:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.892+0000 7f30ab8b2b80 1 --2- 172.21.15.135:0/227769059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604059af3e0 0x5604059bfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.892+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/227769059 >> 172.21.15.135:0/227769059 conn(0x56040590d1b0 msgr2=0x5604059ab020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.892+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/227769059 shutdown_connections 2024-05-08T23:15:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.892+0000 7f30ab8b2b80 1 -- 172.21.15.135:0/227769059 wait complete. 2024-05-08T23:15:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.892+0000 7f30ab8b2b80 20 client.15354 trim_cache size 0 max 16384 2024-05-08T23:15:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-08T23:15:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-08T23:15:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-08T23:15:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-08T23:15:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.893+0000 7f309f6f8700 1 -- 172.21.15.135:0/359377101 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f30840a1230 msgr2=0x7f30840a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.893+0000 7f309f6f8700 1 --2- 172.21.15.135:0/359377101 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f30840a1230 0x7f30840a36f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f308c00b5c0 tx=0x7f308c003790 comp rx=0 tx=0).stop 2024-05-08T23:15:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.893+0000 7f309f6f8700 1 -- 172.21.15.135:0/359377101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3098104330 msgr2=0x7f3098197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:15:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.893+0000 7f309f6f8700 1 --2- 172.21.15.135:0/359377101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3098104330 0x7f3098197360 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f309400d980 tx=0x7f309400dc90 comp rx=0 tx=0).stop 2024-05-08T23:15:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.893+0000 7f309f6f8700 1 -- 172.21.15.135:0/359377101 shutdown_connections 2024-05-08T23:15:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.893+0000 7f309f6f8700 1 --2- 172.21.15.135:0/359377101 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f30840a1230 0x7f30840a36f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.893+0000 7f309f6f8700 1 --2- 172.21.15.135:0/359377101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3098106c60 0x7f309819e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.893+0000 7f309f6f8700 1 --2- 172.21.15.135:0/359377101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3098101a00 0x7f3098196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.893+0000 7f309f6f8700 1 --2- 172.21.15.135:0/359377101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3098104330 0x7f3098197360 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:15:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.893+0000 7f309f6f8700 1 -- 172.21.15.135:0/359377101 >> 172.21.15.135:0/359377101 conn(0x7f30980fb390 msgr2=0x7f30981022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:15:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.893+0000 7f309f6f8700 1 -- 172.21.15.135:0/359377101 shutdown_connections 2024-05-08T23:15:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:15:48.893+0000 7f309f6f8700 1 -- 172.21.15.135:0/359377101 wait complete. 2024-05-08T23:15:50.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:50 smithi179 ceph-mon[46314]: pgmap v269: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-08T23:15:50.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:50 smithi195 ceph-mon[46516]: pgmap v269: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-08T23:15:50.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:50 smithi135 ceph-mon[42440]: pgmap v269: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-08T23:15:52.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:52 smithi179 ceph-mon[46314]: pgmap v270: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-08T23:15:52.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:52 smithi195 ceph-mon[46516]: pgmap v270: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-08T23:15:52.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:52 smithi135 ceph-mon[42440]: pgmap v270: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-08T23:15:54.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:54 smithi179 ceph-mon[46314]: pgmap v271: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 KiB/s wr, 15 op/s 2024-05-08T23:15:54.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:54 smithi195 ceph-mon[46516]: pgmap v271: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 KiB/s wr, 15 op/s 2024-05-08T23:15:54.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:54 smithi135 ceph-mon[42440]: pgmap v271: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 KiB/s wr, 15 op/s 2024-05-08T23:15:56.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:56 smithi179 ceph-mon[46314]: pgmap v272: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-05-08T23:15:56.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:56 smithi195 ceph-mon[46516]: pgmap v272: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-05-08T23:15:56.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:56 smithi135 ceph-mon[42440]: pgmap v272: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-05-08T23:15:58.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:15:58 smithi179 ceph-mon[46314]: pgmap v273: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-05-08T23:15:58.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:15:58 smithi195 ceph-mon[46516]: pgmap v273: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-05-08T23:15:58.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:15:58 smithi135 ceph-mon[42440]: pgmap v273: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-05-08T23:16:00.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:00 smithi179 ceph-mon[46314]: pgmap v274: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-05-08T23:16:00.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:00 smithi195 ceph-mon[46516]: pgmap v274: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-05-08T23:16:00.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:00 smithi135 ceph-mon[42440]: pgmap v274: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-05-08T23:16:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.012+0000 7fe8245f5700 1 -- 172.21.15.135:0/2865396483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe81c100f60 msgr2=0x7fe81c1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.012+0000 7fe8245f5700 1 --2- 172.21.15.135:0/2865396483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe81c100f60 0x7fe81c1013e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe818009990 tx=0x7fe818009ca0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.012+0000 7fe8245f5700 1 -- 172.21.15.135:0/2865396483 shutdown_connections 2024-05-08T23:16:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.012+0000 7fe8245f5700 1 --2- 172.21.15.135:0/2865396483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe81c0ffe10 0x7fe81c100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.012+0000 7fe8245f5700 1 --2- 172.21.15.135:0/2865396483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c101920 0x7fe81c108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.012+0000 7fe8245f5700 1 --2- 172.21.15.135:0/2865396483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe81c100f60 0x7fe81c1013e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.012+0000 7fe8245f5700 1 -- 172.21.15.135:0/2865396483 >> 172.21.15.135:0/2865396483 conn(0x7fe81c0fb380 msgr2=0x7fe81c0fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.012+0000 7fe8245f5700 1 -- 172.21.15.135:0/2865396483 shutdown_connections 2024-05-08T23:16:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.013+0000 7fe8245f5700 1 -- 172.21.15.135:0/2865396483 wait complete. 2024-05-08T23:16:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.013+0000 7fe8245f5700 1 Processor -- start 2024-05-08T23:16:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.013+0000 7fe8245f5700 1 -- start start 2024-05-08T23:16:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.013+0000 7fe8245f5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c0ffe10 0x7fe81c069d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.013+0000 7fe8245f5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe81c100f60 0x7fe81c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.013+0000 7fe8245f5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe81c101920 0x7fe81c19e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.013+0000 7fe8245f5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c19e8c0 con 0x7fe81c100f60 2024-05-08T23:16:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.013+0000 7fe8245f5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c19ea30 con 0x7fe81c0ffe10 2024-05-08T23:16:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.013+0000 7fe8245f5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c19ebf0 con 0x7fe81c101920 2024-05-08T23:16:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.013+0000 7fe821b90700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe81c100f60 0x7fe81c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.013+0000 7fe821b90700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe81c100f60 0x7fe81c19bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58040/0 (socket says 172.21.15.135:58040) 2024-05-08T23:16:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.013+0000 7fe821b90700 1 -- 172.21.15.135:0/1045640044 learned_addr learned my addr 172.21.15.135:0/1045640044 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.014+0000 7fe822391700 1 --2- 172.21.15.135:0/1045640044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c0ffe10 0x7fe81c069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.014+0000 7fe822b92700 1 --2- 172.21.15.135:0/1045640044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe81c101920 0x7fe81c19e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.014+0000 7fe821b90700 1 -- 172.21.15.135:0/1045640044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe81c101920 msgr2=0x7fe81c19e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.014+0000 7fe821b90700 1 --2- 172.21.15.135:0/1045640044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe81c101920 0x7fe81c19e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.014+0000 7fe821b90700 1 -- 172.21.15.135:0/1045640044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c0ffe10 msgr2=0x7fe81c069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.014+0000 7fe821b90700 1 --2- 172.21.15.135:0/1045640044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c0ffe10 0x7fe81c069d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.014+0000 7fe821b90700 1 -- 172.21.15.135:0/1045640044 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8180095f0 con 0x7fe81c100f60 2024-05-08T23:16:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.014+0000 7fe821b90700 1 --2- 172.21.15.135:0/1045640044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe81c100f60 0x7fe81c19bad0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe8180059d0 tx=0x7fe818005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.014+0000 7fe8137fe700 1 -- 172.21.15.135:0/1045640044 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81801d070 con 0x7fe81c100f60 2024-05-08T23:16:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.014+0000 7fe8137fe700 1 -- 172.21.15.135:0/1045640044 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe818004020 con 0x7fe81c100f60 2024-05-08T23:16:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.014+0000 7fe8245f5700 1 -- 172.21.15.135:0/1045640044 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c19ee70 con 0x7fe81c100f60 2024-05-08T23:16:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.014+0000 7fe8137fe700 1 -- 172.21.15.135:0/1045640044 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818022c90 con 0x7fe81c100f60 2024-05-08T23:16:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.014+0000 7fe8245f5700 1 -- 172.21.15.135:0/1045640044 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c19f290 con 0x7fe81c100f60 2024-05-08T23:16:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.016+0000 7fe8137fe700 1 -- 172.21.15.135:0/1045640044 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fe818022470 con 0x7fe81c100f60 2024-05-08T23:16:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.017+0000 7fe8137fe700 1 --2- 172.21.15.135:0/1045640044 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe8080a1230 0x7fe8080a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.017+0000 7fe8137fe700 1 -- 172.21.15.135:0/1045640044 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe8180cdfd0 con 0x7fe81c100f60 2024-05-08T23:16:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.017+0000 7fe822391700 1 --2- 172.21.15.135:0/1045640044 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe8080a1230 0x7fe8080a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.017+0000 7fe822391700 1 --2- 172.21.15.135:0/1045640044 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe8080a1230 0x7fe8080a36f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00ac50 tx=0x7fe80c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.018+0000 7fe8307afb80 1 Processor -- start 2024-05-08T23:16:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.018+0000 7fe8307afb80 1 -- start start 2024-05-08T23:16:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.018+0000 7fe8307afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fd9a80 0x557772fd9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.018+0000 7fe8307afb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fda3e0 0x557772fdacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.018+0000 7fe8307afb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fdb2d0 0x557772fdb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.018+0000 7fe8307afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557772f310f0 con 0x557772fd9a80 2024-05-08T23:16:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.018+0000 7fe8307afb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557772f2eab0 con 0x557772fdb2d0 2024-05-08T23:16:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.018+0000 7fe8307afb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557772f2a3a0 con 0x557772fda3e0 2024-05-08T23:16:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.018+0000 7fe822391700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fd9a80 0x557772fd9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.019+0000 7fe822391700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fd9a80 0x557772fd9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58052/0 (socket says 172.21.15.135:58052) 2024-05-08T23:16:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.019+0000 7fe822391700 1 -- 172.21.15.135:0/2273963078 learned_addr learned my addr 172.21.15.135:0/2273963078 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.019+0000 7fe821b90700 1 --2- 172.21.15.135:0/2273963078 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fda3e0 0x557772fdacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.019+0000 7fe822b92700 1 --2- 172.21.15.135:0/2273963078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fdb2d0 0x557772fdb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.019+0000 7fe822391700 1 -- 172.21.15.135:0/2273963078 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fda3e0 msgr2=0x557772fdacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.019+0000 7fe822391700 1 --2- 172.21.15.135:0/2273963078 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fda3e0 0x557772fdacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.019+0000 7fe822391700 1 -- 172.21.15.135:0/2273963078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fdb2d0 msgr2=0x557772fdb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.019+0000 7fe822391700 1 --2- 172.21.15.135:0/2273963078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fdb2d0 0x557772fdb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.019+0000 7fe822391700 1 -- 172.21.15.135:0/2273963078 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557772dab350 con 0x557772fd9a80 2024-05-08T23:16:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.019+0000 7fe822b92700 1 --2- 172.21.15.135:0/2273963078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fdb2d0 0x557772fdb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:16:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.019+0000 7fe822391700 1 --2- 172.21.15.135:0/2273963078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fd9a80 0x557772fd9ea0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00ff90 tx=0x7fe80c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f75b1f7b21976bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.019+0000 7fe810ff9700 1 -- 172.21.15.135:0/2273963078 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c003a90 con 0x557772fd9a80 2024-05-08T23:16:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.019+0000 7fe810ff9700 1 -- 172.21.15.135:0/2273963078 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe80c003bf0 con 0x557772fd9a80 2024-05-08T23:16:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.019+0000 7fe810ff9700 1 -- 172.21.15.135:0/2273963078 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c01d640 con 0x557772fd9a80 2024-05-08T23:16:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.020+0000 7fe8307afb80 1 -- 172.21.15.135:0/2273963078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fd9a80 msgr2=0x557772fd9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.020+0000 7fe8307afb80 1 --2- 172.21.15.135:0/2273963078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fd9a80 0x557772fd9ea0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00ff90 tx=0x7fe80c012000 comp rx=0 tx=0).stop 2024-05-08T23:16:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.020+0000 7fe8307afb80 1 -- 172.21.15.135:0/2273963078 shutdown_connections 2024-05-08T23:16:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.020+0000 7fe8307afb80 1 --2- 172.21.15.135:0/2273963078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fdb2d0 0x557772fdb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.020+0000 7fe8307afb80 1 --2- 172.21.15.135:0/2273963078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fd9a80 0x557772fd9ea0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.020+0000 7fe8307afb80 1 --2- 172.21.15.135:0/2273963078 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fda3e0 0x557772fdacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.020+0000 7fe8307afb80 1 -- 172.21.15.135:0/2273963078 >> 172.21.15.135:0/2273963078 conn(0x557772f381b0 msgr2=0x557772fd6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.020+0000 7fe8307afb80 1 -- 172.21.15.135:0/2273963078 shutdown_connections 2024-05-08T23:16:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.020+0000 7fe8307afb80 1 -- 172.21.15.135:0/2273963078 wait complete. 2024-05-08T23:16:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.020+0000 7fe8307afb80 1 -- start start 2024-05-08T23:16:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe8307afb80 1 Processor -- start 2024-05-08T23:16:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe8307afb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fd9a80 0x557772fe3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe8307afb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fda3e0 0x557772fe3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe8307afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fdb2d0 0x557772feae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe8307afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557772ec6500 con 0x557772fdb2d0 2024-05-08T23:16:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe8307afb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557772ec61a0 con 0x557772fda3e0 2024-05-08T23:16:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe8307afb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557772dad640 con 0x557772fd9a80 2024-05-08T23:16:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe8307afb80 10 client.0 _ll_register_callbacks cb 0x557772ecfad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:16:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe822b92700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fdb2d0 0x557772feae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe822b92700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fdb2d0 0x557772feae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58054/0 (socket says 172.21.15.135:58054) 2024-05-08T23:16:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe822b92700 1 -- 172.21.15.135:0/2029336643 learned_addr learned my addr 172.21.15.135:0/2029336643 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe822391700 1 --2- 172.21.15.135:0/2029336643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fd9a80 0x557772fe3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe821b90700 1 --2- 172.21.15.135:0/2029336643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fda3e0 0x557772fe3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe822b92700 1 -- 172.21.15.135:0/2029336643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fd9a80 msgr2=0x557772fe3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe822b92700 1 --2- 172.21.15.135:0/2029336643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fd9a80 0x557772fe3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe822b92700 1 -- 172.21.15.135:0/2029336643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fda3e0 msgr2=0x557772fe3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe822b92700 1 --2- 172.21.15.135:0/2029336643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fda3e0 0x557772fe3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe822b92700 1 -- 172.21.15.135:0/2029336643 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c00fc40 con 0x557772fdb2d0 2024-05-08T23:16:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.021+0000 7fe822391700 1 --2- 172.21.15.135:0/2029336643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fd9a80 0x557772fe3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:16:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe822b92700 1 --2- 172.21.15.135:0/2029336643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fdb2d0 0x557772feae10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe814007950 tx=0x7fe814007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d548172b8be5c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe805ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:16:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe805ffb700 1 -- 172.21.15.135:0/2029336643 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814010670 con 0x557772fdb2d0 2024-05-08T23:16:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe805ffb700 1 -- 172.21.15.135:0/2029336643 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe8140107d0 con 0x557772fdb2d0 2024-05-08T23:16:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe8307afb80 1 -- 172.21.15.135:0/2029336643 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557772e83210 con 0x557772fdb2d0 2024-05-08T23:16:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe805ffb700 1 -- 172.21.15.135:0/2029336643 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe814010990 con 0x557772fdb2d0 2024-05-08T23:16:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe8307afb80 10 client.15366 fetch_fsmap learned FSMap version 28 2024-05-08T23:16:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe8307afb80 1 -- 172.21.15.135:0/2029336643 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x557772d57b00 con 0x557772fdb2d0 2024-05-08T23:16:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe805ffb700 1 -- 172.21.15.135:0/2029336643 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557772e83210 con 0x557772fdb2d0 2024-05-08T23:16:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe805ffb700 1 -- 172.21.15.135:0/2029336643 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe814015cb0 con 0x557772fdb2d0 2024-05-08T23:16:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe8307afb80 10 client.15366 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:16:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe8307afb80 10 client.15366 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:16:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe8307afb80 20 client.15366 populate_metadata read hostname 'smithi135' 2024-05-08T23:16:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe8307afb80 1 --2- 172.21.15.135:0/2029336643 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x557772fef6e0 0x557772ff1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe8307afb80 4 client.15366 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:16:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.022+0000 7fe8307afb80 1 -- 172.21.15.135:0/2029336643 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557772fa97b0 con 0x557772fef6e0 2024-05-08T23:16:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.023+0000 7fe822391700 1 --2- 172.21.15.135:0/2029336643 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x557772fef6e0 0x557772ff1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.023+0000 7fe822391700 1 --2- 172.21.15.135:0/2029336643 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x557772fef6e0 0x557772ff1b00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cce37bfba236aa4 server_cookie=f72a14d87ad89fbf in_seq=0 out_seq=0 2024-05-08T23:16:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.023+0000 7fe805ffb700 10 client.15366 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.024+0000 7fe805ffb700 1 -- 172.21.15.135:0/2029336643 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557772fa97b0 con 0x557772fef6e0 2024-05-08T23:16:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.024+0000 7fe805ffb700 10 client.15366 handle_command_reply: tid=0 2024-05-08T23:16:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.024+0000 7fe8307afb80 1 client.15366 shutdown 2024-05-08T23:16:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.024+0000 7fe8307afb80 1 -- 172.21.15.135:0/2029336643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fdb2d0 msgr2=0x557772feae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.024+0000 7fe8307afb80 1 --2- 172.21.15.135:0/2029336643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fdb2d0 0x557772feae10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe814007950 tx=0x7fe814007c60 comp rx=0 tx=0).stop 2024-05-08T23:16:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.024+0000 7fe8307afb80 1 -- 172.21.15.135:0/2029336643 shutdown_connections 2024-05-08T23:16:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.024+0000 7fe8307afb80 1 --2- 172.21.15.135:0/2029336643 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x557772fef6e0 0x557772ff1b00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.024+0000 7fe8307afb80 1 --2- 172.21.15.135:0/2029336643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fd9a80 0x557772fe3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.024+0000 7fe8307afb80 1 --2- 172.21.15.135:0/2029336643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fdb2d0 0x557772feae10 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.024+0000 7fe8307afb80 1 --2- 172.21.15.135:0/2029336643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fda3e0 0x557772fe3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.024+0000 7fe805ffb700 0 client.15366 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.024+0000 7fe8307afb80 1 -- 172.21.15.135:0/2029336643 >> 172.21.15.135:0/2029336643 conn(0x557772f381b0 msgr2=0x557772fd4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.024+0000 7fe8307afb80 1 -- 172.21.15.135:0/2029336643 shutdown_connections 2024-05-08T23:16:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.024+0000 7fe8307afb80 1 -- 172.21.15.135:0/2029336643 wait complete. 2024-05-08T23:16:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.024+0000 7fe8307afb80 20 client.15366 trim_cache size 0 max 16384 2024-05-08T23:16:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe8307afb80 1 Processor -- start 2024-05-08T23:16:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe8307afb80 1 -- start start 2024-05-08T23:16:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe8307afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fd9a80 0x557772ff1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe8307afb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fda3e0 0x557772fe2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe8307afb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fdb2d0 0x557772fdb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe8307afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557772ff6d10 con 0x557772fd9a80 2024-05-08T23:16:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe8307afb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557772fecb10 con 0x557772fda3e0 2024-05-08T23:16:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe8307afb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557772fda9f0 con 0x557772fdb2d0 2024-05-08T23:16:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe822391700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fd9a80 0x557772ff1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe822391700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fd9a80 0x557772ff1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58070/0 (socket says 172.21.15.135:58070) 2024-05-08T23:16:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe822391700 1 -- 172.21.15.135:0/3526430765 learned_addr learned my addr 172.21.15.135:0/3526430765 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe821b90700 1 --2- 172.21.15.135:0/3526430765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fda3e0 0x557772fe2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe822391700 1 -- 172.21.15.135:0/3526430765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fdb2d0 msgr2=0x557772fdb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe822391700 1 --2- 172.21.15.135:0/3526430765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fdb2d0 0x557772fdb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe822391700 1 -- 172.21.15.135:0/3526430765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fda3e0 msgr2=0x557772fe2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.039+0000 7fe822391700 1 --2- 172.21.15.135:0/3526430765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fda3e0 0x557772fe2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.040+0000 7fe822391700 1 -- 172.21.15.135:0/3526430765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557772ef0500 con 0x557772fd9a80 2024-05-08T23:16:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.040+0000 7fe822391700 1 --2- 172.21.15.135:0/3526430765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fd9a80 0x557772ff1ad0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00ff60 tx=0x7fe80c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade2d9ba59001ef7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.040+0000 7fe8117fa700 1 -- 172.21.15.135:0/3526430765 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c02b040 con 0x557772fd9a80 2024-05-08T23:16:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.040+0000 7fe8117fa700 1 -- 172.21.15.135:0/3526430765 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe80c02c040 con 0x557772fd9a80 2024-05-08T23:16:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.040+0000 7fe8117fa700 1 -- 172.21.15.135:0/3526430765 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0055a0 con 0x557772fd9a80 2024-05-08T23:16:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.040+0000 7fe8307afb80 1 -- 172.21.15.135:0/3526430765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fd9a80 msgr2=0x557772ff1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.040+0000 7fe8307afb80 1 --2- 172.21.15.135:0/3526430765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fd9a80 0x557772ff1ad0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00ff60 tx=0x7fe80c016000 comp rx=0 tx=0).stop 2024-05-08T23:16:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.040+0000 7fe8307afb80 1 -- 172.21.15.135:0/3526430765 shutdown_connections 2024-05-08T23:16:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.040+0000 7fe8307afb80 1 --2- 172.21.15.135:0/3526430765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fdb2d0 0x557772fdb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.040+0000 7fe8307afb80 1 --2- 172.21.15.135:0/3526430765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fd9a80 0x557772ff1ad0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.040+0000 7fe8307afb80 1 --2- 172.21.15.135:0/3526430765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fda3e0 0x557772fe2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.040+0000 7fe8307afb80 1 -- 172.21.15.135:0/3526430765 >> 172.21.15.135:0/3526430765 conn(0x557772f381b0 msgr2=0x557772fe17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.040+0000 7fe8307afb80 1 -- 172.21.15.135:0/3526430765 shutdown_connections 2024-05-08T23:16:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.040+0000 7fe8307afb80 1 -- 172.21.15.135:0/3526430765 wait complete. 2024-05-08T23:16:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe8307afb80 1 -- start start 2024-05-08T23:16:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe8307afb80 1 Processor -- start 2024-05-08T23:16:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe8307afb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fd9a80 0x557773040e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe8307afb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fda3e0 0x557773041380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe8307afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fdb2d0 0x557773047ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe8307afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557773048430 con 0x557772fdb2d0 2024-05-08T23:16:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe8307afb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557773048570 con 0x557772fda3e0 2024-05-08T23:16:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe8307afb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557773048700 con 0x557772fd9a80 2024-05-08T23:16:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe8307afb80 10 client.0 _ll_register_callbacks cb 0x557772ecfad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:16:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe822b92700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fdb2d0 0x557773047ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe822b92700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fdb2d0 0x557773047ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58076/0 (socket says 172.21.15.135:58076) 2024-05-08T23:16:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe822b92700 1 -- 172.21.15.135:0/3001600393 learned_addr learned my addr 172.21.15.135:0/3001600393 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe821b90700 1 --2- 172.21.15.135:0/3001600393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fda3e0 0x557773041380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe822391700 1 --2- 172.21.15.135:0/3001600393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fd9a80 0x557773040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe822b92700 1 -- 172.21.15.135:0/3001600393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fd9a80 msgr2=0x557773040e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe822b92700 1 --2- 172.21.15.135:0/3001600393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fd9a80 0x557773040e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe822b92700 1 -- 172.21.15.135:0/3001600393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fda3e0 msgr2=0x557773041380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe822b92700 1 --2- 172.21.15.135:0/3001600393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fda3e0 0x557773041380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe822b92700 1 -- 172.21.15.135:0/3001600393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557772dab350 con 0x557772fdb2d0 2024-05-08T23:16:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.041+0000 7fe822391700 1 --2- 172.21.15.135:0/3001600393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fd9a80 0x557773040e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:16:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe822b92700 1 --2- 172.21.15.135:0/3001600393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fdb2d0 0x557773047ef0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe81400b010 tx=0x7fe814010160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23482f0c2319e97 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe805ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:16:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe805ffb700 1 -- 172.21.15.135:0/3001600393 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814009370 con 0x557772fdb2d0 2024-05-08T23:16:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe805ffb700 1 -- 172.21.15.135:0/3001600393 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe81401d9a0 con 0x557772fdb2d0 2024-05-08T23:16:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe8307afb80 1 -- 172.21.15.135:0/3001600393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe80c003bf0 con 0x557772fdb2d0 2024-05-08T23:16:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe805ffb700 1 -- 172.21.15.135:0/3001600393 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe81401d820 con 0x557772fdb2d0 2024-05-08T23:16:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe8307afb80 10 client.15372 fetch_fsmap learned FSMap version 28 2024-05-08T23:16:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe8307afb80 1 -- 172.21.15.135:0/3001600393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x557772dafc70 con 0x557772fdb2d0 2024-05-08T23:16:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe805ffb700 1 -- 172.21.15.135:0/3001600393 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe814039080 con 0x557772fdb2d0 2024-05-08T23:16:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe805ffb700 1 -- 172.21.15.135:0/3001600393 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe81402a6e0 con 0x557772fdb2d0 2024-05-08T23:16:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe8307afb80 10 client.15372 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:16:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe8307afb80 10 client.15372 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:16:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe8307afb80 20 client.15372 populate_metadata read hostname 'smithi135' 2024-05-08T23:16:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe8307afb80 1 --2- 172.21.15.135:0/3001600393 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55777304a180 0x55777304c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe8307afb80 4 client.15372 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T23:16:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe8307afb80 1 -- 172.21.15.135:0/3001600393 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557772f22e60 con 0x55777304a180 2024-05-08T23:16:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.042+0000 7fe822391700 1 --2- 172.21.15.135:0/3001600393 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55777304a180 0x55777304c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.043+0000 7fe805ffb700 10 client.15372 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.043+0000 7fe822391700 1 --2- 172.21.15.135:0/3001600393 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55777304a180 0x55777304c5a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa27b8e8031ce6ca server_cookie=ee2513bbcfd4aec2 in_seq=0 out_seq=0 2024-05-08T23:16:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.046+0000 7fe805ffb700 1 -- 172.21.15.135:0/3001600393 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557772f22e60 con 0x55777304a180 2024-05-08T23:16:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.046+0000 7fe805ffb700 10 client.15372 handle_command_reply: tid=0 2024-05-08T23:16:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.046+0000 7fe8307afb80 1 client.15372 shutdown 2024-05-08T23:16:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.046+0000 7fe8307afb80 1 -- 172.21.15.135:0/3001600393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fdb2d0 msgr2=0x557773047ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.046+0000 7fe8307afb80 1 --2- 172.21.15.135:0/3001600393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fdb2d0 0x557773047ef0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe81400b010 tx=0x7fe814010160 comp rx=0 tx=0).stop 2024-05-08T23:16:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8307afb80 1 -- 172.21.15.135:0/3001600393 shutdown_connections 2024-05-08T23:16:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8307afb80 1 --2- 172.21.15.135:0/3001600393 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55777304a180 0x55777304c5a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8307afb80 1 --2- 172.21.15.135:0/3001600393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557772fd9a80 0x557773040e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8307afb80 1 --2- 172.21.15.135:0/3001600393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557772fdb2d0 0x557773047ef0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe805ffb700 0 client.15372 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8307afb80 1 --2- 172.21.15.135:0/3001600393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557772fda3e0 0x557773041380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8307afb80 1 -- 172.21.15.135:0/3001600393 >> 172.21.15.135:0/3001600393 conn(0x557772f381b0 msgr2=0x557772fe3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8307afb80 1 -- 172.21.15.135:0/3001600393 shutdown_connections 2024-05-08T23:16:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8307afb80 1 -- 172.21.15.135:0/3001600393 wait complete. 2024-05-08T23:16:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8307afb80 20 client.15372 trim_cache size 0 max 16384 2024-05-08T23:16:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-08T23:16:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-08T23:16:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-08T23:16:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-08T23:16:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8245f5700 1 -- 172.21.15.135:0/1045640044 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe8080a1230 msgr2=0x7fe8080a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8245f5700 1 --2- 172.21.15.135:0/1045640044 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe8080a1230 0x7fe8080a36f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00ac50 tx=0x7fe80c00a380 comp rx=0 tx=0).stop 2024-05-08T23:16:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8245f5700 1 -- 172.21.15.135:0/1045640044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe81c100f60 msgr2=0x7fe81c19bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8245f5700 1 --2- 172.21.15.135:0/1045640044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe81c100f60 0x7fe81c19bad0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe8180059d0 tx=0x7fe818005740 comp rx=0 tx=0).stop 2024-05-08T23:16:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8245f5700 1 -- 172.21.15.135:0/1045640044 shutdown_connections 2024-05-08T23:16:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8245f5700 1 --2- 172.21.15.135:0/1045640044 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fe8080a1230 0x7fe8080a36f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8245f5700 1 --2- 172.21.15.135:0/1045640044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe81c101920 0x7fe81c19e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8245f5700 1 --2- 172.21.15.135:0/1045640044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c0ffe10 0x7fe81c069d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8245f5700 1 --2- 172.21.15.135:0/1045640044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe81c100f60 0x7fe81c19bad0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8245f5700 1 -- 172.21.15.135:0/1045640044 >> 172.21.15.135:0/1045640044 conn(0x7fe81c0fb380 msgr2=0x7fe81c104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8245f5700 1 -- 172.21.15.135:0/1045640044 shutdown_connections 2024-05-08T23:16:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:02.047+0000 7fe8245f5700 1 -- 172.21.15.135:0/1045640044 wait complete. 2024-05-08T23:16:02.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:02 smithi179 ceph-mon[46314]: pgmap v275: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-05-08T23:16:02.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:02 smithi195 ceph-mon[46516]: pgmap v275: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-05-08T23:16:02.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:02 smithi135 ceph-mon[42440]: pgmap v275: 97 pgs: 97 active+clean; 658 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-05-08T23:16:04.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:04 smithi179 ceph-mon[46314]: pgmap v276: 97 pgs: 97 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-05-08T23:16:04.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:04 smithi195 ceph-mon[46516]: pgmap v276: 97 pgs: 97 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-05-08T23:16:04.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:04 smithi135 ceph-mon[42440]: pgmap v276: 97 pgs: 97 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-05-08T23:16:06.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:06 smithi179 ceph-mon[46314]: pgmap v277: 97 pgs: 97 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-08T23:16:06.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:06 smithi195 ceph-mon[46516]: pgmap v277: 97 pgs: 97 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-08T23:16:06.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:06 smithi135 ceph-mon[42440]: pgmap v277: 97 pgs: 97 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-08T23:16:07.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:07 smithi179 ceph-mon[46314]: pgmap v278: 97 pgs: 97 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-08T23:16:07.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:07 smithi195 ceph-mon[46516]: pgmap v278: 97 pgs: 97 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-08T23:16:07.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:07 smithi135 ceph-mon[42440]: pgmap v278: 97 pgs: 97 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-08T23:16:10.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:10 smithi195 ceph-mon[46516]: pgmap v279: 97 pgs: 97 active+clean; 669 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-05-08T23:16:10.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:10 smithi135 ceph-mon[42440]: pgmap v279: 97 pgs: 97 active+clean; 669 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-05-08T23:16:10.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:10 smithi179 ceph-mon[46314]: pgmap v279: 97 pgs: 97 active+clean; 669 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-05-08T23:16:12.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:12 smithi195 ceph-mon[46516]: pgmap v280: 97 pgs: 97 active+clean; 669 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-05-08T23:16:12.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:12 smithi135 ceph-mon[42440]: pgmap v280: 97 pgs: 97 active+clean; 669 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-05-08T23:16:12.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:12 smithi179 ceph-mon[46314]: pgmap v280: 97 pgs: 97 active+clean; 669 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-05-08T23:16:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:14 smithi195 ceph-mon[46516]: pgmap v281: 97 pgs: 97 active+clean; 669 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-08T23:16:14.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:14 smithi135 ceph-mon[42440]: pgmap v281: 97 pgs: 97 active+clean; 669 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-08T23:16:14.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:14 smithi179 ceph-mon[46314]: pgmap v281: 97 pgs: 97 active+clean; 669 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-08T23:16:15.168 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.166+0000 7fb7a05a4700 1 -- 172.21.15.135:0/4242033029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb798100f60 msgr2=0x7fb7981013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.166+0000 7fb7a05a4700 1 --2- 172.21.15.135:0/4242033029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb798100f60 0x7fb7981013e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009990 tx=0x7fb78c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.167+0000 7fb7a05a4700 1 -- 172.21.15.135:0/4242033029 shutdown_connections 2024-05-08T23:16:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.167+0000 7fb7a05a4700 1 --2- 172.21.15.135:0/4242033029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb798101920 0x7fb798108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.167+0000 7fb7a05a4700 1 --2- 172.21.15.135:0/4242033029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7980ffe10 0x7fb798100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.167+0000 7fb7a05a4700 1 --2- 172.21.15.135:0/4242033029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb798100f60 0x7fb7981013e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.167+0000 7fb7a05a4700 1 -- 172.21.15.135:0/4242033029 >> 172.21.15.135:0/4242033029 conn(0x7fb7980fb380 msgr2=0x7fb7980fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.167+0000 7fb7a05a4700 1 -- 172.21.15.135:0/4242033029 shutdown_connections 2024-05-08T23:16:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.167+0000 7fb7a05a4700 1 -- 172.21.15.135:0/4242033029 wait complete. 2024-05-08T23:16:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.167+0000 7fb7a05a4700 1 Processor -- start 2024-05-08T23:16:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.167+0000 7fb7a05a4700 1 -- start start 2024-05-08T23:16:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.167+0000 7fb7a05a4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7980ffe10 0x7fb798196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.167+0000 7fb7a05a4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb798100f60 0x7fb7981973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.167+0000 7fb7a05a4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb798101920 0x7fb79819e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.167+0000 7fb7a05a4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79819e9a0 con 0x7fb798100f60 2024-05-08T23:16:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb7a05a4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79819eae0 con 0x7fb7980ffe10 2024-05-08T23:16:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb7a05a4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79819ec70 con 0x7fb798101920 2024-05-08T23:16:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb79db3f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb798100f60 0x7fb7981973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb79db3f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb798100f60 0x7fb7981973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44036/0 (socket says 172.21.15.135:44036) 2024-05-08T23:16:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb79db3f700 1 -- 172.21.15.135:0/2947854591 learned_addr learned my addr 172.21.15.135:0/2947854591 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb79e340700 1 --2- 172.21.15.135:0/2947854591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7980ffe10 0x7fb798196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb79eb41700 1 --2- 172.21.15.135:0/2947854591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb798101920 0x7fb79819e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb79db3f700 1 -- 172.21.15.135:0/2947854591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb798101920 msgr2=0x7fb79819e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb79db3f700 1 --2- 172.21.15.135:0/2947854591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb798101920 0x7fb79819e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb79db3f700 1 -- 172.21.15.135:0/2947854591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7980ffe10 msgr2=0x7fb798196e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb79db3f700 1 --2- 172.21.15.135:0/2947854591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7980ffe10 0x7fb798196e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb79db3f700 1 -- 172.21.15.135:0/2947854591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c0095f0 con 0x7fb798100f60 2024-05-08T23:16:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb79e340700 1 --2- 172.21.15.135:0/2947854591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7980ffe10 0x7fb798196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:16:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb79db3f700 1 --2- 172.21.15.135:0/2947854591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb798100f60 0x7fb7981973b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb78c005910 tx=0x7fb78c009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb78b7fe700 1 -- 172.21.15.135:0/2947854591 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c01d070 con 0x7fb798100f60 2024-05-08T23:16:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb78b7fe700 1 -- 172.21.15.135:0/2947854591 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb78c003fe0 con 0x7fb798100f60 2024-05-08T23:16:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb7a05a4700 1 -- 172.21.15.135:0/2947854591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79819eef0 con 0x7fb798100f60 2024-05-08T23:16:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb78b7fe700 1 -- 172.21.15.135:0/2947854591 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c022dd0 con 0x7fb798100f60 2024-05-08T23:16:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.168+0000 7fb7a05a4700 1 -- 172.21.15.135:0/2947854591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79819f2b0 con 0x7fb798100f60 2024-05-08T23:16:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.171+0000 7fb78b7fe700 1 -- 172.21.15.135:0/2947854591 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fb78c022470 con 0x7fb798100f60 2024-05-08T23:16:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.171+0000 7fb78b7fe700 1 --2- 172.21.15.135:0/2947854591 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb7840a11b0 0x7fb7840a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.171+0000 7fb79e340700 1 --2- 172.21.15.135:0/2947854591 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb7840a11b0 0x7fb7840a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.171+0000 7fb78b7fe700 1 -- 172.21.15.135:0/2947854591 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fb78c0cdf90 con 0x7fb798100f60 2024-05-08T23:16:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.172+0000 7fb79e340700 1 --2- 172.21.15.135:0/2947854591 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb7840a11b0 0x7fb7840a3670 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb794005950 tx=0x7fb794005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.172+0000 7fb7ac75eb80 1 Processor -- start 2024-05-08T23:16:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.172+0000 7fb7ac75eb80 1 -- start start 2024-05-08T23:16:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.172+0000 7fb7ac75eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb7081a80 0x556eb7081ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.172+0000 7fb7ac75eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70823e0 0x556eb7082cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.172+0000 7fb7ac75eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb70832d0 0x556eb7083750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.172+0000 7fb7ac75eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb6fd90f0 con 0x556eb70823e0 2024-05-08T23:16:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.172+0000 7fb7ac75eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb6fd6ab0 con 0x556eb7081a80 2024-05-08T23:16:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.172+0000 7fb7ac75eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb6fd23a0 con 0x556eb70832d0 2024-05-08T23:16:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.173+0000 7fb79db3f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70823e0 0x556eb7082cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.173+0000 7fb79db3f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70823e0 0x556eb7082cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44050/0 (socket says 172.21.15.135:44050) 2024-05-08T23:16:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.173+0000 7fb79db3f700 1 -- 172.21.15.135:0/385320488 learned_addr learned my addr 172.21.15.135:0/385320488 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.173+0000 7fb79e340700 1 --2- 172.21.15.135:0/385320488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb7081a80 0x556eb7081ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.173+0000 7fb79eb41700 1 --2- 172.21.15.135:0/385320488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb70832d0 0x556eb7083750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.173+0000 7fb79db3f700 1 -- 172.21.15.135:0/385320488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb70832d0 msgr2=0x556eb7083750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.173+0000 7fb79db3f700 1 --2- 172.21.15.135:0/385320488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb70832d0 0x556eb7083750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.173+0000 7fb79db3f700 1 -- 172.21.15.135:0/385320488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb7081a80 msgr2=0x556eb7081ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.173+0000 7fb79db3f700 1 --2- 172.21.15.135:0/385320488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb7081a80 0x556eb7081ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.173+0000 7fb79db3f700 1 -- 172.21.15.135:0/385320488 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556eb6e53350 con 0x556eb70823e0 2024-05-08T23:16:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.173+0000 7fb79e340700 1 --2- 172.21.15.135:0/385320488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb7081a80 0x556eb7081ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:16:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.173+0000 7fb79db3f700 1 --2- 172.21.15.135:0/385320488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70823e0 0x556eb7082cf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0a31b0 tx=0x7fb78c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dffad97e1be4c8b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.173+0000 7fb788ff9700 1 -- 172.21.15.135:0/385320488 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c0b0020 con 0x556eb70823e0 2024-05-08T23:16:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.173+0000 7fb788ff9700 1 -- 172.21.15.135:0/385320488 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb78c09b9f0 con 0x556eb70823e0 2024-05-08T23:16:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.173+0000 7fb788ff9700 1 -- 172.21.15.135:0/385320488 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c09aa40 con 0x556eb70823e0 2024-05-08T23:16:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.174+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/385320488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70823e0 msgr2=0x556eb7082cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.174+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/385320488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70823e0 0x556eb7082cf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0a31b0 tx=0x7fb78c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.174+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/385320488 shutdown_connections 2024-05-08T23:16:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.174+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/385320488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb70832d0 0x556eb7083750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.174+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/385320488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb7081a80 0x556eb7081ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.174+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/385320488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70823e0 0x556eb7082cf0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.174+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/385320488 >> 172.21.15.135:0/385320488 conn(0x556eb6fe01b0 msgr2=0x556eb707e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.174+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/385320488 shutdown_connections 2024-05-08T23:16:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.174+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/385320488 wait complete. 2024-05-08T23:16:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.174+0000 7fb7ac75eb80 1 -- start start 2024-05-08T23:16:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb7ac75eb80 1 Processor -- start 2024-05-08T23:16:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb7ac75eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb7081a80 0x556eb708b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb7ac75eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 0x556eb708ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb7ac75eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb70832d0 0x556eb7092a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb7ac75eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb6f6e500 con 0x556eb7081a80 2024-05-08T23:16:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb7ac75eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb6f6e1a0 con 0x556eb70823e0 2024-05-08T23:16:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb7ac75eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb6e55640 con 0x556eb70832d0 2024-05-08T23:16:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb7ac75eb80 10 client.0 _ll_register_callbacks cb 0x556eb6f77ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:16:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb79e340700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb7081a80 0x556eb708b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb79e340700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb7081a80 0x556eb708b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44054/0 (socket says 172.21.15.135:44054) 2024-05-08T23:16:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb79e340700 1 -- 172.21.15.135:0/2957732808 learned_addr learned my addr 172.21.15.135:0/2957732808 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb79eb41700 1 --2- 172.21.15.135:0/2957732808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb70832d0 0x556eb7092a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb79db3f700 1 --2- 172.21.15.135:0/2957732808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 0x556eb708ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb79e340700 1 -- 172.21.15.135:0/2957732808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb70832d0 msgr2=0x556eb7092a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb79e340700 1 --2- 172.21.15.135:0/2957732808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb70832d0 0x556eb7092a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb79e340700 1 -- 172.21.15.135:0/2957732808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 msgr2=0x556eb708ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb79e340700 1 --2- 172.21.15.135:0/2957732808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 0x556eb708ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb79e340700 1 -- 172.21.15.135:0/2957732808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79819f2b0 con 0x556eb7081a80 2024-05-08T23:16:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.175+0000 7fb79db3f700 1 --2- 172.21.15.135:0/2957732808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 0x556eb708ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:16:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb79e340700 1 --2- 172.21.15.135:0/2957732808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb7081a80 0x556eb708b4e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb794010a30 tx=0x7fb794004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7316f68904cd1ce6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb781ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:16:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb781ffb700 1 -- 172.21.15.135:0/2957732808 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb794010ea0 con 0x556eb7081a80 2024-05-08T23:16:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb781ffb700 1 -- 172.21.15.135:0/2957732808 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fb79400ee80 con 0x556eb7081a80 2024-05-08T23:16:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/2957732808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556eb6f2b210 con 0x556eb7081a80 2024-05-08T23:16:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb781ffb700 1 -- 172.21.15.135:0/2957732808 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb79400fc60 con 0x556eb7081a80 2024-05-08T23:16:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb7ac75eb80 10 client.15384 fetch_fsmap learned FSMap version 28 2024-05-08T23:16:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/2957732808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x556eb6dffb00 con 0x556eb7081a80 2024-05-08T23:16:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb781ffb700 1 -- 172.21.15.135:0/2957732808 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556eb6f2b210 con 0x556eb7081a80 2024-05-08T23:16:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb781ffb700 1 -- 172.21.15.135:0/2957732808 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb794024030 con 0x556eb7081a80 2024-05-08T23:16:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb7ac75eb80 10 client.15384 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:16:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb7ac75eb80 10 client.15384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:16:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb7ac75eb80 20 client.15384 populate_metadata read hostname 'smithi135' 2024-05-08T23:16:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/2957732808 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x556eb7097370 0x556eb7099790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb7ac75eb80 4 client.15384 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:16:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.176+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/2957732808 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556eb70517b0 con 0x556eb7097370 2024-05-08T23:16:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.177+0000 7fb79db3f700 1 --2- 172.21.15.135:0/2957732808 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x556eb7097370 0x556eb7099790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.177+0000 7fb781ffb700 10 client.15384 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.177+0000 7fb79db3f700 1 --2- 172.21.15.135:0/2957732808 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x556eb7097370 0x556eb7099790 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba634e9631ee8762 server_cookie=69f7ca6c6e37bdce in_seq=0 out_seq=0 2024-05-08T23:16:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.178+0000 7fb781ffb700 1 -- 172.21.15.135:0/2957732808 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556eb70517b0 con 0x556eb7097370 2024-05-08T23:16:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.178+0000 7fb781ffb700 10 client.15384 handle_command_reply: tid=0 2024-05-08T23:16:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.178+0000 7fb7ac75eb80 1 client.15384 shutdown 2024-05-08T23:16:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.178+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/2957732808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb7081a80 msgr2=0x556eb708b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.178+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/2957732808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb7081a80 0x556eb708b4e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb794010a30 tx=0x7fb794004750 comp rx=0 tx=0).stop 2024-05-08T23:16:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.178+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/2957732808 shutdown_connections 2024-05-08T23:16:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.178+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/2957732808 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x556eb7097370 0x556eb7099790 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.178+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/2957732808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb70832d0 0x556eb7092a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.178+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/2957732808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb7081a80 0x556eb708b4e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.178+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/2957732808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 0x556eb708ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.178+0000 7fb781ffb700 0 client.15384 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.178+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/2957732808 >> 172.21.15.135:0/2957732808 conn(0x556eb6fe01b0 msgr2=0x556eb707c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.178+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/2957732808 shutdown_connections 2024-05-08T23:16:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.178+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/2957732808 wait complete. 2024-05-08T23:16:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.178+0000 7fb7ac75eb80 20 client.15384 trim_cache size 0 max 16384 2024-05-08T23:16:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb7ac75eb80 1 Processor -- start 2024-05-08T23:16:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb7ac75eb80 1 -- start start 2024-05-08T23:16:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb7ac75eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb7081a80 0x556eb7099760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb7ac75eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 0x556eb7081e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb7ac75eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70832d0 0x556eb7093110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb7ac75eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb707eab0 con 0x556eb70832d0 2024-05-08T23:16:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb7ac75eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb709e9a0 con 0x556eb70823e0 2024-05-08T23:16:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb7ac75eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb7089430 con 0x556eb7081a80 2024-05-08T23:16:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb79eb41700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70832d0 0x556eb7093110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb79eb41700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70832d0 0x556eb7093110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44062/0 (socket says 172.21.15.135:44062) 2024-05-08T23:16:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb79eb41700 1 -- 172.21.15.135:0/2814959747 learned_addr learned my addr 172.21.15.135:0/2814959747 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb79e340700 1 --2- 172.21.15.135:0/2814959747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb7081a80 0x556eb7099760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb79db3f700 1 --2- 172.21.15.135:0/2814959747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 0x556eb7081e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb79eb41700 1 -- 172.21.15.135:0/2814959747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb7081a80 msgr2=0x556eb7099760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb79eb41700 1 --2- 172.21.15.135:0/2814959747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb7081a80 0x556eb7099760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb79eb41700 1 -- 172.21.15.135:0/2814959747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 msgr2=0x556eb7081e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb79eb41700 1 --2- 172.21.15.135:0/2814959747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 0x556eb7081e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb79eb41700 1 -- 172.21.15.135:0/2814959747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556eb6f98500 con 0x556eb70832d0 2024-05-08T23:16:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.193+0000 7fb79db3f700 1 --2- 172.21.15.135:0/2814959747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 0x556eb7081e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:16:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.194+0000 7fb79eb41700 1 --2- 172.21.15.135:0/2814959747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70832d0 0x556eb7093110 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb790009d60 tx=0x7fb7900077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16b9964389b35ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.194+0000 7fb7897fa700 1 -- 172.21.15.135:0/2814959747 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb790017470 con 0x556eb70832d0 2024-05-08T23:16:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.194+0000 7fb7897fa700 1 -- 172.21.15.135:0/2814959747 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb79000f040 con 0x556eb70832d0 2024-05-08T23:16:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.194+0000 7fb7897fa700 1 -- 172.21.15.135:0/2814959747 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb790016890 con 0x556eb70832d0 2024-05-08T23:16:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.194+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/2814959747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70832d0 msgr2=0x556eb7093110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.194+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/2814959747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70832d0 0x556eb7093110 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb790009d60 tx=0x7fb7900077e0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.194+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/2814959747 shutdown_connections 2024-05-08T23:16:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.194+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/2814959747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb7081a80 0x556eb7099760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.194+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/2814959747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70832d0 0x556eb7093110 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.194+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/2814959747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 0x556eb7081e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.194+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/2814959747 >> 172.21.15.135:0/2814959747 conn(0x556eb6fe01b0 msgr2=0x556eb707e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.194+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/2814959747 shutdown_connections 2024-05-08T23:16:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.194+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/2814959747 wait complete. 2024-05-08T23:16:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb7ac75eb80 1 -- start start 2024-05-08T23:16:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb7ac75eb80 1 Processor -- start 2024-05-08T23:16:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb7ac75eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb7081a80 0x556eb708fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb7ac75eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 0x556eb70903d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb7ac75eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70832d0 0x556eb7091340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb7ac75eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb7091880 con 0x556eb70832d0 2024-05-08T23:16:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb7ac75eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb70919f0 con 0x556eb70823e0 2024-05-08T23:16:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb7ac75eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb7091bb0 con 0x556eb7081a80 2024-05-08T23:16:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb7ac75eb80 10 client.0 _ll_register_callbacks cb 0x556eb6f77ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:16:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb79eb41700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70832d0 0x556eb7091340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb79eb41700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70832d0 0x556eb7091340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44074/0 (socket says 172.21.15.135:44074) 2024-05-08T23:16:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb79eb41700 1 -- 172.21.15.135:0/566730362 learned_addr learned my addr 172.21.15.135:0/566730362 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb79e340700 1 --2- 172.21.15.135:0/566730362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb7081a80 0x556eb708fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb79db3f700 1 --2- 172.21.15.135:0/566730362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 0x556eb70903d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb79eb41700 1 -- 172.21.15.135:0/566730362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb7081a80 msgr2=0x556eb708fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb79eb41700 1 --2- 172.21.15.135:0/566730362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb7081a80 0x556eb708fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb79eb41700 1 -- 172.21.15.135:0/566730362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 msgr2=0x556eb70903d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb79eb41700 1 --2- 172.21.15.135:0/566730362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 0x556eb70903d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb79eb41700 1 -- 172.21.15.135:0/566730362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb790009a40 con 0x556eb70832d0 2024-05-08T23:16:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb79eb41700 1 --2- 172.21.15.135:0/566730362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70832d0 0x556eb7091340 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb790007fd0 tx=0x7fb790017720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c3ff5ad45470e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.195+0000 7fb781ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:16:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.196+0000 7fb781ffb700 1 -- 172.21.15.135:0/566730362 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb790009190 con 0x556eb70832d0 2024-05-08T23:16:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.196+0000 7fb781ffb700 1 -- 172.21.15.135:0/566730362 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fb790016610 con 0x556eb70832d0 2024-05-08T23:16:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.196+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/566730362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb78c09b9f0 con 0x556eb70832d0 2024-05-08T23:16:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.196+0000 7fb781ffb700 1 -- 172.21.15.135:0/566730362 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb790017e20 con 0x556eb70832d0 2024-05-08T23:16:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.196+0000 7fb7ac75eb80 10 client.15390 fetch_fsmap learned FSMap version 28 2024-05-08T23:16:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.196+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/566730362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x556eb6e57c70 con 0x556eb70832d0 2024-05-08T23:16:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.196+0000 7fb781ffb700 1 -- 172.21.15.135:0/566730362 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb78c09b9f0 con 0x556eb70832d0 2024-05-08T23:16:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.196+0000 7fb781ffb700 1 -- 172.21.15.135:0/566730362 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb790005430 con 0x556eb70832d0 2024-05-08T23:16:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.196+0000 7fb7ac75eb80 10 client.15390 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:16:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.196+0000 7fb7ac75eb80 10 client.15390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:16:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.196+0000 7fb7ac75eb80 20 client.15390 populate_metadata read hostname 'smithi135' 2024-05-08T23:16:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.196+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/566730362 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x556eb70eddc0 0x556eb70f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.196+0000 7fb7ac75eb80 4 client.15390 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T23:16:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.196+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/566730362 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556eb6fcae60 con 0x556eb70eddc0 2024-05-08T23:16:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.197+0000 7fb79e340700 1 --2- 172.21.15.135:0/566730362 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x556eb70eddc0 0x556eb70f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.197+0000 7fb781ffb700 10 client.15390 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.197+0000 7fb79e340700 1 --2- 172.21.15.135:0/566730362 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x556eb70eddc0 0x556eb70f01e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7a55255ceeeea7d server_cookie=b47813419c92dbbd in_seq=0 out_seq=0 2024-05-08T23:16:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb781ffb700 1 -- 172.21.15.135:0/566730362 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556eb6fcae60 con 0x556eb70eddc0 2024-05-08T23:16:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb781ffb700 10 client.15390 handle_command_reply: tid=0 2024-05-08T23:16:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb7ac75eb80 1 client.15390 shutdown 2024-05-08T23:16:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/566730362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70832d0 msgr2=0x556eb7091340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/566730362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70832d0 0x556eb7091340 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb790007fd0 tx=0x7fb790017720 comp rx=0 tx=0).stop 2024-05-08T23:16:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/566730362 shutdown_connections 2024-05-08T23:16:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/566730362 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x556eb70eddc0 0x556eb70f01e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/566730362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556eb7081a80 0x556eb708fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb781ffb700 0 client.15390 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/566730362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556eb70832d0 0x556eb7091340 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb7ac75eb80 1 --2- 172.21.15.135:0/566730362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556eb70823e0 0x556eb70903d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/566730362 >> 172.21.15.135:0/566730362 conn(0x556eb6fe01b0 msgr2=0x556eb707e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/566730362 shutdown_connections 2024-05-08T23:16:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb7ac75eb80 1 -- 172.21.15.135:0/566730362 wait complete. 2024-05-08T23:16:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb7ac75eb80 20 client.15390 trim_cache size 0 max 16384 2024-05-08T23:16:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-08T23:16:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-08T23:16:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-08T23:16:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-08T23:16:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.204+0000 7fb7a05a4700 1 -- 172.21.15.135:0/2947854591 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb7840a11b0 msgr2=0x7fb7840a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.205+0000 7fb7a05a4700 1 --2- 172.21.15.135:0/2947854591 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb7840a11b0 0x7fb7840a3670 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb794005950 tx=0x7fb794005f50 comp rx=0 tx=0).stop 2024-05-08T23:16:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.205+0000 7fb7a05a4700 1 -- 172.21.15.135:0/2947854591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb798100f60 msgr2=0x7fb7981973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.205+0000 7fb7a05a4700 1 --2- 172.21.15.135:0/2947854591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb798100f60 0x7fb7981973b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb78c005910 tx=0x7fb78c009510 comp rx=0 tx=0).stop 2024-05-08T23:16:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.205+0000 7fb7a05a4700 1 -- 172.21.15.135:0/2947854591 shutdown_connections 2024-05-08T23:16:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.205+0000 7fb7a05a4700 1 --2- 172.21.15.135:0/2947854591 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb7840a11b0 0x7fb7840a3670 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.205+0000 7fb7a05a4700 1 --2- 172.21.15.135:0/2947854591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb798101920 0x7fb79819e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.205+0000 7fb7a05a4700 1 --2- 172.21.15.135:0/2947854591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7980ffe10 0x7fb798196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.205+0000 7fb7a05a4700 1 --2- 172.21.15.135:0/2947854591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb798100f60 0x7fb7981973b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.205+0000 7fb7a05a4700 1 -- 172.21.15.135:0/2947854591 >> 172.21.15.135:0/2947854591 conn(0x7fb7980fb380 msgr2=0x7fb7980fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.205+0000 7fb7a05a4700 1 -- 172.21.15.135:0/2947854591 shutdown_connections 2024-05-08T23:16:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:15.205+0000 7fb7a05a4700 1 -- 172.21.15.135:0/2947854591 wait complete. 2024-05-08T23:16:16.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:16 smithi195 ceph-mon[46516]: pgmap v282: 97 pgs: 97 active+clean; 669 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-08T23:16:16.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:16 smithi135 ceph-mon[42440]: pgmap v282: 97 pgs: 97 active+clean; 669 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-08T23:16:16.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:16 smithi179 ceph-mon[46314]: pgmap v282: 97 pgs: 97 active+clean; 669 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-08T23:16:18.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:18 smithi195 ceph-mon[46516]: pgmap v283: 97 pgs: 97 active+clean; 669 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-08T23:16:18.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:18 smithi135 ceph-mon[42440]: pgmap v283: 97 pgs: 97 active+clean; 669 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-08T23:16:18.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:18 smithi179 ceph-mon[46314]: pgmap v283: 97 pgs: 97 active+clean; 669 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-08T23:16:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:20 smithi195 ceph-mon[46516]: pgmap v284: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-08T23:16:20.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:20 smithi135 ceph-mon[42440]: pgmap v284: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-08T23:16:20.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:20 smithi179 ceph-mon[46314]: pgmap v284: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-08T23:16:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:22 smithi195 ceph-mon[46516]: pgmap v285: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-05-08T23:16:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:22 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:16:22.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:22 smithi135 ceph-mon[42440]: pgmap v285: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-05-08T23:16:22.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:22 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:16:22.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:22 smithi179 ceph-mon[46314]: pgmap v285: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-05-08T23:16:22.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:22 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:16:24.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:24 smithi179 ceph-mon[46314]: pgmap v286: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 13 op/s 2024-05-08T23:16:24.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:24 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:24 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:24 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:24 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:24 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:24 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:24 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:16:24.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:24 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:16:24.350 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:24 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:24 smithi195 ceph-mon[46516]: pgmap v286: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 13 op/s 2024-05-08T23:16:24.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:24 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:24 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:24 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:24 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:24 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:24 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:24 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:16:24.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:24 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:16:24.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:24 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:24 smithi135 ceph-mon[42440]: pgmap v286: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 13 op/s 2024-05-08T23:16:24.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:24 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:24 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:24 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:24 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:24 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:24 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:24.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:24 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:16:24.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:24 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:16:24.455 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:24 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:16:26.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:26 smithi179 ceph-mon[46314]: pgmap v287: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-05-08T23:16:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:26 smithi195 ceph-mon[46516]: pgmap v287: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-05-08T23:16:26.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:26 smithi135 ceph-mon[42440]: pgmap v287: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-05-08T23:16:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.313+0000 7feccba61700 1 -- 172.21.15.135:0/1756130600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecc4106be0 msgr2=0x7fecc4109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.313+0000 7feccba61700 1 --2- 172.21.15.135:0/1756130600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecc4106be0 0x7fecc4109050 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00b0a0 tx=0x7fecbc00b3b0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.313+0000 7feccba61700 1 -- 172.21.15.135:0/1756130600 shutdown_connections 2024-05-08T23:16:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.313+0000 7feccba61700 1 --2- 172.21.15.135:0/1756130600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fecc4101980 0x7fecc4103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.313+0000 7feccba61700 1 --2- 172.21.15.135:0/1756130600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecc4106be0 0x7fecc4109050 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.313+0000 7feccba61700 1 --2- 172.21.15.135:0/1756130600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecc41042b0 0x7fecc41066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.313+0000 7feccba61700 1 -- 172.21.15.135:0/1756130600 >> 172.21.15.135:0/1756130600 conn(0x7fecc40fb390 msgr2=0x7fecc40fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.314+0000 7feccba61700 1 -- 172.21.15.135:0/1756130600 shutdown_connections 2024-05-08T23:16:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.314+0000 7feccba61700 1 -- 172.21.15.135:0/1756130600 wait complete. 2024-05-08T23:16:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.314+0000 7feccba61700 1 Processor -- start 2024-05-08T23:16:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.314+0000 7feccba61700 1 -- start start 2024-05-08T23:16:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7feccba61700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecc4101980 0x7fecc41012a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7feccba61700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecc41042b0 0x7fecc40ff930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7feccba61700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fecc4106be0 0x7fecc40ffe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7feccba61700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc4100610 con 0x7fecc4101980 2024-05-08T23:16:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7feccba61700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc4100780 con 0x7fecc41042b0 2024-05-08T23:16:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7feccba61700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc41a0fa0 con 0x7fecc4106be0 2024-05-08T23:16:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7fecc97fd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecc4101980 0x7fecc41012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7fecc97fd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecc4101980 0x7fecc41012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55804/0 (socket says 172.21.15.135:55804) 2024-05-08T23:16:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7fecc97fd700 1 -- 172.21.15.135:0/587344940 learned_addr learned my addr 172.21.15.135:0/587344940 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7fecc9ffe700 1 --2- 172.21.15.135:0/587344940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fecc4106be0 0x7fecc40ffe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7fecc8ffc700 1 --2- 172.21.15.135:0/587344940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecc41042b0 0x7fecc40ff930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7fecc97fd700 1 -- 172.21.15.135:0/587344940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fecc4106be0 msgr2=0x7fecc40ffe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7fecc97fd700 1 --2- 172.21.15.135:0/587344940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fecc4106be0 0x7fecc40ffe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7fecc97fd700 1 -- 172.21.15.135:0/587344940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecc41042b0 msgr2=0x7fecc40ff930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7fecc97fd700 1 --2- 172.21.15.135:0/587344940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecc41042b0 0x7fecc40ff930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7fecc97fd700 1 -- 172.21.15.135:0/587344940 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc009d00 con 0x7fecc4101980 2024-05-08T23:16:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7fecc9ffe700 1 --2- 172.21.15.135:0/587344940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fecc4106be0 0x7fecc40ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:16:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7fecc97fd700 1 --2- 172.21.15.135:0/587344940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecc4101980 0x7fecc41012a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fecc000d950 tx=0x7fecc000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7fecba7fc700 1 -- 172.21.15.135:0/587344940 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc0009ae0 con 0x7fecc4101980 2024-05-08T23:16:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7fecba7fc700 1 -- 172.21.15.135:0/587344940 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecc0009c40 con 0x7fecc4101980 2024-05-08T23:16:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7feccba61700 1 -- 172.21.15.135:0/587344940 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc41a1230 con 0x7fecc4101980 2024-05-08T23:16:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7fecba7fc700 1 -- 172.21.15.135:0/587344940 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc000f620 con 0x7fecc4101980 2024-05-08T23:16:28.319 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.315+0000 7feccba61700 1 -- 172.21.15.135:0/587344940 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc41a1740 con 0x7fecc4101980 2024-05-08T23:16:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.319+0000 7fecba7fc700 1 -- 172.21.15.135:0/587344940 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fecc0010460 con 0x7fecc4101980 2024-05-08T23:16:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.319+0000 7fecd7c1bb80 1 Processor -- start 2024-05-08T23:16:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.319+0000 7fecd7c1bb80 1 -- start start 2024-05-08T23:16:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.319+0000 7fecba7fc700 1 --2- 172.21.15.135:0/587344940 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fecb00a11b0 0x7fecb00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecd7c1bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8ba80 0x55cc0fd8bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecd7c1bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd8ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecd7c1bb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd8d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecd7c1bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0fce30f0 con 0x55cc0fd8ba80 2024-05-08T23:16:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecd7c1bb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0fce0ab0 con 0x55cc0fd8d2d0 2024-05-08T23:16:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecd7c1bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0fcdc3a0 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecba7fc700 1 -- 172.21.15.135:0/587344940 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fecc00cca20 con 0x7fecc4101980 2024-05-08T23:16:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecc9ffe700 1 --2- 172.21.15.135:0/587344940 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fecb00a11b0 0x7fecb00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecc97fd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8ba80 0x55cc0fd8bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecc8ffc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd8ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecc97fd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8ba80 0x55cc0fd8bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55808/0 (socket says 172.21.15.135:55808) 2024-05-08T23:16:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecc8ffc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd8ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.135:60872/0 (socket says 172.21.15.135:60872) 2024-05-08T23:16:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecc97fd700 1 -- 172.21.15.135:0/4050321676 learned_addr learned my addr 172.21.15.135:0/4050321676 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecc97fd700 1 -- 172.21.15.135:0/4050321676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 msgr2=0x55cc0fd8ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecc97fd700 1 --2- 172.21.15.135:0/4050321676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd8ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecc97fd700 1 -- 172.21.15.135:0/4050321676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8d2d0 msgr2=0x55cc0fd8d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecc97fd700 1 --2- 172.21.15.135:0/4050321676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd8d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecc97fd700 1 -- 172.21.15.135:0/4050321676 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc0fb5d350 con 0x55cc0fd8ba80 2024-05-08T23:16:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecc9ffe700 1 --2- 172.21.15.135:0/587344940 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fecb00a11b0 0x7fecb00a3670 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00b780 tx=0x7fecbc0074e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.320+0000 7fecc97fd700 1 --2- 172.21.15.135:0/4050321676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8ba80 0x55cc0fd8bea0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fecc000b2f0 tx=0x7fecc0099780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9ed9bc99597754 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.321+0000 7fecaf7fe700 1 -- 172.21.15.135:0/4050321676 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc009db20 con 0x55cc0fd8ba80 2024-05-08T23:16:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.321+0000 7fecaf7fe700 1 -- 172.21.15.135:0/4050321676 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecc00a2170 con 0x55cc0fd8ba80 2024-05-08T23:16:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.321+0000 7fecaf7fe700 1 -- 172.21.15.135:0/4050321676 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc00a1ce0 con 0x55cc0fd8ba80 2024-05-08T23:16:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.321+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/4050321676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8ba80 msgr2=0x55cc0fd8bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.321+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/4050321676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8ba80 0x55cc0fd8bea0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fecc000b2f0 tx=0x7fecc0099780 comp rx=0 tx=0).stop 2024-05-08T23:16:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.321+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/4050321676 shutdown_connections 2024-05-08T23:16:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.321+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/4050321676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd8d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.321+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/4050321676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8ba80 0x55cc0fd8bea0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.321+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/4050321676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd8ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.321+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/4050321676 >> 172.21.15.135:0/4050321676 conn(0x55cc0fcea1b0 msgr2=0x55cc0fd88440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.322+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/4050321676 shutdown_connections 2024-05-08T23:16:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.322+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/4050321676 wait complete. 2024-05-08T23:16:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.322+0000 7fecd7c1bb80 1 -- start start 2024-05-08T23:16:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.322+0000 7fecd7c1bb80 1 Processor -- start 2024-05-08T23:16:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecd7c1bb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 0x55cc0fd95890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecd7c1bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd95dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecd7c1bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd9ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecd7c1bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0fc78500 con 0x55cc0fd8d2d0 2024-05-08T23:16:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecd7c1bb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0fc781a0 con 0x55cc0fd8ba80 2024-05-08T23:16:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecd7c1bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0fb5f640 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecd7c1bb80 10 client.0 _ll_register_callbacks cb 0x55cc0fc81ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:16:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecc9ffe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd9ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecc9ffe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd9ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55812/0 (socket says 172.21.15.135:55812) 2024-05-08T23:16:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecc8ffc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd95dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecc9ffe700 1 -- 172.21.15.135:0/1403224125 learned_addr learned my addr 172.21.15.135:0/1403224125 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecc97fd700 1 --2- 172.21.15.135:0/1403224125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 0x55cc0fd95890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecc9ffe700 1 -- 172.21.15.135:0/1403224125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 msgr2=0x55cc0fd95dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecc9ffe700 1 --2- 172.21.15.135:0/1403224125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd95dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecc9ffe700 1 -- 172.21.15.135:0/1403224125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 msgr2=0x55cc0fd95890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecc9ffe700 1 --2- 172.21.15.135:0/1403224125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 0x55cc0fd95890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecc9ffe700 1 -- 172.21.15.135:0/1403224125 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc41a1740 con 0x55cc0fd8d2d0 2024-05-08T23:16:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecc8ffc700 1 --2- 172.21.15.135:0/1403224125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd95dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:16:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecc9ffe700 1 --2- 172.21.15.135:0/1403224125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd9ce10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fecbc015000 tx=0x7fecbc0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e118400f79cdea5c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecacff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:16:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecacff9700 1 -- 172.21.15.135:0/1403224125 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc01d860 con 0x55cc0fd8d2d0 2024-05-08T23:16:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecacff9700 1 -- 172.21.15.135:0/1403224125 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fecbc004e20 con 0x55cc0fd8d2d0 2024-05-08T23:16:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.323+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/1403224125 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc0fc35210 con 0x55cc0fd8d2d0 2024-05-08T23:16:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.324+0000 7fecacff9700 1 -- 172.21.15.135:0/1403224125 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecbc00ce90 con 0x55cc0fd8d2d0 2024-05-08T23:16:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.324+0000 7fecd7c1bb80 10 client.15402 fetch_fsmap learned FSMap version 28 2024-05-08T23:16:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.324+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/1403224125 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55cc0fb09b00 con 0x55cc0fd8d2d0 2024-05-08T23:16:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.324+0000 7fecacff9700 1 -- 172.21.15.135:0/1403224125 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cc0fc35210 con 0x55cc0fd8d2d0 2024-05-08T23:16:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.324+0000 7fecacff9700 1 -- 172.21.15.135:0/1403224125 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fecbc02ab80 con 0x55cc0fd8d2d0 2024-05-08T23:16:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.324+0000 7fecd7c1bb80 10 client.15402 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:16:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.324+0000 7fecd7c1bb80 10 client.15402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:16:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.324+0000 7fecd7c1bb80 20 client.15402 populate_metadata read hostname 'smithi135' 2024-05-08T23:16:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.324+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/1403224125 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55cc0fda1710 0x55cc0fda3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.324+0000 7fecd7c1bb80 4 client.15402 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:16:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.324+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/1403224125 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc0fd5b7b0 con 0x55cc0fda1710 2024-05-08T23:16:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.324+0000 7fecc97fd700 1 --2- 172.21.15.135:0/1403224125 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55cc0fda1710 0x55cc0fda3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.325+0000 7fecc97fd700 1 --2- 172.21.15.135:0/1403224125 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55cc0fda1710 0x55cc0fda3b30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9935ff12eb56deb server_cookie=85c68db945ecf73d in_seq=0 out_seq=0 2024-05-08T23:16:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.325+0000 7fecacff9700 10 client.15402 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.325+0000 7fecacff9700 1 -- 172.21.15.135:0/1403224125 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cc0fd5b7b0 con 0x55cc0fda1710 2024-05-08T23:16:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.325+0000 7fecacff9700 10 client.15402 handle_command_reply: tid=0 2024-05-08T23:16:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.325+0000 7fecd7c1bb80 1 client.15402 shutdown 2024-05-08T23:16:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.325+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/1403224125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8d2d0 msgr2=0x55cc0fd9ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.325+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/1403224125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd9ce10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fecbc015000 tx=0x7fecbc0099e0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.325+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/1403224125 shutdown_connections 2024-05-08T23:16:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.326+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/1403224125 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55cc0fda1710 0x55cc0fda3b30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.326+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/1403224125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd9ce10 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.326+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/1403224125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 0x55cc0fd95890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.326+0000 7fecacff9700 0 client.15402 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.326+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/1403224125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd95dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.326+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/1403224125 >> 172.21.15.135:0/1403224125 conn(0x55cc0fcea1b0 msgr2=0x55cc0fd86860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.326+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/1403224125 shutdown_connections 2024-05-08T23:16:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.326+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/1403224125 wait complete. 2024-05-08T23:16:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.326+0000 7fecd7c1bb80 20 client.15402 trim_cache size 0 max 16384 2024-05-08T23:16:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.341+0000 7fecd7c1bb80 1 Processor -- start 2024-05-08T23:16:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.341+0000 7fecd7c1bb80 1 -- start start 2024-05-08T23:16:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecd7c1bb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 0x55cc0fda3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecd7c1bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd8be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecd7c1bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd9cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecd7c1bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0fda8d40 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecd7c1bb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0fd8b5e0 con 0x55cc0fd8ba80 2024-05-08T23:16:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecd7c1bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0fd96510 con 0x55cc0fd8d2d0 2024-05-08T23:16:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecc8ffc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd8be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecc8ffc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd8be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55822/0 (socket says 172.21.15.135:55822) 2024-05-08T23:16:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecc8ffc700 1 -- 172.21.15.135:0/1332265218 learned_addr learned my addr 172.21.15.135:0/1332265218 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecc97fd700 1 --2- 172.21.15.135:0/1332265218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 0x55cc0fda3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecc9ffe700 1 --2- 172.21.15.135:0/1332265218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd9cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecc8ffc700 1 -- 172.21.15.135:0/1332265218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8d2d0 msgr2=0x55cc0fd9cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecc8ffc700 1 --2- 172.21.15.135:0/1332265218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd9cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecc8ffc700 1 -- 172.21.15.135:0/1332265218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 msgr2=0x55cc0fda3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecc8ffc700 1 --2- 172.21.15.135:0/1332265218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 0x55cc0fda3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecc8ffc700 1 -- 172.21.15.135:0/1332265218 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc0fca2500 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecc97fd700 1 --2- 172.21.15.135:0/1332265218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 0x55cc0fda3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:16:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.342+0000 7fecc8ffc700 1 --2- 172.21.15.135:0/1332265218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd8be60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fecb4012550 tx=0x7fecb4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8129b912afc646e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.343+0000 7fecaffff700 1 -- 172.21.15.135:0/1332265218 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4017050 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.343+0000 7fecaffff700 1 -- 172.21.15.135:0/1332265218 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecb4018040 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.343+0000 7fecaffff700 1 -- 172.21.15.135:0/1332265218 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb401c820 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.343+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/1332265218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8c3e0 msgr2=0x55cc0fd8be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.343+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/1332265218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd8be60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fecb4012550 tx=0x7fecb4009260 comp rx=0 tx=0).stop 2024-05-08T23:16:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.343+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/1332265218 shutdown_connections 2024-05-08T23:16:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.343+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/1332265218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd9cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.343+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/1332265218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 0x55cc0fda3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.343+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/1332265218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd8be60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.343+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/1332265218 >> 172.21.15.135:0/1332265218 conn(0x55cc0fcea1b0 msgr2=0x55cc0fd93860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.343+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/1332265218 shutdown_connections 2024-05-08T23:16:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.343+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/1332265218 wait complete. 2024-05-08T23:16:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.344+0000 7fecd7c1bb80 1 -- start start 2024-05-08T23:16:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.344+0000 7fecd7c1bb80 1 Processor -- start 2024-05-08T23:16:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.344+0000 7fecd7c1bb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 0x55cc0fd9a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.344+0000 7fecd7c1bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd9a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.344+0000 7fecd7c1bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd9b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.344+0000 7fecd7c1bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0fd9bba0 con 0x55cc0fd8d2d0 2024-05-08T23:16:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.344+0000 7fecd7c1bb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0fd9bd10 con 0x55cc0fd8ba80 2024-05-08T23:16:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.344+0000 7fecd7c1bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc0fd9bed0 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.344+0000 7fecd7c1bb80 10 client.0 _ll_register_callbacks cb 0x55cc0fc81ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:16:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.344+0000 7fecc8ffc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd9a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.344+0000 7fecc9ffe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd9b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.344+0000 7fecc8ffc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd9a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.135:60900/0 (socket says 172.21.15.135:60900) 2024-05-08T23:16:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.344+0000 7fecc8ffc700 1 -- 172.21.15.135:0/3211944662 learned_addr learned my addr 172.21.15.135:0/3211944662 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.345+0000 7fecc97fd700 1 --2- 172.21.15.135:0/3211944662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 0x55cc0fd9a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.345+0000 7fecc8ffc700 1 -- 172.21.15.135:0/3211944662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 msgr2=0x55cc0fd9a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.345+0000 7fecc8ffc700 1 --2- 172.21.15.135:0/3211944662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 0x55cc0fd9a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.345+0000 7fecc8ffc700 1 -- 172.21.15.135:0/3211944662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8d2d0 msgr2=0x55cc0fd9b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.345+0000 7fecc8ffc700 1 --2- 172.21.15.135:0/3211944662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd9b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.345+0000 7fecc8ffc700 1 -- 172.21.15.135:0/3211944662 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc0fb5d350 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.345+0000 7fecc9ffe700 1 --2- 172.21.15.135:0/3211944662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd9b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:16:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.345+0000 7fecc8ffc700 1 --2- 172.21.15.135:0/3211944662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd9a6a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009b50 tx=0x7fecb401ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85434f78f7223837 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.345+0000 7fecacff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2024-05-08T23:16:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.345+0000 7fecacff9700 1 -- 172.21.15.135:0/3211944662 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4005460 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.345+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/3211944662 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fecc00a2170 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.345+0000 7fecacff9700 1 -- 172.21.15.135:0/3211944662 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fecb40055c0 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.345+0000 7fecacff9700 1 -- 172.21.15.135:0/3211944662 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecb4017020 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.345+0000 7fecd7c1bb80 10 client.24988 fetch_fsmap learned FSMap version 28 2024-05-08T23:16:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.345+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/3211944662 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7fecb4009de0 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.346+0000 7fecacff9700 1 -- 172.21.15.135:0/3211944662 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecc00a2170 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.346+0000 7fecacff9700 1 -- 172.21.15.135:0/3211944662 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fecb400f910 con 0x55cc0fd8c3e0 2024-05-08T23:16:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.346+0000 7fecd7c1bb80 10 client.24988 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:16:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.346+0000 7fecd7c1bb80 10 client.24988 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:16:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.346+0000 7fecd7c1bb80 20 client.24988 populate_metadata read hostname 'smithi135' 2024-05-08T23:16:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.346+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/3211944662 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55cc0fdf8160 0x55cc0fdfa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.346+0000 7fecd7c1bb80 4 client.24988 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T23:16:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.346+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/3211944662 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cc0fcd4e60 con 0x55cc0fdf8160 2024-05-08T23:16:28.351 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.346+0000 7fecc97fd700 1 --2- 172.21.15.135:0/3211944662 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55cc0fdf8160 0x55cc0fdfa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:28.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.346+0000 7fecacff9700 10 client.24988 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:28.352 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.346+0000 7fecc97fd700 1 --2- 172.21.15.135:0/3211944662 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55cc0fdf8160 0x55cc0fdfa580 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3a0440baf28f763 server_cookie=335d2b99863ededb in_seq=0 out_seq=0 2024-05-08T23:16:28.352 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:28 smithi179 ceph-mon[46314]: pgmap v288: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-08T23:16:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.350+0000 7fecacff9700 1 -- 172.21.15.135:0/3211944662 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cc0fcd4e60 con 0x55cc0fdf8160 2024-05-08T23:16:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.350+0000 7fecacff9700 10 client.24988 handle_command_reply: tid=0 2024-05-08T23:16:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.350+0000 7fecd7c1bb80 1 client.24988 shutdown 2024-05-08T23:16:28.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.350+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/3211944662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 msgr2=0x55cc0fd9a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.350+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/3211944662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd9a6a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009b50 tx=0x7fecb401ca60 comp rx=0 tx=0).stop 2024-05-08T23:16:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.350+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/3211944662 shutdown_connections 2024-05-08T23:16:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.350+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/3211944662 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55cc0fdf8160 0x55cc0fdfa580 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.350+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/3211944662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc0fd8d2d0 0x55cc0fd9b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.350+0000 7fecacff9700 0 client.24988 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.350+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/3211944662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cc0fd8ba80 0x55cc0fd9a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.350+0000 7fecd7c1bb80 1 --2- 172.21.15.135:0/3211944662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cc0fd8c3e0 0x55cc0fd9a6a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.350+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/3211944662 >> 172.21.15.135:0/3211944662 conn(0x55cc0fcea1b0 msgr2=0x55cc0fd9d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.350+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/3211944662 shutdown_connections 2024-05-08T23:16:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.350+0000 7fecd7c1bb80 1 -- 172.21.15.135:0/3211944662 wait complete. 2024-05-08T23:16:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.350+0000 7fecd7c1bb80 20 client.24988 trim_cache size 0 max 16384 2024-05-08T23:16:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-08T23:16:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-08T23:16:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-08T23:16:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-08T23:16:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.351+0000 7feccba61700 1 -- 172.21.15.135:0/587344940 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fecb00a11b0 msgr2=0x7fecb00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.351+0000 7feccba61700 1 --2- 172.21.15.135:0/587344940 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fecb00a11b0 0x7fecb00a3670 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00b780 tx=0x7fecbc0074e0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.351+0000 7feccba61700 1 -- 172.21.15.135:0/587344940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecc4101980 msgr2=0x7fecc41012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.351+0000 7feccba61700 1 --2- 172.21.15.135:0/587344940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecc4101980 0x7fecc41012a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fecc000d950 tx=0x7fecc000dd10 comp rx=0 tx=0).stop 2024-05-08T23:16:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.351+0000 7feccba61700 1 -- 172.21.15.135:0/587344940 shutdown_connections 2024-05-08T23:16:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.351+0000 7feccba61700 1 --2- 172.21.15.135:0/587344940 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fecb00a11b0 0x7fecb00a3670 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.351+0000 7feccba61700 1 --2- 172.21.15.135:0/587344940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fecc4106be0 0x7fecc40ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.351+0000 7feccba61700 1 --2- 172.21.15.135:0/587344940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecc4101980 0x7fecc41012a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.351+0000 7feccba61700 1 --2- 172.21.15.135:0/587344940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecc41042b0 0x7fecc40ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.351+0000 7feccba61700 1 -- 172.21.15.135:0/587344940 >> 172.21.15.135:0/587344940 conn(0x7fecc40fb390 msgr2=0x7fecc4102380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.351+0000 7feccba61700 1 -- 172.21.15.135:0/587344940 shutdown_connections 2024-05-08T23:16:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:28.351+0000 7feccba61700 1 -- 172.21.15.135:0/587344940 wait complete. 2024-05-08T23:16:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:28 smithi195 ceph-mon[46516]: pgmap v288: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-08T23:16:28.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:28 smithi135 ceph-mon[42440]: pgmap v288: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-08T23:16:30.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:30 smithi179 ceph-mon[46314]: pgmap v289: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-08T23:16:30.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:30 smithi195 ceph-mon[46516]: pgmap v289: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-08T23:16:30.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:30 smithi135 ceph-mon[42440]: pgmap v289: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-08T23:16:32.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:32 smithi179 ceph-mon[46314]: pgmap v290: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-08T23:16:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:32 smithi195 ceph-mon[46516]: pgmap v290: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-08T23:16:32.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:32 smithi135 ceph-mon[42440]: pgmap v290: 97 pgs: 97 active+clean; 670 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-08T23:16:34.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:34 smithi179 ceph-mon[46314]: pgmap v291: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-08T23:16:34.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:34 smithi195 ceph-mon[46516]: pgmap v291: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-08T23:16:34.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:34 smithi135 ceph-mon[42440]: pgmap v291: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-08T23:16:36.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:36 smithi179 ceph-mon[46314]: pgmap v292: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-08T23:16:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:36 smithi195 ceph-mon[46516]: pgmap v292: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-08T23:16:36.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:36 smithi135 ceph-mon[42440]: pgmap v292: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-08T23:16:38.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:38 smithi179 ceph-mon[46314]: pgmap v293: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-08T23:16:38.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:38 smithi195 ceph-mon[46516]: pgmap v293: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-08T23:16:38.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:38 smithi135 ceph-mon[42440]: pgmap v293: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-08T23:16:40.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:40 smithi195 ceph-mon[46516]: pgmap v294: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-08T23:16:40.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:40 smithi135 ceph-mon[42440]: pgmap v294: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-08T23:16:40.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:40 smithi179 ceph-mon[46314]: pgmap v294: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-08T23:16:41.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.520+0000 7f16edf75700 1 -- 172.21.15.135:0/300212810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e8100080 msgr2=0x7f16e81004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:41.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.520+0000 7f16edf75700 1 --2- 172.21.15.135:0/300212810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e8100080 0x7f16e81004e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009a10 tx=0x7f16dc009d20 comp rx=0 tx=0).stop 2024-05-08T23:16:41.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.521+0000 7f16edf75700 1 -- 172.21.15.135:0/300212810 shutdown_connections 2024-05-08T23:16:41.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.521+0000 7f16edf75700 1 --2- 172.21.15.135:0/300212810 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16e81013e0 0x7f16e8101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.521+0000 7f16edf75700 1 --2- 172.21.15.135:0/300212810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8100a20 0x7f16e81082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.521+0000 7f16edf75700 1 --2- 172.21.15.135:0/300212810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e8100080 0x7f16e81004e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.521+0000 7f16edf75700 1 -- 172.21.15.135:0/300212810 >> 172.21.15.135:0/300212810 conn(0x7f16e80faaf0 msgr2=0x7f16e80fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:41.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.521+0000 7f16edf75700 1 -- 172.21.15.135:0/300212810 shutdown_connections 2024-05-08T23:16:41.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.521+0000 7f16edf75700 1 -- 172.21.15.135:0/300212810 wait complete. 2024-05-08T23:16:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.521+0000 7f16edf75700 1 Processor -- start 2024-05-08T23:16:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.522+0000 7f16edf75700 1 -- start start 2024-05-08T23:16:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.522+0000 7f16edf75700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e8100080 0x7f16e8194cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.522+0000 7f16edf75700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8100a20 0x7f16e8195210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.522+0000 7f16edf75700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16e81013e0 0x7f16e819c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.522+0000 7f16edf75700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e819c7c0 con 0x7f16e8100080 2024-05-08T23:16:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.522+0000 7f16edf75700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e819c930 con 0x7f16e8100a20 2024-05-08T23:16:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.522+0000 7f16edf75700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e819caf0 con 0x7f16e81013e0 2024-05-08T23:16:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.522+0000 7f16e77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e8100080 0x7f16e8194cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.522+0000 7f16e77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e8100080 0x7f16e8194cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58462/0 (socket says 172.21.15.135:58462) 2024-05-08T23:16:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.522+0000 7f16e77fe700 1 -- 172.21.15.135:0/963472367 learned_addr learned my addr 172.21.15.135:0/963472367 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.522+0000 7f16e7fff700 1 --2- 172.21.15.135:0/963472367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16e81013e0 0x7f16e819c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:41.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.522+0000 7f16e6ffd700 1 --2- 172.21.15.135:0/963472367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8100a20 0x7f16e8195210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.523+0000 7f16e77fe700 1 -- 172.21.15.135:0/963472367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16e81013e0 msgr2=0x7f16e819c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.523+0000 7f16e77fe700 1 --2- 172.21.15.135:0/963472367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16e81013e0 0x7f16e819c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.523+0000 7f16e77fe700 1 -- 172.21.15.135:0/963472367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8100a20 msgr2=0x7f16e8195210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.523+0000 7f16e77fe700 1 --2- 172.21.15.135:0/963472367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8100a20 0x7f16e8195210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.523+0000 7f16e77fe700 1 -- 172.21.15.135:0/963472367 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0095f0 con 0x7f16e8100080 2024-05-08T23:16:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.523+0000 7f16e6ffd700 1 --2- 172.21.15.135:0/963472367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8100a20 0x7f16e8195210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:16:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.523+0000 7f16e77fe700 1 --2- 172.21.15.135:0/963472367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e8100080 0x7f16e8194cd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f16d800d980 tx=0x7f16d800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.523+0000 7f16e4ff9700 1 -- 172.21.15.135:0/963472367 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8004020 con 0x7f16e8100080 2024-05-08T23:16:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.523+0000 7f16e4ff9700 1 -- 172.21.15.135:0/963472367 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16d8009730 con 0x7f16e8100080 2024-05-08T23:16:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.523+0000 7f16e4ff9700 1 -- 172.21.15.135:0/963472367 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8003a30 con 0x7f16e8100080 2024-05-08T23:16:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.523+0000 7f16edf75700 1 -- 172.21.15.135:0/963472367 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e819cdd0 con 0x7f16e8100080 2024-05-08T23:16:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.523+0000 7f16edf75700 1 -- 172.21.15.135:0/963472367 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e819d1d0 con 0x7f16e8100080 2024-05-08T23:16:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.527+0000 7f16e4ff9700 1 -- 172.21.15.135:0/963472367 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f16d80098a0 con 0x7f16e8100080 2024-05-08T23:16:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.528+0000 7f16e4ff9700 1 --2- 172.21.15.135:0/963472367 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f16d00a11b0 0x7f16d00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.528+0000 7f16e4ff9700 1 -- 172.21.15.135:0/963472367 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f16d80cc740 con 0x7f16e8100080 2024-05-08T23:16:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.528+0000 7f16fa12fb80 1 Processor -- start 2024-05-08T23:16:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.528+0000 7f16fa12fb80 1 -- start start 2024-05-08T23:16:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.528+0000 7f16fa12fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310d3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.528+0000 7f16fa12fb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d43f0 0x55a8310d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.528+0000 7f16fa12fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d52e0 0x55a8310d5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.529+0000 7f16fa12fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83101a0f0 con 0x55a8310d3a90 2024-05-08T23:16:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.529+0000 7f16fa12fb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a831017ab0 con 0x55a8310d43f0 2024-05-08T23:16:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.529+0000 7f16fa12fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8310133a0 con 0x55a8310d52e0 2024-05-08T23:16:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.529+0000 7f16e6ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d43f0 0x55a8310d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.529+0000 7f16e6ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d43f0 0x55a8310d4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.135:54076/0 (socket says 172.21.15.135:54076) 2024-05-08T23:16:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.529+0000 7f16e6ffd700 1 -- 172.21.15.135:0/2934675686 learned_addr learned my addr 172.21.15.135:0/2934675686 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.529+0000 7f16e7fff700 1 --2- 172.21.15.135:0/2934675686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d52e0 0x55a8310d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.529+0000 7f16e77fe700 1 --2- 172.21.15.135:0/2934675686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310d3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.529+0000 7f16e7fff700 1 -- 172.21.15.135:0/2934675686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d43f0 msgr2=0x55a8310d4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.529+0000 7f16e7fff700 1 --2- 172.21.15.135:0/2934675686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d43f0 0x55a8310d4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.529+0000 7f16e7fff700 1 -- 172.21.15.135:0/2934675686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 msgr2=0x55a8310d3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.529+0000 7f16e7fff700 1 --2- 172.21.15.135:0/2934675686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310d3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.529+0000 7f16e7fff700 1 -- 172.21.15.135:0/2934675686 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a830e94350 con 0x55a8310d52e0 2024-05-08T23:16:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.529+0000 7f16e77fe700 1 --2- 172.21.15.135:0/2934675686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310d3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:16:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.529+0000 7f16e7fff700 1 --2- 172.21.15.135:0/2934675686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d52e0 0x55a8310d5760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f16e000b400 tx=0x7f16e000bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36ec151b2f0be816 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.530+0000 7f16cdffb700 1 -- 172.21.15.135:0/2934675686 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0010070 con 0x55a8310d52e0 2024-05-08T23:16:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.530+0000 7f16e6ffd700 1 --2- 172.21.15.135:0/963472367 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f16d00a11b0 0x7f16d00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.530+0000 7f16cdffb700 1 -- 172.21.15.135:0/2934675686 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16e0011040 con 0x55a8310d52e0 2024-05-08T23:16:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.530+0000 7f16cdffb700 1 -- 172.21.15.135:0/2934675686 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0004930 con 0x55a8310d52e0 2024-05-08T23:16:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.531+0000 7f16fa12fb80 1 -- 172.21.15.135:0/2934675686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d52e0 msgr2=0x55a8310d5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.531+0000 7f16e6ffd700 1 --2- 172.21.15.135:0/963472367 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f16d00a11b0 0x7f16d00a3670 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009fd0 tx=0x7f16dc009f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.531+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/2934675686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d52e0 0x55a8310d5760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f16e000b400 tx=0x7f16e000bad0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.533 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.531+0000 7f16fa12fb80 1 -- 172.21.15.135:0/2934675686 shutdown_connections 2024-05-08T23:16:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.531+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/2934675686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d52e0 0x55a8310d5760 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.531+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/2934675686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310d3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.531+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/2934675686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d43f0 0x55a8310d4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.531+0000 7f16fa12fb80 1 -- 172.21.15.135:0/2934675686 >> 172.21.15.135:0/2934675686 conn(0x55a8310211b0 msgr2=0x55a8310bf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.531+0000 7f16fa12fb80 1 -- 172.21.15.135:0/2934675686 shutdown_connections 2024-05-08T23:16:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.531+0000 7f16fa12fb80 1 -- 172.21.15.135:0/2934675686 wait complete. 2024-05-08T23:16:41.534 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.531+0000 7f16fa12fb80 1 -- start start 2024-05-08T23:16:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.532+0000 7f16fa12fb80 1 Processor -- start 2024-05-08T23:16:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.532+0000 7f16fa12fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.532+0000 7f16fa12fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d43f0 0x55a8310c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.532+0000 7f16fa12fb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d52e0 0x55a8310cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.532+0000 7f16fa12fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a830faf500 con 0x55a8310d3a90 2024-05-08T23:16:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.532+0000 7f16fa12fb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a830faf1a0 con 0x55a8310d52e0 2024-05-08T23:16:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.532+0000 7f16fa12fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a830e96640 con 0x55a8310d43f0 2024-05-08T23:16:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.532+0000 7f16fa12fb80 10 client.0 _ll_register_callbacks cb 0x55a830fb8ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:16:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.532+0000 7f16e7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d52e0 0x55a8310cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.532+0000 7f16e7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d52e0 0x55a8310cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.135:54086/0 (socket says 172.21.15.135:54086) 2024-05-08T23:16:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.532+0000 7f16e7fff700 1 -- 172.21.15.135:0/1984017901 learned_addr learned my addr 172.21.15.135:0/1984017901 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.533+0000 7f16e7fff700 1 -- 172.21.15.135:0/1984017901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d43f0 msgr2=0x55a8310c4380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T23:16:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.533+0000 7f16e7fff700 1 --2- 172.21.15.135:0/1984017901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d43f0 0x55a8310c4380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.533+0000 7f16e77fe700 1 --2- 172.21.15.135:0/1984017901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.533+0000 7f16e7fff700 1 -- 172.21.15.135:0/1984017901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 msgr2=0x55a8310c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.533+0000 7f16e7fff700 1 --2- 172.21.15.135:0/1984017901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.533+0000 7f16e7fff700 1 -- 172.21.15.135:0/1984017901 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e000b0b0 con 0x55a8310d52e0 2024-05-08T23:16:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.533+0000 7f16e77fe700 1 --2- 172.21.15.135:0/1984017901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:16:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.533+0000 7f16e7fff700 1 --2- 172.21.15.135:0/1984017901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d52e0 0x55a8310cb370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009f50 tx=0x7f16e00042e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b1c58ce57a5c1d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.533+0000 7f16c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-05-08T23:16:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.533+0000 7f16c6ffd700 1 -- 172.21.15.135:0/1984017901 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0025070 con 0x55a8310d52e0 2024-05-08T23:16:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.533+0000 7f16c6ffd700 1 -- 172.21.15.135:0/1984017901 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f16e00048d0 con 0x55a8310d52e0 2024-05-08T23:16:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.533+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1984017901 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a830f6c210 con 0x55a8310d52e0 2024-05-08T23:16:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.534+0000 7f16c6ffd700 1 -- 172.21.15.135:0/1984017901 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16e0010040 con 0x55a8310d52e0 2024-05-08T23:16:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.534+0000 7f16fa12fb80 10 client.25022 fetch_fsmap learned FSMap version 28 2024-05-08T23:16:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.534+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1984017901 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a830e40b00 con 0x55a8310d52e0 2024-05-08T23:16:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.534+0000 7f16c6ffd700 1 -- 172.21.15.135:0/1984017901 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a830f6c210 con 0x55a8310d52e0 2024-05-08T23:16:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.534+0000 7f16c6ffd700 1 -- 172.21.15.135:0/1984017901 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f16e0028020 con 0x55a8310d52e0 2024-05-08T23:16:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.534+0000 7f16fa12fb80 10 client.25022 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:16:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.534+0000 7f16fa12fb80 10 client.25022 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:16:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.534+0000 7f16fa12fb80 20 client.25022 populate_metadata read hostname 'smithi135' 2024-05-08T23:16:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.534+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/1984017901 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55a8310cfb30 0x55a8310d1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.534+0000 7f16fa12fb80 4 client.25022 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:16:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.534+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1984017901 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8310927b0 con 0x55a8310cfb30 2024-05-08T23:16:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.535+0000 7f16e77fe700 1 --2- 172.21.15.135:0/1984017901 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55a8310cfb30 0x55a8310d1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.536+0000 7f16c6ffd700 10 client.25022 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.536+0000 7f16e77fe700 1 --2- 172.21.15.135:0/1984017901 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55a8310cfb30 0x55a8310d1f50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0fcf9f01d09d8b4 server_cookie=6586d9385a242292 in_seq=0 out_seq=0 2024-05-08T23:16:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.536+0000 7f16c6ffd700 1 -- 172.21.15.135:0/1984017901 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a8310927b0 con 0x55a8310cfb30 2024-05-08T23:16:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.536+0000 7f16c6ffd700 10 client.25022 handle_command_reply: tid=0 2024-05-08T23:16:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.536+0000 7f16fa12fb80 1 client.25022 shutdown 2024-05-08T23:16:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.536+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1984017901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d52e0 msgr2=0x55a8310cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.537+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/1984017901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d52e0 0x55a8310cb370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009f50 tx=0x7f16e00042e0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.537+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1984017901 shutdown_connections 2024-05-08T23:16:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.537+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/1984017901 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55a8310cfb30 0x55a8310d1f50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.537+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/1984017901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d52e0 0x55a8310cb370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.537+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/1984017901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.537+0000 7f16c6ffd700 0 client.25022 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.537+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/1984017901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d43f0 0x55a8310c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.537+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1984017901 >> 172.21.15.135:0/1984017901 conn(0x55a8310211b0 msgr2=0x55a8310bd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.537+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1984017901 shutdown_connections 2024-05-08T23:16:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.537+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1984017901 wait complete. 2024-05-08T23:16:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.537+0000 7f16fa12fb80 20 client.25022 trim_cache size 0 max 16384 2024-05-08T23:16:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.565+0000 7f16fa12fb80 1 Processor -- start 2024-05-08T23:16:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16fa12fb80 1 -- start start 2024-05-08T23:16:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16fa12fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d3a90 0x55a8310d1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16fa12fb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d43f0 0x55a8310c29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16fa12fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d52e0 0x55a8310cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16fa12fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8310ba9b0 con 0x55a8310d52e0 2024-05-08T23:16:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16fa12fb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8310c5040 con 0x55a8310d43f0 2024-05-08T23:16:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16fa12fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8310cc4f0 con 0x55a8310d3a90 2024-05-08T23:16:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16e7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d52e0 0x55a8310cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16e7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d52e0 0x55a8310cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58476/0 (socket says 172.21.15.135:58476) 2024-05-08T23:16:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16e7fff700 1 -- 172.21.15.135:0/126707062 learned_addr learned my addr 172.21.15.135:0/126707062 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16e77fe700 1 --2- 172.21.15.135:0/126707062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d3a90 0x55a8310d1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16e77fe700 1 -- 172.21.15.135:0/126707062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d43f0 msgr2=0x55a8310c29c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T23:16:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16e77fe700 1 --2- 172.21.15.135:0/126707062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d43f0 0x55a8310c29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16e77fe700 1 -- 172.21.15.135:0/126707062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d52e0 msgr2=0x55a8310cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16e77fe700 1 --2- 172.21.15.135:0/126707062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d52e0 0x55a8310cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16e77fe700 1 -- 172.21.15.135:0/126707062 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a830fd9500 con 0x55a8310d3a90 2024-05-08T23:16:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.566+0000 7f16e7fff700 1 --2- 172.21.15.135:0/126707062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d52e0 0x55a8310cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:16:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.567+0000 7f16e77fe700 1 --2- 172.21.15.135:0/126707062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d3a90 0x55a8310d1f20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f16d80ca0a0 tx=0x7f16d80b9040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d03953c38677867 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.567+0000 7f16ce7fc700 1 -- 172.21.15.135:0/126707062 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d809d840 con 0x55a8310d3a90 2024-05-08T23:16:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.567+0000 7f16ce7fc700 1 -- 172.21.15.135:0/126707062 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16d80a1e90 con 0x55a8310d3a90 2024-05-08T23:16:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.567+0000 7f16ce7fc700 1 -- 172.21.15.135:0/126707062 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d80b2210 con 0x55a8310d3a90 2024-05-08T23:16:41.570 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.568+0000 7f16fa12fb80 1 -- 172.21.15.135:0/126707062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d3a90 msgr2=0x55a8310d1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:41.570 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.568+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/126707062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d3a90 0x55a8310d1f20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f16d80ca0a0 tx=0x7f16d80b9040 comp rx=0 tx=0).stop 2024-05-08T23:16:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.568+0000 7f16fa12fb80 1 -- 172.21.15.135:0/126707062 shutdown_connections 2024-05-08T23:16:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.568+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/126707062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d3a90 0x55a8310d1f20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.568+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/126707062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d52e0 0x55a8310cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.568+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/126707062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d43f0 0x55a8310c29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.568+0000 7f16fa12fb80 1 -- 172.21.15.135:0/126707062 >> 172.21.15.135:0/126707062 conn(0x55a8310211b0 msgr2=0x55a8310c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.568+0000 7f16fa12fb80 1 -- 172.21.15.135:0/126707062 shutdown_connections 2024-05-08T23:16:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.568+0000 7f16fa12fb80 1 -- 172.21.15.135:0/126707062 wait complete. 2024-05-08T23:16:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.568+0000 7f16fa12fb80 1 -- start start 2024-05-08T23:16:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16fa12fb80 1 Processor -- start 2024-05-08T23:16:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16fa12fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310c7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16fa12fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d43f0 0x55a8310c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16fa12fb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d52e0 0x55a8310caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16fa12fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8310cafd0 con 0x55a8310d3a90 2024-05-08T23:16:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16fa12fb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8310cb140 con 0x55a8310d52e0 2024-05-08T23:16:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16fa12fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8310cb300 con 0x55a8310d43f0 2024-05-08T23:16:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16fa12fb80 10 client.0 _ll_register_callbacks cb 0x55a830fb8ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:16:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16e77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16e77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310c7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58486/0 (socket says 172.21.15.135:58486) 2024-05-08T23:16:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16e77fe700 1 -- 172.21.15.135:0/1302337493 learned_addr learned my addr 172.21.15.135:0/1302337493 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16e7fff700 1 --2- 172.21.15.135:0/1302337493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d52e0 0x55a8310caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16e77fe700 1 -- 172.21.15.135:0/1302337493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d43f0 msgr2=0x55a8310c7aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T23:16:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16e77fe700 1 --2- 172.21.15.135:0/1302337493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d43f0 0x55a8310c7aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16e77fe700 1 -- 172.21.15.135:0/1302337493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d52e0 msgr2=0x55a8310caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16e77fe700 1 --2- 172.21.15.135:0/1302337493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d52e0 0x55a8310caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.569+0000 7f16e77fe700 1 -- 172.21.15.135:0/1302337493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a830e40b00 con 0x55a8310d3a90 2024-05-08T23:16:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.570+0000 7f16e77fe700 1 --2- 172.21.15.135:0/1302337493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310c7560 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f16d80ca070 tx=0x7f16d809a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b108a7489a369a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.570+0000 7f16c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:16:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.570+0000 7f16c6ffd700 1 -- 172.21.15.135:0/1302337493 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d809d840 con 0x55a8310d3a90 2024-05-08T23:16:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.570+0000 7f16c6ffd700 1 -- 172.21.15.135:0/1302337493 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f16d80b2210 con 0x55a8310d3a90 2024-05-08T23:16:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.570+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1302337493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16e0011040 con 0x55a8310d3a90 2024-05-08T23:16:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.570+0000 7f16c6ffd700 1 -- 172.21.15.135:0/1302337493 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16d8098f00 con 0x55a8310d3a90 2024-05-08T23:16:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.570+0000 7f16fa12fb80 10 client.15423 fetch_fsmap learned FSMap version 28 2024-05-08T23:16:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.570+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1302337493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f16e819d1d0 con 0x55a8310d3a90 2024-05-08T23:16:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.571+0000 7f16c6ffd700 1 -- 172.21.15.135:0/1302337493 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16e0011040 con 0x55a8310d3a90 2024-05-08T23:16:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.571+0000 7f16c6ffd700 1 -- 172.21.15.135:0/1302337493 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f16d8003b90 con 0x55a8310d3a90 2024-05-08T23:16:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.571+0000 7f16fa12fb80 10 client.15423 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:16:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.571+0000 7f16fa12fb80 10 client.15423 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:16:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.571+0000 7f16fa12fb80 20 client.15423 populate_metadata read hostname 'smithi135' 2024-05-08T23:16:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.571+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/1302337493 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55a83112a820 0x55a83112cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.571+0000 7f16fa12fb80 4 client.15423 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T23:16:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.571+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1302337493 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a83100be60 con 0x55a83112a820 2024-05-08T23:16:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.571+0000 7f16e6ffd700 1 --2- 172.21.15.135:0/1302337493 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55a83112a820 0x55a83112cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.572+0000 7f16c6ffd700 10 client.15423 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.572+0000 7f16e6ffd700 1 --2- 172.21.15.135:0/1302337493 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55a83112a820 0x55a83112cc40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8acb6fcc3942d59 server_cookie=eec9c35f45501f2e in_seq=0 out_seq=0 2024-05-08T23:16:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.575+0000 7f16c6ffd700 1 -- 172.21.15.135:0/1302337493 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a83100be60 con 0x55a83112a820 2024-05-08T23:16:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.575+0000 7f16c6ffd700 10 client.15423 handle_command_reply: tid=0 2024-05-08T23:16:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.575+0000 7f16fa12fb80 1 client.15423 shutdown 2024-05-08T23:16:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.575+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1302337493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 msgr2=0x55a8310c7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.575+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/1302337493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310c7560 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f16d80ca070 tx=0x7f16d809a010 comp rx=0 tx=0).stop 2024-05-08T23:16:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.575+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1302337493 shutdown_connections 2024-05-08T23:16:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.575+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/1302337493 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55a83112a820 0x55a83112cc40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.575+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/1302337493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a8310d52e0 0x55a8310caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.575+0000 7f16c6ffd700 0 client.15423 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.575+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/1302337493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8310d3a90 0x55a8310c7560 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.575+0000 7f16fa12fb80 1 --2- 172.21.15.135:0/1302337493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8310d43f0 0x55a8310c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.575+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1302337493 >> 172.21.15.135:0/1302337493 conn(0x55a8310211b0 msgr2=0x55a8310c3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:41.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.576+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1302337493 shutdown_connections 2024-05-08T23:16:41.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.576+0000 7f16fa12fb80 1 -- 172.21.15.135:0/1302337493 wait complete. 2024-05-08T23:16:41.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.576+0000 7f16fa12fb80 20 client.15423 trim_cache size 0 max 16384 2024-05-08T23:16:41.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-08T23:16:41.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-08T23:16:41.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-08T23:16:41.577 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-08T23:16:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.576+0000 7f16edf75700 1 -- 172.21.15.135:0/963472367 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f16d00a11b0 msgr2=0x7f16d00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.576+0000 7f16edf75700 1 --2- 172.21.15.135:0/963472367 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f16d00a11b0 0x7f16d00a3670 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009fd0 tx=0x7f16dc009f60 comp rx=0 tx=0).stop 2024-05-08T23:16:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.576+0000 7f16edf75700 1 -- 172.21.15.135:0/963472367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e8100080 msgr2=0x7f16e8194cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.576+0000 7f16edf75700 1 --2- 172.21.15.135:0/963472367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e8100080 0x7f16e8194cd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f16d800d980 tx=0x7f16d800dc90 comp rx=0 tx=0).stop 2024-05-08T23:16:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.576+0000 7f16edf75700 1 -- 172.21.15.135:0/963472367 shutdown_connections 2024-05-08T23:16:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.576+0000 7f16edf75700 1 --2- 172.21.15.135:0/963472367 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f16d00a11b0 0x7f16d00a3670 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.576+0000 7f16edf75700 1 --2- 172.21.15.135:0/963472367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16e81013e0 0x7f16e819c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.576+0000 7f16edf75700 1 --2- 172.21.15.135:0/963472367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16e8100080 0x7f16e8194cd0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.576+0000 7f16edf75700 1 --2- 172.21.15.135:0/963472367 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8100a20 0x7f16e8195210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.576+0000 7f16edf75700 1 -- 172.21.15.135:0/963472367 >> 172.21.15.135:0/963472367 conn(0x7f16e80faaf0 msgr2=0x7f16e8104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.577+0000 7f16edf75700 1 -- 172.21.15.135:0/963472367 shutdown_connections 2024-05-08T23:16:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:41.577+0000 7f16edf75700 1 -- 172.21.15.135:0/963472367 wait complete. 2024-05-08T23:16:42.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:42 smithi195 ceph-mon[46516]: pgmap v295: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-08T23:16:42.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:42 smithi135 ceph-mon[42440]: pgmap v295: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-08T23:16:42.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:42 smithi179 ceph-mon[46314]: pgmap v295: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-08T23:16:44.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:44 smithi195 ceph-mon[46516]: pgmap v296: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 12 op/s 2024-05-08T23:16:44.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:44 smithi135 ceph-mon[42440]: pgmap v296: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 12 op/s 2024-05-08T23:16:44.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:44 smithi179 ceph-mon[46314]: pgmap v296: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 12 op/s 2024-05-08T23:16:46.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:46 smithi195 ceph-mon[46516]: pgmap v297: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-08T23:16:46.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:46 smithi135 ceph-mon[42440]: pgmap v297: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-08T23:16:46.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:46 smithi179 ceph-mon[46314]: pgmap v297: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-08T23:16:48.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:48 smithi195 ceph-mon[46516]: pgmap v298: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-08T23:16:48.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:48 smithi135 ceph-mon[42440]: pgmap v298: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-08T23:16:48.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:48 smithi179 ceph-mon[46314]: pgmap v298: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-08T23:16:50.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:50 smithi195 ceph-mon[46516]: pgmap v299: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-08T23:16:50.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:50 smithi135 ceph-mon[42440]: pgmap v299: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-08T23:16:50.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:50 smithi179 ceph-mon[46314]: pgmap v299: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-08T23:16:52.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:52 smithi135 ceph-mon[42440]: pgmap v300: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-08T23:16:52.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:52 smithi179 ceph-mon[46314]: pgmap v300: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-08T23:16:52.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:52 smithi195 ceph-mon[46516]: pgmap v300: 97 pgs: 97 active+clean; 671 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-08T23:16:53.459 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:53 smithi135 ceph-mon[42440]: mgrmap e18: x(active, since 7m), standbys: z, y 2024-05-08T23:16:53.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:53 smithi179 ceph-mon[46314]: mgrmap e18: x(active, since 7m), standbys: z, y 2024-05-08T23:16:53.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:53 smithi195 ceph-mon[46516]: mgrmap e18: x(active, since 7m), standbys: z, y 2024-05-08T23:16:54.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:54 smithi135 ceph-mon[42440]: pgmap v301: 97 pgs: 97 active+clean; 672 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-08T23:16:54.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:54 smithi179 ceph-mon[46314]: pgmap v301: 97 pgs: 97 active+clean; 672 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-08T23:16:54.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:54 smithi195 ceph-mon[46516]: pgmap v301: 97 pgs: 97 active+clean; 672 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-08T23:16:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.700+0000 7f0e37672700 1 -- 172.21.15.135:0/3662989457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e300ff770 msgr2=0x7f0e30101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.700+0000 7f0e37672700 1 --2- 172.21.15.135:0/3662989457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e300ff770 0x7f0e30101ba0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009990 tx=0x7f0e2c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.700+0000 7f0e37672700 1 -- 172.21.15.135:0/3662989457 shutdown_connections 2024-05-08T23:16:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.700+0000 7f0e37672700 1 --2- 172.21.15.135:0/3662989457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e30104ab0 0x7f0e30104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.700+0000 7f0e37672700 1 --2- 172.21.15.135:0/3662989457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e300ff770 0x7f0e30101ba0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.700+0000 7f0e37672700 1 --2- 172.21.15.135:0/3662989457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e301020e0 0x7f0e30104570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.700+0000 7f0e37672700 1 -- 172.21.15.135:0/3662989457 >> 172.21.15.135:0/3662989457 conn(0x7f0e300fb390 msgr2=0x7f0e300fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.700+0000 7f0e37672700 1 -- 172.21.15.135:0/3662989457 shutdown_connections 2024-05-08T23:16:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.700+0000 7f0e37672700 1 -- 172.21.15.135:0/3662989457 wait complete. 2024-05-08T23:16:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.701+0000 7f0e37672700 1 Processor -- start 2024-05-08T23:16:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.701+0000 7f0e37672700 1 -- start start 2024-05-08T23:16:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.701+0000 7f0e37672700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e300ff770 0x7f0e3019d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.701+0000 7f0e37672700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e301020e0 0x7f0e3019d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.701+0000 7f0e37672700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e30104ab0 0x7f0e301a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.701+0000 7f0e37672700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e301a4f70 con 0x7f0e300ff770 2024-05-08T23:16:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.701+0000 7f0e37672700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e30105d90 con 0x7f0e301020e0 2024-05-08T23:16:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.701+0000 7f0e37672700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e30105f20 con 0x7f0e30104ab0 2024-05-08T23:16:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.701+0000 7f0e3540e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e300ff770 0x7f0e3019d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.701+0000 7f0e3540e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e300ff770 0x7f0e3019d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59942/0 (socket says 172.21.15.135:59942) 2024-05-08T23:16:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.701+0000 7f0e3540e700 1 -- 172.21.15.135:0/1211733875 learned_addr learned my addr 172.21.15.135:0/1211733875 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.702+0000 7f0e34c0d700 1 --2- 172.21.15.135:0/1211733875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e301020e0 0x7f0e3019d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.702+0000 7f0e35c0f700 1 --2- 172.21.15.135:0/1211733875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e30104ab0 0x7f0e301a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.702+0000 7f0e3540e700 1 -- 172.21.15.135:0/1211733875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e30104ab0 msgr2=0x7f0e301a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.702+0000 7f0e3540e700 1 --2- 172.21.15.135:0/1211733875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e30104ab0 0x7f0e301a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.702+0000 7f0e3540e700 1 -- 172.21.15.135:0/1211733875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e301020e0 msgr2=0x7f0e3019d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.702+0000 7f0e3540e700 1 --2- 172.21.15.135:0/1211733875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e301020e0 0x7f0e3019d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.702+0000 7f0e3540e700 1 -- 172.21.15.135:0/1211733875 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c0095f0 con 0x7f0e300ff770 2024-05-08T23:16:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.702+0000 7f0e34c0d700 1 --2- 172.21.15.135:0/1211733875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e301020e0 0x7f0e3019d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:16:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.702+0000 7f0e3540e700 1 --2- 172.21.15.135:0/1211733875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e300ff770 0x7f0e3019d440 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c005910 tx=0x7f0e2c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.702+0000 7f0e267fc700 1 -- 172.21.15.135:0/1211733875 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c01d070 con 0x7f0e300ff770 2024-05-08T23:16:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.702+0000 7f0e37672700 1 -- 172.21.15.135:0/1211733875 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e301061a0 con 0x7f0e300ff770 2024-05-08T23:16:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.702+0000 7f0e267fc700 1 -- 172.21.15.135:0/1211733875 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e2c021410 con 0x7f0e300ff770 2024-05-08T23:16:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.702+0000 7f0e37672700 1 -- 172.21.15.135:0/1211733875 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e301066a0 con 0x7f0e300ff770 2024-05-08T23:16:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.703+0000 7f0e267fc700 1 -- 172.21.15.135:0/1211733875 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c017650 con 0x7f0e300ff770 2024-05-08T23:16:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.706+0000 7f0e267fc700 1 -- 172.21.15.135:0/1211733875 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f0e2c0177b0 con 0x7f0e300ff770 2024-05-08T23:16:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.706+0000 7f0e4382cb80 1 Processor -- start 2024-05-08T23:16:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.706+0000 7f0e4382cb80 1 -- start start 2024-05-08T23:16:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.706+0000 7f0e4382cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67caa80 0x55d7f67caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e4382cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cb3e0 0x55d7f67cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e4382cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cc2d0 0x55d7f67cc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e4382cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7f67220f0 con 0x55d7f67caa80 2024-05-08T23:16:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e4382cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7f671fab0 con 0x55d7f67cb3e0 2024-05-08T23:16:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e4382cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7f671b3a0 con 0x55d7f67cc2d0 2024-05-08T23:16:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e35c0f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67caa80 0x55d7f67caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e35c0f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67caa80 0x55d7f67caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59954/0 (socket says 172.21.15.135:59954) 2024-05-08T23:16:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e35c0f700 1 -- 172.21.15.135:0/4247604795 learned_addr learned my addr 172.21.15.135:0/4247604795 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e267fc700 1 --2- 172.21.15.135:0/1211733875 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e1c0a11a0 0x7f0e1c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e3540e700 1 --2- 172.21.15.135:0/4247604795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cb3e0 0x55d7f67cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e34c0d700 1 --2- 172.21.15.135:0/4247604795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cc2d0 0x55d7f67cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e35c0f700 1 -- 172.21.15.135:0/4247604795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cc2d0 msgr2=0x55d7f67cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e35c0f700 1 --2- 172.21.15.135:0/4247604795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cc2d0 0x55d7f67cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e35c0f700 1 -- 172.21.15.135:0/4247604795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cb3e0 msgr2=0x55d7f67cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e35c0f700 1 --2- 172.21.15.135:0/4247604795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cb3e0 0x55d7f67cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e35c0f700 1 -- 172.21.15.135:0/4247604795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7f659c350 con 0x55d7f67caa80 2024-05-08T23:16:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e267fc700 1 -- 172.21.15.135:0/1211733875 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0e2c0cdbd0 con 0x7f0e300ff770 2024-05-08T23:16:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e35c0f700 1 --2- 172.21.15.135:0/1211733875 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e1c0a11a0 0x7f0e1c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.707+0000 7f0e3540e700 1 --2- 172.21.15.135:0/4247604795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cb3e0 0x55d7f67cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:16:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.708+0000 7f0e35c0f700 1 --2- 172.21.15.135:0/4247604795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67caa80 0x55d7f67caea0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800f6b0 tx=0x7f0e2800f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85e714dbf4ac6eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.708+0000 7f0e1b7fe700 1 -- 172.21.15.135:0/4247604795 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2800e040 con 0x55d7f67caa80 2024-05-08T23:16:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.708+0000 7f0e35c0f700 1 --2- 172.21.15.135:0/1211733875 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e1c0a11a0 0x7f0e1c0a3660 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e28022000 tx=0x7f0e2801f000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.708+0000 7f0e1b7fe700 1 -- 172.21.15.135:0/4247604795 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e2800f040 con 0x55d7f67caa80 2024-05-08T23:16:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.708+0000 7f0e1b7fe700 1 -- 172.21.15.135:0/4247604795 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28023910 con 0x55d7f67caa80 2024-05-08T23:16:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.709+0000 7f0e4382cb80 1 -- 172.21.15.135:0/4247604795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67caa80 msgr2=0x55d7f67caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.709+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/4247604795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67caa80 0x55d7f67caea0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800f6b0 tx=0x7f0e2800f9c0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.709+0000 7f0e4382cb80 1 -- 172.21.15.135:0/4247604795 shutdown_connections 2024-05-08T23:16:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.709+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/4247604795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cc2d0 0x55d7f67cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.709+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/4247604795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67caa80 0x55d7f67caea0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.709+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/4247604795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cb3e0 0x55d7f67cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.709+0000 7f0e4382cb80 1 -- 172.21.15.135:0/4247604795 >> 172.21.15.135:0/4247604795 conn(0x55d7f67291b0 msgr2=0x55d7f67c7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.709+0000 7f0e4382cb80 1 -- 172.21.15.135:0/4247604795 shutdown_connections 2024-05-08T23:16:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.709+0000 7f0e4382cb80 1 -- 172.21.15.135:0/4247604795 wait complete. 2024-05-08T23:16:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.709+0000 7f0e4382cb80 1 -- start start 2024-05-08T23:16:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.709+0000 7f0e4382cb80 1 Processor -- start 2024-05-08T23:16:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e4382cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67caa80 0x55d7f67d4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e4382cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67cb3e0 0x55d7f67d4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e4382cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cc2d0 0x55d7f67dbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e4382cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7f66b7500 con 0x55d7f67cb3e0 2024-05-08T23:16:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e4382cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7f66b71a0 con 0x55d7f67caa80 2024-05-08T23:16:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e4382cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7f659e640 con 0x55d7f67cc2d0 2024-05-08T23:16:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e4382cb80 10 client.0 _ll_register_callbacks cb 0x55d7f66c0ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:16:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e34c0d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67cb3e0 0x55d7f67d4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e34c0d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67cb3e0 0x55d7f67d4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59966/0 (socket says 172.21.15.135:59966) 2024-05-08T23:16:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e34c0d700 1 -- 172.21.15.135:0/257192153 learned_addr learned my addr 172.21.15.135:0/257192153 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e3540e700 1 --2- 172.21.15.135:0/257192153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67caa80 0x55d7f67d4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e35c0f700 1 --2- 172.21.15.135:0/257192153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cc2d0 0x55d7f67dbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e3540e700 1 -- 172.21.15.135:0/257192153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cc2d0 msgr2=0x55d7f67dbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e3540e700 1 --2- 172.21.15.135:0/257192153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cc2d0 0x55d7f67dbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e3540e700 1 -- 172.21.15.135:0/257192153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67cb3e0 msgr2=0x55d7f67d4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e3540e700 1 --2- 172.21.15.135:0/257192153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67cb3e0 0x55d7f67d4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.710+0000 7f0e3540e700 1 -- 172.21.15.135:0/257192153 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2800f360 con 0x55d7f67caa80 2024-05-08T23:16:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.711+0000 7f0e3540e700 1 --2- 172.21.15.135:0/257192153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67caa80 0x55d7f67d4920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c098b40 tx=0x7f0e2c09bc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=818f1258a9c0e785 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.711+0000 7f0e18ff9700 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-05-08T23:16:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.711+0000 7f0e18ff9700 1 -- 172.21.15.135:0/257192153 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c09b7c0 con 0x55d7f67caa80 2024-05-08T23:16:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.711+0000 7f0e4382cb80 1 -- 172.21.15.135:0/257192153 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7f6674210 con 0x55d7f67caa80 2024-05-08T23:16:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.711+0000 7f0e18ff9700 1 -- 172.21.15.135:0/257192153 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0e2c09c7d0 con 0x55d7f67caa80 2024-05-08T23:16:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.711+0000 7f0e18ff9700 1 -- 172.21.15.135:0/257192153 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e2c0a4470 con 0x55d7f67caa80 2024-05-08T23:16:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.711+0000 7f0e4382cb80 10 client.25034 fetch_fsmap learned FSMap version 28 2024-05-08T23:16:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.711+0000 7f0e4382cb80 1 -- 172.21.15.135:0/257192153 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d7f6548b00 con 0x55d7f67caa80 2024-05-08T23:16:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.711+0000 7f0e18ff9700 1 -- 172.21.15.135:0/257192153 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e2c0b7080 con 0x55d7f67caa80 2024-05-08T23:16:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.712+0000 7f0e18ff9700 1 -- 172.21.15.135:0/257192153 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0e2c021580 con 0x55d7f67caa80 2024-05-08T23:16:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.712+0000 7f0e4382cb80 10 client.25034 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:16:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.712+0000 7f0e4382cb80 10 client.25034 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:16:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.712+0000 7f0e4382cb80 20 client.25034 populate_metadata read hostname 'smithi135' 2024-05-08T23:16:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.712+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/257192153 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55d7f67e0330 0x55d7f67e2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.712+0000 7f0e4382cb80 4 client.25034 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:16:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.712+0000 7f0e4382cb80 1 -- 172.21.15.135:0/257192153 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7f679a7b0 con 0x55d7f67e0330 2024-05-08T23:16:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.712+0000 7f0e34c0d700 1 --2- 172.21.15.135:0/257192153 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55d7f67e0330 0x55d7f67e2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.713+0000 7f0e34c0d700 1 --2- 172.21.15.135:0/257192153 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55d7f67e0330 0x55d7f67e2750 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c242edc76708e846 server_cookie=39ef7611c8a415ee in_seq=0 out_seq=0 2024-05-08T23:16:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.713+0000 7f0e18ff9700 10 client.25034 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.713+0000 7f0e18ff9700 1 -- 172.21.15.135:0/257192153 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d7f679a7b0 con 0x55d7f67e0330 2024-05-08T23:16:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.713+0000 7f0e18ff9700 10 client.25034 handle_command_reply: tid=0 2024-05-08T23:16:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.713+0000 7f0e4382cb80 1 client.25034 shutdown 2024-05-08T23:16:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.713+0000 7f0e4382cb80 1 -- 172.21.15.135:0/257192153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67caa80 msgr2=0x55d7f67d4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.713+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/257192153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67caa80 0x55d7f67d4920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c098b40 tx=0x7f0e2c09bc10 comp rx=0 tx=0).stop 2024-05-08T23:16:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.713+0000 7f0e4382cb80 1 -- 172.21.15.135:0/257192153 shutdown_connections 2024-05-08T23:16:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.713+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/257192153 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55d7f67e0330 0x55d7f67e2750 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.713+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/257192153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cc2d0 0x55d7f67dbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.713+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/257192153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67caa80 0x55d7f67d4920 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.713+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/257192153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67cb3e0 0x55d7f67d4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.713+0000 7f0e4382cb80 1 -- 172.21.15.135:0/257192153 >> 172.21.15.135:0/257192153 conn(0x55d7f67291b0 msgr2=0x55d7f67c5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.713+0000 7f0e18ff9700 0 client.25034 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.714+0000 7f0e4382cb80 1 -- 172.21.15.135:0/257192153 shutdown_connections 2024-05-08T23:16:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.714+0000 7f0e4382cb80 1 -- 172.21.15.135:0/257192153 wait complete. 2024-05-08T23:16:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.714+0000 7f0e4382cb80 20 client.25034 trim_cache size 0 max 16384 2024-05-08T23:16:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.729+0000 7f0e4382cb80 1 Processor -- start 2024-05-08T23:16:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.729+0000 7f0e4382cb80 1 -- start start 2024-05-08T23:16:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.729+0000 7f0e4382cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67caa80 0x55d7f67dc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.729+0000 7f0e4382cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cb3e0 0x55d7f67dbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.729+0000 7f0e4382cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cc2d0 0x55d7f67cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.729+0000 7f0e4382cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7f67c0330 con 0x55d7f67caa80 2024-05-08T23:16:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.729+0000 7f0e4382cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7f67c29b0 con 0x55d7f67cc2d0 2024-05-08T23:16:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.729+0000 7f0e4382cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7f67d4490 con 0x55d7f67cb3e0 2024-05-08T23:16:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.729+0000 7f0e3540e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67caa80 0x55d7f67dc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.729+0000 7f0e3540e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67caa80 0x55d7f67dc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59980/0 (socket says 172.21.15.135:59980) 2024-05-08T23:16:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.729+0000 7f0e3540e700 1 -- 172.21.15.135:0/1741029624 learned_addr learned my addr 172.21.15.135:0/1741029624 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.729+0000 7f0e34c0d700 1 --2- 172.21.15.135:0/1741029624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cb3e0 0x55d7f67dbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.730+0000 7f0e35c0f700 1 --2- 172.21.15.135:0/1741029624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cc2d0 0x55d7f67cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.730+0000 7f0e3540e700 1 -- 172.21.15.135:0/1741029624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cb3e0 msgr2=0x55d7f67dbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.730+0000 7f0e3540e700 1 --2- 172.21.15.135:0/1741029624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cb3e0 0x55d7f67dbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.730+0000 7f0e3540e700 1 -- 172.21.15.135:0/1741029624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cc2d0 msgr2=0x55d7f67cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.730+0000 7f0e3540e700 1 --2- 172.21.15.135:0/1741029624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cc2d0 0x55d7f67cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.730+0000 7f0e3540e700 1 -- 172.21.15.135:0/1741029624 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7f66e1500 con 0x55d7f67caa80 2024-05-08T23:16:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.730+0000 7f0e34c0d700 1 --2- 172.21.15.135:0/1741029624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cb3e0 0x55d7f67dbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:16:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.730+0000 7f0e3540e700 1 --2- 172.21.15.135:0/1741029624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67caa80 0x55d7f67dc550 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0985d0 tx=0x7f0e2c009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27eeec0a4dda0526 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.730+0000 7f0e1bfff700 1 -- 172.21.15.135:0/1741029624 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c0a4470 con 0x55d7f67caa80 2024-05-08T23:16:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.730+0000 7f0e1bfff700 1 -- 172.21.15.135:0/1741029624 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d7f6674210 con 0x55d7f67caa80 2024-05-08T23:16:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.730+0000 7f0e1bfff700 1 -- 172.21.15.135:0/1741029624 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c0b9180 con 0x55d7f67caa80 2024-05-08T23:16:54.734 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.731+0000 7f0e4382cb80 1 -- 172.21.15.135:0/1741029624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67caa80 msgr2=0x55d7f67dc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:54.734 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.731+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/1741029624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67caa80 0x55d7f67dc550 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0985d0 tx=0x7f0e2c009380 comp rx=0 tx=0).stop 2024-05-08T23:16:54.734 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.731+0000 7f0e4382cb80 1 -- 172.21.15.135:0/1741029624 shutdown_connections 2024-05-08T23:16:54.734 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.731+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/1741029624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cc2d0 0x55d7f67cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.731+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/1741029624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67caa80 0x55d7f67dc550 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.731+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/1741029624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67cb3e0 0x55d7f67dbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.731+0000 7f0e4382cb80 1 -- 172.21.15.135:0/1741029624 >> 172.21.15.135:0/1741029624 conn(0x55d7f67291b0 msgr2=0x55d7f67d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.731+0000 7f0e4382cb80 1 -- 172.21.15.135:0/1741029624 shutdown_connections 2024-05-08T23:16:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.731+0000 7f0e4382cb80 1 -- 172.21.15.135:0/1741029624 wait complete. 2024-05-08T23:16:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.731+0000 7f0e4382cb80 1 -- start start 2024-05-08T23:16:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.731+0000 7f0e4382cb80 1 Processor -- start 2024-05-08T23:16:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e4382cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67caa80 0x55d7f67d9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e4382cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67cb3e0 0x55d7f67d9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e4382cb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cc2d0 0x55d7f67da9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e4382cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7f67daf10 con 0x55d7f67cb3e0 2024-05-08T23:16:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e4382cb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7f67db080 con 0x55d7f67cc2d0 2024-05-08T23:16:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e4382cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7f67db240 con 0x55d7f67caa80 2024-05-08T23:16:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e4382cb80 10 client.0 _ll_register_callbacks cb 0x55d7f66c0ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:16:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e34c0d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67cb3e0 0x55d7f67d9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e34c0d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67cb3e0 0x55d7f67d9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59982/0 (socket says 172.21.15.135:59982) 2024-05-08T23:16:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e34c0d700 1 -- 172.21.15.135:0/1512645182 learned_addr learned my addr 172.21.15.135:0/1512645182 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:16:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e3540e700 1 --2- 172.21.15.135:0/1512645182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67caa80 0x55d7f67d9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e35c0f700 1 --2- 172.21.15.135:0/1512645182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cc2d0 0x55d7f67da9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e34c0d700 1 -- 172.21.15.135:0/1512645182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67caa80 msgr2=0x55d7f67d9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e34c0d700 1 --2- 172.21.15.135:0/1512645182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67caa80 0x55d7f67d9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e34c0d700 1 -- 172.21.15.135:0/1512645182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cc2d0 msgr2=0x55d7f67da9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:16:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e34c0d700 1 --2- 172.21.15.135:0/1512645182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cc2d0 0x55d7f67da9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e34c0d700 1 -- 172.21.15.135:0/1512645182 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7f6548b00 con 0x55d7f67cb3e0 2024-05-08T23:16:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.732+0000 7f0e3540e700 1 --2- 172.21.15.135:0/1512645182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67caa80 0x55d7f67d9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:16:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.733+0000 7f0e34c0d700 1 --2- 172.21.15.135:0/1512645182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67cb3e0 0x55d7f67d9a60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x55d7f67e3000 tx=0x7f0e20009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c6baee9d1ccbad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:16:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.733+0000 7f0e18ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:16:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.733+0000 7f0e18ff9700 1 -- 172.21.15.135:0/1512645182 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20018040 con 0x55d7f67cb3e0 2024-05-08T23:16:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.733+0000 7f0e4382cb80 1 -- 172.21.15.135:0/1512645182 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e2800f040 con 0x55d7f67cb3e0 2024-05-08T23:16:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.733+0000 7f0e18ff9700 1 -- 172.21.15.135:0/1512645182 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0e20003a90 con 0x55d7f67cb3e0 2024-05-08T23:16:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.733+0000 7f0e18ff9700 1 -- 172.21.15.135:0/1512645182 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e20003c90 con 0x55d7f67cb3e0 2024-05-08T23:16:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.733+0000 7f0e4382cb80 10 client.15441 fetch_fsmap learned FSMap version 28 2024-05-08T23:16:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.733+0000 7f0e4382cb80 1 -- 172.21.15.135:0/1512645182 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d7f65a0c70 con 0x55d7f67cb3e0 2024-05-08T23:16:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.733+0000 7f0e18ff9700 1 -- 172.21.15.135:0/1512645182 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e2800f040 con 0x55d7f67cb3e0 2024-05-08T23:16:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.733+0000 7f0e18ff9700 1 -- 172.21.15.135:0/1512645182 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0e20012cb0 con 0x55d7f67cb3e0 2024-05-08T23:16:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.734+0000 7f0e4382cb80 10 client.15441 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:16:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.734+0000 7f0e4382cb80 10 client.15441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:16:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.734+0000 7f0e4382cb80 20 client.15441 populate_metadata read hostname 'smithi135' 2024-05-08T23:16:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.734+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/1512645182 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55d7f6837190 0x55d7f68395b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:16:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.734+0000 7f0e4382cb80 4 client.15441 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T23:16:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.734+0000 7f0e4382cb80 1 -- 172.21.15.135:0/1512645182 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d7f6713e60 con 0x55d7f6837190 2024-05-08T23:16:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.734+0000 7f0e3540e700 1 --2- 172.21.15.135:0/1512645182 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55d7f6837190 0x55d7f68395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:16:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.734+0000 7f0e18ff9700 10 client.15441 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.734+0000 7f0e3540e700 1 --2- 172.21.15.135:0/1512645182 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55d7f6837190 0x55d7f68395b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7ec762faad88a52 server_cookie=9d824215af7ac978 in_seq=0 out_seq=0 2024-05-08T23:16:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.739+0000 7f0e18ff9700 1 -- 172.21.15.135:0/1512645182 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d7f6713e60 con 0x55d7f6837190 2024-05-08T23:16:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.740+0000 7f0e18ff9700 10 client.15441 handle_command_reply: tid=0 2024-05-08T23:16:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.740+0000 7f0e4382cb80 1 client.15441 shutdown 2024-05-08T23:16:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.740+0000 7f0e4382cb80 1 -- 172.21.15.135:0/1512645182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67cb3e0 msgr2=0x55d7f67d9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.740+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/1512645182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67cb3e0 0x55d7f67d9a60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x55d7f67e3000 tx=0x7f0e20009f40 comp rx=0 tx=0).stop 2024-05-08T23:16:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.740+0000 7f0e4382cb80 1 -- 172.21.15.135:0/1512645182 shutdown_connections 2024-05-08T23:16:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.740+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/1512645182 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55d7f6837190 0x55d7f68395b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.740+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/1512645182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7f67caa80 0x55d7f67d9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.740+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/1512645182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d7f67cc2d0 0x55d7f67da9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.740+0000 7f0e4382cb80 1 --2- 172.21.15.135:0/1512645182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d7f67cb3e0 0x55d7f67d9a60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.740+0000 7f0e4382cb80 1 -- 172.21.15.135:0/1512645182 >> 172.21.15.135:0/1512645182 conn(0x55d7f67291b0 msgr2=0x55d7f67cf510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.740+0000 7f0e18ff9700 0 client.15441 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:16:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.740+0000 7f0e4382cb80 1 -- 172.21.15.135:0/1512645182 shutdown_connections 2024-05-08T23:16:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.740+0000 7f0e4382cb80 1 -- 172.21.15.135:0/1512645182 wait complete. 2024-05-08T23:16:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.740+0000 7f0e4382cb80 20 client.15441 trim_cache size 0 max 16384 2024-05-08T23:16:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-08T23:16:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-08T23:16:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-08T23:16:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-08T23:16:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.740+0000 7f0e37672700 1 -- 172.21.15.135:0/1211733875 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e1c0a11a0 msgr2=0x7f0e1c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.741+0000 7f0e37672700 1 --2- 172.21.15.135:0/1211733875 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e1c0a11a0 0x7f0e1c0a3660 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e28022000 tx=0x7f0e2801f000 comp rx=0 tx=0).stop 2024-05-08T23:16:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.741+0000 7f0e37672700 1 -- 172.21.15.135:0/1211733875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e300ff770 msgr2=0x7f0e3019d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:16:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.741+0000 7f0e37672700 1 --2- 172.21.15.135:0/1211733875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e300ff770 0x7f0e3019d440 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c005910 tx=0x7f0e2c009580 comp rx=0 tx=0).stop 2024-05-08T23:16:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.741+0000 7f0e37672700 1 -- 172.21.15.135:0/1211733875 shutdown_connections 2024-05-08T23:16:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.741+0000 7f0e37672700 1 --2- 172.21.15.135:0/1211733875 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f0e1c0a11a0 0x7f0e1c0a3660 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.741+0000 7f0e37672700 1 --2- 172.21.15.135:0/1211733875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e30104ab0 0x7f0e301a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.741+0000 7f0e37672700 1 --2- 172.21.15.135:0/1211733875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e300ff770 0x7f0e3019d440 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.741+0000 7f0e37672700 1 --2- 172.21.15.135:0/1211733875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e301020e0 0x7f0e3019d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:16:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.741+0000 7f0e37672700 1 -- 172.21.15.135:0/1211733875 >> 172.21.15.135:0/1211733875 conn(0x7f0e300fb390 msgr2=0x7f0e301015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:16:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.741+0000 7f0e37672700 1 -- 172.21.15.135:0/1211733875 shutdown_connections 2024-05-08T23:16:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:16:54.741+0000 7f0e37672700 1 -- 172.21.15.135:0/1211733875 wait complete. 2024-05-08T23:16:56.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:56 smithi135 ceph-mon[42440]: pgmap v302: 97 pgs: 97 active+clean; 672 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 10 op/s 2024-05-08T23:16:56.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:56 smithi179 ceph-mon[46314]: pgmap v302: 97 pgs: 97 active+clean; 672 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 10 op/s 2024-05-08T23:16:56.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:56 smithi195 ceph-mon[46516]: pgmap v302: 97 pgs: 97 active+clean; 672 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 10 op/s 2024-05-08T23:16:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:16:58 smithi135 ceph-mon[42440]: pgmap v303: 97 pgs: 97 active+clean; 672 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-08T23:16:58.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:16:58 smithi179 ceph-mon[46314]: pgmap v303: 97 pgs: 97 active+clean; 672 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-08T23:16:58.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:16:58 smithi195 ceph-mon[46516]: pgmap v303: 97 pgs: 97 active+clean; 672 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-08T23:16:59.192 INFO:tasks.workunit.client.0.smithi135.stderr:Updating files: 98% (12045/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-08T23:16:59.694 INFO:tasks.workunit.client.0.smithi135.stderr:Note: switching to 'd21e4f961318b56f0d915caa2490c3711bf13c34'. 2024-05-08T23:16:59.694 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T23:16:59.694 INFO:tasks.workunit.client.0.smithi135.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T23:16:59.695 INFO:tasks.workunit.client.0.smithi135.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T23:16:59.695 INFO:tasks.workunit.client.0.smithi135.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T23:16:59.695 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T23:16:59.695 INFO:tasks.workunit.client.0.smithi135.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T23:16:59.695 INFO:tasks.workunit.client.0.smithi135.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T23:16:59.695 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T23:16:59.695 INFO:tasks.workunit.client.0.smithi135.stderr: git switch -c 2024-05-08T23:16:59.695 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T23:16:59.695 INFO:tasks.workunit.client.0.smithi135.stderr:Or undo this operation with: 2024-05-08T23:16:59.695 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T23:16:59.695 INFO:tasks.workunit.client.0.smithi135.stderr: git switch - 2024-05-08T23:16:59.695 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T23:16:59.695 INFO:tasks.workunit.client.0.smithi135.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T23:16:59.695 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T23:16:59.695 INFO:tasks.workunit.client.0.smithi135.stderr:HEAD is now at d21e4f96131 Merge PR #57343 into wip-pdonnell-testing-20240508.150423-reef 2024-05-08T23:16:59.700 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-08T23:16:59.769 INFO:tasks.workunit.client.0.smithi135.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-08T23:16:59.771 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T23:16:59.771 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-08T23:17:00.254 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-08T23:17:00.312 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-08T23:17:00.350 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T23:17:00.351 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T23:17:00.351 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-08T23:17:00.388 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T23:17:00.391 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:17:00.391 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-08T23:17:00.449 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-05-08T23:17:00.450 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-05-08T23:17:00.450 DEBUG:teuthology.orchestra.run.smithi135:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d21e4f961318b56f0d915caa2490c3711bf13c34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-05-08T23:17:00.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:00 smithi135 ceph-mon[42440]: pgmap v304: 97 pgs: 97 active+clean; 673 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-05-08T23:17:00.476 INFO:tasks.workunit.client.0.smithi135.stderr:+ set -e 2024-05-08T23:17:00.476 INFO:tasks.workunit.client.0.smithi135.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-05-08T23:17:00.569 INFO:tasks.workunit.client.0.smithi135.stderr:--2024-05-08 23:17:00-- http://download.ceph.com/qa/fsync-tester.c 2024-05-08T23:17:00.569 INFO:tasks.workunit.client.0.smithi135.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-05-08T23:17:00.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:00 smithi179 ceph-mon[46314]: pgmap v304: 97 pgs: 97 active+clean; 673 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-05-08T23:17:00.606 INFO:tasks.workunit.client.0.smithi135.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-05-08T23:17:00.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:00 smithi195 ceph-mon[46516]: pgmap v304: 97 pgs: 97 active+clean; 673 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-05-08T23:17:00.641 INFO:tasks.workunit.client.0.smithi135.stderr:HTTP request sent, awaiting response... 200 OK 2024-05-08T23:17:00.641 INFO:tasks.workunit.client.0.smithi135.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-05-08T23:17:00.643 INFO:tasks.workunit.client.0.smithi135.stderr:Saving to: ‘fsync-tester.c’ 2024-05-08T23:17:00.646 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T23:17:00.646 INFO:tasks.workunit.client.0.smithi135.stderr: 0K .. 100% 177M=0s 2024-05-08T23:17:00.646 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T23:17:00.646 INFO:tasks.workunit.client.0.smithi135.stderr:2024-05-08 23:17:00 (177 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-05-08T23:17:00.646 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T23:17:00.646 INFO:tasks.workunit.client.0.smithi135.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-05-08T23:17:00.699 INFO:tasks.workunit.client.0.smithi135.stderr:+ ./fsync-tester 2024-05-08T23:17:02.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:02 smithi135 ceph-mon[42440]: pgmap v305: 97 pgs: 97 active+clean; 673 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-08T23:17:02.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:02 smithi179 ceph-mon[46314]: pgmap v305: 97 pgs: 97 active+clean; 673 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-08T23:17:02.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:02 smithi195 ceph-mon[46516]: pgmap v305: 97 pgs: 97 active+clean; 673 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-08T23:17:04.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:04 smithi135 ceph-mon[42440]: pgmap v306: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 92 KiB/s wr, 15 op/s 2024-05-08T23:17:04.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:04 smithi179 ceph-mon[46314]: pgmap v306: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 92 KiB/s wr, 15 op/s 2024-05-08T23:17:04.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:04 smithi195 ceph-mon[46516]: pgmap v306: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 92 KiB/s wr, 15 op/s 2024-05-08T23:17:06.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:06 smithi135 ceph-mon[42440]: pgmap v307: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 91 KiB/s wr, 11 op/s 2024-05-08T23:17:06.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:06 smithi179 ceph-mon[46314]: pgmap v307: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 91 KiB/s wr, 11 op/s 2024-05-08T23:17:06.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:06 smithi195 ceph-mon[46516]: pgmap v307: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 91 KiB/s wr, 11 op/s 2024-05-08T23:17:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.855+0000 7f9a517b8700 1 -- 172.21.15.135:0/3023134528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a4c0ff1c0 msgr2=0x7f9a4c0ff5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.855+0000 7f9a517b8700 1 --2- 172.21.15.135:0/3023134528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a4c0ff1c0 0x7f9a4c0ff5e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009990 tx=0x7f9a3c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.855+0000 7f9a517b8700 1 -- 172.21.15.135:0/3023134528 shutdown_connections 2024-05-08T23:17:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.855+0000 7f9a517b8700 1 --2- 172.21.15.135:0/3023134528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a4c102b30 0x7f9a4c1093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.855+0000 7f9a517b8700 1 --2- 172.21.15.135:0/3023134528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a4c0ff1c0 0x7f9a4c0ff5e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.855+0000 7f9a517b8700 1 --2- 172.21.15.135:0/3023134528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a4c102190 0x7f9a4c1025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.855+0000 7f9a517b8700 1 -- 172.21.15.135:0/3023134528 >> 172.21.15.135:0/3023134528 conn(0x7f9a4c0faaf0 msgr2=0x7f9a4c0fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.855+0000 7f9a517b8700 1 -- 172.21.15.135:0/3023134528 shutdown_connections 2024-05-08T23:17:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.855+0000 7f9a517b8700 1 -- 172.21.15.135:0/3023134528 wait complete. 2024-05-08T23:17:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.856+0000 7f9a517b8700 1 Processor -- start 2024-05-08T23:17:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.856+0000 7f9a517b8700 1 -- start start 2024-05-08T23:17:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.856+0000 7f9a517b8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a4c0ff1c0 0x7f9a4c101ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.856+0000 7f9a517b8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a4c102190 0x7f9a4c100140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.856+0000 7f9a517b8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a4c102b30 0x7f9a4c100680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.856+0000 7f9a517b8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c100e20 con 0x7f9a4c102190 2024-05-08T23:17:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.856+0000 7f9a517b8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c100f90 con 0x7f9a4c102b30 2024-05-08T23:17:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.856+0000 7f9a517b8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c1a0ee0 con 0x7f9a4c0ff1c0 2024-05-08T23:17:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.856+0000 7f9a4a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a4c102190 0x7f9a4c100140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.856+0000 7f9a4a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a4c102190 0x7f9a4c100140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41926/0 (socket says 172.21.15.135:41926) 2024-05-08T23:17:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.856+0000 7f9a4a7fc700 1 -- 172.21.15.135:0/3772508485 learned_addr learned my addr 172.21.15.135:0/3772508485 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.856+0000 7f9a4b7fe700 1 --2- 172.21.15.135:0/3772508485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a4c102b30 0x7f9a4c100680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.856+0000 7f9a4affd700 1 --2- 172.21.15.135:0/3772508485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a4c0ff1c0 0x7f9a4c101ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.857+0000 7f9a4a7fc700 1 -- 172.21.15.135:0/3772508485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a4c0ff1c0 msgr2=0x7f9a4c101ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.857+0000 7f9a4a7fc700 1 --2- 172.21.15.135:0/3772508485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a4c0ff1c0 0x7f9a4c101ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.857+0000 7f9a4a7fc700 1 -- 172.21.15.135:0/3772508485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a4c102b30 msgr2=0x7f9a4c100680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.857+0000 7f9a4a7fc700 1 --2- 172.21.15.135:0/3772508485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a4c102b30 0x7f9a4c100680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.857+0000 7f9a4a7fc700 1 -- 172.21.15.135:0/3772508485 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c0095f0 con 0x7f9a4c102190 2024-05-08T23:17:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.857+0000 7f9a4a7fc700 1 --2- 172.21.15.135:0/3772508485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a4c102190 0x7f9a4c100140 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000e9a0 tx=0x7f9a4000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.857+0000 7f9a33fff700 1 -- 172.21.15.135:0/3772508485 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a40009790 con 0x7f9a4c102190 2024-05-08T23:17:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.857+0000 7f9a33fff700 1 -- 172.21.15.135:0/3772508485 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a4000ce70 con 0x7f9a4c102190 2024-05-08T23:17:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.857+0000 7f9a517b8700 1 -- 172.21.15.135:0/3772508485 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4c1a1170 con 0x7f9a4c102190 2024-05-08T23:17:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.857+0000 7f9a33fff700 1 -- 172.21.15.135:0/3772508485 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a40018420 con 0x7f9a4c102190 2024-05-08T23:17:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.857+0000 7f9a517b8700 1 -- 172.21.15.135:0/3772508485 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4c1a1680 con 0x7f9a4c102190 2024-05-08T23:17:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.859+0000 7f9a33fff700 1 -- 172.21.15.135:0/3772508485 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f9a400106f0 con 0x7f9a4c102190 2024-05-08T23:17:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.859+0000 7f9a33fff700 1 --2- 172.21.15.135:0/3772508485 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9a340a1120 0x7f9a340a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.860+0000 7f9a33fff700 1 -- 172.21.15.135:0/3772508485 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f9a40014070 con 0x7f9a4c102190 2024-05-08T23:17:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.860+0000 7f9a4affd700 1 --2- 172.21.15.135:0/3772508485 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9a340a1120 0x7f9a340a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.860+0000 7f9a4affd700 1 --2- 172.21.15.135:0/3772508485 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9a340a1120 0x7f9a340a35e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00b680 tx=0x7f9a3c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.861+0000 7f9a5d972b80 1 Processor -- start 2024-05-08T23:17:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.861+0000 7f9a5d972b80 1 -- start start 2024-05-08T23:17:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.861+0000 7f9a5d972b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8edea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.861+0000 7f9a5d972b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ee3e0 0x5625ff8eecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a5d972b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ef2d0 0x5625ff8ef750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a5d972b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625ff8450f0 con 0x5625ff8eda80 2024-05-08T23:17:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a5d972b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625ff842ab0 con 0x5625ff8ef2d0 2024-05-08T23:17:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a5d972b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625ff83e3a0 con 0x5625ff8ee3e0 2024-05-08T23:17:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8edea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8edea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41932/0 (socket says 172.21.15.135:41932) 2024-05-08T23:17:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a4affd700 1 -- 172.21.15.135:0/263289028 learned_addr learned my addr 172.21.15.135:0/263289028 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a4b7fe700 1 --2- 172.21.15.135:0/263289028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ef2d0 0x5625ff8ef750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a4a7fc700 1 --2- 172.21.15.135:0/263289028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ee3e0 0x5625ff8eecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a4affd700 1 -- 172.21.15.135:0/263289028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ee3e0 msgr2=0x5625ff8eecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a4affd700 1 --2- 172.21.15.135:0/263289028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ee3e0 0x5625ff8eecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a4affd700 1 -- 172.21.15.135:0/263289028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ef2d0 msgr2=0x5625ff8ef750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a4affd700 1 --2- 172.21.15.135:0/263289028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ef2d0 0x5625ff8ef750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a4affd700 1 -- 172.21.15.135:0/263289028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625ff6bf350 con 0x5625ff8eda80 2024-05-08T23:17:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a4a7fc700 1 --2- 172.21.15.135:0/263289028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ee3e0 0x5625ff8eecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:17:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a4affd700 1 --2- 172.21.15.135:0/263289028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8edea0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c068080 tx=0x7f9a3c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5715ac9043933332 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a317fa700 1 -- 172.21.15.135:0/263289028 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c02b070 con 0x5625ff8eda80 2024-05-08T23:17:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a317fa700 1 -- 172.21.15.135:0/263289028 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a3c01e040 con 0x5625ff8eda80 2024-05-08T23:17:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.862+0000 7f9a317fa700 1 -- 172.21.15.135:0/263289028 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c00f780 con 0x5625ff8eda80 2024-05-08T23:17:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.863+0000 7f9a5d972b80 1 -- 172.21.15.135:0/263289028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 msgr2=0x5625ff8edea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.863+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/263289028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8edea0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c068080 tx=0x7f9a3c020000 comp rx=0 tx=0).stop 2024-05-08T23:17:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.863+0000 7f9a5d972b80 1 -- 172.21.15.135:0/263289028 shutdown_connections 2024-05-08T23:17:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.863+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/263289028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ef2d0 0x5625ff8ef750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.863+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/263289028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8edea0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.863+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/263289028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ee3e0 0x5625ff8eecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.863+0000 7f9a5d972b80 1 -- 172.21.15.135:0/263289028 >> 172.21.15.135:0/263289028 conn(0x5625ff84c1b0 msgr2=0x5625ff8ea440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.863+0000 7f9a5d972b80 1 -- 172.21.15.135:0/263289028 shutdown_connections 2024-05-08T23:17:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.863+0000 7f9a5d972b80 1 -- 172.21.15.135:0/263289028 wait complete. 2024-05-08T23:17:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a5d972b80 1 -- start start 2024-05-08T23:17:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a5d972b80 1 Processor -- start 2024-05-08T23:17:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a5d972b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a5d972b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ee3e0 0x5625ff8f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a5d972b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ef2d0 0x5625ff8fed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a5d972b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625ff7da500 con 0x5625ff8eda80 2024-05-08T23:17:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a5d972b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625ff7da1a0 con 0x5625ff8ee3e0 2024-05-08T23:17:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a5d972b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625ff6c1640 con 0x5625ff8ef2d0 2024-05-08T23:17:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a5d972b80 10 client.0 _ll_register_callbacks cb 0x5625ff7e3ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:17:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8f77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41936/0 (socket says 172.21.15.135:41936) 2024-05-08T23:17:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a4affd700 1 -- 172.21.15.135:0/2788991117 learned_addr learned my addr 172.21.15.135:0/2788991117 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a4a7fc700 1 --2- 172.21.15.135:0/2788991117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ee3e0 0x5625ff8f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a4b7fe700 1 --2- 172.21.15.135:0/2788991117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ef2d0 0x5625ff8fed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a4affd700 1 -- 172.21.15.135:0/2788991117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ef2d0 msgr2=0x5625ff8fed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a4affd700 1 --2- 172.21.15.135:0/2788991117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ef2d0 0x5625ff8fed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a4affd700 1 -- 172.21.15.135:0/2788991117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ee3e0 msgr2=0x5625ff8f7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a4affd700 1 --2- 172.21.15.135:0/2788991117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ee3e0 0x5625ff8f7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a4affd700 1 -- 172.21.15.135:0/2788991117 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4c109ce0 con 0x5625ff8eda80 2024-05-08T23:17:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a4affd700 1 --2- 172.21.15.135:0/2788991117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8f77d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009350 tx=0x7f9a3c00fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6263fb0e1a606937 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.864+0000 7f9a2eff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:17:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.865+0000 7f9a2eff5700 1 -- 172.21.15.135:0/2788991117 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c02b040 con 0x5625ff8eda80 2024-05-08T23:17:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.865+0000 7f9a2eff5700 1 -- 172.21.15.135:0/2788991117 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f9a3c004910 con 0x5625ff8eda80 2024-05-08T23:17:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.865+0000 7f9a5d972b80 1 -- 172.21.15.135:0/2788991117 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625ff797210 con 0x5625ff8eda80 2024-05-08T23:17:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.865+0000 7f9a2eff5700 1 -- 172.21.15.135:0/2788991117 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a3c004d20 con 0x5625ff8eda80 2024-05-08T23:17:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.865+0000 7f9a5d972b80 10 client.15453 fetch_fsmap learned FSMap version 28 2024-05-08T23:17:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.865+0000 7f9a5d972b80 1 -- 172.21.15.135:0/2788991117 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5625ff66bb00 con 0x5625ff8eda80 2024-05-08T23:17:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.865+0000 7f9a2eff5700 1 -- 172.21.15.135:0/2788991117 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5625ff797210 con 0x5625ff8eda80 2024-05-08T23:17:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.865+0000 7f9a2eff5700 1 -- 172.21.15.135:0/2788991117 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9a3c0414c0 con 0x5625ff8eda80 2024-05-08T23:17:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.865+0000 7f9a5d972b80 10 client.15453 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:17:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.865+0000 7f9a5d972b80 10 client.15453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:17:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.865+0000 7f9a5d972b80 20 client.15453 populate_metadata read hostname 'smithi135' 2024-05-08T23:17:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.865+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/2788991117 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5625ff903120 0x5625ff905540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.865+0000 7f9a5d972b80 4 client.15453 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:17:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.865+0000 7f9a5d972b80 1 -- 172.21.15.135:0/2788991117 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625ff8bd7b0 con 0x5625ff903120 2024-05-08T23:17:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.865+0000 7f9a4a7fc700 1 --2- 172.21.15.135:0/2788991117 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5625ff903120 0x5625ff905540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.866+0000 7f9a2eff5700 10 client.15453 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.866+0000 7f9a4a7fc700 1 --2- 172.21.15.135:0/2788991117 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5625ff903120 0x5625ff905540 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=279aa2b613f6d688 server_cookie=d17a5c73aab13b3f in_seq=0 out_seq=0 2024-05-08T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.866+0000 7f9a2eff5700 1 -- 172.21.15.135:0/2788991117 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5625ff8bd7b0 con 0x5625ff903120 2024-05-08T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.866+0000 7f9a2eff5700 10 client.15453 handle_command_reply: tid=0 2024-05-08T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.866+0000 7f9a5d972b80 1 client.15453 shutdown 2024-05-08T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.867+0000 7f9a5d972b80 1 -- 172.21.15.135:0/2788991117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 msgr2=0x5625ff8f77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.867+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/2788991117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8f77d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009350 tx=0x7f9a3c00fc70 comp rx=0 tx=0).stop 2024-05-08T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.867+0000 7f9a5d972b80 1 -- 172.21.15.135:0/2788991117 shutdown_connections 2024-05-08T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.867+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/2788991117 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5625ff903120 0x5625ff905540 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.867+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/2788991117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ef2d0 0x5625ff8fed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.867+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/2788991117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8f77d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.867+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/2788991117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ee3e0 0x5625ff8f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.867+0000 7f9a2eff5700 0 client.15453 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.867+0000 7f9a5d972b80 1 -- 172.21.15.135:0/2788991117 >> 172.21.15.135:0/2788991117 conn(0x5625ff84c1b0 msgr2=0x5625ff8e8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.867+0000 7f9a5d972b80 1 -- 172.21.15.135:0/2788991117 shutdown_connections 2024-05-08T23:17:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.867+0000 7f9a5d972b80 1 -- 172.21.15.135:0/2788991117 wait complete. 2024-05-08T23:17:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.867+0000 7f9a5d972b80 20 client.15453 trim_cache size 0 max 16384 2024-05-08T23:17:07.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.882+0000 7f9a5d972b80 1 Processor -- start 2024-05-08T23:17:07.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.882+0000 7f9a5d972b80 1 -- start start 2024-05-08T23:17:07.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.882+0000 7f9a5d972b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff905510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.882+0000 7f9a5d972b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ee3e0 0x5625ff8fed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.882+0000 7f9a5d972b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ef2d0 0x5625ff8ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.894 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.882+0000 7f9a5d972b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625ff8ffed0 con 0x5625ff8eda80 2024-05-08T23:17:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.882+0000 7f9a5d972b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625ff8e9930 con 0x5625ff8ef2d0 2024-05-08T23:17:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.882+0000 7f9a5d972b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625ff90a780 con 0x5625ff8ee3e0 2024-05-08T23:17:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.882+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff905510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.882+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff905510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41952/0 (socket says 172.21.15.135:41952) 2024-05-08T23:17:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.882+0000 7f9a4affd700 1 -- 172.21.15.135:0/2203830788 learned_addr learned my addr 172.21.15.135:0/2203830788 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.882+0000 7f9a4b7fe700 1 --2- 172.21.15.135:0/2203830788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ef2d0 0x5625ff8ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.883+0000 7f9a4a7fc700 1 --2- 172.21.15.135:0/2203830788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ee3e0 0x5625ff8fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.883+0000 7f9a4affd700 1 -- 172.21.15.135:0/2203830788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ee3e0 msgr2=0x5625ff8fed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.883+0000 7f9a4affd700 1 --2- 172.21.15.135:0/2203830788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ee3e0 0x5625ff8fed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.883+0000 7f9a4affd700 1 -- 172.21.15.135:0/2203830788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ef2d0 msgr2=0x5625ff8ef6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.883+0000 7f9a4affd700 1 --2- 172.21.15.135:0/2203830788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ef2d0 0x5625ff8ef6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.883+0000 7f9a4affd700 1 -- 172.21.15.135:0/2203830788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625ff804500 con 0x5625ff8eda80 2024-05-08T23:17:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.883+0000 7f9a4a7fc700 1 --2- 172.21.15.135:0/2203830788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ee3e0 0x5625ff8fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:17:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.883+0000 7f9a4affd700 1 --2- 172.21.15.135:0/2203830788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff905510 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00c010 tx=0x7f9a3c005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6946a1bd93306d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.883+0000 7f9a31ffb700 1 -- 172.21.15.135:0/2203830788 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c045070 con 0x5625ff8eda80 2024-05-08T23:17:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.883+0000 7f9a31ffb700 1 -- 172.21.15.135:0/2203830788 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a3c00fd90 con 0x5625ff8eda80 2024-05-08T23:17:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.883+0000 7f9a31ffb700 1 -- 172.21.15.135:0/2203830788 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c02b070 con 0x5625ff8eda80 2024-05-08T23:17:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.884+0000 7f9a5d972b80 1 -- 172.21.15.135:0/2203830788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 msgr2=0x5625ff905510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.884+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/2203830788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff905510 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00c010 tx=0x7f9a3c005ce0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.884+0000 7f9a5d972b80 1 -- 172.21.15.135:0/2203830788 shutdown_connections 2024-05-08T23:17:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.884+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/2203830788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ef2d0 0x5625ff8ef6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.884+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/2203830788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff905510 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.884+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/2203830788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ee3e0 0x5625ff8fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.884+0000 7f9a5d972b80 1 -- 172.21.15.135:0/2203830788 >> 172.21.15.135:0/2203830788 conn(0x5625ff84c1b0 msgr2=0x5625ff8f57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.884+0000 7f9a5d972b80 1 -- 172.21.15.135:0/2203830788 shutdown_connections 2024-05-08T23:17:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.884+0000 7f9a5d972b80 1 -- 172.21.15.135:0/2203830788 wait complete. 2024-05-08T23:17:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a5d972b80 1 -- start start 2024-05-08T23:17:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a5d972b80 1 Processor -- start 2024-05-08T23:17:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a5d972b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8fba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a5d972b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ee3e0 0x5625ff8fbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a5d972b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ef2d0 0x5625ff957600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a5d972b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625ff8fc580 con 0x5625ff8eda80 2024-05-08T23:17:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a5d972b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625ff8fc6c0 con 0x5625ff8ee3e0 2024-05-08T23:17:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a5d972b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625ff957b90 con 0x5625ff8ef2d0 2024-05-08T23:17:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a5d972b80 10 client.0 _ll_register_callbacks cb 0x5625ff7e3ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:17:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8fba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8fba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41960/0 (socket says 172.21.15.135:41960) 2024-05-08T23:17:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a4affd700 1 -- 172.21.15.135:0/731941274 learned_addr learned my addr 172.21.15.135:0/731941274 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a4a7fc700 1 --2- 172.21.15.135:0/731941274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ee3e0 0x5625ff8fbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a4affd700 1 -- 172.21.15.135:0/731941274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ef2d0 msgr2=0x5625ff957600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a4affd700 1 --2- 172.21.15.135:0/731941274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ef2d0 0x5625ff957600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a4affd700 1 -- 172.21.15.135:0/731941274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ee3e0 msgr2=0x5625ff8fbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a4affd700 1 --2- 172.21.15.135:0/731941274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ee3e0 0x5625ff8fbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a4affd700 1 -- 172.21.15.135:0/731941274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625ff66bb00 con 0x5625ff8eda80 2024-05-08T23:17:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.885+0000 7f9a4a7fc700 1 --2- 172.21.15.135:0/731941274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ee3e0 0x5625ff8fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:17:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a4affd700 1 --2- 172.21.15.135:0/731941274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8fba70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c004cb0 tx=0x7f9a3c004de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4678f4364425e60 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a2eff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:17:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a2eff5700 1 -- 172.21.15.135:0/731941274 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c02b050 con 0x5625ff8eda80 2024-05-08T23:17:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a2eff5700 1 -- 172.21.15.135:0/731941274 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f9a3c004920 con 0x5625ff8eda80 2024-05-08T23:17:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a5d972b80 1 -- 172.21.15.135:0/731941274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625ff836e60 con 0x5625ff8eda80 2024-05-08T23:17:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a2eff5700 1 -- 172.21.15.135:0/731941274 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a3c045040 con 0x5625ff8eda80 2024-05-08T23:17:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a5d972b80 10 client.15459 fetch_fsmap learned FSMap version 28 2024-05-08T23:17:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a5d972b80 1 -- 172.21.15.135:0/731941274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5625ff6c3c70 con 0x5625ff8eda80 2024-05-08T23:17:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a2eff5700 1 -- 172.21.15.135:0/731941274 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5625ff836e60 con 0x5625ff8eda80 2024-05-08T23:17:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a2eff5700 1 -- 172.21.15.135:0/731941274 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9a3c054430 con 0x5625ff8eda80 2024-05-08T23:17:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a5d972b80 10 client.15459 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:17:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a5d972b80 10 client.15459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:17:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a5d972b80 20 client.15459 populate_metadata read hostname 'smithi135' 2024-05-08T23:17:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/731941274 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5625ff959110 0x5625ff95b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a5d972b80 4 client.15459 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T23:17:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.886+0000 7f9a5d972b80 1 -- 172.21.15.135:0/731941274 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5625ff68cc90 con 0x5625ff959110 2024-05-08T23:17:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.887+0000 7f9a4a7fc700 1 --2- 172.21.15.135:0/731941274 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5625ff959110 0x5625ff95b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.887+0000 7f9a2eff5700 10 client.15459 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.887+0000 7f9a4a7fc700 1 --2- 172.21.15.135:0/731941274 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5625ff959110 0x5625ff95b500 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=624afb78c85f97f server_cookie=af45354a94494802 in_seq=0 out_seq=0 2024-05-08T23:17:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.898+0000 7f9a2eff5700 1 -- 172.21.15.135:0/731941274 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5625ff68cc90 con 0x5625ff959110 2024-05-08T23:17:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.898+0000 7f9a2eff5700 10 client.15459 handle_command_reply: tid=0 2024-05-08T23:17:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.898+0000 7f9a5d972b80 1 client.15459 shutdown 2024-05-08T23:17:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.898+0000 7f9a5d972b80 1 -- 172.21.15.135:0/731941274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 msgr2=0x5625ff8fba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.898+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/731941274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8fba70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c004cb0 tx=0x7f9a3c004de0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.898+0000 7f9a5d972b80 1 -- 172.21.15.135:0/731941274 shutdown_connections 2024-05-08T23:17:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.898+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/731941274 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5625ff959110 0x5625ff95b500 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.898+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/731941274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625ff8ef2d0 0x5625ff957600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.898+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/731941274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625ff8eda80 0x5625ff8fba70 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.898+0000 7f9a2eff5700 0 client.15459 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.898+0000 7f9a5d972b80 1 --2- 172.21.15.135:0/731941274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5625ff8ee3e0 0x5625ff8fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.898+0000 7f9a5d972b80 1 -- 172.21.15.135:0/731941274 >> 172.21.15.135:0/731941274 conn(0x5625ff84c1b0 msgr2=0x5625ff8f7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.898+0000 7f9a5d972b80 1 -- 172.21.15.135:0/731941274 shutdown_connections 2024-05-08T23:17:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.898+0000 7f9a5d972b80 1 -- 172.21.15.135:0/731941274 wait complete. 2024-05-08T23:17:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.898+0000 7f9a5d972b80 20 client.15459 trim_cache size 0 max 16384 2024-05-08T23:17:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-08T23:17:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-08T23:17:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-08T23:17:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-08T23:17:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.899+0000 7f9a517b8700 1 -- 172.21.15.135:0/3772508485 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9a340a1120 msgr2=0x7f9a340a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.899+0000 7f9a517b8700 1 --2- 172.21.15.135:0/3772508485 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9a340a1120 0x7f9a340a35e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00b680 tx=0x7f9a3c005fd0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.899+0000 7f9a517b8700 1 -- 172.21.15.135:0/3772508485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a4c102190 msgr2=0x7f9a4c100140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.899+0000 7f9a517b8700 1 --2- 172.21.15.135:0/3772508485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a4c102190 0x7f9a4c100140 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000e9a0 tx=0x7f9a4000ecb0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.899+0000 7f9a517b8700 1 -- 172.21.15.135:0/3772508485 shutdown_connections 2024-05-08T23:17:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.899+0000 7f9a517b8700 1 --2- 172.21.15.135:0/3772508485 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f9a340a1120 0x7f9a340a35e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.899+0000 7f9a517b8700 1 --2- 172.21.15.135:0/3772508485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a4c0ff1c0 0x7f9a4c101ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.899+0000 7f9a517b8700 1 --2- 172.21.15.135:0/3772508485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a4c102b30 0x7f9a4c100680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.899+0000 7f9a517b8700 1 --2- 172.21.15.135:0/3772508485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a4c102190 0x7f9a4c100140 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.899+0000 7f9a517b8700 1 -- 172.21.15.135:0/3772508485 >> 172.21.15.135:0/3772508485 conn(0x7f9a4c0faaf0 msgr2=0x7f9a4c1055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.899+0000 7f9a517b8700 1 -- 172.21.15.135:0/3772508485 shutdown_connections 2024-05-08T23:17:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:07.899+0000 7f9a517b8700 1 -- 172.21.15.135:0/3772508485 wait complete. 2024-05-08T23:17:08.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:08 smithi135 ceph-mon[42440]: pgmap v308: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 517 KiB/s wr, 12 op/s 2024-05-08T23:17:08.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:08 smithi179 ceph-mon[46314]: pgmap v308: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 517 KiB/s wr, 12 op/s 2024-05-08T23:17:08.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:08 smithi195 ceph-mon[46516]: pgmap v308: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 517 KiB/s wr, 12 op/s 2024-05-08T23:17:10.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:10 smithi135 ceph-mon[42440]: pgmap v309: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 520 KiB/s wr, 14 op/s 2024-05-08T23:17:10.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:10 smithi179 ceph-mon[46314]: pgmap v309: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 520 KiB/s wr, 14 op/s 2024-05-08T23:17:10.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:10 smithi195 ceph-mon[46516]: pgmap v309: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 520 KiB/s wr, 14 op/s 2024-05-08T23:17:12.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:12 smithi135 ceph-mon[42440]: pgmap v310: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 520 KiB/s wr, 12 op/s 2024-05-08T23:17:12.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:12 smithi179 ceph-mon[46314]: pgmap v310: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 520 KiB/s wr, 12 op/s 2024-05-08T23:17:12.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:12 smithi195 ceph-mon[46516]: pgmap v310: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 520 KiB/s wr, 12 op/s 2024-05-08T23:17:14.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:14 smithi135 ceph-mon[42440]: pgmap v311: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 951 KiB/s wr, 19 op/s 2024-05-08T23:17:14.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:14 smithi179 ceph-mon[46314]: pgmap v311: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 951 KiB/s wr, 19 op/s 2024-05-08T23:17:14.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:14 smithi195 ceph-mon[46516]: pgmap v311: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 951 KiB/s wr, 19 op/s 2024-05-08T23:17:16.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:16 smithi135 ceph-mon[42440]: pgmap v312: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 861 KiB/s wr, 14 op/s 2024-05-08T23:17:16.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:16 smithi179 ceph-mon[46314]: pgmap v312: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 861 KiB/s wr, 14 op/s 2024-05-08T23:17:16.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:16 smithi195 ceph-mon[46516]: pgmap v312: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 861 KiB/s wr, 14 op/s 2024-05-08T23:17:18.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:18 smithi135 ceph-mon[42440]: pgmap v313: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 16 op/s 2024-05-08T23:17:18.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:18 smithi179 ceph-mon[46314]: pgmap v313: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 16 op/s 2024-05-08T23:17:18.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:18 smithi195 ceph-mon[46516]: pgmap v313: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 16 op/s 2024-05-08T23:17:20.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:20 smithi135 ceph-mon[42440]: pgmap v314: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 864 KiB/s wr, 17 op/s 2024-05-08T23:17:20.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:20 smithi179 ceph-mon[46314]: pgmap v314: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 864 KiB/s wr, 17 op/s 2024-05-08T23:17:20.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:20 smithi195 ceph-mon[46516]: pgmap v314: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 864 KiB/s wr, 17 op/s 2024-05-08T23:17:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.021+0000 7fabfe40c700 1 -- 172.21.15.135:0/3759481714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf8102a30 msgr2=0x7fabf8109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.021+0000 7fabfe40c700 1 --2- 172.21.15.135:0/3759481714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf8102a30 0x7fabf8109350 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fabf000b0a0 tx=0x7fabf000b3b0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.021+0000 7fabfe40c700 1 -- 172.21.15.135:0/3759481714 shutdown_connections 2024-05-08T23:17:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.021+0000 7fabfe40c700 1 --2- 172.21.15.135:0/3759481714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabf8100f20 0x7fabf8101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.021+0000 7fabfe40c700 1 --2- 172.21.15.135:0/3759481714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf8102a30 0x7fabf8109350 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.021+0000 7fabfe40c700 1 --2- 172.21.15.135:0/3759481714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf8102070 0x7fabf81024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.021+0000 7fabfe40c700 1 -- 172.21.15.135:0/3759481714 >> 172.21.15.135:0/3759481714 conn(0x7fabf80fc490 msgr2=0x7fabf80fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.021+0000 7fabfe40c700 1 -- 172.21.15.135:0/3759481714 shutdown_connections 2024-05-08T23:17:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.021+0000 7fabfe40c700 1 -- 172.21.15.135:0/3759481714 wait complete. 2024-05-08T23:17:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.022+0000 7fabfe40c700 1 Processor -- start 2024-05-08T23:17:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.022+0000 7fabfe40c700 1 -- start start 2024-05-08T23:17:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.022+0000 7fabfe40c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabf8100f20 0x7fabf8196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.022+0000 7fabfe40c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf8102070 0x7fabf8197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.022+0000 7fabfe40c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf8102a30 0x7fabf819e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.022+0000 7fabfe40c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf819eaf0 con 0x7fabf8102070 2024-05-08T23:17:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.022+0000 7fabfe40c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf819ec30 con 0x7fabf8102a30 2024-05-08T23:17:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.022+0000 7fabfe40c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf819edc0 con 0x7fabf8100f20 2024-05-08T23:17:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.022+0000 7fabf77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf8102070 0x7fabf8197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.022+0000 7fabf77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf8102070 0x7fabf8197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53676/0 (socket says 172.21.15.135:53676) 2024-05-08T23:17:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.022+0000 7fabf77fe700 1 -- 172.21.15.135:0/2166611840 learned_addr learned my addr 172.21.15.135:0/2166611840 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.022+0000 7fabfc9a9700 1 --2- 172.21.15.135:0/2166611840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf8102a30 0x7fabf819e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.023+0000 7fabf7fff700 1 --2- 172.21.15.135:0/2166611840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabf8100f20 0x7fabf8196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.023+0000 7fabf77fe700 1 -- 172.21.15.135:0/2166611840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabf8100f20 msgr2=0x7fabf8196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.023+0000 7fabf77fe700 1 --2- 172.21.15.135:0/2166611840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabf8100f20 0x7fabf8196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.023+0000 7fabf77fe700 1 -- 172.21.15.135:0/2166611840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf8102a30 msgr2=0x7fabf819e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.023+0000 7fabf77fe700 1 --2- 172.21.15.135:0/2166611840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf8102a30 0x7fabf819e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.023+0000 7fabf77fe700 1 -- 172.21.15.135:0/2166611840 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf0009d00 con 0x7fabf8102070 2024-05-08T23:17:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.023+0000 7fabf77fe700 1 --2- 172.21.15.135:0/2166611840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf8102070 0x7fabf8197500 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fabec00d980 tx=0x7fabec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.023+0000 7fabf57fa700 1 -- 172.21.15.135:0/2166611840 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec004220 con 0x7fabf8102070 2024-05-08T23:17:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.023+0000 7fabfe40c700 1 -- 172.21.15.135:0/2166611840 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf819f0a0 con 0x7fabf8102070 2024-05-08T23:17:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.023+0000 7fabf57fa700 1 -- 172.21.15.135:0/2166611840 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fabec007640 con 0x7fabf8102070 2024-05-08T23:17:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.023+0000 7fabf57fa700 1 -- 172.21.15.135:0/2166611840 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec005690 con 0x7fabf8102070 2024-05-08T23:17:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.023+0000 7fabfe40c700 1 -- 172.21.15.135:0/2166611840 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf819f5b0 con 0x7fabf8102070 2024-05-08T23:17:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.026+0000 7fabf57fa700 1 -- 172.21.15.135:0/2166611840 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fabec004750 con 0x7fabf8102070 2024-05-08T23:17:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.026+0000 7fabf57fa700 1 --2- 172.21.15.135:0/2166611840 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fabe00a1120 0x7fabe00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.027+0000 7fabf7fff700 1 --2- 172.21.15.135:0/2166611840 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fabe00a1120 0x7fabe00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.027+0000 7fabf57fa700 1 -- 172.21.15.135:0/2166611840 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fabec0cc6d0 con 0x7fabf8102070 2024-05-08T23:17:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.027+0000 7fabf7fff700 1 --2- 172.21.15.135:0/2166611840 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fabe00a1120 0x7fabe00a35e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009c60 tx=0x7fabe8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fac0a5c6b80 1 Processor -- start 2024-05-08T23:17:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fac0a5c6b80 1 -- start start 2024-05-08T23:17:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fac0a5c6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98ea80 0x56348f98eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fac0a5c6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f98f3e0 0x56348f98fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fac0a5c6b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f9902d0 0x56348f990750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fac0a5c6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348f8e60f0 con 0x56348f98ea80 2024-05-08T23:17:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fac0a5c6b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348f8e3ab0 con 0x56348f9902d0 2024-05-08T23:17:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fac0a5c6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348f8df3a0 con 0x56348f98f3e0 2024-05-08T23:17:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fabf7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98ea80 0x56348f98eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fabf7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98ea80 0x56348f98eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53688/0 (socket says 172.21.15.135:53688) 2024-05-08T23:17:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fabf7fff700 1 -- 172.21.15.135:0/1756931344 learned_addr learned my addr 172.21.15.135:0/1756931344 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fabf77fe700 1 --2- 172.21.15.135:0/1756931344 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f98f3e0 0x56348f98fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fabfc9a9700 1 --2- 172.21.15.135:0/1756931344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f9902d0 0x56348f990750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fabf7fff700 1 -- 172.21.15.135:0/1756931344 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f98f3e0 msgr2=0x56348f98fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fabf7fff700 1 --2- 172.21.15.135:0/1756931344 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f98f3e0 0x56348f98fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fabf7fff700 1 -- 172.21.15.135:0/1756931344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f9902d0 msgr2=0x56348f990750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fabf7fff700 1 --2- 172.21.15.135:0/1756931344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f9902d0 0x56348f990750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fabf7fff700 1 -- 172.21.15.135:0/1756931344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56348f760350 con 0x56348f98ea80 2024-05-08T23:17:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.028+0000 7fabf77fe700 1 --2- 172.21.15.135:0/1756931344 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f98f3e0 0x56348f98fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:17:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.029+0000 7fabf7fff700 1 --2- 172.21.15.135:0/1756931344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98ea80 0x56348f98eea0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fabe800e4e0 tx=0x7fabe8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185db41efe428a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.029+0000 7fabde7fc700 1 -- 172.21.15.135:0/1756931344 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8026430 con 0x56348f98ea80 2024-05-08T23:17:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.029+0000 7fabde7fc700 1 -- 172.21.15.135:0/1756931344 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fabe8021070 con 0x56348f98ea80 2024-05-08T23:17:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.029+0000 7fabde7fc700 1 -- 172.21.15.135:0/1756931344 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe801d760 con 0x56348f98ea80 2024-05-08T23:17:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.029+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/1756931344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98ea80 msgr2=0x56348f98eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.029+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/1756931344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98ea80 0x56348f98eea0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fabe800e4e0 tx=0x7fabe8014000 comp rx=0 tx=0).stop 2024-05-08T23:17:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.029+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/1756931344 shutdown_connections 2024-05-08T23:17:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.029+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/1756931344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f9902d0 0x56348f990750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.030+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/1756931344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98ea80 0x56348f98eea0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.030+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/1756931344 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f98f3e0 0x56348f98fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.030+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/1756931344 >> 172.21.15.135:0/1756931344 conn(0x56348f8ed1b0 msgr2=0x56348f98b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.030+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/1756931344 shutdown_connections 2024-05-08T23:17:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.030+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/1756931344 wait complete. 2024-05-08T23:17:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.030+0000 7fac0a5c6b80 1 -- start start 2024-05-08T23:17:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.030+0000 7fac0a5c6b80 1 Processor -- start 2024-05-08T23:17:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.030+0000 7fac0a5c6b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f98ea80 0x56348f998890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.030+0000 7fac0a5c6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98f3e0 0x56348f998dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.030+0000 7fac0a5c6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f9902d0 0x56348f99fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.030+0000 7fac0a5c6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348f87b500 con 0x56348f98f3e0 2024-05-08T23:17:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.030+0000 7fac0a5c6b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348f87b1a0 con 0x56348f98ea80 2024-05-08T23:17:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.030+0000 7fac0a5c6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348f762640 con 0x56348f9902d0 2024-05-08T23:17:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.030+0000 7fac0a5c6b80 10 client.0 _ll_register_callbacks cb 0x56348f884ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:17:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabf77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98f3e0 0x56348f998dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabf77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98f3e0 0x56348f998dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53698/0 (socket says 172.21.15.135:53698) 2024-05-08T23:17:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabf77fe700 1 -- 172.21.15.135:0/3606050779 learned_addr learned my addr 172.21.15.135:0/3606050779 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabfc9a9700 1 --2- 172.21.15.135:0/3606050779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f9902d0 0x56348f99fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabf7fff700 1 --2- 172.21.15.135:0/3606050779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f98ea80 0x56348f998890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabf77fe700 1 -- 172.21.15.135:0/3606050779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f9902d0 msgr2=0x56348f99fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabf77fe700 1 --2- 172.21.15.135:0/3606050779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f9902d0 0x56348f99fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabf77fe700 1 -- 172.21.15.135:0/3606050779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f98ea80 msgr2=0x56348f998890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabf77fe700 1 --2- 172.21.15.135:0/3606050779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f98ea80 0x56348f998890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabf77fe700 1 -- 172.21.15.135:0/3606050779 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe8017070 con 0x56348f98f3e0 2024-05-08T23:17:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabfc9a9700 1 --2- 172.21.15.135:0/3606050779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f9902d0 0x56348f99fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:17:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabf77fe700 1 --2- 172.21.15.135:0/3606050779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98f3e0 0x56348f998dd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fabec0997a0 tx=0x7fabec099b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9150e8486b7e69 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabd77fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:17:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabd77fe700 1 -- 172.21.15.135:0/3606050779 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec09d930 con 0x56348f98f3e0 2024-05-08T23:17:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabd77fe700 1 -- 172.21.15.135:0/3606050779 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fabec0a1f20 con 0x56348f98f3e0 2024-05-08T23:17:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/3606050779 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56348f838210 con 0x56348f98f3e0 2024-05-08T23:17:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fabd77fe700 1 -- 172.21.15.135:0/3606050779 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabec004380 con 0x56348f98f3e0 2024-05-08T23:17:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fac0a5c6b80 10 client.15471 fetch_fsmap learned FSMap version 28 2024-05-08T23:17:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.031+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/3606050779 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56348f70cb00 con 0x56348f98f3e0 2024-05-08T23:17:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.032+0000 7fabd77fe700 1 -- 172.21.15.135:0/3606050779 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fabec063020 con 0x56348f98f3e0 2024-05-08T23:17:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.032+0000 7fabd77fe700 1 -- 172.21.15.135:0/3606050779 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fabec0a1a90 con 0x56348f98f3e0 2024-05-08T23:17:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.032+0000 7fac0a5c6b80 10 client.15471 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:17:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.032+0000 7fac0a5c6b80 10 client.15471 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:17:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.032+0000 7fac0a5c6b80 20 client.15471 populate_metadata read hostname 'smithi135' 2024-05-08T23:17:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.032+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/3606050779 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56348f9a4660 0x56348f9a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.032+0000 7fac0a5c6b80 4 client.15471 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:17:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.032+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/3606050779 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56348f95e7b0 con 0x56348f9a4660 2024-05-08T23:17:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.032+0000 7fabf7fff700 1 --2- 172.21.15.135:0/3606050779 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56348f9a4660 0x56348f9a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.032+0000 7fabd77fe700 10 client.15471 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:21.038 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.032+0000 7fabf7fff700 1 --2- 172.21.15.135:0/3606050779 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56348f9a4660 0x56348f9a6a80 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8697866071928eff server_cookie=25a787739cbdebcf in_seq=0 out_seq=0 2024-05-08T23:17:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.033+0000 7fabd77fe700 1 -- 172.21.15.135:0/3606050779 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56348f95e7b0 con 0x56348f9a4660 2024-05-08T23:17:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.033+0000 7fabd77fe700 10 client.15471 handle_command_reply: tid=0 2024-05-08T23:17:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.033+0000 7fac0a5c6b80 1 client.15471 shutdown 2024-05-08T23:17:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.033+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/3606050779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98f3e0 msgr2=0x56348f998dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.033+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/3606050779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98f3e0 0x56348f998dd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fabec0997a0 tx=0x7fabec099b70 comp rx=0 tx=0).stop 2024-05-08T23:17:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.033+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/3606050779 shutdown_connections 2024-05-08T23:17:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.033+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/3606050779 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56348f9a4660 0x56348f9a6a80 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.033+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/3606050779 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f9902d0 0x56348f99fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.033+0000 7fabd77fe700 0 client.15471 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.033+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/3606050779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f98ea80 0x56348f998890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.033+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/3606050779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98f3e0 0x56348f998dd0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.033+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/3606050779 >> 172.21.15.135:0/3606050779 conn(0x56348f8ed1b0 msgr2=0x56348f989860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.033+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/3606050779 shutdown_connections 2024-05-08T23:17:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.033+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/3606050779 wait complete. 2024-05-08T23:17:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.033+0000 7fac0a5c6b80 20 client.15471 trim_cache size 0 max 16384 2024-05-08T23:17:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fac0a5c6b80 1 Processor -- start 2024-05-08T23:17:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fac0a5c6b80 1 -- start start 2024-05-08T23:17:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fac0a5c6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f98ea80 0x56348f9a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fac0a5c6b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f98f3e0 0x56348f99fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fac0a5c6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f9902d0 0x56348f98ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fac0a5c6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348f998400 con 0x56348f9902d0 2024-05-08T23:17:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fac0a5c6b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348f9abc90 con 0x56348f98f3e0 2024-05-08T23:17:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fac0a5c6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348f999510 con 0x56348f98ea80 2024-05-08T23:17:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fabfc9a9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f9902d0 0x56348f98ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fabfc9a9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f9902d0 0x56348f98ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53708/0 (socket says 172.21.15.135:53708) 2024-05-08T23:17:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fabfc9a9700 1 -- 172.21.15.135:0/3116277079 learned_addr learned my addr 172.21.15.135:0/3116277079 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fabf77fe700 1 --2- 172.21.15.135:0/3116277079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f98f3e0 0x56348f99fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fabf7fff700 1 --2- 172.21.15.135:0/3116277079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f98ea80 0x56348f9a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fabfc9a9700 1 -- 172.21.15.135:0/3116277079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f98ea80 msgr2=0x56348f9a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fabfc9a9700 1 --2- 172.21.15.135:0/3116277079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f98ea80 0x56348f9a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fabfc9a9700 1 -- 172.21.15.135:0/3116277079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f98f3e0 msgr2=0x56348f99fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fabfc9a9700 1 --2- 172.21.15.135:0/3116277079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f98f3e0 0x56348f99fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fabfc9a9700 1 -- 172.21.15.135:0/3116277079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56348f8a5500 con 0x56348f9902d0 2024-05-08T23:17:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.049+0000 7fabf7fff700 1 --2- 172.21.15.135:0/3116277079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f98ea80 0x56348f9a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:17:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.050+0000 7fabfc9a9700 1 --2- 172.21.15.135:0/3116277079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f9902d0 0x56348f98ee60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fabf000d010 tx=0x7fabf0007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8985ce2b39681b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.050+0000 7fabdeffd700 1 -- 172.21.15.135:0/3116277079 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf000e040 con 0x56348f9902d0 2024-05-08T23:17:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.050+0000 7fabdeffd700 1 -- 172.21.15.135:0/3116277079 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fabf00076e0 con 0x56348f9902d0 2024-05-08T23:17:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.050+0000 7fabdeffd700 1 -- 172.21.15.135:0/3116277079 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf00052a0 con 0x56348f9902d0 2024-05-08T23:17:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.050+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/3116277079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f9902d0 msgr2=0x56348f98ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/3116277079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f9902d0 0x56348f98ee60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fabf000d010 tx=0x7fabf0007d20 comp rx=0 tx=0).stop 2024-05-08T23:17:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/3116277079 shutdown_connections 2024-05-08T23:17:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/3116277079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f98ea80 0x56348f9a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/3116277079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f9902d0 0x56348f98ee60 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/3116277079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f98f3e0 0x56348f99fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/3116277079 >> 172.21.15.135:0/3116277079 conn(0x56348f8ed1b0 msgr2=0x56348f993510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/3116277079 shutdown_connections 2024-05-08T23:17:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/3116277079 wait complete. 2024-05-08T23:17:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 -- start start 2024-05-08T23:17:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 Processor -- start 2024-05-08T23:17:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f98ea80 0x56348f99d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98f3e0 0x56348f99d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f9902d0 0x56348f99e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348f99ecb0 con 0x56348f98f3e0 2024-05-08T23:17:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348f99ee20 con 0x56348f98ea80 2024-05-08T23:17:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348f99efe0 con 0x56348f9902d0 2024-05-08T23:17:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fac0a5c6b80 10 client.0 _ll_register_callbacks cb 0x56348f884ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:17:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.051+0000 7fabf77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98f3e0 0x56348f99d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fabf77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98f3e0 0x56348f99d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53716/0 (socket says 172.21.15.135:53716) 2024-05-08T23:17:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fabf77fe700 1 -- 172.21.15.135:0/1655148953 learned_addr learned my addr 172.21.15.135:0/1655148953 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fabfc9a9700 1 --2- 172.21.15.135:0/1655148953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f9902d0 0x56348f99e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fabf7fff700 1 --2- 172.21.15.135:0/1655148953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f98ea80 0x56348f99d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fabf77fe700 1 -- 172.21.15.135:0/1655148953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f9902d0 msgr2=0x56348f99e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fabf77fe700 1 --2- 172.21.15.135:0/1655148953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f9902d0 0x56348f99e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fabf77fe700 1 -- 172.21.15.135:0/1655148953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f98ea80 msgr2=0x56348f99d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fabf77fe700 1 --2- 172.21.15.135:0/1655148953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f98ea80 0x56348f99d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fabf77fe700 1 -- 172.21.15.135:0/1655148953 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf8109c80 con 0x56348f98f3e0 2024-05-08T23:17:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fabf77fe700 1 --2- 172.21.15.135:0/1655148953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98f3e0 0x56348f99d760 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fabec00d950 tx=0x7fabec09a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57ee12863e79691 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fabd77fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:17:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fabd77fe700 1 -- 172.21.15.135:0/1655148953 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec014070 con 0x56348f98f3e0 2024-05-08T23:17:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fabd77fe700 1 -- 172.21.15.135:0/1655148953 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fabec064080 con 0x56348f98f3e0 2024-05-08T23:17:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/1655148953 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fabe8021070 con 0x56348f98f3e0 2024-05-08T23:17:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fabd77fe700 1 -- 172.21.15.135:0/1655148953 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabec0a1f20 con 0x56348f98f3e0 2024-05-08T23:17:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fac0a5c6b80 10 client.15477 fetch_fsmap learned FSMap version 28 2024-05-08T23:17:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.052+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/1655148953 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56348f764c70 con 0x56348f98f3e0 2024-05-08T23:17:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.053+0000 7fabd77fe700 1 -- 172.21.15.135:0/1655148953 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fabe8021070 con 0x56348f98f3e0 2024-05-08T23:17:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.053+0000 7fabd77fe700 1 -- 172.21.15.135:0/1655148953 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fabec0b2290 con 0x56348f98f3e0 2024-05-08T23:17:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.053+0000 7fac0a5c6b80 10 client.15477 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:17:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.053+0000 7fac0a5c6b80 10 client.15477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:17:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.053+0000 7fac0a5c6b80 20 client.15477 populate_metadata read hostname 'smithi135' 2024-05-08T23:17:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.053+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/1655148953 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56348f9fadd0 0x56348f9fd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.053+0000 7fac0a5c6b80 4 client.15477 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T23:17:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.053+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/1655148953 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56348f8d7e60 con 0x56348f9fadd0 2024-05-08T23:17:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.053+0000 7fabf7fff700 1 --2- 172.21.15.135:0/1655148953 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56348f9fadd0 0x56348f9fd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.053+0000 7fabf7fff700 1 --2- 172.21.15.135:0/1655148953 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56348f9fadd0 0x56348f9fd1f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88e37f177bce1b40 server_cookie=dabf45ad9bf59f2b in_seq=0 out_seq=0 2024-05-08T23:17:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.053+0000 7fabd77fe700 10 client.15477 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.064+0000 7fabd77fe700 1 -- 172.21.15.135:0/1655148953 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56348f8d7e60 con 0x56348f9fadd0 2024-05-08T23:17:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.064+0000 7fabd77fe700 10 client.15477 handle_command_reply: tid=0 2024-05-08T23:17:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.064+0000 7fac0a5c6b80 1 client.15477 shutdown 2024-05-08T23:17:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.064+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/1655148953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98f3e0 msgr2=0x56348f99d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.064+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/1655148953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98f3e0 0x56348f99d760 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fabec00d950 tx=0x7fabec09a300 comp rx=0 tx=0).stop 2024-05-08T23:17:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.064+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/1655148953 shutdown_connections 2024-05-08T23:17:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.064+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/1655148953 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x56348f9fadd0 0x56348f9fd1f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.064+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/1655148953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56348f9902d0 0x56348f99e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.064+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/1655148953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56348f98ea80 0x56348f99d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.064+0000 7fac0a5c6b80 1 --2- 172.21.15.135:0/1655148953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56348f98f3e0 0x56348f99d760 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.064+0000 7fabd77fe700 0 client.15477 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.064+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/1655148953 >> 172.21.15.135:0/1655148953 conn(0x56348f8ed1b0 msgr2=0x56348f997ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.064+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/1655148953 shutdown_connections 2024-05-08T23:17:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.064+0000 7fac0a5c6b80 1 -- 172.21.15.135:0/1655148953 wait complete. 2024-05-08T23:17:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.064+0000 7fac0a5c6b80 20 client.15477 trim_cache size 0 max 16384 2024-05-08T23:17:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-08T23:17:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-08T23:17:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-08T23:17:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-08T23:17:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.065+0000 7fabfe40c700 1 -- 172.21.15.135:0/2166611840 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fabe00a1120 msgr2=0x7fabe00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.065+0000 7fabfe40c700 1 --2- 172.21.15.135:0/2166611840 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fabe00a1120 0x7fabe00a35e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009c60 tx=0x7fabe8009260 comp rx=0 tx=0).stop 2024-05-08T23:17:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.065+0000 7fabfe40c700 1 -- 172.21.15.135:0/2166611840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf8102070 msgr2=0x7fabf8197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.065+0000 7fabfe40c700 1 --2- 172.21.15.135:0/2166611840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf8102070 0x7fabf8197500 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fabec00d980 tx=0x7fabec00dc90 comp rx=0 tx=0).stop 2024-05-08T23:17:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.065+0000 7fabfe40c700 1 -- 172.21.15.135:0/2166611840 shutdown_connections 2024-05-08T23:17:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.065+0000 7fabfe40c700 1 --2- 172.21.15.135:0/2166611840 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fabe00a1120 0x7fabe00a35e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.065+0000 7fabfe40c700 1 --2- 172.21.15.135:0/2166611840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabf8100f20 0x7fabf8196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.065+0000 7fabfe40c700 1 --2- 172.21.15.135:0/2166611840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf8102a30 0x7fabf819e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.065+0000 7fabfe40c700 1 --2- 172.21.15.135:0/2166611840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf8102070 0x7fabf8197500 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.065+0000 7fabfe40c700 1 -- 172.21.15.135:0/2166611840 >> 172.21.15.135:0/2166611840 conn(0x7fabf80fc490 msgr2=0x7fabf81054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.065+0000 7fabfe40c700 1 -- 172.21.15.135:0/2166611840 shutdown_connections 2024-05-08T23:17:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:21.065+0000 7fabfe40c700 1 -- 172.21.15.135:0/2166611840 wait complete. 2024-05-08T23:17:22.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:22 smithi135 ceph-mon[42440]: pgmap v315: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 861 KiB/s wr, 14 op/s 2024-05-08T23:17:22.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:22 smithi179 ceph-mon[46314]: pgmap v315: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 861 KiB/s wr, 14 op/s 2024-05-08T23:17:22.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:22 smithi195 ceph-mon[46516]: pgmap v315: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 861 KiB/s wr, 14 op/s 2024-05-08T23:17:24.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:24 smithi135 ceph-mon[42440]: pgmap v316: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 MiB/s wr, 19 op/s 2024-05-08T23:17:24.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:24 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:17:24.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:24 smithi179 ceph-mon[46314]: pgmap v316: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 MiB/s wr, 19 op/s 2024-05-08T23:17:24.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:24 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:17:24.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:24 smithi195 ceph-mon[46516]: pgmap v316: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 MiB/s wr, 19 op/s 2024-05-08T23:17:24.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:24 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:17:25.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:25 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:17:25.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:25 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:17:25.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:25 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:17:25.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:25 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:17:25.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:25 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:17:25.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:25 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:17:25.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:25 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:17:25.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:25 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:17:25.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:25 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:17:26.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:26 smithi179 ceph-mon[46314]: pgmap v317: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 861 KiB/s wr, 13 op/s 2024-05-08T23:17:26.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:26 smithi195 ceph-mon[46516]: pgmap v317: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 861 KiB/s wr, 13 op/s 2024-05-08T23:17:26.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:26 smithi135 ceph-mon[42440]: pgmap v317: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 861 KiB/s wr, 13 op/s 2024-05-08T23:17:28.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:28 smithi179 ceph-mon[46314]: pgmap v318: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-05-08T23:17:28.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:28 smithi195 ceph-mon[46516]: pgmap v318: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-05-08T23:17:28.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:28 smithi135 ceph-mon[42440]: pgmap v318: 97 pgs: 97 active+clean; 1.8 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-05-08T23:17:30.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:30 smithi179 ceph-mon[46314]: pgmap v319: 97 pgs: 97 active+clean; 1.9 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 864 KiB/s wr, 16 op/s 2024-05-08T23:17:30.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:30 smithi195 ceph-mon[46516]: pgmap v319: 97 pgs: 97 active+clean; 1.9 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 864 KiB/s wr, 16 op/s 2024-05-08T23:17:30.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:30 smithi135 ceph-mon[42440]: pgmap v319: 97 pgs: 97 active+clean; 1.9 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 864 KiB/s wr, 16 op/s 2024-05-08T23:17:32.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:32 smithi179 ceph-mon[46314]: pgmap v320: 97 pgs: 97 active+clean; 1.9 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 861 KiB/s wr, 13 op/s 2024-05-08T23:17:32.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:32 smithi195 ceph-mon[46516]: pgmap v320: 97 pgs: 97 active+clean; 1.9 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 861 KiB/s wr, 13 op/s 2024-05-08T23:17:32.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:32 smithi135 ceph-mon[42440]: pgmap v320: 97 pgs: 97 active+clean; 1.9 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 861 KiB/s wr, 13 op/s 2024-05-08T23:17:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.183+0000 7f3926af6700 1 -- 172.21.15.135:0/1407670488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3920106c10 msgr2=0x7f3920109080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.183+0000 7f3926af6700 1 --2- 172.21.15.135:0/1407670488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3920106c10 0x7f3920109080 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f391800b0a0 tx=0x7f391800b3b0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.183+0000 7f3926af6700 1 -- 172.21.15.135:0/1407670488 shutdown_connections 2024-05-08T23:17:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.183+0000 7f3926af6700 1 --2- 172.21.15.135:0/1407670488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39201019b0 0x7f3920103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.183+0000 7f3926af6700 1 --2- 172.21.15.135:0/1407670488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3920106c10 0x7f3920109080 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.183+0000 7f3926af6700 1 --2- 172.21.15.135:0/1407670488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39201042e0 0x7f39201066d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.183+0000 7f3926af6700 1 -- 172.21.15.135:0/1407670488 >> 172.21.15.135:0/1407670488 conn(0x7f39200fb3a0 msgr2=0x7f39200fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.184+0000 7f3926af6700 1 -- 172.21.15.135:0/1407670488 shutdown_connections 2024-05-08T23:17:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.184+0000 7f3926af6700 1 -- 172.21.15.135:0/1407670488 wait complete. 2024-05-08T23:17:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.184+0000 7f3926af6700 1 Processor -- start 2024-05-08T23:17:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.184+0000 7f3926af6700 1 -- start start 2024-05-08T23:17:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.184+0000 7f3926af6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39201019b0 0x7f39201012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.184+0000 7f3926af6700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39201042e0 0x7f39200ff960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.184+0000 7f3926af6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3920106c10 0x7f39200ffea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.184+0000 7f3926af6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3920100640 con 0x7f39201019b0 2024-05-08T23:17:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.184+0000 7f3926af6700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39201007b0 con 0x7f39201042e0 2024-05-08T23:17:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.184+0000 7f3926af6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39201a0fd0 con 0x7f3920106c10 2024-05-08T23:17:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.184+0000 7f3924892700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39201019b0 0x7f39201012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.184+0000 7f3924892700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39201019b0 0x7f39201012d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54884/0 (socket says 172.21.15.135:54884) 2024-05-08T23:17:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.184+0000 7f3924892700 1 -- 172.21.15.135:0/2305595220 learned_addr learned my addr 172.21.15.135:0/2305595220 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.185+0000 7f391ffff700 1 --2- 172.21.15.135:0/2305595220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39201042e0 0x7f39200ff960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.185+0000 7f3925093700 1 --2- 172.21.15.135:0/2305595220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3920106c10 0x7f39200ffea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.185+0000 7f3924892700 1 -- 172.21.15.135:0/2305595220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3920106c10 msgr2=0x7f39200ffea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.185+0000 7f3924892700 1 --2- 172.21.15.135:0/2305595220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3920106c10 0x7f39200ffea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.185+0000 7f3924892700 1 -- 172.21.15.135:0/2305595220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39201042e0 msgr2=0x7f39200ff960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.185+0000 7f3924892700 1 --2- 172.21.15.135:0/2305595220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39201042e0 0x7f39200ff960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.185+0000 7f3924892700 1 -- 172.21.15.135:0/2305595220 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3918009d00 con 0x7f39201019b0 2024-05-08T23:17:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.185+0000 7f3924892700 1 --2- 172.21.15.135:0/2305595220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39201019b0 0x7f39201012d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f391400d950 tx=0x7f391400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.185+0000 7f391dffb700 1 -- 172.21.15.135:0/2305595220 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39140098e0 con 0x7f39201019b0 2024-05-08T23:17:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.185+0000 7f3926af6700 1 -- 172.21.15.135:0/2305595220 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39201a1260 con 0x7f39201019b0 2024-05-08T23:17:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.185+0000 7f391dffb700 1 -- 172.21.15.135:0/2305595220 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3914010460 con 0x7f39201019b0 2024-05-08T23:17:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.185+0000 7f391dffb700 1 -- 172.21.15.135:0/2305595220 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391400f620 con 0x7f39201019b0 2024-05-08T23:17:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.185+0000 7f3926af6700 1 -- 172.21.15.135:0/2305595220 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39201a1770 con 0x7f39201019b0 2024-05-08T23:17:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.189+0000 7f3932cb0b80 1 Processor -- start 2024-05-08T23:17:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.189+0000 7f3932cb0b80 1 -- start start 2024-05-08T23:17:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.189+0000 7f3932cb0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 0x5576a3654ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.189+0000 7f3932cb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36553e0 0x5576a3655cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.189+0000 7f3932cb0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36562d0 0x5576a3656750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.189+0000 7f3932cb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a35ac0f0 con 0x5576a36553e0 2024-05-08T23:17:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.189+0000 7f3932cb0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a35a9ab0 con 0x5576a3654a80 2024-05-08T23:17:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.189+0000 7f3932cb0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a35a53a0 con 0x5576a36562d0 2024-05-08T23:17:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.189+0000 7f3924892700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36553e0 0x5576a3655cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.189+0000 7f3924892700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36553e0 0x5576a3655cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54900/0 (socket says 172.21.15.135:54900) 2024-05-08T23:17:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.189+0000 7f3924892700 1 -- 172.21.15.135:0/2816469786 learned_addr learned my addr 172.21.15.135:0/2816469786 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.189+0000 7f3925093700 1 --2- 172.21.15.135:0/2816469786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 0x5576a3654ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.189+0000 7f391ffff700 1 --2- 172.21.15.135:0/2816469786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36562d0 0x5576a3656750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.189+0000 7f3924892700 1 -- 172.21.15.135:0/2816469786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36562d0 msgr2=0x5576a3656750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.190+0000 7f3924892700 1 --2- 172.21.15.135:0/2816469786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36562d0 0x5576a3656750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.190+0000 7f3924892700 1 -- 172.21.15.135:0/2816469786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 msgr2=0x5576a3654ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.190+0000 7f3924892700 1 --2- 172.21.15.135:0/2816469786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 0x5576a3654ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.190+0000 7f3924892700 1 -- 172.21.15.135:0/2816469786 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576a3426350 con 0x5576a36553e0 2024-05-08T23:17:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.190+0000 7f3925093700 1 --2- 172.21.15.135:0/2816469786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 0x5576a3654ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:17:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.190+0000 7f3924892700 1 --2- 172.21.15.135:0/2816469786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36553e0 0x5576a3655cf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3914010d10 tx=0x7f3914009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50282bb3b9fc1d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.191+0000 7f391dffb700 1 -- 172.21.15.135:0/2305595220 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f391402b070 con 0x7f39201019b0 2024-05-08T23:17:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.191+0000 7f390affd700 1 -- 172.21.15.135:0/2816469786 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39140ceed0 con 0x5576a36553e0 2024-05-08T23:17:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.191+0000 7f390affd700 1 -- 172.21.15.135:0/2816469786 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39140cf6e0 con 0x5576a36553e0 2024-05-08T23:17:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.191+0000 7f390affd700 1 -- 172.21.15.135:0/2816469786 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39140d09b0 con 0x5576a36553e0 2024-05-08T23:17:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.191+0000 7f391dffb700 1 --2- 172.21.15.135:0/2305595220 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f39100a1120 0x7f39100a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.192+0000 7f391dffb700 1 -- 172.21.15.135:0/2305595220 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f39140ce940 con 0x7f39201019b0 2024-05-08T23:17:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.192+0000 7f3925093700 1 --2- 172.21.15.135:0/2305595220 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f39100a1120 0x7f39100a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.192+0000 7f3932cb0b80 1 -- 172.21.15.135:0/2816469786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36553e0 msgr2=0x5576a3655cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.192+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/2816469786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36553e0 0x5576a3655cf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3914010d10 tx=0x7f3914009d20 comp rx=0 tx=0).stop 2024-05-08T23:17:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.192+0000 7f3932cb0b80 1 -- 172.21.15.135:0/2816469786 shutdown_connections 2024-05-08T23:17:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.192+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/2816469786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36562d0 0x5576a3656750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.192+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/2816469786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 0x5576a3654ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.192+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/2816469786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36553e0 0x5576a3655cf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.192+0000 7f3932cb0b80 1 -- 172.21.15.135:0/2816469786 >> 172.21.15.135:0/2816469786 conn(0x5576a35b31b0 msgr2=0x5576a3651440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.192+0000 7f3932cb0b80 1 -- 172.21.15.135:0/2816469786 shutdown_connections 2024-05-08T23:17:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.192+0000 7f3932cb0b80 1 -- 172.21.15.135:0/2816469786 wait complete. 2024-05-08T23:17:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.192+0000 7f3925093700 1 --2- 172.21.15.135:0/2305595220 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f39100a1120 0x7f39100a35e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f391800b830 tx=0x7f39180061f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.192+0000 7f3932cb0b80 1 -- start start 2024-05-08T23:17:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f3932cb0b80 1 Processor -- start 2024-05-08T23:17:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f3932cb0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 0x5576a365e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f3932cb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36553e0 0x5576a365ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f3932cb0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36562d0 0x5576a3665d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f3932cb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a3541500 con 0x5576a36553e0 2024-05-08T23:17:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f3932cb0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a35411a0 con 0x5576a3654a80 2024-05-08T23:17:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f3932cb0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a3428640 con 0x5576a36562d0 2024-05-08T23:17:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f3932cb0b80 10 client.0 _ll_register_callbacks cb 0x5576a354aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:17:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f391ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36553e0 0x5576a365ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f391ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36553e0 0x5576a365ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54914/0 (socket says 172.21.15.135:54914) 2024-05-08T23:17:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f391ffff700 1 -- 172.21.15.135:0/76971007 learned_addr learned my addr 172.21.15.135:0/76971007 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f3924892700 1 --2- 172.21.15.135:0/76971007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 0x5576a365e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f3925093700 1 --2- 172.21.15.135:0/76971007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36562d0 0x5576a3665d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f391ffff700 1 -- 172.21.15.135:0/76971007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36562d0 msgr2=0x5576a3665d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f391ffff700 1 --2- 172.21.15.135:0/76971007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36562d0 0x5576a3665d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f391ffff700 1 -- 172.21.15.135:0/76971007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 msgr2=0x5576a365e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f391ffff700 1 --2- 172.21.15.135:0/76971007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 0x5576a365e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f391ffff700 1 -- 172.21.15.135:0/76971007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39201a1770 con 0x5576a36553e0 2024-05-08T23:17:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f3924892700 1 --2- 172.21.15.135:0/76971007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 0x5576a365e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:17:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.193+0000 7f3925093700 1 --2- 172.21.15.135:0/76971007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36562d0 0x5576a3665d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:17:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f391ffff700 1 --2- 172.21.15.135:0/76971007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36553e0 0x5576a365ece0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f390c00bac0 tx=0x7f390c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9521d3e56b38155b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f38fffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:17:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f38fffff700 1 -- 172.21.15.135:0/76971007 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c004830 con 0x5576a36553e0 2024-05-08T23:17:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f38fffff700 1 -- 172.21.15.135:0/76971007 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f390c004990 con 0x5576a36553e0 2024-05-08T23:17:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f3932cb0b80 1 -- 172.21.15.135:0/76971007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5576a34fe210 con 0x5576a36553e0 2024-05-08T23:17:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f38fffff700 1 -- 172.21.15.135:0/76971007 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f390c004b50 con 0x5576a36553e0 2024-05-08T23:17:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f3932cb0b80 10 client.15489 fetch_fsmap learned FSMap version 28 2024-05-08T23:17:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f3932cb0b80 1 -- 172.21.15.135:0/76971007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5576a33d2b00 con 0x5576a36553e0 2024-05-08T23:17:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f38fffff700 1 -- 172.21.15.135:0/76971007 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5576a34fe210 con 0x5576a36553e0 2024-05-08T23:17:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f38fffff700 1 -- 172.21.15.135:0/76971007 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f390c023050 con 0x5576a36553e0 2024-05-08T23:17:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f3932cb0b80 10 client.15489 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:17:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f3932cb0b80 10 client.15489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:17:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f3932cb0b80 20 client.15489 populate_metadata read hostname 'smithi135' 2024-05-08T23:17:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/76971007 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5576a366a600 0x5576a366ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f3932cb0b80 4 client.15489 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:17:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.194+0000 7f3932cb0b80 1 -- 172.21.15.135:0/76971007 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5576a36247b0 con 0x5576a366a600 2024-05-08T23:17:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.195+0000 7f3924892700 1 --2- 172.21.15.135:0/76971007 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5576a366a600 0x5576a366ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.195+0000 7f38fffff700 10 client.15489 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.195+0000 7f3924892700 1 --2- 172.21.15.135:0/76971007 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5576a366a600 0x5576a366ca20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36c85d555dae76b5 server_cookie=4734b1d98c3f0502 in_seq=0 out_seq=0 2024-05-08T23:17:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.196+0000 7f38fffff700 1 -- 172.21.15.135:0/76971007 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5576a36247b0 con 0x5576a366a600 2024-05-08T23:17:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.196+0000 7f38fffff700 10 client.15489 handle_command_reply: tid=0 2024-05-08T23:17:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.196+0000 7f3932cb0b80 1 client.15489 shutdown 2024-05-08T23:17:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.196+0000 7f3932cb0b80 1 -- 172.21.15.135:0/76971007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36553e0 msgr2=0x5576a365ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.196+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/76971007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36553e0 0x5576a365ece0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f390c00bac0 tx=0x7f390c00be80 comp rx=0 tx=0).stop 2024-05-08T23:17:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.196+0000 7f3932cb0b80 1 -- 172.21.15.135:0/76971007 shutdown_connections 2024-05-08T23:17:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.196+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/76971007 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5576a366a600 0x5576a366ca20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.196+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/76971007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36562d0 0x5576a3665d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.196+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/76971007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 0x5576a365e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.196+0000 7f38fffff700 0 client.15489 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.196+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/76971007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36553e0 0x5576a365ece0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.196+0000 7f3932cb0b80 1 -- 172.21.15.135:0/76971007 >> 172.21.15.135:0/76971007 conn(0x5576a35b31b0 msgr2=0x5576a364f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.196+0000 7f3932cb0b80 1 -- 172.21.15.135:0/76971007 shutdown_connections 2024-05-08T23:17:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.196+0000 7f3932cb0b80 1 -- 172.21.15.135:0/76971007 wait complete. 2024-05-08T23:17:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.196+0000 7f3932cb0b80 20 client.15489 trim_cache size 0 max 16384 2024-05-08T23:17:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.211+0000 7f3932cb0b80 1 Processor -- start 2024-05-08T23:17:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.211+0000 7f3932cb0b80 1 -- start start 2024-05-08T23:17:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.211+0000 7f3932cb0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 0x5576a366c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.211+0000 7f3932cb0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36553e0 0x5576a3665ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.211+0000 7f3932cb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36562d0 0x5576a36566b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f3932cb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a3666ee0 con 0x5576a36562d0 2024-05-08T23:17:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f3932cb0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a3650b20 con 0x5576a3654a80 2024-05-08T23:17:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f3932cb0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a3671c60 con 0x5576a36553e0 2024-05-08T23:17:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f3925093700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36562d0 0x5576a36566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f3925093700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36562d0 0x5576a36566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54926/0 (socket says 172.21.15.135:54926) 2024-05-08T23:17:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f3925093700 1 -- 172.21.15.135:0/2217707476 learned_addr learned my addr 172.21.15.135:0/2217707476 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f3924892700 1 --2- 172.21.15.135:0/2217707476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 0x5576a366c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f391ffff700 1 --2- 172.21.15.135:0/2217707476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36553e0 0x5576a3665ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f3925093700 1 -- 172.21.15.135:0/2217707476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36553e0 msgr2=0x5576a3665ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f3925093700 1 --2- 172.21.15.135:0/2217707476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36553e0 0x5576a3665ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f3925093700 1 -- 172.21.15.135:0/2217707476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 msgr2=0x5576a366c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f3925093700 1 --2- 172.21.15.135:0/2217707476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 0x5576a366c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f3925093700 1 -- 172.21.15.135:0/2217707476 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576a356b500 con 0x5576a36562d0 2024-05-08T23:17:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f391ffff700 1 --2- 172.21.15.135:0/2217707476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36553e0 0x5576a3665ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:17:34.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f3925093700 1 --2- 172.21.15.135:0/2217707476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36562d0 0x5576a36566b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f391800b070 tx=0x7f391801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b806e2e8baed2e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f390b7fe700 1 -- 172.21.15.135:0/2217707476 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391800e040 con 0x5576a36562d0 2024-05-08T23:17:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f390b7fe700 1 -- 172.21.15.135:0/2217707476 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3918004c50 con 0x5576a36562d0 2024-05-08T23:17:34.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.212+0000 7f390b7fe700 1 -- 172.21.15.135:0/2217707476 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918028680 con 0x5576a36562d0 2024-05-08T23:17:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.213+0000 7f3932cb0b80 1 -- 172.21.15.135:0/2217707476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36562d0 msgr2=0x5576a36566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.213+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/2217707476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36562d0 0x5576a36566b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f391800b070 tx=0x7f391801d000 comp rx=0 tx=0).stop 2024-05-08T23:17:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.213+0000 7f3932cb0b80 1 -- 172.21.15.135:0/2217707476 shutdown_connections 2024-05-08T23:17:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.213+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/2217707476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a36562d0 0x5576a36566b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.213+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/2217707476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a3654a80 0x5576a366c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.213+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/2217707476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36553e0 0x5576a3665ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.213+0000 7f3932cb0b80 1 -- 172.21.15.135:0/2217707476 >> 172.21.15.135:0/2217707476 conn(0x5576a35b31b0 msgr2=0x5576a365d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.213+0000 7f3932cb0b80 1 -- 172.21.15.135:0/2217707476 shutdown_connections 2024-05-08T23:17:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.214+0000 7f3932cb0b80 1 -- 172.21.15.135:0/2217707476 wait complete. 2024-05-08T23:17:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.214+0000 7f3932cb0b80 1 -- start start 2024-05-08T23:17:34.218 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.214+0000 7f3932cb0b80 1 Processor -- start 2024-05-08T23:17:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.214+0000 7f3932cb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a3654a80 0x5576a3663190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.214+0000 7f3932cb0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36553e0 0x5576a36636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3932cb0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a36562d0 0x5576a36646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3932cb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a3664c20 con 0x5576a3654a80 2024-05-08T23:17:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3932cb0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a3664d90 con 0x5576a36562d0 2024-05-08T23:17:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3932cb0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a3664f50 con 0x5576a36553e0 2024-05-08T23:17:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3932cb0b80 10 client.0 _ll_register_callbacks cb 0x5576a354aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:17:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3924892700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a3654a80 0x5576a3663190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3924892700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a3654a80 0x5576a3663190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54930/0 (socket says 172.21.15.135:54930) 2024-05-08T23:17:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3924892700 1 -- 172.21.15.135:0/1343584697 learned_addr learned my addr 172.21.15.135:0/1343584697 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f391ffff700 1 --2- 172.21.15.135:0/1343584697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36553e0 0x5576a36636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3925093700 1 --2- 172.21.15.135:0/1343584697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a36562d0 0x5576a36646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3924892700 1 -- 172.21.15.135:0/1343584697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36553e0 msgr2=0x5576a36636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:34.219 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3924892700 1 --2- 172.21.15.135:0/1343584697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36553e0 0x5576a36636d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3924892700 1 -- 172.21.15.135:0/1343584697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a36562d0 msgr2=0x5576a36646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3924892700 1 --2- 172.21.15.135:0/1343584697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a36562d0 0x5576a36646e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3924892700 1 -- 172.21.15.135:0/1343584697 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3920109c70 con 0x5576a3654a80 2024-05-08T23:17:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f391ffff700 1 --2- 172.21.15.135:0/1343584697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36553e0 0x5576a36636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:17:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3924892700 1 --2- 172.21.15.135:0/1343584697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a3654a80 0x5576a3663190 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f391402bff0 tx=0x7f3914010950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0a58057a08a28e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f38fffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:17:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f38fffff700 1 -- 172.21.15.135:0/1343584697 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914009e40 con 0x5576a3654a80 2024-05-08T23:17:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f38fffff700 1 -- 172.21.15.135:0/1343584697 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f391409c610 con 0x5576a3654a80 2024-05-08T23:17:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3932cb0b80 1 -- 172.21.15.135:0/1343584697 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39140cf6e0 con 0x5576a3654a80 2024-05-08T23:17:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f38fffff700 1 -- 172.21.15.135:0/1343584697 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f391409bf10 con 0x5576a3654a80 2024-05-08T23:17:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3932cb0b80 10 client.15495 fetch_fsmap learned FSMap version 28 2024-05-08T23:17:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.215+0000 7f3932cb0b80 1 -- 172.21.15.135:0/1343584697 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5576a342ac70 con 0x5576a3654a80 2024-05-08T23:17:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.216+0000 7f38fffff700 1 -- 172.21.15.135:0/1343584697 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39140cf6e0 con 0x5576a3654a80 2024-05-08T23:17:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.216+0000 7f38fffff700 1 -- 172.21.15.135:0/1343584697 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f391409c170 con 0x5576a3654a80 2024-05-08T23:17:34.220 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.216+0000 7f3932cb0b80 10 client.15495 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:17:34.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.216+0000 7f3932cb0b80 10 client.15495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:17:34.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.216+0000 7f3932cb0b80 20 client.15495 populate_metadata read hostname 'smithi135' 2024-05-08T23:17:34.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.216+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/1343584697 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5576a36c0e40 0x5576a36c3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:34.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.216+0000 7f3932cb0b80 4 client.15495 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T23:17:34.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.216+0000 7f3932cb0b80 1 -- 172.21.15.135:0/1343584697 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5576a359de60 con 0x5576a36c0e40 2024-05-08T23:17:34.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.216+0000 7f391ffff700 1 --2- 172.21.15.135:0/1343584697 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5576a36c0e40 0x5576a36c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:34.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.217+0000 7f38fffff700 10 client.15495 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:34.221 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.217+0000 7f391ffff700 1 --2- 172.21.15.135:0/1343584697 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5576a36c0e40 0x5576a36c3260 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=704b8b2c9e0fbbcb server_cookie=ece06fead229600b in_seq=0 out_seq=0 2024-05-08T23:17:34.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.227+0000 7f38fffff700 1 -- 172.21.15.135:0/1343584697 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5576a359de60 con 0x5576a36c0e40 2024-05-08T23:17:34.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.227+0000 7f38fffff700 10 client.15495 handle_command_reply: tid=0 2024-05-08T23:17:34.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.227+0000 7f3932cb0b80 1 client.15495 shutdown 2024-05-08T23:17:34.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.227+0000 7f3932cb0b80 1 -- 172.21.15.135:0/1343584697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a3654a80 msgr2=0x5576a3663190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:34.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.227+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/1343584697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a3654a80 0x5576a3663190 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f391402bff0 tx=0x7f3914010950 comp rx=0 tx=0).stop 2024-05-08T23:17:34.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.227+0000 7f3932cb0b80 1 -- 172.21.15.135:0/1343584697 shutdown_connections 2024-05-08T23:17:34.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.227+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/1343584697 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x5576a36c0e40 0x5576a36c3260 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.227+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/1343584697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5576a36562d0 0x5576a36646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.227+0000 7f38fffff700 0 client.15495 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:34.227 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.227+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/1343584697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a3654a80 0x5576a3663190 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.227+0000 7f3932cb0b80 1 --2- 172.21.15.135:0/1343584697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5576a36553e0 0x5576a36636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.227+0000 7f3932cb0b80 1 -- 172.21.15.135:0/1343584697 >> 172.21.15.135:0/1343584697 conn(0x5576a35b31b0 msgr2=0x5576a365dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:34.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.227+0000 7f3932cb0b80 1 -- 172.21.15.135:0/1343584697 shutdown_connections 2024-05-08T23:17:34.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.227+0000 7f3932cb0b80 1 -- 172.21.15.135:0/1343584697 wait complete. 2024-05-08T23:17:34.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.227+0000 7f3932cb0b80 20 client.15495 trim_cache size 0 max 16384 2024-05-08T23:17:34.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-08T23:17:34.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-08T23:17:34.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-08T23:17:34.228 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-08T23:17:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.228+0000 7f3926af6700 1 -- 172.21.15.135:0/2305595220 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f39100a1120 msgr2=0x7f39100a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.228+0000 7f3926af6700 1 --2- 172.21.15.135:0/2305595220 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f39100a1120 0x7f39100a35e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f391800b830 tx=0x7f39180061f0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.228+0000 7f3926af6700 1 -- 172.21.15.135:0/2305595220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39201019b0 msgr2=0x7f39201012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.228+0000 7f3926af6700 1 --2- 172.21.15.135:0/2305595220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39201019b0 0x7f39201012d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f391400d950 tx=0x7f391400dc60 comp rx=0 tx=0).stop 2024-05-08T23:17:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.228+0000 7f3926af6700 1 -- 172.21.15.135:0/2305595220 shutdown_connections 2024-05-08T23:17:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.228+0000 7f3926af6700 1 --2- 172.21.15.135:0/2305595220 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f39100a1120 0x7f39100a35e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.228+0000 7f3926af6700 1 --2- 172.21.15.135:0/2305595220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3920106c10 0x7f39200ffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.228+0000 7f3926af6700 1 --2- 172.21.15.135:0/2305595220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39201019b0 0x7f39201012d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.228+0000 7f3926af6700 1 --2- 172.21.15.135:0/2305595220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39201042e0 0x7f39200ff960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.228+0000 7f3926af6700 1 -- 172.21.15.135:0/2305595220 >> 172.21.15.135:0/2305595220 conn(0x7f39200fb3a0 msgr2=0x7f3920102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.228+0000 7f3926af6700 1 -- 172.21.15.135:0/2305595220 shutdown_connections 2024-05-08T23:17:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:34.228+0000 7f3926af6700 1 -- 172.21.15.135:0/2305595220 wait complete. 2024-05-08T23:17:34.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:34 smithi179 ceph-mon[46314]: pgmap v321: 97 pgs: 97 active+clean; 114 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 20 op/s 2024-05-08T23:17:34.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:34 smithi195 ceph-mon[46516]: pgmap v321: 97 pgs: 97 active+clean; 114 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 20 op/s 2024-05-08T23:17:34.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:34 smithi135 ceph-mon[42440]: pgmap v321: 97 pgs: 97 active+clean; 114 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 20 op/s 2024-05-08T23:17:36.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:36 smithi179 ceph-mon[46314]: pgmap v322: 97 pgs: 97 active+clean; 174 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 15 op/s 2024-05-08T23:17:36.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:36 smithi195 ceph-mon[46516]: pgmap v322: 97 pgs: 97 active+clean; 174 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 15 op/s 2024-05-08T23:17:36.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:36 smithi135 ceph-mon[42440]: pgmap v322: 97 pgs: 97 active+clean; 174 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 15 op/s 2024-05-08T23:17:38.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:38 smithi179 ceph-mon[46314]: pgmap v323: 97 pgs: 97 active+clean; 258 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 MiB/s wr, 19 op/s 2024-05-08T23:17:38.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:38 smithi195 ceph-mon[46516]: pgmap v323: 97 pgs: 97 active+clean; 258 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 MiB/s wr, 19 op/s 2024-05-08T23:17:38.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:38 smithi135 ceph-mon[42440]: pgmap v323: 97 pgs: 97 active+clean; 258 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 MiB/s wr, 19 op/s 2024-05-08T23:17:40.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:40 smithi179 ceph-mon[46314]: pgmap v324: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 MiB/s wr, 22 op/s 2024-05-08T23:17:40.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:40 smithi195 ceph-mon[46516]: pgmap v324: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 MiB/s wr, 22 op/s 2024-05-08T23:17:40.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:40 smithi135 ceph-mon[42440]: pgmap v324: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 MiB/s wr, 22 op/s 2024-05-08T23:17:42.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:42 smithi179 ceph-mon[46314]: pgmap v325: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 MiB/s wr, 19 op/s 2024-05-08T23:17:42.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:42 smithi195 ceph-mon[46516]: pgmap v325: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 MiB/s wr, 19 op/s 2024-05-08T23:17:42.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:42 smithi135 ceph-mon[42440]: pgmap v325: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 MiB/s wr, 19 op/s 2024-05-08T23:17:44.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:44 smithi179 ceph-mon[46314]: pgmap v326: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 23 op/s 2024-05-08T23:17:44.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:44 smithi195 ceph-mon[46516]: pgmap v326: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 23 op/s 2024-05-08T23:17:44.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:44 smithi135 ceph-mon[42440]: pgmap v326: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 23 op/s 2024-05-08T23:17:46.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:46 smithi179 ceph-mon[46314]: pgmap v327: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 17 op/s 2024-05-08T23:17:46.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:46 smithi195 ceph-mon[46516]: pgmap v327: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 17 op/s 2024-05-08T23:17:46.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:46 smithi135 ceph-mon[42440]: pgmap v327: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 17 op/s 2024-05-08T23:17:47.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.346+0000 7f8ae9a74700 1 -- 172.21.15.135:0/2180695071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae4104350 msgr2=0x7f8ae4106740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:47.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.346+0000 7f8ae9a74700 1 --2- 172.21.15.135:0/2180695071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae4104350 0x7f8ae4106740 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009990 tx=0x7f8ad8009ca0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.346+0000 7f8ae9a74700 1 -- 172.21.15.135:0/2180695071 shutdown_connections 2024-05-08T23:17:47.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.346+0000 7f8ae9a74700 1 --2- 172.21.15.135:0/2180695071 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ae4106c80 0x7f8ae4109070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.346+0000 7f8ae9a74700 1 --2- 172.21.15.135:0/2180695071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae4101a20 0x7f8ae4103e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.346+0000 7f8ae9a74700 1 --2- 172.21.15.135:0/2180695071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae4104350 0x7f8ae4106740 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.346+0000 7f8ae9a74700 1 -- 172.21.15.135:0/2180695071 >> 172.21.15.135:0/2180695071 conn(0x7f8ae40fb390 msgr2=0x7f8ae40fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:47.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.346+0000 7f8ae9a74700 1 -- 172.21.15.135:0/2180695071 shutdown_connections 2024-05-08T23:17:47.390 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.346+0000 7f8ae9a74700 1 -- 172.21.15.135:0/2180695071 wait complete. 2024-05-08T23:17:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.346+0000 7f8ae9a74700 1 Processor -- start 2024-05-08T23:17:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae9a74700 1 -- start start 2024-05-08T23:17:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae9a74700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ae4101a20 0x7f8ae4196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae9a74700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae4104350 0x7f8ae4197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae9a74700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae4106c80 0x7f8ae419e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae9a74700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae419e8e0 con 0x7f8ae4106c80 2024-05-08T23:17:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae9a74700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae419ea20 con 0x7f8ae4104350 2024-05-08T23:17:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae9a74700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae419ebb0 con 0x7f8ae4101a20 2024-05-08T23:17:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae4106c80 0x7f8ae419e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae4106c80 0x7f8ae419e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50756/0 (socket says 172.21.15.135:50756) 2024-05-08T23:17:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae3fff700 1 -- 172.21.15.135:0/3146621660 learned_addr learned my addr 172.21.15.135:0/3146621660 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae2ffd700 1 --2- 172.21.15.135:0/3146621660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae4104350 0x7f8ae4197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae37fe700 1 --2- 172.21.15.135:0/3146621660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ae4101a20 0x7f8ae4196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae3fff700 1 -- 172.21.15.135:0/3146621660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ae4101a20 msgr2=0x7f8ae4196e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae3fff700 1 --2- 172.21.15.135:0/3146621660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ae4101a20 0x7f8ae4196e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae3fff700 1 -- 172.21.15.135:0/3146621660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae4104350 msgr2=0x7f8ae4197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae3fff700 1 --2- 172.21.15.135:0/3146621660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae4104350 0x7f8ae4197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae3fff700 1 -- 172.21.15.135:0/3146621660 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad80095f0 con 0x7f8ae4106c80 2024-05-08T23:17:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae3fff700 1 --2- 172.21.15.135:0/3146621660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae4106c80 0x7f8ae419e310 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8adc007d70 tx=0x7f8adc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.347+0000 7f8ae0ff9700 1 -- 172.21.15.135:0/3146621660 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc00ad40 con 0x7f8ae4106c80 2024-05-08T23:17:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.348+0000 7f8ae9a74700 1 -- 172.21.15.135:0/3146621660 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae419ee90 con 0x7f8ae4106c80 2024-05-08T23:17:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.348+0000 7f8ae0ff9700 1 -- 172.21.15.135:0/3146621660 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8adc0128e0 con 0x7f8ae4106c80 2024-05-08T23:17:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.348+0000 7f8ae0ff9700 1 -- 172.21.15.135:0/3146621660 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0116b0 con 0x7f8ae4106c80 2024-05-08T23:17:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.348+0000 7f8ae9a74700 1 -- 172.21.15.135:0/3146621660 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae419f310 con 0x7f8ae4106c80 2024-05-08T23:17:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.350+0000 7f8ae0ff9700 1 -- 172.21.15.135:0/3146621660 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f8adc012420 con 0x7f8ae4106c80 2024-05-08T23:17:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.351+0000 7f8ae0ff9700 1 --2- 172.21.15.135:0/3146621660 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8acc0a1120 0x7f8acc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.351+0000 7f8ae0ff9700 1 -- 172.21.15.135:0/3146621660 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8adc0ccb80 con 0x7f8ae4106c80 2024-05-08T23:17:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.351+0000 7f8ae37fe700 1 --2- 172.21.15.135:0/3146621660 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8acc0a1120 0x7f8acc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.352+0000 7f8ae37fe700 1 --2- 172.21.15.135:0/3146621660 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8acc0a1120 0x7f8acc0a35e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4005fd0 tx=0x7f8ad400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.352+0000 7f8af5c2eb80 1 Processor -- start 2024-05-08T23:17:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.352+0000 7f8af5c2eb80 1 -- start start 2024-05-08T23:17:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.352+0000 7f8af5c2eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b430a80 0x561d7b430ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.352+0000 7f8af5c2eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4313e0 0x561d7b431cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.352+0000 7f8af5c2eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4322d0 0x561d7b432750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.352+0000 7f8af5c2eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7b3880f0 con 0x561d7b4322d0 2024-05-08T23:17:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.352+0000 7f8af5c2eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7b385ab0 con 0x561d7b4313e0 2024-05-08T23:17:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.352+0000 7f8af5c2eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7b3813a0 con 0x561d7b430a80 2024-05-08T23:17:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.352+0000 7f8ae3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4322d0 0x561d7b432750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.353+0000 7f8ae3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4322d0 0x561d7b432750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50758/0 (socket says 172.21.15.135:50758) 2024-05-08T23:17:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.353+0000 7f8ae3fff700 1 -- 172.21.15.135:0/2470239325 learned_addr learned my addr 172.21.15.135:0/2470239325 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.353+0000 7f8ae37fe700 1 --2- 172.21.15.135:0/2470239325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b430a80 0x561d7b430ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.353+0000 7f8ae2ffd700 1 --2- 172.21.15.135:0/2470239325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4313e0 0x561d7b431cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.353+0000 7f8ae3fff700 1 -- 172.21.15.135:0/2470239325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b430a80 msgr2=0x561d7b430ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.353+0000 7f8ae3fff700 1 --2- 172.21.15.135:0/2470239325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b430a80 0x561d7b430ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.353+0000 7f8ae3fff700 1 -- 172.21.15.135:0/2470239325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4313e0 msgr2=0x561d7b431cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.353+0000 7f8ae3fff700 1 --2- 172.21.15.135:0/2470239325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4313e0 0x561d7b431cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.353+0000 7f8ae3fff700 1 -- 172.21.15.135:0/2470239325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d7b202350 con 0x561d7b4322d0 2024-05-08T23:17:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.353+0000 7f8ae3fff700 1 --2- 172.21.15.135:0/2470239325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4322d0 0x561d7b432750 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0a1f00 tx=0x7f8adc099c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc0d2b2d991f6bf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.353+0000 7f8ac9ffb700 1 -- 172.21.15.135:0/2470239325 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc099fb0 con 0x561d7b4322d0 2024-05-08T23:17:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.353+0000 7f8ac9ffb700 1 -- 172.21.15.135:0/2470239325 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8adc09dde0 con 0x561d7b4322d0 2024-05-08T23:17:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.353+0000 7f8ac9ffb700 1 -- 172.21.15.135:0/2470239325 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc099700 con 0x561d7b4322d0 2024-05-08T23:17:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.354+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2470239325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4322d0 msgr2=0x561d7b432750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.354+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/2470239325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4322d0 0x561d7b432750 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0a1f00 tx=0x7f8adc099c20 comp rx=0 tx=0).stop 2024-05-08T23:17:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.354+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2470239325 shutdown_connections 2024-05-08T23:17:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.354+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/2470239325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b430a80 0x561d7b430ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.354+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/2470239325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4322d0 0x561d7b432750 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.354+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/2470239325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4313e0 0x561d7b431cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.354+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2470239325 >> 172.21.15.135:0/2470239325 conn(0x561d7b38f1b0 msgr2=0x561d7b42d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.354+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2470239325 shutdown_connections 2024-05-08T23:17:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.354+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2470239325 wait complete. 2024-05-08T23:17:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.354+0000 7f8af5c2eb80 1 -- start start 2024-05-08T23:17:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8af5c2eb80 1 Processor -- start 2024-05-08T23:17:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8af5c2eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b430a80 0x561d7b43a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8af5c2eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4313e0 0x561d7b43ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8af5c2eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4322d0 0x561d7b441eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8af5c2eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7b31d500 con 0x561d7b4313e0 2024-05-08T23:17:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8af5c2eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7b31d1a0 con 0x561d7b4322d0 2024-05-08T23:17:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8af5c2eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7b204640 con 0x561d7b430a80 2024-05-08T23:17:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8af5c2eb80 10 client.0 _ll_register_callbacks cb 0x561d7b326ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:17:47.408 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8ae2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4313e0 0x561d7b43ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.408 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8ae2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4313e0 0x561d7b43ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50768/0 (socket says 172.21.15.135:50768) 2024-05-08T23:17:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8ae2ffd700 1 -- 172.21.15.135:0/1287371938 learned_addr learned my addr 172.21.15.135:0/1287371938 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8ae37fe700 1 --2- 172.21.15.135:0/1287371938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b430a80 0x561d7b43a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8ae3fff700 1 --2- 172.21.15.135:0/1287371938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4322d0 0x561d7b441eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8ae2ffd700 1 -- 172.21.15.135:0/1287371938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b430a80 msgr2=0x561d7b43a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8ae2ffd700 1 --2- 172.21.15.135:0/1287371938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b430a80 0x561d7b43a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8ae2ffd700 1 -- 172.21.15.135:0/1287371938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4322d0 msgr2=0x561d7b441eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8ae2ffd700 1 --2- 172.21.15.135:0/1287371938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4322d0 0x561d7b441eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8ae2ffd700 1 -- 172.21.15.135:0/1287371938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae419f310 con 0x561d7b4313e0 2024-05-08T23:17:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8ae37fe700 1 --2- 172.21.15.135:0/1287371938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b430a80 0x561d7b43a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:17:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8ae2ffd700 1 --2- 172.21.15.135:0/1287371938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4313e0 0x561d7b43ae70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8015000 tx=0x7f8ad8009fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfb6090b9178f0d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.355+0000 7f8ac2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:17:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.356+0000 7f8ac2ffd700 1 -- 172.21.15.135:0/1287371938 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad801d040 con 0x561d7b4313e0 2024-05-08T23:17:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.356+0000 7f8ac2ffd700 1 -- 172.21.15.135:0/1287371938 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8ad8003ca0 con 0x561d7b4313e0 2024-05-08T23:17:47.410 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.356+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/1287371938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d7b2da210 con 0x561d7b4313e0 2024-05-08T23:17:47.410 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.356+0000 7f8ac2ffd700 1 -- 172.21.15.135:0/1287371938 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ad8003e60 con 0x561d7b4313e0 2024-05-08T23:17:47.410 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.356+0000 7f8af5c2eb80 10 client.15507 fetch_fsmap learned FSMap version 28 2024-05-08T23:17:47.410 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.356+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/1287371938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x561d7b1aeb00 con 0x561d7b4313e0 2024-05-08T23:17:47.410 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.356+0000 7f8ac2ffd700 1 -- 172.21.15.135:0/1287371938 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ad8033080 con 0x561d7b4313e0 2024-05-08T23:17:47.410 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.356+0000 7f8ac2ffd700 1 -- 172.21.15.135:0/1287371938 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8ad802d030 con 0x561d7b4313e0 2024-05-08T23:17:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.356+0000 7f8af5c2eb80 10 client.15507 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:17:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.356+0000 7f8af5c2eb80 10 client.15507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:17:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.356+0000 7f8af5c2eb80 20 client.15507 populate_metadata read hostname 'smithi135' 2024-05-08T23:17:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.356+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/1287371938 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x561d7b446760 0x561d7b448b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.356+0000 7f8af5c2eb80 4 client.15507 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:17:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.356+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/1287371938 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d7b4007b0 con 0x561d7b446760 2024-05-08T23:17:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.356+0000 7f8ae37fe700 1 --2- 172.21.15.135:0/1287371938 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x561d7b446760 0x561d7b448b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.357+0000 7f8ac2ffd700 10 client.15507 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.357+0000 7f8ae37fe700 1 --2- 172.21.15.135:0/1287371938 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x561d7b446760 0x561d7b448b80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a92b0381e94eb47 server_cookie=7d5c358dec10ede1 in_seq=0 out_seq=0 2024-05-08T23:17:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.357+0000 7f8ac2ffd700 1 -- 172.21.15.135:0/1287371938 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561d7b4007b0 con 0x561d7b446760 2024-05-08T23:17:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.357+0000 7f8ac2ffd700 10 client.15507 handle_command_reply: tid=0 2024-05-08T23:17:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.358+0000 7f8af5c2eb80 1 client.15507 shutdown 2024-05-08T23:17:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.358+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/1287371938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4313e0 msgr2=0x561d7b43ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.358+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/1287371938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4313e0 0x561d7b43ae70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8015000 tx=0x7f8ad8009fb0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.358+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/1287371938 shutdown_connections 2024-05-08T23:17:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.358+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/1287371938 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x561d7b446760 0x561d7b448b80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.358+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/1287371938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b430a80 0x561d7b43a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.358+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/1287371938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4322d0 0x561d7b441eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.358+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/1287371938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4313e0 0x561d7b43ae70 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.358+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/1287371938 >> 172.21.15.135:0/1287371938 conn(0x561d7b38f1b0 msgr2=0x561d7b42b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.358+0000 7f8ac2ffd700 0 client.15507 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.358+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/1287371938 shutdown_connections 2024-05-08T23:17:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.358+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/1287371938 wait complete. 2024-05-08T23:17:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.358+0000 7f8af5c2eb80 20 client.15507 trim_cache size 0 max 16384 2024-05-08T23:17:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.373+0000 7f8af5c2eb80 1 Processor -- start 2024-05-08T23:17:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.373+0000 7f8af5c2eb80 1 -- start start 2024-05-08T23:17:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.373+0000 7f8af5c2eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b430a80 0x561d7b439540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.373+0000 7f8af5c2eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b4313e0 0x561d7b432710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.373+0000 7f8af5c2eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4322d0 0x561d7b439e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.373+0000 7f8af5c2eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7b431f00 con 0x561d7b430a80 2024-05-08T23:17:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.373+0000 7f8af5c2eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7b432100 con 0x561d7b4322d0 2024-05-08T23:17:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.373+0000 7f8af5c2eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7b438520 con 0x561d7b4313e0 2024-05-08T23:17:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.374+0000 7f8ae3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4322d0 0x561d7b439e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.374+0000 7f8ae37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b430a80 0x561d7b439540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.374+0000 7f8ae3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4322d0 0x561d7b439e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.135:51408/0 (socket says 172.21.15.135:51408) 2024-05-08T23:17:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.374+0000 7f8ae2ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b4313e0 0x561d7b432710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.374+0000 7f8ae3fff700 1 -- 172.21.15.135:0/2522144721 learned_addr learned my addr 172.21.15.135:0/2522144721 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.374+0000 7f8ae3fff700 1 -- 172.21.15.135:0/2522144721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b4313e0 msgr2=0x561d7b432710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.374+0000 7f8ae3fff700 1 --2- 172.21.15.135:0/2522144721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b4313e0 0x561d7b432710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.374+0000 7f8ae3fff700 1 -- 172.21.15.135:0/2522144721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b430a80 msgr2=0x561d7b439540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.374+0000 7f8ae3fff700 1 --2- 172.21.15.135:0/2522144721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b430a80 0x561d7b439540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.374+0000 7f8ae3fff700 1 -- 172.21.15.135:0/2522144721 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d7b347500 con 0x561d7b4322d0 2024-05-08T23:17:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.374+0000 7f8ae3fff700 1 --2- 172.21.15.135:0/2522144721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4322d0 0x561d7b439e40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00afd0 tx=0x7f8adc099eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2cd9663c3661e0a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.374+0000 7f8aca7fc700 1 -- 172.21.15.135:0/2522144721 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc099fb0 con 0x561d7b4322d0 2024-05-08T23:17:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.374+0000 7f8aca7fc700 1 -- 172.21.15.135:0/2522144721 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8adc0a2430 con 0x561d7b4322d0 2024-05-08T23:17:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.374+0000 7f8aca7fc700 1 -- 172.21.15.135:0/2522144721 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0a1fa0 con 0x561d7b4322d0 2024-05-08T23:17:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.375+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2522144721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4322d0 msgr2=0x561d7b439e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.375+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/2522144721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4322d0 0x561d7b439e40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00afd0 tx=0x7f8adc099eb0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.375+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2522144721 shutdown_connections 2024-05-08T23:17:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.375+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/2522144721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b4322d0 0x561d7b439e40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.375+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/2522144721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b430a80 0x561d7b439540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.375+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/2522144721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b4313e0 0x561d7b432710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.375+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2522144721 >> 172.21.15.135:0/2522144721 conn(0x561d7b38f1b0 msgr2=0x561d7b4388a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:47.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.375+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2522144721 shutdown_connections 2024-05-08T23:17:47.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.375+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2522144721 wait complete. 2024-05-08T23:17:47.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.375+0000 7f8af5c2eb80 1 -- start start 2024-05-08T23:17:47.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.376+0000 7f8af5c2eb80 1 Processor -- start 2024-05-08T23:17:47.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.376+0000 7f8af5c2eb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b430a80 0x561d7b43f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.376+0000 7f8af5c2eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b4313e0 0x561d7b43f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.376+0000 7f8af5c2eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4322d0 0x561d7b49ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.376+0000 7f8af5c2eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7b43fd60 con 0x561d7b4322d0 2024-05-08T23:17:47.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.376+0000 7f8af5c2eb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7b49b180 con 0x561d7b430a80 2024-05-08T23:17:47.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.376+0000 7f8af5c2eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7b49b310 con 0x561d7b4313e0 2024-05-08T23:17:47.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.376+0000 7f8af5c2eb80 10 client.0 _ll_register_callbacks cb 0x561d7b326ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:17:47.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.376+0000 7f8ae3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4322d0 0x561d7b49ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.376+0000 7f8ae3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4322d0 0x561d7b49ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50788/0 (socket says 172.21.15.135:50788) 2024-05-08T23:17:47.415 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.376+0000 7f8ae3fff700 1 -- 172.21.15.135:0/2576180126 learned_addr learned my addr 172.21.15.135:0/2576180126 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:17:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.376+0000 7f8ae37fe700 1 --2- 172.21.15.135:0/2576180126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b430a80 0x561d7b43f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.376+0000 7f8ae2ffd700 1 --2- 172.21.15.135:0/2576180126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b4313e0 0x561d7b43f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8ae3fff700 1 -- 172.21.15.135:0/2576180126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b4313e0 msgr2=0x561d7b43f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8ae3fff700 1 --2- 172.21.15.135:0/2576180126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b4313e0 0x561d7b43f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8ae3fff700 1 -- 172.21.15.135:0/2576180126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b430a80 msgr2=0x561d7b43f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:17:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8ae3fff700 1 --2- 172.21.15.135:0/2576180126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b430a80 0x561d7b43f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8ae3fff700 1 -- 172.21.15.135:0/2576180126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d7b202350 con 0x561d7b4322d0 2024-05-08T23:17:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8ae37fe700 1 --2- 172.21.15.135:0/2576180126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b430a80 0x561d7b43f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:17:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8ae3fff700 1 --2- 172.21.15.135:0/2576180126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4322d0 0x561d7b49ac40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8adc096460 tx=0x7f8adc099c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d20a3953f31ca7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:17:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8ac2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:17:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8ac2ffd700 1 -- 172.21.15.135:0/2576180126 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc099fb0 con 0x561d7b4322d0 2024-05-08T23:17:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8ac2ffd700 1 -- 172.21.15.135:0/2576180126 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8adc0b8280 con 0x561d7b4322d0 2024-05-08T23:17:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2576180126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8adc09dde0 con 0x561d7b4322d0 2024-05-08T23:17:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8ac2ffd700 1 -- 172.21.15.135:0/2576180126 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8adc0995a0 con 0x561d7b4322d0 2024-05-08T23:17:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8af5c2eb80 10 client.15513 fetch_fsmap learned FSMap version 28 2024-05-08T23:17:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2576180126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x561d7b206c70 con 0x561d7b4322d0 2024-05-08T23:17:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8ac2ffd700 1 -- 172.21.15.135:0/2576180126 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8adc09dde0 con 0x561d7b4322d0 2024-05-08T23:17:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8ac2ffd700 1 -- 172.21.15.135:0/2576180126 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8adc094c50 con 0x561d7b4322d0 2024-05-08T23:17:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8af5c2eb80 10 client.15513 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:17:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8af5c2eb80 10 client.15513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:17:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8af5c2eb80 20 client.15513 populate_metadata read hostname 'smithi135' 2024-05-08T23:17:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/2576180126 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x561d7b49c890 0x561d7b49ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:17:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8af5c2eb80 4 client.15513 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T23:17:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.377+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2576180126 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561d7b379e60 con 0x561d7b49c890 2024-05-08T23:17:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.378+0000 7f8ae37fe700 1 --2- 172.21.15.135:0/2576180126 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x561d7b49c890 0x561d7b49ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:17:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.378+0000 7f8ac2ffd700 10 client.15513 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.378+0000 7f8ae37fe700 1 --2- 172.21.15.135:0/2576180126 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x561d7b49c890 0x561d7b49ec80 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb5063fdc86aaec0 server_cookie=102b08c631ee2d78 in_seq=0 out_seq=0 2024-05-08T23:17:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.388+0000 7f8ac2ffd700 1 -- 172.21.15.135:0/2576180126 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561d7b379e60 con 0x561d7b49c890 2024-05-08T23:17:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.388+0000 7f8ac2ffd700 10 client.15513 handle_command_reply: tid=0 2024-05-08T23:17:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.388+0000 7f8af5c2eb80 1 client.15513 shutdown 2024-05-08T23:17:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2576180126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4322d0 msgr2=0x561d7b49ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/2576180126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4322d0 0x561d7b49ac40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8adc096460 tx=0x7f8adc099c20 comp rx=0 tx=0).stop 2024-05-08T23:17:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2576180126 shutdown_connections 2024-05-08T23:17:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/2576180126 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x561d7b49c890 0x561d7b49ec80 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/2576180126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561d7b4322d0 0x561d7b49ac40 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8ac2ffd700 0 client.15513 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:17:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/2576180126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561d7b430a80 0x561d7b43f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8af5c2eb80 1 --2- 172.21.15.135:0/2576180126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d7b4313e0 0x561d7b43f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2576180126 >> 172.21.15.135:0/2576180126 conn(0x561d7b38f1b0 msgr2=0x561d7b438840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2576180126 shutdown_connections 2024-05-08T23:17:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8af5c2eb80 1 -- 172.21.15.135:0/2576180126 wait complete. 2024-05-08T23:17:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8af5c2eb80 20 client.15513 trim_cache size 0 max 16384 2024-05-08T23:17:47.419 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-08T23:17:47.419 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-08T23:17:47.419 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-08T23:17:47.419 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-08T23:17:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8ae9a74700 1 -- 172.21.15.135:0/3146621660 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8acc0a1120 msgr2=0x7f8acc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8ae9a74700 1 --2- 172.21.15.135:0/3146621660 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8acc0a1120 0x7f8acc0a35e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4005fd0 tx=0x7f8ad400a560 comp rx=0 tx=0).stop 2024-05-08T23:17:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8ae9a74700 1 -- 172.21.15.135:0/3146621660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae4106c80 msgr2=0x7f8ae419e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:17:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8ae9a74700 1 --2- 172.21.15.135:0/3146621660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae4106c80 0x7f8ae419e310 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8adc007d70 tx=0x7f8adc00a340 comp rx=0 tx=0).stop 2024-05-08T23:17:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8ae9a74700 1 -- 172.21.15.135:0/3146621660 shutdown_connections 2024-05-08T23:17:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8ae9a74700 1 --2- 172.21.15.135:0/3146621660 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f8acc0a1120 0x7f8acc0a35e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8ae9a74700 1 --2- 172.21.15.135:0/3146621660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ae4101a20 0x7f8ae4196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8ae9a74700 1 --2- 172.21.15.135:0/3146621660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ae4106c80 0x7f8ae419e310 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8ae9a74700 1 --2- 172.21.15.135:0/3146621660 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ae4104350 0x7f8ae4197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:17:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.389+0000 7f8ae9a74700 1 -- 172.21.15.135:0/3146621660 >> 172.21.15.135:0/3146621660 conn(0x7f8ae40fb390 msgr2=0x7f8ae41024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:17:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.390+0000 7f8ae9a74700 1 -- 172.21.15.135:0/3146621660 shutdown_connections 2024-05-08T23:17:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:17:47.390+0000 7f8ae9a74700 1 -- 172.21.15.135:0/3146621660 wait complete. 2024-05-08T23:17:48.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:48 smithi179 ceph-mon[46314]: pgmap v328: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 17 op/s 2024-05-08T23:17:48.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:48 smithi195 ceph-mon[46516]: pgmap v328: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 17 op/s 2024-05-08T23:17:48.705 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:48 smithi135 ceph-mon[42440]: pgmap v328: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 17 op/s 2024-05-08T23:17:50.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:50 smithi179 ceph-mon[46314]: pgmap v329: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 778 KiB/s wr, 16 op/s 2024-05-08T23:17:50.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:50 smithi195 ceph-mon[46516]: pgmap v329: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 778 KiB/s wr, 16 op/s 2024-05-08T23:17:50.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:50 smithi135 ceph-mon[42440]: pgmap v329: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 778 KiB/s wr, 16 op/s 2024-05-08T23:17:52.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:52 smithi179 ceph-mon[46314]: pgmap v330: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 774 KiB/s wr, 12 op/s 2024-05-08T23:17:52.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:52 smithi195 ceph-mon[46516]: pgmap v330: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 774 KiB/s wr, 12 op/s 2024-05-08T23:17:52.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:52 smithi135 ceph-mon[42440]: pgmap v330: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 774 KiB/s wr, 12 op/s 2024-05-08T23:17:53.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:53 smithi179 ceph-mon[46314]: pgmap v331: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-05-08T23:17:53.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:53 smithi195 ceph-mon[46516]: pgmap v331: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-05-08T23:17:53.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:53 smithi135 ceph-mon[42440]: pgmap v331: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-05-08T23:17:56.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:56 smithi135 ceph-mon[42440]: pgmap v332: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 775 KiB/s wr, 13 op/s 2024-05-08T23:17:56.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:56 smithi179 ceph-mon[46314]: pgmap v332: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 775 KiB/s wr, 13 op/s 2024-05-08T23:17:56.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:56 smithi195 ceph-mon[46516]: pgmap v332: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 775 KiB/s wr, 13 op/s 2024-05-08T23:17:58.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:17:58 smithi135 ceph-mon[42440]: pgmap v333: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 15 op/s 2024-05-08T23:17:58.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:17:58 smithi179 ceph-mon[46314]: pgmap v333: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 15 op/s 2024-05-08T23:17:58.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:17:58 smithi195 ceph-mon[46516]: pgmap v333: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 15 op/s 2024-05-08T23:18:00.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:00 smithi135 ceph-mon[42440]: pgmap v334: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 864 KiB/s wr, 16 op/s 2024-05-08T23:18:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.506+0000 7f4fb997d700 1 -- 172.21.15.135:0/1462137384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb4101a60 msgr2=0x7f4fb4103e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.506+0000 7f4fb997d700 1 --2- 172.21.15.135:0/1462137384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb4101a60 0x7f4fb4103e50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009990 tx=0x7f4fa4009ca0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.506+0000 7f4fb997d700 1 -- 172.21.15.135:0/1462137384 shutdown_connections 2024-05-08T23:18:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.506+0000 7f4fb997d700 1 --2- 172.21.15.135:0/1462137384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4fb4106cc0 0x7f4fb41090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.506+0000 7f4fb997d700 1 --2- 172.21.15.135:0/1462137384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb4101a60 0x7f4fb4103e50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.506+0000 7f4fb997d700 1 --2- 172.21.15.135:0/1462137384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fb4104390 0x7f4fb4106780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.506+0000 7f4fb997d700 1 -- 172.21.15.135:0/1462137384 >> 172.21.15.135:0/1462137384 conn(0x7f4fb40fb3b0 msgr2=0x7f4fb40fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.506+0000 7f4fb997d700 1 -- 172.21.15.135:0/1462137384 shutdown_connections 2024-05-08T23:18:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.506+0000 7f4fb997d700 1 -- 172.21.15.135:0/1462137384 wait complete. 2024-05-08T23:18:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb997d700 1 Processor -- start 2024-05-08T23:18:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb997d700 1 -- start start 2024-05-08T23:18:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb997d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb4101a60 0x7f4fb4101380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb997d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4fb4104390 0x7f4fb40ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb997d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fb4106cc0 0x7f4fb40fff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb997d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb41006f0 con 0x7f4fb4101a60 2024-05-08T23:18:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb997d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb4100860 con 0x7f4fb4106cc0 2024-05-08T23:18:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb997d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb41a0ec0 con 0x7f4fb4104390 2024-05-08T23:18:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb4101a60 0x7f4fb4101380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb4101a60 0x7f4fb4101380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44652/0 (socket says 172.21.15.135:44652) 2024-05-08T23:18:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb2ffd700 1 -- 172.21.15.135:0/131781138 learned_addr learned my addr 172.21.15.135:0/131781138 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb37fe700 1 --2- 172.21.15.135:0/131781138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fb4106cc0 0x7f4fb40fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb27fc700 1 --2- 172.21.15.135:0/131781138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4fb4104390 0x7f4fb40ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb2ffd700 1 -- 172.21.15.135:0/131781138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4fb4104390 msgr2=0x7f4fb40ffa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb2ffd700 1 --2- 172.21.15.135:0/131781138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4fb4104390 0x7f4fb40ffa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb2ffd700 1 -- 172.21.15.135:0/131781138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fb4106cc0 msgr2=0x7f4fb40fff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb2ffd700 1 --2- 172.21.15.135:0/131781138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fb4106cc0 0x7f4fb40fff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.507+0000 7f4fb2ffd700 1 -- 172.21.15.135:0/131781138 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa40095f0 con 0x7f4fb4101a60 2024-05-08T23:18:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.508+0000 7f4fb2ffd700 1 --2- 172.21.15.135:0/131781138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb4101a60 0x7f4fb4101380 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4000c00 tx=0x7f4fa4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.508+0000 7f4fb897b700 1 -- 172.21.15.135:0/131781138 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa401d070 con 0x7f4fb4101a60 2024-05-08T23:18:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.508+0000 7f4fb897b700 1 -- 172.21.15.135:0/131781138 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fa40054f0 con 0x7f4fb4101a60 2024-05-08T23:18:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.508+0000 7f4fb997d700 1 -- 172.21.15.135:0/131781138 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb41a10f0 con 0x7f4fb4101a60 2024-05-08T23:18:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.508+0000 7f4fb897b700 1 -- 172.21.15.135:0/131781138 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4004bd0 con 0x7f4fb4101a60 2024-05-08T23:18:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.508+0000 7f4fb997d700 1 -- 172.21.15.135:0/131781138 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb41a1460 con 0x7f4fb4101a60 2024-05-08T23:18:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.510+0000 7f4fb897b700 1 -- 172.21.15.135:0/131781138 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f4fa400fb90 con 0x7f4fb4101a60 2024-05-08T23:18:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.511+0000 7f4fb897b700 1 --2- 172.21.15.135:0/131781138 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4f9c0a1120 0x7f4f9c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.511+0000 7f4fb897b700 1 -- 172.21.15.135:0/131781138 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4fa40cdb70 con 0x7f4fb4101a60 2024-05-08T23:18:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.511+0000 7f4fb27fc700 1 --2- 172.21.15.135:0/131781138 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4f9c0a1120 0x7f4f9c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.511+0000 7f4fb27fc700 1 --2- 172.21.15.135:0/131781138 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4f9c0a1120 0x7f4f9c0a35e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8005950 tx=0x7f4fa800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.511+0000 7f4fc5b37b80 1 Processor -- start 2024-05-08T23:18:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fc5b37b80 1 -- start start 2024-05-08T23:18:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fc5b37b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 0x55bc73ef3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fc5b37b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef43e0 0x55bc73ef4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fc5b37b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef52d0 0x55bc73ef5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fc5b37b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc73e4b0f0 con 0x55bc73ef52d0 2024-05-08T23:18:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fc5b37b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc73e48ab0 con 0x55bc73ef3a80 2024-05-08T23:18:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fc5b37b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc73e443a0 con 0x55bc73ef43e0 2024-05-08T23:18:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fb37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef52d0 0x55bc73ef5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fb37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef52d0 0x55bc73ef5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44668/0 (socket says 172.21.15.135:44668) 2024-05-08T23:18:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fb37fe700 1 -- 172.21.15.135:0/1525794386 learned_addr learned my addr 172.21.15.135:0/1525794386 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fb2ffd700 1 --2- 172.21.15.135:0/1525794386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 0x55bc73ef3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fb27fc700 1 --2- 172.21.15.135:0/1525794386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef43e0 0x55bc73ef4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fb37fe700 1 -- 172.21.15.135:0/1525794386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef43e0 msgr2=0x55bc73ef4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:18:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fb37fe700 1 --2- 172.21.15.135:0/1525794386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef43e0 0x55bc73ef4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fb37fe700 1 -- 172.21.15.135:0/1525794386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 msgr2=0x55bc73ef3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:18:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fb37fe700 1 --2- 172.21.15.135:0/1525794386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 0x55bc73ef3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.512+0000 7f4fb37fe700 1 -- 172.21.15.135:0/1525794386 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc73cc5350 con 0x55bc73ef52d0 2024-05-08T23:18:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.513+0000 7f4fb37fe700 1 --2- 172.21.15.135:0/1525794386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef52d0 0x55bc73ef5750 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4fac011680 tx=0x7f4fac009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f399c6421c72fa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.513+0000 7f4f99ffb700 1 -- 172.21.15.135:0/1525794386 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac00e040 con 0x55bc73ef52d0 2024-05-08T23:18:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.513+0000 7f4f99ffb700 1 -- 172.21.15.135:0/1525794386 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fac00f040 con 0x55bc73ef52d0 2024-05-08T23:18:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.513+0000 7f4f99ffb700 1 -- 172.21.15.135:0/1525794386 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac004860 con 0x55bc73ef52d0 2024-05-08T23:18:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.513+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/1525794386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef52d0 msgr2=0x55bc73ef5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.513+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/1525794386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef52d0 0x55bc73ef5750 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4fac011680 tx=0x7f4fac009920 comp rx=0 tx=0).stop 2024-05-08T23:18:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.513+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/1525794386 shutdown_connections 2024-05-08T23:18:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.513+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/1525794386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef52d0 0x55bc73ef5750 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.513+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/1525794386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 0x55bc73ef3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.513+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/1525794386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef43e0 0x55bc73ef4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.513+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/1525794386 >> 172.21.15.135:0/1525794386 conn(0x55bc73e521b0 msgr2=0x55bc73ef0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.514+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/1525794386 shutdown_connections 2024-05-08T23:18:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.514+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/1525794386 wait complete. 2024-05-08T23:18:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.514+0000 7f4fc5b37b80 1 -- start start 2024-05-08T23:18:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.514+0000 7f4fc5b37b80 1 Processor -- start 2024-05-08T23:18:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fc5b37b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 0x55bc73efd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fc5b37b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73efddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fc5b37b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef52d0 0x55bc73f04df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fc5b37b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc73de0500 con 0x55bc73ef43e0 2024-05-08T23:18:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fc5b37b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc73de01a0 con 0x55bc73ef3a80 2024-05-08T23:18:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fc5b37b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc73cc7640 con 0x55bc73ef52d0 2024-05-08T23:18:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fc5b37b80 10 client.0 _ll_register_callbacks cb 0x55bc73de9ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:18:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fb27fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73efddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fb27fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73efddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44676/0 (socket says 172.21.15.135:44676) 2024-05-08T23:18:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fb27fc700 1 -- 172.21.15.135:0/1203760355 learned_addr learned my addr 172.21.15.135:0/1203760355 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fb37fe700 1 --2- 172.21.15.135:0/1203760355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef52d0 0x55bc73f04df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fb2ffd700 1 --2- 172.21.15.135:0/1203760355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 0x55bc73efd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fb27fc700 1 -- 172.21.15.135:0/1203760355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef52d0 msgr2=0x55bc73f04df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:18:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fb27fc700 1 --2- 172.21.15.135:0/1203760355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef52d0 0x55bc73f04df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fb27fc700 1 -- 172.21.15.135:0/1203760355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 msgr2=0x55bc73efd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:18:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fb27fc700 1 --2- 172.21.15.135:0/1203760355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 0x55bc73efd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fb27fc700 1 -- 172.21.15.135:0/1203760355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fac011330 con 0x55bc73ef43e0 2024-05-08T23:18:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fb37fe700 1 --2- 172.21.15.135:0/1203760355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef52d0 0x55bc73f04df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T23:18:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4fb27fc700 1 --2- 172.21.15.135:0/1203760355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73efddb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80116c0 tx=0x7f4fa80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653e6634b25818c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4f92ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:18:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.515+0000 7f4f92ffd700 1 -- 172.21.15.135:0/1203760355 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8004a30 con 0x55bc73ef43e0 2024-05-08T23:18:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.516+0000 7f4f92ffd700 1 -- 172.21.15.135:0/1203760355 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4fa8017070 con 0x55bc73ef43e0 2024-05-08T23:18:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.516+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/1203760355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc73d9d210 con 0x55bc73ef43e0 2024-05-08T23:18:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.516+0000 7f4f92ffd700 1 -- 172.21.15.135:0/1203760355 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fa8010ec0 con 0x55bc73ef43e0 2024-05-08T23:18:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.516+0000 7f4fc5b37b80 10 client.15525 fetch_fsmap learned FSMap version 28 2024-05-08T23:18:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.516+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/1203760355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55bc73c71b00 con 0x55bc73ef43e0 2024-05-08T23:18:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.516+0000 7f4f92ffd700 1 -- 172.21.15.135:0/1203760355 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bc73d9d210 con 0x55bc73ef43e0 2024-05-08T23:18:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.516+0000 7f4f92ffd700 1 -- 172.21.15.135:0/1203760355 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4fa801f640 con 0x55bc73ef43e0 2024-05-08T23:18:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.516+0000 7f4fc5b37b80 10 client.15525 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:18:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.516+0000 7f4fc5b37b80 10 client.15525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:18:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.516+0000 7f4fc5b37b80 20 client.15525 populate_metadata read hostname 'smithi135' 2024-05-08T23:18:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.516+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/1203760355 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55bc73f09730 0x55bc73f0bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.516+0000 7f4fc5b37b80 4 client.15525 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T23:18:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.516+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/1203760355 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc73ec37b0 con 0x55bc73f09730 2024-05-08T23:18:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.516+0000 7f4fb2ffd700 1 --2- 172.21.15.135:0/1203760355 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55bc73f09730 0x55bc73f0bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.517+0000 7f4f92ffd700 10 client.15525 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:18:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.517+0000 7f4fb2ffd700 1 --2- 172.21.15.135:0/1203760355 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55bc73f09730 0x55bc73f0bb50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a6d102ad2cec551 server_cookie=a9bbfe98c3a25ce0 in_seq=0 out_seq=0 2024-05-08T23:18:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.518+0000 7f4f92ffd700 1 -- 172.21.15.135:0/1203760355 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bc73ec37b0 con 0x55bc73f09730 2024-05-08T23:18:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.518+0000 7f4f92ffd700 10 client.15525 handle_command_reply: tid=0 2024-05-08T23:18:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.518+0000 7f4fc5b37b80 1 client.15525 shutdown 2024-05-08T23:18:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.518+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/1203760355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 msgr2=0x55bc73efddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.518+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/1203760355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73efddb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80116c0 tx=0x7f4fa80047c0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.518+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/1203760355 shutdown_connections 2024-05-08T23:18:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.518+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/1203760355 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55bc73f09730 0x55bc73f0bb50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.518+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/1203760355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef52d0 0x55bc73f04df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.518+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/1203760355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 0x55bc73efd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.518+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/1203760355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73efddb0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.518+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/1203760355 >> 172.21.15.135:0/1203760355 conn(0x55bc73e521b0 msgr2=0x55bc73eee860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.518+0000 7f4f92ffd700 0 client.15525 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:18:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.518+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/1203760355 shutdown_connections 2024-05-08T23:18:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.518+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/1203760355 wait complete. 2024-05-08T23:18:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.518+0000 7f4fc5b37b80 20 client.15525 trim_cache size 0 max 16384 2024-05-08T23:18:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.533+0000 7f4fc5b37b80 1 Processor -- start 2024-05-08T23:18:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.533+0000 7f4fc5b37b80 1 -- start start 2024-05-08T23:18:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.533+0000 7f4fc5b37b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef3a80 0x55bc73ef56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.533+0000 7f4fc5b37b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73efcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.533+0000 7f4fc5b37b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef52d0 0x55bc73f04db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.533+0000 7f4fc5b37b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc73efd3e0 con 0x55bc73ef43e0 2024-05-08T23:18:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.533+0000 7f4fc5b37b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc73ef47c0 con 0x55bc73ef52d0 2024-05-08T23:18:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.533+0000 7f4fc5b37b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc73eefbc0 con 0x55bc73ef3a80 2024-05-08T23:18:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.534+0000 7f4fb27fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73efcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.534+0000 7f4fb27fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73efcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44688/0 (socket says 172.21.15.135:44688) 2024-05-08T23:18:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.534+0000 7f4fb27fc700 1 -- 172.21.15.135:0/2281730137 learned_addr learned my addr 172.21.15.135:0/2281730137 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.534+0000 7f4fb37fe700 1 --2- 172.21.15.135:0/2281730137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef52d0 0x55bc73f04db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.534+0000 7f4fb2ffd700 1 --2- 172.21.15.135:0/2281730137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef3a80 0x55bc73ef56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.534+0000 7f4fb27fc700 1 -- 172.21.15.135:0/2281730137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef3a80 msgr2=0x55bc73ef56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:18:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.534+0000 7f4fb27fc700 1 --2- 172.21.15.135:0/2281730137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef3a80 0x55bc73ef56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.534+0000 7f4fb27fc700 1 -- 172.21.15.135:0/2281730137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef52d0 msgr2=0x55bc73f04db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:18:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.534+0000 7f4fb27fc700 1 --2- 172.21.15.135:0/2281730137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef52d0 0x55bc73f04db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.534+0000 7f4fb27fc700 1 -- 172.21.15.135:0/2281730137 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc73e0a500 con 0x55bc73ef43e0 2024-05-08T23:18:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.534+0000 7f4fb27fc700 1 --2- 172.21.15.135:0/2281730137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73efcd80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8005e10 tx=0x7f4fa8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3fc345c15f1817 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.534+0000 7f4f9a7fc700 1 -- 172.21.15.135:0/2281730137 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa801fbc0 con 0x55bc73ef43e0 2024-05-08T23:18:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.534+0000 7f4f9a7fc700 1 -- 172.21.15.135:0/2281730137 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fa8015070 con 0x55bc73ef43e0 2024-05-08T23:18:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.534+0000 7f4f9a7fc700 1 -- 172.21.15.135:0/2281730137 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8032480 con 0x55bc73ef43e0 2024-05-08T23:18:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.535+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/2281730137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 msgr2=0x55bc73efcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.535+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/2281730137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73efcd80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8005e10 tx=0x7f4fa8004750 comp rx=0 tx=0).stop 2024-05-08T23:18:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.535+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/2281730137 shutdown_connections 2024-05-08T23:18:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.535+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/2281730137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef3a80 0x55bc73ef56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.535+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/2281730137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef52d0 0x55bc73f04db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.535+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/2281730137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73efcd80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.535+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/2281730137 >> 172.21.15.135:0/2281730137 conn(0x55bc73e521b0 msgr2=0x55bc73efb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:00.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.535+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/2281730137 shutdown_connections 2024-05-08T23:18:00.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.535+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/2281730137 wait complete. 2024-05-08T23:18:00.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.535+0000 7f4fc5b37b80 1 -- start start 2024-05-08T23:18:00.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fc5b37b80 1 Processor -- start 2024-05-08T23:18:00.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fc5b37b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 0x55bc73f01c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fc5b37b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73f02170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fc5b37b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef52d0 0x55bc73f5dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fc5b37b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc73f026f0 con 0x55bc73ef43e0 2024-05-08T23:18:00.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fc5b37b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc73f02860 con 0x55bc73ef3a80 2024-05-08T23:18:00.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fc5b37b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc73f5e140 con 0x55bc73ef52d0 2024-05-08T23:18:00.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fc5b37b80 10 client.0 _ll_register_callbacks cb 0x55bc73de9ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T23:18:00.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fb27fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73f02170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fb27fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73f02170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44700/0 (socket says 172.21.15.135:44700) 2024-05-08T23:18:00.541 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fb27fc700 1 -- 172.21.15.135:0/39392939 learned_addr learned my addr 172.21.15.135:0/39392939 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fb2ffd700 1 --2- 172.21.15.135:0/39392939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 0x55bc73f01c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fb37fe700 1 --2- 172.21.15.135:0/39392939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef52d0 0x55bc73f5dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fb27fc700 1 -- 172.21.15.135:0/39392939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef52d0 msgr2=0x55bc73f5dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:18:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fb27fc700 1 --2- 172.21.15.135:0/39392939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef52d0 0x55bc73f5dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fb27fc700 1 -- 172.21.15.135:0/39392939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 msgr2=0x55bc73f01c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T23:18:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fb27fc700 1 --2- 172.21.15.135:0/39392939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 0x55bc73f01c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fb27fc700 1 -- 172.21.15.135:0/39392939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc73c71b00 con 0x55bc73ef43e0 2024-05-08T23:18:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fb37fe700 1 --2- 172.21.15.135:0/39392939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef52d0 0x55bc73f5dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:18:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.536+0000 7f4fb2ffd700 1 --2- 172.21.15.135:0/39392939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 0x55bc73f01c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:18:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4fb27fc700 1 --2- 172.21.15.135:0/39392939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73f02170 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8005810 tx=0x7f4fa801fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e7451e6f3b08f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4f92ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T23:18:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4f92ffd700 1 -- 172.21.15.135:0/39392939 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa803b890 con 0x55bc73ef43e0 2024-05-08T23:18:00.542 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4f92ffd700 1 -- 172.21.15.135:0/39392939 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4fa8017070 con 0x55bc73ef43e0 2024-05-08T23:18:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/39392939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4fac00f040 con 0x55bc73ef43e0 2024-05-08T23:18:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4f92ffd700 1 -- 172.21.15.135:0/39392939 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fa8032480 con 0x55bc73ef43e0 2024-05-08T23:18:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4fc5b37b80 10 client.15531 fetch_fsmap learned FSMap version 28 2024-05-08T23:18:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/39392939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55bc73cc9c70 con 0x55bc73ef43e0 2024-05-08T23:18:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4f92ffd700 1 -- 172.21.15.135:0/39392939 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fac00f040 con 0x55bc73ef43e0 2024-05-08T23:18:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4f92ffd700 1 -- 172.21.15.135:0/39392939 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4fa80446a0 con 0x55bc73ef43e0 2024-05-08T23:18:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4fc5b37b80 10 client.15531 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T23:18:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4fc5b37b80 10 client.15531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-05-08T23:18:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4fc5b37b80 20 client.15531 populate_metadata read hostname 'smithi135' 2024-05-08T23:18:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/39392939 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55bc73f5f6d0 0x55bc73f61af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4fc5b37b80 4 client.15531 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T23:18:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.537+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/39392939 --> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bc73e3ce60 con 0x55bc73f5f6d0 2024-05-08T23:18:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.538+0000 7f4fb2ffd700 1 --2- 172.21.15.135:0/39392939 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55bc73f5f6d0 0x55bc73f61af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.538+0000 7f4fb2ffd700 1 --2- 172.21.15.135:0/39392939 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55bc73f5f6d0 0x55bc73f61af0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc80ce22a6baf1ca server_cookie=618c07965a5d9fa9 in_seq=0 out_seq=0 2024-05-08T23:18:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.538+0000 7f4f92ffd700 10 client.15531 ms_handle_connect on v2:172.21.15.195:6838/1730571841 2024-05-08T23:18:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.548+0000 7f4f92ffd700 1 -- 172.21.15.135:0/39392939 <== mds.0 v2:172.21.15.195:6838/1730571841 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bc73e3ce60 con 0x55bc73f5f6d0 2024-05-08T23:18:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.548+0000 7f4f92ffd700 10 client.15531 handle_command_reply: tid=0 2024-05-08T23:18:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.548+0000 7f4fc5b37b80 1 client.15531 shutdown 2024-05-08T23:18:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.548+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/39392939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 msgr2=0x55bc73f02170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.548+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/39392939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73f02170 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8005810 tx=0x7f4fa801fbc0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.548+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/39392939 shutdown_connections 2024-05-08T23:18:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.548+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/39392939 >> [v2:172.21.15.195:6838/1730571841,v1:172.21.15.195:6839/1730571841] conn(0x55bc73f5f6d0 0x55bc73f61af0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.548+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/39392939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bc73ef52d0 0x55bc73f5dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.548+0000 7f4f92ffd700 0 client.15531 ms_handle_reset on v2:172.21.15.195:6838/1730571841 2024-05-08T23:18:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.548+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/39392939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc73ef3a80 0x55bc73f01c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.548+0000 7f4fc5b37b80 1 --2- 172.21.15.135:0/39392939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc73ef43e0 0x55bc73f02170 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.548+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/39392939 >> 172.21.15.135:0/39392939 conn(0x55bc73e521b0 msgr2=0x55bc73efb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:00.552 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.548+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/39392939 shutdown_connections 2024-05-08T23:18:00.552 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.548+0000 7f4fc5b37b80 1 -- 172.21.15.135:0/39392939 wait complete. 2024-05-08T23:18:00.552 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.548+0000 7f4fc5b37b80 20 client.15531 trim_cache size 0 max 16384 2024-05-08T23:18:00.552 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-05-08T23:18:00.552 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-05-08T23:18:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-05-08T23:18:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-05-08T23:18:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.549+0000 7f4fb997d700 1 -- 172.21.15.135:0/131781138 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4f9c0a1120 msgr2=0x7f4f9c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.549+0000 7f4fb997d700 1 --2- 172.21.15.135:0/131781138 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4f9c0a1120 0x7f4f9c0a35e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8005950 tx=0x7f4fa800b410 comp rx=0 tx=0).stop 2024-05-08T23:18:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.549+0000 7f4fb997d700 1 -- 172.21.15.135:0/131781138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb4101a60 msgr2=0x7f4fb4101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.549+0000 7f4fb997d700 1 --2- 172.21.15.135:0/131781138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb4101a60 0x7f4fb4101380 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4000c00 tx=0x7f4fa4004730 comp rx=0 tx=0).stop 2024-05-08T23:18:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.549+0000 7f4fb997d700 1 -- 172.21.15.135:0/131781138 shutdown_connections 2024-05-08T23:18:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.549+0000 7f4fb997d700 1 --2- 172.21.15.135:0/131781138 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4f9c0a1120 0x7f4f9c0a35e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.549+0000 7f4fb997d700 1 --2- 172.21.15.135:0/131781138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fb4106cc0 0x7f4fb40fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.549+0000 7f4fb997d700 1 --2- 172.21.15.135:0/131781138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fb4101a60 0x7f4fb4101380 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.549+0000 7f4fb997d700 1 --2- 172.21.15.135:0/131781138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4fb4104390 0x7f4fb40ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.549+0000 7f4fb997d700 1 -- 172.21.15.135:0/131781138 >> 172.21.15.135:0/131781138 conn(0x7f4fb40fb3b0 msgr2=0x7f4fb4102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.549+0000 7f4fb997d700 1 -- 172.21.15.135:0/131781138 shutdown_connections 2024-05-08T23:18:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-05-08T23:18:00.549+0000 7f4fb997d700 1 -- 172.21.15.135:0/131781138 wait complete. 2024-05-08T23:18:00.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:00 smithi179 ceph-mon[46314]: pgmap v334: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 864 KiB/s wr, 16 op/s 2024-05-08T23:18:00.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:00 smithi195 ceph-mon[46516]: pgmap v334: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 864 KiB/s wr, 16 op/s 2024-05-08T23:18:01.218 INFO:tasks.workunit.client.0.smithi135.stdout:setting up random write file 2024-05-08T23:18:01.218 INFO:tasks.workunit.client.0.smithi135.stdout:done setting up random write file 2024-05-08T23:18:01.218 INFO:tasks.workunit.client.0.smithi135.stdout:starting fsync run 2024-05-08T23:18:01.218 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0207s 2024-05-08T23:18:01.219 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0060s 2024-05-08T23:18:01.219 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0057s 2024-05-08T23:18:01.219 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0061s 2024-05-08T23:18:01.219 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0063s 2024-05-08T23:18:01.219 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0059s 2024-05-08T23:18:01.219 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0055s 2024-05-08T23:18:01.219 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0002s fsync time: 0.0056s 2024-05-08T23:18:01.219 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0057s 2024-05-08T23:18:01.219 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0058s 2024-05-08T23:18:01.219 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0062s 2024-05-08T23:18:01.219 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0061s 2024-05-08T23:18:01.219 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0055s 2024-05-08T23:18:01.219 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0055s 2024-05-08T23:18:01.219 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0059s 2024-05-08T23:18:01.219 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0060s 2024-05-08T23:18:01.220 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0055s 2024-05-08T23:18:01.220 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0064s 2024-05-08T23:18:01.220 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0056s 2024-05-08T23:18:01.220 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0056s 2024-05-08T23:18:01.220 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0057s 2024-05-08T23:18:01.220 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0056s 2024-05-08T23:18:01.220 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0059s 2024-05-08T23:18:01.220 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0046s 2024-05-08T23:18:01.220 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0052s 2024-05-08T23:18:01.220 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0058s 2024-05-08T23:18:01.220 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0054s 2024-05-08T23:18:01.220 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0055s 2024-05-08T23:18:01.220 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0055s 2024-05-08T23:18:01.220 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0062s 2024-05-08T23:18:01.220 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0066s 2024-05-08T23:18:01.221 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0047s 2024-05-08T23:18:01.221 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0057s 2024-05-08T23:18:01.221 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0056s 2024-05-08T23:18:01.221 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0059s 2024-05-08T23:18:01.221 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0053s 2024-05-08T23:18:01.221 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0058s 2024-05-08T23:18:01.221 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0056s 2024-05-08T23:18:01.221 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0053s 2024-05-08T23:18:01.221 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0053s 2024-05-08T23:18:01.221 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0057s 2024-05-08T23:18:01.221 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0060s 2024-05-08T23:18:01.221 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0056s 2024-05-08T23:18:01.221 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0059s 2024-05-08T23:18:01.221 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0060s 2024-05-08T23:18:01.221 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0056s 2024-05-08T23:18:01.222 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0002s fsync time: 0.0053s 2024-05-08T23:18:01.222 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0055s 2024-05-08T23:18:01.222 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0057s 2024-05-08T23:18:01.222 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0054s 2024-05-08T23:18:01.222 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0055s 2024-05-08T23:18:01.222 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0054s 2024-05-08T23:18:01.222 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0054s 2024-05-08T23:18:01.222 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0057s 2024-05-08T23:18:01.222 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0057s 2024-05-08T23:18:01.222 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0002s fsync time: 0.0057s 2024-05-08T23:18:01.222 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0053s 2024-05-08T23:18:01.222 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0055s 2024-05-08T23:18:01.222 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0053s 2024-05-08T23:18:01.222 INFO:tasks.workunit.client.0.smithi135.stdout:write time: 0.0003s fsync time: 0.0053s 2024-05-08T23:18:01.222 INFO:tasks.workunit.client.0.smithi135.stdout:run done 61 fsyncs total, killing random writer 2024-05-08T23:18:01.223 INFO:tasks.workunit.client.0.smithi135.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-05-08T23:18:01.223 INFO:tasks.workunit.client.0.smithi135.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-05-08T23:18:01.223 INFO:tasks.workunit.client.0.smithi135.stderr:+ whereis lsof 2024-05-08T23:18:01.229 INFO:tasks.workunit.client.0.smithi135.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-05-08T23:18:01.229 INFO:tasks.workunit.client.0.smithi135.stderr:+ lsof 2024-05-08T23:18:01.252 INFO:tasks.workunit.client.0.smithi135.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/322e5de2cf95453ec21f5d1909810a28ad6e89ebf48e7aece2e11a62af4b8214/merged 2024-05-08T23:18:01.252 INFO:tasks.workunit.client.0.smithi135.stderr: Output information may be incomplete. 2024-05-08T23:18:01.252 INFO:tasks.workunit.client.0.smithi135.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/fc99eab3a4ede48a88fe1c29237c4f905a6f30a730360835bf7cb3cf4eef7dae/merged 2024-05-08T23:18:01.252 INFO:tasks.workunit.client.0.smithi135.stderr: Output information may be incomplete. 2024-05-08T23:18:01.252 INFO:tasks.workunit.client.0.smithi135.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/f2f3707ad32925524b2753eb252d4417fda2977e16e5a7b4337176e4c2713ebc/merged 2024-05-08T23:18:01.252 INFO:tasks.workunit.client.0.smithi135.stderr: Output information may be incomplete. 2024-05-08T23:18:01.252 INFO:tasks.workunit.client.0.smithi135.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/4b4a1a39fcda1ae60aa171befec8bbca2209d6bd460df1b73ca9962a715873db/merged 2024-05-08T23:18:01.252 INFO:tasks.workunit.client.0.smithi135.stderr: Output information may be incomplete. 2024-05-08T23:18:01.252 INFO:tasks.workunit.client.0.smithi135.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/4f21e35751bfda32a842372030ed82d2c15063e9e2fbbda4a6dcb90971efa9b4/merged 2024-05-08T23:18:01.252 INFO:tasks.workunit.client.0.smithi135.stderr: Output information may be incomplete. 2024-05-08T23:18:01.252 INFO:tasks.workunit.client.0.smithi135.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/d9ba1feca82cfd1b1e0d741c701d39994eba135f8744914f72aa3b0fd67dd844/merged 2024-05-08T23:18:01.253 INFO:tasks.workunit.client.0.smithi135.stderr: Output information may be incomplete. 2024-05-08T23:18:01.253 INFO:tasks.workunit.client.0.smithi135.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/f4a06f03536b90ea89edfe6da24073f7bd102ac7683763c997c4a90b9d1a8342/merged 2024-05-08T23:18:01.253 INFO:tasks.workunit.client.0.smithi135.stderr: Output information may be incomplete. 2024-05-08T23:18:01.253 INFO:tasks.workunit.client.0.smithi135.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/1477bc5a2df88048a7aa28f4f2bd2aef23e326703989d217ebe98599fc0136d0/merged 2024-05-08T23:18:01.253 INFO:tasks.workunit.client.0.smithi135.stderr: Output information may be incomplete. 2024-05-08T23:18:01.253 INFO:tasks.workunit.client.0.smithi135.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/116a6859c1957b5f19c0301ab2cc360139e1c9c1d4dba2df3bdb54e33a89dcf6/merged 2024-05-08T23:18:01.253 INFO:tasks.workunit.client.0.smithi135.stderr: Output information may be incomplete. 2024-05-08T23:18:01.253 INFO:tasks.workunit.client.0.smithi135.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/ce58ab3cc7a3b6652186fdac7e429cf20d109d4ef1439a94245ca2ef8f165c32/merged 2024-05-08T23:18:01.253 INFO:tasks.workunit.client.0.smithi135.stderr: Output information may be incomplete. 2024-05-08T23:18:01.318 INFO:tasks.workunit.client.0.smithi135.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-05-08T23:18:01.318 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-05-08T23:18:01.318 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-05-08T23:18:01.318 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-05-08T23:18:01.318 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-05-08T23:18:01.319 INFO:tasks.workunit.client.0.smithi135.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-05-08T23:18:01.319 INFO:tasks.workunit.client.0.smithi135.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-05-08T23:18:01.319 INFO:tasks.workunit.client.0.smithi135.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-05-08T23:18:01.319 INFO:tasks.workunit.client.0.smithi135.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-05-08T23:18:01.319 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_gp 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-05-08T23:18:01.319 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_gp 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-05-08T23:18:01.319 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_gp 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-05-08T23:18:01.319 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_gp 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-05-08T23:18:01.319 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_par_g 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-05-08T23:18:01.319 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_par_g 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-05-08T23:18:01.319 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_par_g 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-05-08T23:18:01.319 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_par_g 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-05-08T23:18:01.319 INFO:tasks.workunit.client.0.smithi135.stdout:slub_flus 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-05-08T23:18:01.319 INFO:tasks.workunit.client.0.smithi135.stdout:slub_flus 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-05-08T23:18:01.320 INFO:tasks.workunit.client.0.smithi135.stdout:slub_flus 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-05-08T23:18:01.320 INFO:tasks.workunit.client.0.smithi135.stdout:slub_flus 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-05-08T23:18:01.320 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 7 root cwd unknown /proc/7/cwd (readlink: Permission denied) 2024-05-08T23:18:01.320 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 7 root rtd unknown /proc/7/root (readlink: Permission denied) 2024-05-08T23:18:01.320 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 7 root txt unknown /proc/7/exe (readlink: Permission denied) 2024-05-08T23:18:01.320 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 7 root NOFD /proc/7/fd (opendir: Permission denied) 2024-05-08T23:18:01.320 INFO:tasks.workunit.client.0.smithi135.stdout:mm_percpu 10 root cwd unknown /proc/10/cwd (readlink: Permission denied) 2024-05-08T23:18:01.320 INFO:tasks.workunit.client.0.smithi135.stdout:mm_percpu 10 root rtd unknown /proc/10/root (readlink: Permission denied) 2024-05-08T23:18:01.320 INFO:tasks.workunit.client.0.smithi135.stdout:mm_percpu 10 root txt unknown /proc/10/exe (readlink: Permission denied) 2024-05-08T23:18:01.320 INFO:tasks.workunit.client.0.smithi135.stdout:mm_percpu 10 root NOFD /proc/10/fd (opendir: Permission denied) 2024-05-08T23:18:01.320 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_tasks 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2024-05-08T23:18:01.320 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_tasks 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2024-05-08T23:18:01.320 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_tasks 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2024-05-08T23:18:01.320 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_tasks 11 root NOFD /proc/11/fd (opendir: Permission denied) 2024-05-08T23:18:01.320 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_tasks 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2024-05-08T23:18:01.321 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_tasks 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2024-05-08T23:18:01.321 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_tasks 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2024-05-08T23:18:01.321 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_tasks 12 root NOFD /proc/12/fd (opendir: Permission denied) 2024-05-08T23:18:01.321 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-05-08T23:18:01.321 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-05-08T23:18:01.321 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-05-08T23:18:01.321 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-05-08T23:18:01.321 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_sched 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-05-08T23:18:01.321 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_sched 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-05-08T23:18:01.321 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_sched 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-05-08T23:18:01.321 INFO:tasks.workunit.client.0.smithi135.stdout:rcu_sched 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-05-08T23:18:01.321 INFO:tasks.workunit.client.0.smithi135.stdout:migration 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-05-08T23:18:01.321 INFO:tasks.workunit.client.0.smithi135.stdout:migration 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-05-08T23:18:01.322 INFO:tasks.workunit.client.0.smithi135.stdout:migration 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-05-08T23:18:01.322 INFO:tasks.workunit.client.0.smithi135.stdout:migration 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-05-08T23:18:01.322 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-05-08T23:18:01.322 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-05-08T23:18:01.322 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-05-08T23:18:01.322 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-05-08T23:18:01.322 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/0 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-05-08T23:18:01.322 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/0 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-05-08T23:18:01.322 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/0 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-05-08T23:18:01.322 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/0 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-05-08T23:18:01.322 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/1 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-05-08T23:18:01.322 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/1 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-05-08T23:18:01.323 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/1 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-05-08T23:18:01.323 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/1 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-05-08T23:18:01.323 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-05-08T23:18:01.323 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-05-08T23:18:01.323 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-05-08T23:18:01.323 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-05-08T23:18:01.323 INFO:tasks.workunit.client.0.smithi135.stdout:migration 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2024-05-08T23:18:01.323 INFO:tasks.workunit.client.0.smithi135.stdout:migration 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2024-05-08T23:18:01.323 INFO:tasks.workunit.client.0.smithi135.stdout:migration 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2024-05-08T23:18:01.323 INFO:tasks.workunit.client.0.smithi135.stdout:migration 20 root NOFD /proc/20/fd (opendir: Permission denied) 2024-05-08T23:18:01.323 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 21 root cwd unknown /proc/21/cwd (readlink: Permission denied) 2024-05-08T23:18:01.323 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 21 root rtd unknown /proc/21/root (readlink: Permission denied) 2024-05-08T23:18:01.323 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 21 root txt unknown /proc/21/exe (readlink: Permission denied) 2024-05-08T23:18:01.323 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 21 root NOFD /proc/21/fd (opendir: Permission denied) 2024-05-08T23:18:01.324 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-05-08T23:18:01.324 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-05-08T23:18:01.324 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-05-08T23:18:01.324 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-05-08T23:18:01.324 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/2 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-05-08T23:18:01.324 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/2 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-05-08T23:18:01.325 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/2 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-05-08T23:18:01.325 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/2 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-05-08T23:18:01.325 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 25 root cwd unknown /proc/25/cwd (readlink: Permission denied) 2024-05-08T23:18:01.325 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 25 root rtd unknown /proc/25/root (readlink: Permission denied) 2024-05-08T23:18:01.325 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 25 root txt unknown /proc/25/exe (readlink: Permission denied) 2024-05-08T23:18:01.325 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 25 root NOFD /proc/25/fd (opendir: Permission denied) 2024-05-08T23:18:01.325 INFO:tasks.workunit.client.0.smithi135.stdout:migration 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2024-05-08T23:18:01.325 INFO:tasks.workunit.client.0.smithi135.stdout:migration 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2024-05-08T23:18:01.325 INFO:tasks.workunit.client.0.smithi135.stdout:migration 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2024-05-08T23:18:01.325 INFO:tasks.workunit.client.0.smithi135.stdout:migration 26 root NOFD /proc/26/fd (opendir: Permission denied) 2024-05-08T23:18:01.325 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 27 root cwd unknown /proc/27/cwd (readlink: Permission denied) 2024-05-08T23:18:01.325 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 27 root rtd unknown /proc/27/root (readlink: Permission denied) 2024-05-08T23:18:01.325 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 27 root txt unknown /proc/27/exe (readlink: Permission denied) 2024-05-08T23:18:01.325 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 27 root NOFD /proc/27/fd (opendir: Permission denied) 2024-05-08T23:18:01.325 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-05-08T23:18:01.326 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-05-08T23:18:01.326 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-05-08T23:18:01.326 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-05-08T23:18:01.326 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/3 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2024-05-08T23:18:01.326 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/3 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2024-05-08T23:18:01.326 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/3 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2024-05-08T23:18:01.326 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/3 30 root NOFD /proc/30/fd (opendir: Permission denied) 2024-05-08T23:18:01.326 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-05-08T23:18:01.326 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-05-08T23:18:01.326 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-05-08T23:18:01.326 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-05-08T23:18:01.326 INFO:tasks.workunit.client.0.smithi135.stdout:migration 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2024-05-08T23:18:01.326 INFO:tasks.workunit.client.0.smithi135.stdout:migration 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2024-05-08T23:18:01.326 INFO:tasks.workunit.client.0.smithi135.stdout:migration 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2024-05-08T23:18:01.327 INFO:tasks.workunit.client.0.smithi135.stdout:migration 32 root NOFD /proc/32/fd (opendir: Permission denied) 2024-05-08T23:18:01.327 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 33 root cwd unknown /proc/33/cwd (readlink: Permission denied) 2024-05-08T23:18:01.327 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 33 root rtd unknown /proc/33/root (readlink: Permission denied) 2024-05-08T23:18:01.327 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 33 root txt unknown /proc/33/exe (readlink: Permission denied) 2024-05-08T23:18:01.327 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 33 root NOFD /proc/33/fd (opendir: Permission denied) 2024-05-08T23:18:01.327 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2024-05-08T23:18:01.327 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2024-05-08T23:18:01.327 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2024-05-08T23:18:01.327 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 35 root NOFD /proc/35/fd (opendir: Permission denied) 2024-05-08T23:18:01.327 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/4 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-05-08T23:18:01.327 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/4 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-05-08T23:18:01.327 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/4 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-05-08T23:18:01.327 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/4 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-05-08T23:18:01.327 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-05-08T23:18:01.328 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-05-08T23:18:01.328 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-05-08T23:18:01.328 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-05-08T23:18:01.328 INFO:tasks.workunit.client.0.smithi135.stdout:migration 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2024-05-08T23:18:01.328 INFO:tasks.workunit.client.0.smithi135.stdout:migration 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2024-05-08T23:18:01.328 INFO:tasks.workunit.client.0.smithi135.stdout:migration 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2024-05-08T23:18:01.328 INFO:tasks.workunit.client.0.smithi135.stdout:migration 38 root NOFD /proc/38/fd (opendir: Permission denied) 2024-05-08T23:18:01.328 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 39 root cwd unknown /proc/39/cwd (readlink: Permission denied) 2024-05-08T23:18:01.328 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 39 root rtd unknown /proc/39/root (readlink: Permission denied) 2024-05-08T23:18:01.328 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 39 root txt unknown /proc/39/exe (readlink: Permission denied) 2024-05-08T23:18:01.328 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 39 root NOFD /proc/39/fd (opendir: Permission denied) 2024-05-08T23:18:01.328 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-05-08T23:18:01.328 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-05-08T23:18:01.328 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-05-08T23:18:01.328 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-05-08T23:18:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/5 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-05-08T23:18:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/5 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-05-08T23:18:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/5 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-05-08T23:18:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/5 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-05-08T23:18:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-05-08T23:18:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-05-08T23:18:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-05-08T23:18:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-05-08T23:18:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:migration 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2024-05-08T23:18:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:migration 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2024-05-08T23:18:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:migration 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2024-05-08T23:18:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:migration 44 root NOFD /proc/44/fd (opendir: Permission denied) 2024-05-08T23:18:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 45 root cwd unknown /proc/45/cwd (readlink: Permission denied) 2024-05-08T23:18:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 45 root rtd unknown /proc/45/root (readlink: Permission denied) 2024-05-08T23:18:01.329 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 45 root txt unknown /proc/45/exe (readlink: Permission denied) 2024-05-08T23:18:01.330 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 45 root NOFD /proc/45/fd (opendir: Permission denied) 2024-05-08T23:18:01.330 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-05-08T23:18:01.330 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-05-08T23:18:01.330 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-05-08T23:18:01.330 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-05-08T23:18:01.330 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/6 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-05-08T23:18:01.330 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/6 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-05-08T23:18:01.330 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/6 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-05-08T23:18:01.330 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/6 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-05-08T23:18:01.330 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-05-08T23:18:01.330 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-05-08T23:18:01.330 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-05-08T23:18:01.330 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-05-08T23:18:01.330 INFO:tasks.workunit.client.0.smithi135.stdout:migration 50 root cwd unknown /proc/50/cwd (readlink: Permission denied) 2024-05-08T23:18:01.331 INFO:tasks.workunit.client.0.smithi135.stdout:migration 50 root rtd unknown /proc/50/root (readlink: Permission denied) 2024-05-08T23:18:01.331 INFO:tasks.workunit.client.0.smithi135.stdout:migration 50 root txt unknown /proc/50/exe (readlink: Permission denied) 2024-05-08T23:18:01.331 INFO:tasks.workunit.client.0.smithi135.stdout:migration 50 root NOFD /proc/50/fd (opendir: Permission denied) 2024-05-08T23:18:01.331 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 51 root cwd unknown /proc/51/cwd (readlink: Permission denied) 2024-05-08T23:18:01.331 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 51 root rtd unknown /proc/51/root (readlink: Permission denied) 2024-05-08T23:18:01.331 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 51 root txt unknown /proc/51/exe (readlink: Permission denied) 2024-05-08T23:18:01.331 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 51 root NOFD /proc/51/fd (opendir: Permission denied) 2024-05-08T23:18:01.331 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-05-08T23:18:01.331 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-05-08T23:18:01.331 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-05-08T23:18:01.331 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-05-08T23:18:01.331 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/7 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-05-08T23:18:01.331 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/7 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-05-08T23:18:01.331 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/7 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-05-08T23:18:01.332 INFO:tasks.workunit.client.0.smithi135.stdout:cpuhp/7 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-05-08T23:18:01.332 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 55 root cwd unknown /proc/55/cwd (readlink: Permission denied) 2024-05-08T23:18:01.332 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 55 root rtd unknown /proc/55/root (readlink: Permission denied) 2024-05-08T23:18:01.332 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 55 root txt unknown /proc/55/exe (readlink: Permission denied) 2024-05-08T23:18:01.332 INFO:tasks.workunit.client.0.smithi135.stdout:watchdog/ 55 root NOFD /proc/55/fd (opendir: Permission denied) 2024-05-08T23:18:01.332 INFO:tasks.workunit.client.0.smithi135.stdout:migration 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2024-05-08T23:18:01.332 INFO:tasks.workunit.client.0.smithi135.stdout:migration 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2024-05-08T23:18:01.332 INFO:tasks.workunit.client.0.smithi135.stdout:migration 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2024-05-08T23:18:01.332 INFO:tasks.workunit.client.0.smithi135.stdout:migration 56 root NOFD /proc/56/fd (opendir: Permission denied) 2024-05-08T23:18:01.332 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 57 root cwd unknown /proc/57/cwd (readlink: Permission denied) 2024-05-08T23:18:01.332 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 57 root rtd unknown /proc/57/root (readlink: Permission denied) 2024-05-08T23:18:01.332 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 57 root txt unknown /proc/57/exe (readlink: Permission denied) 2024-05-08T23:18:01.332 INFO:tasks.workunit.client.0.smithi135.stdout:ksoftirqd 57 root NOFD /proc/57/fd (opendir: Permission denied) 2024-05-08T23:18:01.332 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 63 root cwd unknown /proc/63/cwd (readlink: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 63 root rtd unknown /proc/63/root (readlink: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 63 root txt unknown /proc/63/exe (readlink: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 63 root NOFD /proc/63/fd (opendir: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:kdevtmpfs 68 root cwd unknown /proc/68/cwd (readlink: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:kdevtmpfs 68 root rtd unknown /proc/68/root (readlink: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:kdevtmpfs 68 root txt unknown /proc/68/exe (readlink: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:kdevtmpfs 68 root NOFD /proc/68/fd (opendir: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:netns 69 root cwd unknown /proc/69/cwd (readlink: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:netns 69 root rtd unknown /proc/69/root (readlink: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:netns 69 root txt unknown /proc/69/exe (readlink: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:netns 69 root NOFD /proc/69/fd (opendir: Permission denied) 2024-05-08T23:18:01.333 INFO:tasks.workunit.client.0.smithi135.stdout:kauditd 70 root cwd unknown /proc/70/cwd (readlink: Permission denied) 2024-05-08T23:18:01.334 INFO:tasks.workunit.client.0.smithi135.stdout:kauditd 70 root rtd unknown /proc/70/root (readlink: Permission denied) 2024-05-08T23:18:01.334 INFO:tasks.workunit.client.0.smithi135.stdout:kauditd 70 root txt unknown /proc/70/exe (readlink: Permission denied) 2024-05-08T23:18:01.334 INFO:tasks.workunit.client.0.smithi135.stdout:kauditd 70 root NOFD /proc/70/fd (opendir: Permission denied) 2024-05-08T23:18:01.334 INFO:tasks.workunit.client.0.smithi135.stdout:khungtask 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2024-05-08T23:18:01.334 INFO:tasks.workunit.client.0.smithi135.stdout:khungtask 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2024-05-08T23:18:01.334 INFO:tasks.workunit.client.0.smithi135.stdout:khungtask 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2024-05-08T23:18:01.334 INFO:tasks.workunit.client.0.smithi135.stdout:khungtask 72 root NOFD /proc/72/fd (opendir: Permission denied) 2024-05-08T23:18:01.334 INFO:tasks.workunit.client.0.smithi135.stdout:oom_reape 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2024-05-08T23:18:01.334 INFO:tasks.workunit.client.0.smithi135.stdout:oom_reape 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2024-05-08T23:18:01.335 INFO:tasks.workunit.client.0.smithi135.stdout:oom_reape 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2024-05-08T23:18:01.335 INFO:tasks.workunit.client.0.smithi135.stdout:oom_reape 73 root NOFD /proc/73/fd (opendir: Permission denied) 2024-05-08T23:18:01.335 INFO:tasks.workunit.client.0.smithi135.stdout:writeback 74 root cwd unknown /proc/74/cwd (readlink: Permission denied) 2024-05-08T23:18:01.335 INFO:tasks.workunit.client.0.smithi135.stdout:writeback 74 root rtd unknown /proc/74/root (readlink: Permission denied) 2024-05-08T23:18:01.335 INFO:tasks.workunit.client.0.smithi135.stdout:writeback 74 root txt unknown /proc/74/exe (readlink: Permission denied) 2024-05-08T23:18:01.335 INFO:tasks.workunit.client.0.smithi135.stdout:writeback 74 root NOFD /proc/74/fd (opendir: Permission denied) 2024-05-08T23:18:01.335 INFO:tasks.workunit.client.0.smithi135.stdout:kcompactd 75 root cwd unknown /proc/75/cwd (readlink: Permission denied) 2024-05-08T23:18:01.335 INFO:tasks.workunit.client.0.smithi135.stdout:kcompactd 75 root rtd unknown /proc/75/root (readlink: Permission denied) 2024-05-08T23:18:01.335 INFO:tasks.workunit.client.0.smithi135.stdout:kcompactd 75 root txt unknown /proc/75/exe (readlink: Permission denied) 2024-05-08T23:18:01.335 INFO:tasks.workunit.client.0.smithi135.stdout:kcompactd 75 root NOFD /proc/75/fd (opendir: Permission denied) 2024-05-08T23:18:01.335 INFO:tasks.workunit.client.0.smithi135.stdout:ksmd 76 root cwd unknown /proc/76/cwd (readlink: Permission denied) 2024-05-08T23:18:01.335 INFO:tasks.workunit.client.0.smithi135.stdout:ksmd 76 root rtd unknown /proc/76/root (readlink: Permission denied) 2024-05-08T23:18:01.336 INFO:tasks.workunit.client.0.smithi135.stdout:ksmd 76 root txt unknown /proc/76/exe (readlink: Permission denied) 2024-05-08T23:18:01.336 INFO:tasks.workunit.client.0.smithi135.stdout:ksmd 76 root NOFD /proc/76/fd (opendir: Permission denied) 2024-05-08T23:18:01.336 INFO:tasks.workunit.client.0.smithi135.stdout:khugepage 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2024-05-08T23:18:01.336 INFO:tasks.workunit.client.0.smithi135.stdout:khugepage 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2024-05-08T23:18:01.336 INFO:tasks.workunit.client.0.smithi135.stdout:khugepage 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2024-05-08T23:18:01.336 INFO:tasks.workunit.client.0.smithi135.stdout:khugepage 77 root NOFD /proc/77/fd (opendir: Permission denied) 2024-05-08T23:18:01.336 INFO:tasks.workunit.client.0.smithi135.stdout:crypto 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2024-05-08T23:18:01.336 INFO:tasks.workunit.client.0.smithi135.stdout:crypto 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2024-05-08T23:18:01.336 INFO:tasks.workunit.client.0.smithi135.stdout:crypto 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2024-05-08T23:18:01.336 INFO:tasks.workunit.client.0.smithi135.stdout:crypto 78 root NOFD /proc/78/fd (opendir: Permission denied) 2024-05-08T23:18:01.336 INFO:tasks.workunit.client.0.smithi135.stdout:kintegrit 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-05-08T23:18:01.336 INFO:tasks.workunit.client.0.smithi135.stdout:kintegrit 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-05-08T23:18:01.336 INFO:tasks.workunit.client.0.smithi135.stdout:kintegrit 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-05-08T23:18:01.336 INFO:tasks.workunit.client.0.smithi135.stdout:kintegrit 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-05-08T23:18:01.336 INFO:tasks.workunit.client.0.smithi135.stdout:kblockd 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-05-08T23:18:01.337 INFO:tasks.workunit.client.0.smithi135.stdout:kblockd 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-05-08T23:18:01.337 INFO:tasks.workunit.client.0.smithi135.stdout:kblockd 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-05-08T23:18:01.337 INFO:tasks.workunit.client.0.smithi135.stdout:kblockd 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-05-08T23:18:01.337 INFO:tasks.workunit.client.0.smithi135.stdout:blkcg_pun 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2024-05-08T23:18:01.337 INFO:tasks.workunit.client.0.smithi135.stdout:blkcg_pun 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2024-05-08T23:18:01.337 INFO:tasks.workunit.client.0.smithi135.stdout:blkcg_pun 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2024-05-08T23:18:01.337 INFO:tasks.workunit.client.0.smithi135.stdout:blkcg_pun 81 root NOFD /proc/81/fd (opendir: Permission denied) 2024-05-08T23:18:01.337 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2024-05-08T23:18:01.337 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2024-05-08T23:18:01.337 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2024-05-08T23:18:01.338 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 82 root NOFD /proc/82/fd (opendir: Permission denied) 2024-05-08T23:18:01.338 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2024-05-08T23:18:01.338 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2024-05-08T23:18:01.338 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2024-05-08T23:18:01.338 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 83 root NOFD /proc/83/fd (opendir: Permission denied) 2024-05-08T23:18:01.338 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 86 root cwd unknown /proc/86/cwd (readlink: Permission denied) 2024-05-08T23:18:01.338 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 86 root rtd unknown /proc/86/root (readlink: Permission denied) 2024-05-08T23:18:01.339 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 86 root txt unknown /proc/86/exe (readlink: Permission denied) 2024-05-08T23:18:01.339 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 86 root NOFD /proc/86/fd (opendir: Permission denied) 2024-05-08T23:18:01.339 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2024-05-08T23:18:01.339 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2024-05-08T23:18:01.339 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2024-05-08T23:18:01.339 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 87 root NOFD /proc/87/fd (opendir: Permission denied) 2024-05-08T23:18:01.339 INFO:tasks.workunit.client.0.smithi135.stdout:tpm_dev_w 88 root cwd unknown /proc/88/cwd (readlink: Permission denied) 2024-05-08T23:18:01.339 INFO:tasks.workunit.client.0.smithi135.stdout:tpm_dev_w 88 root rtd unknown /proc/88/root (readlink: Permission denied) 2024-05-08T23:18:01.339 INFO:tasks.workunit.client.0.smithi135.stdout:tpm_dev_w 88 root txt unknown /proc/88/exe (readlink: Permission denied) 2024-05-08T23:18:01.339 INFO:tasks.workunit.client.0.smithi135.stdout:tpm_dev_w 88 root NOFD /proc/88/fd (opendir: Permission denied) 2024-05-08T23:18:01.339 INFO:tasks.workunit.client.0.smithi135.stdout:md 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-05-08T23:18:01.339 INFO:tasks.workunit.client.0.smithi135.stdout:md 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-05-08T23:18:01.339 INFO:tasks.workunit.client.0.smithi135.stdout:md 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-05-08T23:18:01.340 INFO:tasks.workunit.client.0.smithi135.stdout:md 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-05-08T23:18:01.340 INFO:tasks.workunit.client.0.smithi135.stdout:edac-poll 90 root cwd unknown /proc/90/cwd (readlink: Permission denied) 2024-05-08T23:18:01.340 INFO:tasks.workunit.client.0.smithi135.stdout:edac-poll 90 root rtd unknown /proc/90/root (readlink: Permission denied) 2024-05-08T23:18:01.340 INFO:tasks.workunit.client.0.smithi135.stdout:edac-poll 90 root txt unknown /proc/90/exe (readlink: Permission denied) 2024-05-08T23:18:01.340 INFO:tasks.workunit.client.0.smithi135.stdout:edac-poll 90 root NOFD /proc/90/fd (opendir: Permission denied) 2024-05-08T23:18:01.340 INFO:tasks.workunit.client.0.smithi135.stdout:watchdogd 91 root cwd unknown /proc/91/cwd (readlink: Permission denied) 2024-05-08T23:18:01.340 INFO:tasks.workunit.client.0.smithi135.stdout:watchdogd 91 root rtd unknown /proc/91/root (readlink: Permission denied) 2024-05-08T23:18:01.340 INFO:tasks.workunit.client.0.smithi135.stdout:watchdogd 91 root txt unknown /proc/91/exe (readlink: Permission denied) 2024-05-08T23:18:01.340 INFO:tasks.workunit.client.0.smithi135.stdout:watchdogd 91 root NOFD /proc/91/fd (opendir: Permission denied) 2024-05-08T23:18:01.340 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 92 root cwd unknown /proc/92/cwd (readlink: Permission denied) 2024-05-08T23:18:01.340 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 92 root rtd unknown /proc/92/root (readlink: Permission denied) 2024-05-08T23:18:01.340 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 92 root txt unknown /proc/92/exe (readlink: Permission denied) 2024-05-08T23:18:01.340 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 92 root NOFD /proc/92/fd (opendir: Permission denied) 2024-05-08T23:18:01.341 INFO:tasks.workunit.client.0.smithi135.stdout:kswapd0 109 root cwd unknown /proc/109/cwd (readlink: Permission denied) 2024-05-08T23:18:01.341 INFO:tasks.workunit.client.0.smithi135.stdout:kswapd0 109 root rtd unknown /proc/109/root (readlink: Permission denied) 2024-05-08T23:18:01.341 INFO:tasks.workunit.client.0.smithi135.stdout:kswapd0 109 root txt unknown /proc/109/exe (readlink: Permission denied) 2024-05-08T23:18:01.341 INFO:tasks.workunit.client.0.smithi135.stdout:kswapd0 109 root NOFD /proc/109/fd (opendir: Permission denied) 2024-05-08T23:18:01.341 INFO:tasks.workunit.client.0.smithi135.stdout:kthrotld 170 root cwd unknown /proc/170/cwd (readlink: Permission denied) 2024-05-08T23:18:01.341 INFO:tasks.workunit.client.0.smithi135.stdout:kthrotld 170 root rtd unknown /proc/170/root (readlink: Permission denied) 2024-05-08T23:18:01.341 INFO:tasks.workunit.client.0.smithi135.stdout:kthrotld 170 root txt unknown /proc/170/exe (readlink: Permission denied) 2024-05-08T23:18:01.341 INFO:tasks.workunit.client.0.smithi135.stdout:kthrotld 170 root NOFD /proc/170/fd (opendir: Permission denied) 2024-05-08T23:18:01.341 INFO:tasks.workunit.client.0.smithi135.stdout:acpi_ther 171 root cwd unknown /proc/171/cwd (readlink: Permission denied) 2024-05-08T23:18:01.341 INFO:tasks.workunit.client.0.smithi135.stdout:acpi_ther 171 root rtd unknown /proc/171/root (readlink: Permission denied) 2024-05-08T23:18:01.341 INFO:tasks.workunit.client.0.smithi135.stdout:acpi_ther 171 root txt unknown /proc/171/exe (readlink: Permission denied) 2024-05-08T23:18:01.341 INFO:tasks.workunit.client.0.smithi135.stdout:acpi_ther 171 root NOFD /proc/171/fd (opendir: Permission denied) 2024-05-08T23:18:01.341 INFO:tasks.workunit.client.0.smithi135.stdout:kmpath_rd 172 root cwd unknown /proc/172/cwd (readlink: Permission denied) 2024-05-08T23:18:01.341 INFO:tasks.workunit.client.0.smithi135.stdout:kmpath_rd 172 root rtd unknown /proc/172/root (readlink: Permission denied) 2024-05-08T23:18:01.341 INFO:tasks.workunit.client.0.smithi135.stdout:kmpath_rd 172 root txt unknown /proc/172/exe (readlink: Permission denied) 2024-05-08T23:18:01.342 INFO:tasks.workunit.client.0.smithi135.stdout:kmpath_rd 172 root NOFD /proc/172/fd (opendir: Permission denied) 2024-05-08T23:18:01.342 INFO:tasks.workunit.client.0.smithi135.stdout:kaluad 173 root cwd unknown /proc/173/cwd (readlink: Permission denied) 2024-05-08T23:18:01.342 INFO:tasks.workunit.client.0.smithi135.stdout:kaluad 173 root rtd unknown /proc/173/root (readlink: Permission denied) 2024-05-08T23:18:01.342 INFO:tasks.workunit.client.0.smithi135.stdout:kaluad 173 root txt unknown /proc/173/exe (readlink: Permission denied) 2024-05-08T23:18:01.342 INFO:tasks.workunit.client.0.smithi135.stdout:kaluad 173 root NOFD /proc/173/fd (opendir: Permission denied) 2024-05-08T23:18:01.342 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 177 root cwd unknown /proc/177/cwd (readlink: Permission denied) 2024-05-08T23:18:01.342 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 177 root rtd unknown /proc/177/root (readlink: Permission denied) 2024-05-08T23:18:01.342 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 177 root txt unknown /proc/177/exe (readlink: Permission denied) 2024-05-08T23:18:01.342 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 177 root NOFD /proc/177/fd (opendir: Permission denied) 2024-05-08T23:18:01.342 INFO:tasks.workunit.client.0.smithi135.stdout:ipv6_addr 178 root cwd unknown /proc/178/cwd (readlink: Permission denied) 2024-05-08T23:18:01.342 INFO:tasks.workunit.client.0.smithi135.stdout:ipv6_addr 178 root rtd unknown /proc/178/root (readlink: Permission denied) 2024-05-08T23:18:01.342 INFO:tasks.workunit.client.0.smithi135.stdout:ipv6_addr 178 root txt unknown /proc/178/exe (readlink: Permission denied) 2024-05-08T23:18:01.342 INFO:tasks.workunit.client.0.smithi135.stdout:ipv6_addr 178 root NOFD /proc/178/fd (opendir: Permission denied) 2024-05-08T23:18:01.342 INFO:tasks.workunit.client.0.smithi135.stdout:kstrp 179 root cwd unknown /proc/179/cwd (readlink: Permission denied) 2024-05-08T23:18:01.343 INFO:tasks.workunit.client.0.smithi135.stdout:kstrp 179 root rtd unknown /proc/179/root (readlink: Permission denied) 2024-05-08T23:18:01.343 INFO:tasks.workunit.client.0.smithi135.stdout:kstrp 179 root txt unknown /proc/179/exe (readlink: Permission denied) 2024-05-08T23:18:01.343 INFO:tasks.workunit.client.0.smithi135.stdout:kstrp 179 root NOFD /proc/179/fd (opendir: Permission denied) 2024-05-08T23:18:01.343 INFO:tasks.workunit.client.0.smithi135.stdout:zswap-shr 218 root cwd unknown /proc/218/cwd (readlink: Permission denied) 2024-05-08T23:18:01.343 INFO:tasks.workunit.client.0.smithi135.stdout:zswap-shr 218 root rtd unknown /proc/218/root (readlink: Permission denied) 2024-05-08T23:18:01.343 INFO:tasks.workunit.client.0.smithi135.stdout:zswap-shr 218 root txt unknown /proc/218/exe (readlink: Permission denied) 2024-05-08T23:18:01.343 INFO:tasks.workunit.client.0.smithi135.stdout:zswap-shr 218 root NOFD /proc/218/fd (opendir: Permission denied) 2024-05-08T23:18:01.343 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 238 root cwd unknown /proc/238/cwd (readlink: Permission denied) 2024-05-08T23:18:01.343 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 238 root rtd unknown /proc/238/root (readlink: Permission denied) 2024-05-08T23:18:01.343 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 238 root txt unknown /proc/238/exe (readlink: Permission denied) 2024-05-08T23:18:01.343 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 238 root NOFD /proc/238/fd (opendir: Permission denied) 2024-05-08T23:18:01.343 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 266 root cwd unknown /proc/266/cwd (readlink: Permission denied) 2024-05-08T23:18:01.343 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 266 root rtd unknown /proc/266/root (readlink: Permission denied) 2024-05-08T23:18:01.343 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 266 root txt unknown /proc/266/exe (readlink: Permission denied) 2024-05-08T23:18:01.343 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 266 root NOFD /proc/266/fd (opendir: Permission denied) 2024-05-08T23:18:01.344 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 267 root cwd unknown /proc/267/cwd (readlink: Permission denied) 2024-05-08T23:18:01.344 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 267 root rtd unknown /proc/267/root (readlink: Permission denied) 2024-05-08T23:18:01.344 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 267 root txt unknown /proc/267/exe (readlink: Permission denied) 2024-05-08T23:18:01.344 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 267 root NOFD /proc/267/fd (opendir: Permission denied) 2024-05-08T23:18:01.344 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 338 root cwd unknown /proc/338/cwd (readlink: Permission denied) 2024-05-08T23:18:01.344 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 338 root rtd unknown /proc/338/root (readlink: Permission denied) 2024-05-08T23:18:01.344 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 338 root txt unknown /proc/338/exe (readlink: Permission denied) 2024-05-08T23:18:01.344 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 338 root NOFD /proc/338/fd (opendir: Permission denied) 2024-05-08T23:18:01.344 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 340 root cwd unknown /proc/340/cwd (readlink: Permission denied) 2024-05-08T23:18:01.344 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 340 root rtd unknown /proc/340/root (readlink: Permission denied) 2024-05-08T23:18:01.344 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 340 root txt unknown /proc/340/exe (readlink: Permission denied) 2024-05-08T23:18:01.344 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 340 root NOFD /proc/340/fd (opendir: Permission denied) 2024-05-08T23:18:01.344 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 369 root cwd unknown /proc/369/cwd (readlink: Permission denied) 2024-05-08T23:18:01.344 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 369 root rtd unknown /proc/369/root (readlink: Permission denied) 2024-05-08T23:18:01.344 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 369 root txt unknown /proc/369/exe (readlink: Permission denied) 2024-05-08T23:18:01.345 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 369 root NOFD /proc/369/fd (opendir: Permission denied) 2024-05-08T23:18:01.345 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 370 root cwd unknown /proc/370/cwd (readlink: Permission denied) 2024-05-08T23:18:01.345 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 370 root rtd unknown /proc/370/root (readlink: Permission denied) 2024-05-08T23:18:01.345 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 370 root txt unknown /proc/370/exe (readlink: Permission denied) 2024-05-08T23:18:01.345 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 370 root NOFD /proc/370/fd (opendir: Permission denied) 2024-05-08T23:18:01.345 INFO:tasks.workunit.client.0.smithi135.stdout:nvme-wq 416 root cwd unknown /proc/416/cwd (readlink: Permission denied) 2024-05-08T23:18:01.345 INFO:tasks.workunit.client.0.smithi135.stdout:nvme-wq 416 root rtd unknown /proc/416/root (readlink: Permission denied) 2024-05-08T23:18:01.345 INFO:tasks.workunit.client.0.smithi135.stdout:nvme-wq 416 root txt unknown /proc/416/exe (readlink: Permission denied) 2024-05-08T23:18:01.345 INFO:tasks.workunit.client.0.smithi135.stdout:nvme-wq 416 root NOFD /proc/416/fd (opendir: Permission denied) 2024-05-08T23:18:01.345 INFO:tasks.workunit.client.0.smithi135.stdout:nvme-rese 417 root cwd unknown /proc/417/cwd (readlink: Permission denied) 2024-05-08T23:18:01.345 INFO:tasks.workunit.client.0.smithi135.stdout:nvme-rese 417 root rtd unknown /proc/417/root (readlink: Permission denied) 2024-05-08T23:18:01.345 INFO:tasks.workunit.client.0.smithi135.stdout:nvme-rese 417 root txt unknown /proc/417/exe (readlink: Permission denied) 2024-05-08T23:18:01.345 INFO:tasks.workunit.client.0.smithi135.stdout:nvme-rese 417 root NOFD /proc/417/fd (opendir: Permission denied) 2024-05-08T23:18:01.345 INFO:tasks.workunit.client.0.smithi135.stdout:nvme-dele 418 root cwd unknown /proc/418/cwd (readlink: Permission denied) 2024-05-08T23:18:01.345 INFO:tasks.workunit.client.0.smithi135.stdout:nvme-dele 418 root rtd unknown /proc/418/root (readlink: Permission denied) 2024-05-08T23:18:01.346 INFO:tasks.workunit.client.0.smithi135.stdout:nvme-dele 418 root txt unknown /proc/418/exe (readlink: Permission denied) 2024-05-08T23:18:01.346 INFO:tasks.workunit.client.0.smithi135.stdout:nvme-dele 418 root NOFD /proc/418/fd (opendir: Permission denied) 2024-05-08T23:18:01.346 INFO:tasks.workunit.client.0.smithi135.stdout:ata_sff 419 root cwd unknown /proc/419/cwd (readlink: Permission denied) 2024-05-08T23:18:01.346 INFO:tasks.workunit.client.0.smithi135.stdout:ata_sff 419 root rtd unknown /proc/419/root (readlink: Permission denied) 2024-05-08T23:18:01.346 INFO:tasks.workunit.client.0.smithi135.stdout:ata_sff 419 root txt unknown /proc/419/exe (readlink: Permission denied) 2024-05-08T23:18:01.346 INFO:tasks.workunit.client.0.smithi135.stdout:ata_sff 419 root NOFD /proc/419/fd (opendir: Permission denied) 2024-05-08T23:18:01.346 INFO:tasks.workunit.client.0.smithi135.stdout:ixgbe 429 root cwd unknown /proc/429/cwd (readlink: Permission denied) 2024-05-08T23:18:01.346 INFO:tasks.workunit.client.0.smithi135.stdout:ixgbe 429 root rtd unknown /proc/429/root (readlink: Permission denied) 2024-05-08T23:18:01.346 INFO:tasks.workunit.client.0.smithi135.stdout:ixgbe 429 root txt unknown /proc/429/exe (readlink: Permission denied) 2024-05-08T23:18:01.346 INFO:tasks.workunit.client.0.smithi135.stdout:ixgbe 429 root NOFD /proc/429/fd (opendir: Permission denied) 2024-05-08T23:18:01.346 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_0 432 root cwd unknown /proc/432/cwd (readlink: Permission denied) 2024-05-08T23:18:01.346 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_0 432 root rtd unknown /proc/432/root (readlink: Permission denied) 2024-05-08T23:18:01.346 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_0 432 root txt unknown /proc/432/exe (readlink: Permission denied) 2024-05-08T23:18:01.346 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_0 432 root NOFD /proc/432/fd (opendir: Permission denied) 2024-05-08T23:18:01.346 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 433 root cwd unknown /proc/433/cwd (readlink: Permission denied) 2024-05-08T23:18:01.347 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 433 root rtd unknown /proc/433/root (readlink: Permission denied) 2024-05-08T23:18:01.347 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 433 root txt unknown /proc/433/exe (readlink: Permission denied) 2024-05-08T23:18:01.347 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 433 root NOFD /proc/433/fd (opendir: Permission denied) 2024-05-08T23:18:01.347 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_1 434 root cwd unknown /proc/434/cwd (readlink: Permission denied) 2024-05-08T23:18:01.347 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_1 434 root rtd unknown /proc/434/root (readlink: Permission denied) 2024-05-08T23:18:01.347 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_1 434 root txt unknown /proc/434/exe (readlink: Permission denied) 2024-05-08T23:18:01.347 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_1 434 root NOFD /proc/434/fd (opendir: Permission denied) 2024-05-08T23:18:01.347 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 435 root cwd unknown /proc/435/cwd (readlink: Permission denied) 2024-05-08T23:18:01.347 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 435 root rtd unknown /proc/435/root (readlink: Permission denied) 2024-05-08T23:18:01.347 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 435 root txt unknown /proc/435/exe (readlink: Permission denied) 2024-05-08T23:18:01.347 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 435 root NOFD /proc/435/fd (opendir: Permission denied) 2024-05-08T23:18:01.347 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_2 436 root cwd unknown /proc/436/cwd (readlink: Permission denied) 2024-05-08T23:18:01.347 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_2 436 root rtd unknown /proc/436/root (readlink: Permission denied) 2024-05-08T23:18:01.347 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_2 436 root txt unknown /proc/436/exe (readlink: Permission denied) 2024-05-08T23:18:01.348 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_2 436 root NOFD /proc/436/fd (opendir: Permission denied) 2024-05-08T23:18:01.348 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 437 root cwd unknown /proc/437/cwd (readlink: Permission denied) 2024-05-08T23:18:01.348 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 437 root rtd unknown /proc/437/root (readlink: Permission denied) 2024-05-08T23:18:01.348 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 437 root txt unknown /proc/437/exe (readlink: Permission denied) 2024-05-08T23:18:01.348 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 437 root NOFD /proc/437/fd (opendir: Permission denied) 2024-05-08T23:18:01.348 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_3 438 root cwd unknown /proc/438/cwd (readlink: Permission denied) 2024-05-08T23:18:01.348 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_3 438 root rtd unknown /proc/438/root (readlink: Permission denied) 2024-05-08T23:18:01.348 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_3 438 root txt unknown /proc/438/exe (readlink: Permission denied) 2024-05-08T23:18:01.348 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_3 438 root NOFD /proc/438/fd (opendir: Permission denied) 2024-05-08T23:18:01.348 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 439 root cwd unknown /proc/439/cwd (readlink: Permission denied) 2024-05-08T23:18:01.348 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 439 root rtd unknown /proc/439/root (readlink: Permission denied) 2024-05-08T23:18:01.348 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 439 root txt unknown /proc/439/exe (readlink: Permission denied) 2024-05-08T23:18:01.348 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 439 root NOFD /proc/439/fd (opendir: Permission denied) 2024-05-08T23:18:01.348 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_4 442 root cwd unknown /proc/442/cwd (readlink: Permission denied) 2024-05-08T23:18:01.348 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_4 442 root rtd unknown /proc/442/root (readlink: Permission denied) 2024-05-08T23:18:01.349 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_4 442 root txt unknown /proc/442/exe (readlink: Permission denied) 2024-05-08T23:18:01.349 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_4 442 root NOFD /proc/442/fd (opendir: Permission denied) 2024-05-08T23:18:01.349 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 443 root cwd unknown /proc/443/cwd (readlink: Permission denied) 2024-05-08T23:18:01.349 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 443 root rtd unknown /proc/443/root (readlink: Permission denied) 2024-05-08T23:18:01.349 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 443 root txt unknown /proc/443/exe (readlink: Permission denied) 2024-05-08T23:18:01.349 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 443 root NOFD /proc/443/fd (opendir: Permission denied) 2024-05-08T23:18:01.349 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_5 444 root cwd unknown /proc/444/cwd (readlink: Permission denied) 2024-05-08T23:18:01.349 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_5 444 root rtd unknown /proc/444/root (readlink: Permission denied) 2024-05-08T23:18:01.349 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_5 444 root txt unknown /proc/444/exe (readlink: Permission denied) 2024-05-08T23:18:01.349 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_5 444 root NOFD /proc/444/fd (opendir: Permission denied) 2024-05-08T23:18:01.349 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 445 root cwd unknown /proc/445/cwd (readlink: Permission denied) 2024-05-08T23:18:01.349 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 445 root rtd unknown /proc/445/root (readlink: Permission denied) 2024-05-08T23:18:01.349 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 445 root txt unknown /proc/445/exe (readlink: Permission denied) 2024-05-08T23:18:01.349 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 445 root NOFD /proc/445/fd (opendir: Permission denied) 2024-05-08T23:18:01.349 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_6 446 root cwd unknown /proc/446/cwd (readlink: Permission denied) 2024-05-08T23:18:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_6 446 root rtd unknown /proc/446/root (readlink: Permission denied) 2024-05-08T23:18:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_6 446 root txt unknown /proc/446/exe (readlink: Permission denied) 2024-05-08T23:18:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_6 446 root NOFD /proc/446/fd (opendir: Permission denied) 2024-05-08T23:18:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 447 root cwd unknown /proc/447/cwd (readlink: Permission denied) 2024-05-08T23:18:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 447 root rtd unknown /proc/447/root (readlink: Permission denied) 2024-05-08T23:18:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 447 root txt unknown /proc/447/exe (readlink: Permission denied) 2024-05-08T23:18:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 447 root NOFD /proc/447/fd (opendir: Permission denied) 2024-05-08T23:18:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_7 448 root cwd unknown /proc/448/cwd (readlink: Permission denied) 2024-05-08T23:18:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_7 448 root rtd unknown /proc/448/root (readlink: Permission denied) 2024-05-08T23:18:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_7 448 root txt unknown /proc/448/exe (readlink: Permission denied) 2024-05-08T23:18:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_7 448 root NOFD /proc/448/fd (opendir: Permission denied) 2024-05-08T23:18:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 449 root cwd unknown /proc/449/cwd (readlink: Permission denied) 2024-05-08T23:18:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 449 root rtd unknown /proc/449/root (readlink: Permission denied) 2024-05-08T23:18:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 449 root txt unknown /proc/449/exe (readlink: Permission denied) 2024-05-08T23:18:01.350 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 449 root NOFD /proc/449/fd (opendir: Permission denied) 2024-05-08T23:18:01.351 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_8 450 root cwd unknown /proc/450/cwd (readlink: Permission denied) 2024-05-08T23:18:01.351 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_8 450 root rtd unknown /proc/450/root (readlink: Permission denied) 2024-05-08T23:18:01.351 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_8 450 root txt unknown /proc/450/exe (readlink: Permission denied) 2024-05-08T23:18:01.351 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_8 450 root NOFD /proc/450/fd (opendir: Permission denied) 2024-05-08T23:18:01.351 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 451 root cwd unknown /proc/451/cwd (readlink: Permission denied) 2024-05-08T23:18:01.351 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 451 root rtd unknown /proc/451/root (readlink: Permission denied) 2024-05-08T23:18:01.351 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 451 root txt unknown /proc/451/exe (readlink: Permission denied) 2024-05-08T23:18:01.351 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 451 root NOFD /proc/451/fd (opendir: Permission denied) 2024-05-08T23:18:01.351 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_9 452 root cwd unknown /proc/452/cwd (readlink: Permission denied) 2024-05-08T23:18:01.351 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_9 452 root rtd unknown /proc/452/root (readlink: Permission denied) 2024-05-08T23:18:01.351 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_9 452 root txt unknown /proc/452/exe (readlink: Permission denied) 2024-05-08T23:18:01.351 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_eh_9 452 root NOFD /proc/452/fd (opendir: Permission denied) 2024-05-08T23:18:01.351 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 453 root cwd unknown /proc/453/cwd (readlink: Permission denied) 2024-05-08T23:18:01.351 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 453 root rtd unknown /proc/453/root (readlink: Permission denied) 2024-05-08T23:18:01.352 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 453 root txt unknown /proc/453/exe (readlink: Permission denied) 2024-05-08T23:18:01.352 INFO:tasks.workunit.client.0.smithi135.stdout:scsi_tmf_ 453 root NOFD /proc/453/fd (opendir: Permission denied) 2024-05-08T23:18:01.352 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 454 root cwd unknown /proc/454/cwd (readlink: Permission denied) 2024-05-08T23:18:01.352 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 454 root rtd unknown /proc/454/root (readlink: Permission denied) 2024-05-08T23:18:01.352 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 454 root txt unknown /proc/454/exe (readlink: Permission denied) 2024-05-08T23:18:01.352 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 454 root NOFD /proc/454/fd (opendir: Permission denied) 2024-05-08T23:18:01.352 INFO:tasks.workunit.client.0.smithi135.stdout:jbd2/sda1 486 root cwd unknown /proc/486/cwd (readlink: Permission denied) 2024-05-08T23:18:01.352 INFO:tasks.workunit.client.0.smithi135.stdout:jbd2/sda1 486 root rtd unknown /proc/486/root (readlink: Permission denied) 2024-05-08T23:18:01.352 INFO:tasks.workunit.client.0.smithi135.stdout:jbd2/sda1 486 root txt unknown /proc/486/exe (readlink: Permission denied) 2024-05-08T23:18:01.352 INFO:tasks.workunit.client.0.smithi135.stdout:jbd2/sda1 486 root NOFD /proc/486/fd (opendir: Permission denied) 2024-05-08T23:18:01.352 INFO:tasks.workunit.client.0.smithi135.stdout:ext4-rsv- 487 root cwd unknown /proc/487/cwd (readlink: Permission denied) 2024-05-08T23:18:01.352 INFO:tasks.workunit.client.0.smithi135.stdout:ext4-rsv- 487 root rtd unknown /proc/487/root (readlink: Permission denied) 2024-05-08T23:18:01.352 INFO:tasks.workunit.client.0.smithi135.stdout:ext4-rsv- 487 root txt unknown /proc/487/exe (readlink: Permission denied) 2024-05-08T23:18:01.352 INFO:tasks.workunit.client.0.smithi135.stdout:ext4-rsv- 487 root NOFD /proc/487/fd (opendir: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:systemd-j 587 root cwd unknown /proc/587/cwd (readlink: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:systemd-j 587 root rtd unknown /proc/587/root (readlink: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:systemd-j 587 root txt unknown /proc/587/exe (readlink: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:systemd-j 587 root NOFD /proc/587/fd (opendir: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:ext4lazyi 600 root cwd unknown /proc/600/cwd (readlink: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:ext4lazyi 600 root rtd unknown /proc/600/root (readlink: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:ext4lazyi 600 root txt unknown /proc/600/exe (readlink: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:ext4lazyi 600 root NOFD /proc/600/fd (opendir: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 627 root cwd unknown /proc/627/cwd (readlink: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 627 root rtd unknown /proc/627/root (readlink: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 627 root txt unknown /proc/627/exe (readlink: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 627 root NOFD /proc/627/fd (opendir: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:systemd-u 655 root cwd unknown /proc/655/cwd (readlink: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:systemd-u 655 root rtd unknown /proc/655/root (readlink: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:systemd-u 655 root txt unknown /proc/655/exe (readlink: Permission denied) 2024-05-08T23:18:01.353 INFO:tasks.workunit.client.0.smithi135.stdout:systemd-u 655 root NOFD /proc/655/fd (opendir: Permission denied) 2024-05-08T23:18:01.354 INFO:tasks.workunit.client.0.smithi135.stdout:rpcbind 658 rpc cwd unknown /proc/658/cwd (readlink: Permission denied) 2024-05-08T23:18:01.354 INFO:tasks.workunit.client.0.smithi135.stdout:rpcbind 658 rpc rtd unknown /proc/658/root (readlink: Permission denied) 2024-05-08T23:18:01.354 INFO:tasks.workunit.client.0.smithi135.stdout:rpcbind 658 rpc txt unknown /proc/658/exe (readlink: Permission denied) 2024-05-08T23:18:01.354 INFO:tasks.workunit.client.0.smithi135.stdout:rpcbind 658 rpc NOFD /proc/658/fd (opendir: Permission denied) 2024-05-08T23:18:01.354 INFO:tasks.workunit.client.0.smithi135.stdout:rpciod 662 root cwd unknown /proc/662/cwd (readlink: Permission denied) 2024-05-08T23:18:01.354 INFO:tasks.workunit.client.0.smithi135.stdout:rpciod 662 root rtd unknown /proc/662/root (readlink: Permission denied) 2024-05-08T23:18:01.354 INFO:tasks.workunit.client.0.smithi135.stdout:rpciod 662 root txt unknown /proc/662/exe (readlink: Permission denied) 2024-05-08T23:18:01.354 INFO:tasks.workunit.client.0.smithi135.stdout:rpciod 662 root NOFD /proc/662/fd (opendir: Permission denied) 2024-05-08T23:18:01.354 INFO:tasks.workunit.client.0.smithi135.stdout:xprtiod 663 root cwd unknown /proc/663/cwd (readlink: Permission denied) 2024-05-08T23:18:01.354 INFO:tasks.workunit.client.0.smithi135.stdout:xprtiod 663 root rtd unknown /proc/663/root (readlink: Permission denied) 2024-05-08T23:18:01.354 INFO:tasks.workunit.client.0.smithi135.stdout:xprtiod 663 root txt unknown /proc/663/exe (readlink: Permission denied) 2024-05-08T23:18:01.354 INFO:tasks.workunit.client.0.smithi135.stdout:xprtiod 663 root NOFD /proc/663/fd (opendir: Permission denied) 2024-05-08T23:18:01.354 INFO:tasks.workunit.client.0.smithi135.stdout:auditd 665 root cwd unknown /proc/665/cwd (readlink: Permission denied) 2024-05-08T23:18:01.355 INFO:tasks.workunit.client.0.smithi135.stdout:auditd 665 root rtd unknown /proc/665/root (readlink: Permission denied) 2024-05-08T23:18:01.355 INFO:tasks.workunit.client.0.smithi135.stdout:auditd 665 root txt unknown /proc/665/exe (readlink: Permission denied) 2024-05-08T23:18:01.355 INFO:tasks.workunit.client.0.smithi135.stdout:auditd 665 root NOFD /proc/665/fd (opendir: Permission denied) 2024-05-08T23:18:01.355 INFO:tasks.workunit.client.0.smithi135.stdout:auditd 665 666 auditd root cwd unknown /proc/665/task/666/cwd (readlink: Permission denied) 2024-05-08T23:18:01.355 INFO:tasks.workunit.client.0.smithi135.stdout:auditd 665 666 auditd root rtd unknown /proc/665/task/666/root (readlink: Permission denied) 2024-05-08T23:18:01.355 INFO:tasks.workunit.client.0.smithi135.stdout:auditd 665 666 auditd root txt unknown /proc/665/task/666/exe (readlink: Permission denied) 2024-05-08T23:18:01.355 INFO:tasks.workunit.client.0.smithi135.stdout:auditd 665 666 auditd root NOFD /proc/665/task/666/fd (opendir: Permission denied) 2024-05-08T23:18:01.355 INFO:tasks.workunit.client.0.smithi135.stdout:auditd 665 668 auditd root cwd unknown /proc/665/task/668/cwd (readlink: Permission denied) 2024-05-08T23:18:01.355 INFO:tasks.workunit.client.0.smithi135.stdout:auditd 665 668 auditd root rtd unknown /proc/665/task/668/root (readlink: Permission denied) 2024-05-08T23:18:01.355 INFO:tasks.workunit.client.0.smithi135.stdout:auditd 665 668 auditd root txt unknown /proc/665/task/668/exe (readlink: Permission denied) 2024-05-08T23:18:01.355 INFO:tasks.workunit.client.0.smithi135.stdout:auditd 665 668 auditd root NOFD /proc/665/task/668/fd (opendir: Permission denied) 2024-05-08T23:18:01.355 INFO:tasks.workunit.client.0.smithi135.stdout:sedispatc 667 root cwd unknown /proc/667/cwd (readlink: Permission denied) 2024-05-08T23:18:01.355 INFO:tasks.workunit.client.0.smithi135.stdout:sedispatc 667 root rtd unknown /proc/667/root (readlink: Permission denied) 2024-05-08T23:18:01.355 INFO:tasks.workunit.client.0.smithi135.stdout:sedispatc 667 root txt unknown /proc/667/exe (readlink: Permission denied) 2024-05-08T23:18:01.356 INFO:tasks.workunit.client.0.smithi135.stdout:sedispatc 667 root NOFD /proc/667/fd (opendir: Permission denied) 2024-05-08T23:18:01.356 INFO:tasks.workunit.client.0.smithi135.stdout:ipmi-msgh 702 root cwd unknown /proc/702/cwd (readlink: Permission denied) 2024-05-08T23:18:01.356 INFO:tasks.workunit.client.0.smithi135.stdout:ipmi-msgh 702 root rtd unknown /proc/702/root (readlink: Permission denied) 2024-05-08T23:18:01.356 INFO:tasks.workunit.client.0.smithi135.stdout:ipmi-msgh 702 root txt unknown /proc/702/exe (readlink: Permission denied) 2024-05-08T23:18:01.356 INFO:tasks.workunit.client.0.smithi135.stdout:ipmi-msgh 702 root NOFD /proc/702/fd (opendir: Permission denied) 2024-05-08T23:18:01.356 INFO:tasks.workunit.client.0.smithi135.stdout:kipmi0 724 root cwd unknown /proc/724/cwd (readlink: Permission denied) 2024-05-08T23:18:01.356 INFO:tasks.workunit.client.0.smithi135.stdout:kipmi0 724 root rtd unknown /proc/724/root (readlink: Permission denied) 2024-05-08T23:18:01.356 INFO:tasks.workunit.client.0.smithi135.stdout:kipmi0 724 root txt unknown /proc/724/exe (readlink: Permission denied) 2024-05-08T23:18:01.356 INFO:tasks.workunit.client.0.smithi135.stdout:kipmi0 724 root NOFD /proc/724/fd (opendir: Permission denied) 2024-05-08T23:18:01.356 INFO:tasks.workunit.client.0.smithi135.stdout:mcelog 803 root cwd unknown /proc/803/cwd (readlink: Permission denied) 2024-05-08T23:18:01.356 INFO:tasks.workunit.client.0.smithi135.stdout:mcelog 803 root rtd unknown /proc/803/root (readlink: Permission denied) 2024-05-08T23:18:01.356 INFO:tasks.workunit.client.0.smithi135.stdout:mcelog 803 root txt unknown /proc/803/exe (readlink: Permission denied) 2024-05-08T23:18:01.356 INFO:tasks.workunit.client.0.smithi135.stdout:mcelog 803 root NOFD /proc/803/fd (opendir: Permission denied) 2024-05-08T23:18:01.356 INFO:tasks.workunit.client.0.smithi135.stdout:dbus-daem 804 dbus cwd unknown /proc/804/cwd (readlink: Permission denied) 2024-05-08T23:18:01.356 INFO:tasks.workunit.client.0.smithi135.stdout:dbus-daem 804 dbus rtd unknown /proc/804/root (readlink: Permission denied) 2024-05-08T23:18:01.357 INFO:tasks.workunit.client.0.smithi135.stdout:dbus-daem 804 dbus txt unknown /proc/804/exe (readlink: Permission denied) 2024-05-08T23:18:01.357 INFO:tasks.workunit.client.0.smithi135.stdout:dbus-daem 804 dbus NOFD /proc/804/fd (opendir: Permission denied) 2024-05-08T23:18:01.357 INFO:tasks.workunit.client.0.smithi135.stdout:dbus-daem 804 855 dbus-daem dbus cwd unknown /proc/804/task/855/cwd (readlink: Permission denied) 2024-05-08T23:18:01.357 INFO:tasks.workunit.client.0.smithi135.stdout:dbus-daem 804 855 dbus-daem dbus rtd unknown /proc/804/task/855/root (readlink: Permission denied) 2024-05-08T23:18:01.357 INFO:tasks.workunit.client.0.smithi135.stdout:dbus-daem 804 855 dbus-daem dbus txt unknown /proc/804/task/855/exe (readlink: Permission denied) 2024-05-08T23:18:01.357 INFO:tasks.workunit.client.0.smithi135.stdout:dbus-daem 804 855 dbus-daem dbus NOFD /proc/804/task/855/fd (opendir: Permission denied) 2024-05-08T23:18:01.357 INFO:tasks.workunit.client.0.smithi135.stdout:lsmd 807 libstoragemgmt cwd unknown /proc/807/cwd (readlink: Permission denied) 2024-05-08T23:18:01.357 INFO:tasks.workunit.client.0.smithi135.stdout:lsmd 807 libstoragemgmt rtd unknown /proc/807/root (readlink: Permission denied) 2024-05-08T23:18:01.357 INFO:tasks.workunit.client.0.smithi135.stdout:lsmd 807 libstoragemgmt txt unknown /proc/807/exe (readlink: Permission denied) 2024-05-08T23:18:01.357 INFO:tasks.workunit.client.0.smithi135.stdout:lsmd 807 libstoragemgmt NOFD /proc/807/fd (opendir: Permission denied) 2024-05-08T23:18:01.357 INFO:tasks.workunit.client.0.smithi135.stdout:irqbalanc 808 root cwd unknown /proc/808/cwd (readlink: Permission denied) 2024-05-08T23:18:01.357 INFO:tasks.workunit.client.0.smithi135.stdout:irqbalanc 808 root rtd unknown /proc/808/root (readlink: Permission denied) 2024-05-08T23:18:01.357 INFO:tasks.workunit.client.0.smithi135.stdout:irqbalanc 808 root txt unknown /proc/808/exe (readlink: Permission denied) 2024-05-08T23:18:01.357 INFO:tasks.workunit.client.0.smithi135.stdout:irqbalanc 808 root NOFD /proc/808/fd (opendir: Permission denied) 2024-05-08T23:18:01.358 INFO:tasks.workunit.client.0.smithi135.stdout:irqbalanc 808 822 gmain root cwd unknown /proc/808/task/822/cwd (readlink: Permission denied) 2024-05-08T23:18:01.358 INFO:tasks.workunit.client.0.smithi135.stdout:irqbalanc 808 822 gmain root rtd unknown /proc/808/task/822/root (readlink: Permission denied) 2024-05-08T23:18:01.358 INFO:tasks.workunit.client.0.smithi135.stdout:irqbalanc 808 822 gmain root txt unknown /proc/808/task/822/exe (readlink: Permission denied) 2024-05-08T23:18:01.358 INFO:tasks.workunit.client.0.smithi135.stdout:irqbalanc 808 822 gmain root NOFD /proc/808/task/822/fd (opendir: Permission denied) 2024-05-08T23:18:01.358 INFO:tasks.workunit.client.0.smithi135.stdout:avahi-dae 809 avahi cwd unknown /proc/809/cwd (readlink: Permission denied) 2024-05-08T23:18:01.358 INFO:tasks.workunit.client.0.smithi135.stdout:avahi-dae 809 avahi rtd unknown /proc/809/root (readlink: Permission denied) 2024-05-08T23:18:01.358 INFO:tasks.workunit.client.0.smithi135.stdout:avahi-dae 809 avahi txt unknown /proc/809/exe (readlink: Permission denied) 2024-05-08T23:18:01.358 INFO:tasks.workunit.client.0.smithi135.stdout:avahi-dae 809 avahi NOFD /proc/809/fd (opendir: Permission denied) 2024-05-08T23:18:01.358 INFO:tasks.workunit.client.0.smithi135.stdout:sssd 813 root cwd unknown /proc/813/cwd (readlink: Permission denied) 2024-05-08T23:18:01.358 INFO:tasks.workunit.client.0.smithi135.stdout:sssd 813 root rtd unknown /proc/813/root (readlink: Permission denied) 2024-05-08T23:18:01.358 INFO:tasks.workunit.client.0.smithi135.stdout:sssd 813 root txt unknown /proc/813/exe (readlink: Permission denied) 2024-05-08T23:18:01.358 INFO:tasks.workunit.client.0.smithi135.stdout:sssd 813 root NOFD /proc/813/fd (opendir: Permission denied) 2024-05-08T23:18:01.358 INFO:tasks.workunit.client.0.smithi135.stdout:smartd 815 root cwd unknown /proc/815/cwd (readlink: Permission denied) 2024-05-08T23:18:01.358 INFO:tasks.workunit.client.0.smithi135.stdout:smartd 815 root rtd unknown /proc/815/root (readlink: Permission denied) 2024-05-08T23:18:01.359 INFO:tasks.workunit.client.0.smithi135.stdout:smartd 815 root txt unknown /proc/815/exe (readlink: Permission denied) 2024-05-08T23:18:01.359 INFO:tasks.workunit.client.0.smithi135.stdout:smartd 815 root NOFD /proc/815/fd (opendir: Permission denied) 2024-05-08T23:18:01.362 INFO:tasks.workunit.client.0.smithi135.stdout:NetworkMa 816 root cwd unknown /proc/816/cwd (readlink: Permission denied) 2024-05-08T23:18:01.362 INFO:tasks.workunit.client.0.smithi135.stdout:NetworkMa 816 root rtd unknown /proc/816/root (readlink: Permission denied) 2024-05-08T23:18:01.362 INFO:tasks.workunit.client.0.smithi135.stdout:NetworkMa 816 root txt unknown /proc/816/exe (readlink: Permission denied) 2024-05-08T23:18:01.362 INFO:tasks.workunit.client.0.smithi135.stdout:NetworkMa 816 root NOFD /proc/816/fd (opendir: Permission denied) 2024-05-08T23:18:01.362 INFO:tasks.workunit.client.0.smithi135.stdout:NetworkMa 816 860 gmain root cwd unknown /proc/816/task/860/cwd (readlink: Permission denied) 2024-05-08T23:18:01.362 INFO:tasks.workunit.client.0.smithi135.stdout:NetworkMa 816 860 gmain root rtd unknown /proc/816/task/860/root (readlink: Permission denied) 2024-05-08T23:18:01.362 INFO:tasks.workunit.client.0.smithi135.stdout:NetworkMa 816 860 gmain root txt unknown /proc/816/task/860/exe (readlink: Permission denied) 2024-05-08T23:18:01.362 INFO:tasks.workunit.client.0.smithi135.stdout:NetworkMa 816 860 gmain root NOFD /proc/816/task/860/fd (opendir: Permission denied) 2024-05-08T23:18:01.362 INFO:tasks.workunit.client.0.smithi135.stdout:NetworkMa 816 865 gdbus root cwd unknown /proc/816/task/865/cwd (readlink: Permission denied) 2024-05-08T23:18:01.362 INFO:tasks.workunit.client.0.smithi135.stdout:NetworkMa 816 865 gdbus root rtd unknown /proc/816/task/865/root (readlink: Permission denied) 2024-05-08T23:18:01.362 INFO:tasks.workunit.client.0.smithi135.stdout:NetworkMa 816 865 gdbus root txt unknown /proc/816/task/865/exe (readlink: Permission denied) 2024-05-08T23:18:01.362 INFO:tasks.workunit.client.0.smithi135.stdout:NetworkMa 816 865 gdbus root NOFD /proc/816/task/865/fd (opendir: Permission denied) 2024-05-08T23:18:01.362 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 polkitd cwd unknown /proc/819/cwd (readlink: Permission denied) 2024-05-08T23:18:01.363 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 polkitd rtd unknown /proc/819/root (readlink: Permission denied) 2024-05-08T23:18:01.363 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 polkitd txt unknown /proc/819/exe (readlink: Permission denied) 2024-05-08T23:18:01.363 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 polkitd NOFD /proc/819/fd (opendir: Permission denied) 2024-05-08T23:18:01.363 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 880 gmain polkitd cwd unknown /proc/819/task/880/cwd (readlink: Permission denied) 2024-05-08T23:18:01.363 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 880 gmain polkitd rtd unknown /proc/819/task/880/root (readlink: Permission denied) 2024-05-08T23:18:01.363 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 880 gmain polkitd txt unknown /proc/819/task/880/exe (readlink: Permission denied) 2024-05-08T23:18:01.363 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 880 gmain polkitd NOFD /proc/819/task/880/fd (opendir: Permission denied) 2024-05-08T23:18:01.363 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 881 gdbus polkitd cwd unknown /proc/819/task/881/cwd (readlink: Permission denied) 2024-05-08T23:18:01.363 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 881 gdbus polkitd rtd unknown /proc/819/task/881/root (readlink: Permission denied) 2024-05-08T23:18:01.363 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 881 gdbus polkitd txt unknown /proc/819/task/881/exe (readlink: Permission denied) 2024-05-08T23:18:01.363 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 881 gdbus polkitd NOFD /proc/819/task/881/fd (opendir: Permission denied) 2024-05-08T23:18:01.363 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 888 JS\x20Hel polkitd cwd unknown /proc/819/task/888/cwd (readlink: Permission denied) 2024-05-08T23:18:01.363 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 888 JS\x20Hel polkitd rtd unknown /proc/819/task/888/root (readlink: Permission denied) 2024-05-08T23:18:01.363 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 888 JS\x20Hel polkitd txt unknown /proc/819/task/888/exe (readlink: Permission denied) 2024-05-08T23:18:01.363 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 888 JS\x20Hel polkitd NOFD /proc/819/task/888/fd (opendir: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 889 JS\x20Hel polkitd cwd unknown /proc/819/task/889/cwd (readlink: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 889 JS\x20Hel polkitd rtd unknown /proc/819/task/889/root (readlink: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 889 JS\x20Hel polkitd txt unknown /proc/819/task/889/exe (readlink: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 889 JS\x20Hel polkitd NOFD /proc/819/task/889/fd (opendir: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 890 JS\x20Hel polkitd cwd unknown /proc/819/task/890/cwd (readlink: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 890 JS\x20Hel polkitd rtd unknown /proc/819/task/890/root (readlink: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 890 JS\x20Hel polkitd txt unknown /proc/819/task/890/exe (readlink: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 890 JS\x20Hel polkitd NOFD /proc/819/task/890/fd (opendir: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 891 JS\x20Hel polkitd cwd unknown /proc/819/task/891/cwd (readlink: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 891 JS\x20Hel polkitd rtd unknown /proc/819/task/891/root (readlink: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 891 JS\x20Hel polkitd txt unknown /proc/819/task/891/exe (readlink: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 891 JS\x20Hel polkitd NOFD /proc/819/task/891/fd (opendir: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 892 JS\x20Hel polkitd cwd unknown /proc/819/task/892/cwd (readlink: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 892 JS\x20Hel polkitd rtd unknown /proc/819/task/892/root (readlink: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 892 JS\x20Hel polkitd txt unknown /proc/819/task/892/exe (readlink: Permission denied) 2024-05-08T23:18:01.364 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 892 JS\x20Hel polkitd NOFD /proc/819/task/892/fd (opendir: Permission denied) 2024-05-08T23:18:01.365 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 893 JS\x20Hel polkitd cwd unknown /proc/819/task/893/cwd (readlink: Permission denied) 2024-05-08T23:18:01.365 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 893 JS\x20Hel polkitd rtd unknown /proc/819/task/893/root (readlink: Permission denied) 2024-05-08T23:18:01.365 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 893 JS\x20Hel polkitd txt unknown /proc/819/task/893/exe (readlink: Permission denied) 2024-05-08T23:18:01.365 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 893 JS\x20Hel polkitd NOFD /proc/819/task/893/fd (opendir: Permission denied) 2024-05-08T23:18:01.365 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 894 JS\x20Hel polkitd cwd unknown /proc/819/task/894/cwd (readlink: Permission denied) 2024-05-08T23:18:01.365 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 894 JS\x20Hel polkitd rtd unknown /proc/819/task/894/root (readlink: Permission denied) 2024-05-08T23:18:01.365 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 894 JS\x20Hel polkitd txt unknown /proc/819/task/894/exe (readlink: Permission denied) 2024-05-08T23:18:01.365 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 894 JS\x20Hel polkitd NOFD /proc/819/task/894/fd (opendir: Permission denied) 2024-05-08T23:18:01.365 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 895 JS\x20Hel polkitd cwd unknown /proc/819/task/895/cwd (readlink: Permission denied) 2024-05-08T23:18:01.365 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 895 JS\x20Hel polkitd rtd unknown /proc/819/task/895/root (readlink: Permission denied) 2024-05-08T23:18:01.365 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 895 JS\x20Hel polkitd txt unknown /proc/819/task/895/exe (readlink: Permission denied) 2024-05-08T23:18:01.365 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 895 JS\x20Hel polkitd NOFD /proc/819/task/895/fd (opendir: Permission denied) 2024-05-08T23:18:01.365 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 896 polkitd polkitd cwd unknown /proc/819/task/896/cwd (readlink: Permission denied) 2024-05-08T23:18:01.365 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 896 polkitd polkitd rtd unknown /proc/819/task/896/root (readlink: Permission denied) 2024-05-08T23:18:01.366 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 896 polkitd polkitd txt unknown /proc/819/task/896/exe (readlink: Permission denied) 2024-05-08T23:18:01.366 INFO:tasks.workunit.client.0.smithi135.stdout:polkitd 819 896 polkitd polkitd NOFD /proc/819/task/896/fd (opendir: Permission denied) 2024-05-08T23:18:01.366 INFO:tasks.workunit.client.0.smithi135.stdout:avahi-dae 857 avahi cwd unknown /proc/857/cwd (readlink: Permission denied) 2024-05-08T23:18:01.366 INFO:tasks.workunit.client.0.smithi135.stdout:avahi-dae 857 avahi rtd unknown /proc/857/root (readlink: Permission denied) 2024-05-08T23:18:01.366 INFO:tasks.workunit.client.0.smithi135.stdout:avahi-dae 857 avahi txt unknown /proc/857/exe (readlink: Permission denied) 2024-05-08T23:18:01.366 INFO:tasks.workunit.client.0.smithi135.stdout:avahi-dae 857 avahi NOFD /proc/857/fd (opendir: Permission denied) 2024-05-08T23:18:01.366 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 870 root cwd unknown /proc/870/cwd (readlink: Permission denied) 2024-05-08T23:18:01.366 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 870 root rtd unknown /proc/870/root (readlink: Permission denied) 2024-05-08T23:18:01.366 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 870 root txt unknown /proc/870/exe (readlink: Permission denied) 2024-05-08T23:18:01.366 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 870 root NOFD /proc/870/fd (opendir: Permission denied) 2024-05-08T23:18:01.366 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 root cwd unknown /proc/871/cwd (readlink: Permission denied) 2024-05-08T23:18:01.366 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 root rtd unknown /proc/871/root (readlink: Permission denied) 2024-05-08T23:18:01.366 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 root txt unknown /proc/871/exe (readlink: Permission denied) 2024-05-08T23:18:01.366 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 root NOFD /proc/871/fd (opendir: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1099 tuned root cwd unknown /proc/871/task/1099/cwd (readlink: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1099 tuned root rtd unknown /proc/871/task/1099/root (readlink: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1099 tuned root txt unknown /proc/871/task/1099/exe (readlink: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1099 tuned root NOFD /proc/871/task/1099/fd (opendir: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1104 tuned root cwd unknown /proc/871/task/1104/cwd (readlink: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1104 tuned root rtd unknown /proc/871/task/1104/root (readlink: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1104 tuned root txt unknown /proc/871/task/1104/exe (readlink: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1104 tuned root NOFD /proc/871/task/1104/fd (opendir: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1121 tuned root cwd unknown /proc/871/task/1121/cwd (readlink: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1121 tuned root rtd unknown /proc/871/task/1121/root (readlink: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1121 tuned root txt unknown /proc/871/task/1121/exe (readlink: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1121 tuned root NOFD /proc/871/task/1121/fd (opendir: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1122 tuned root cwd unknown /proc/871/task/1122/cwd (readlink: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1122 tuned root rtd unknown /proc/871/task/1122/root (readlink: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1122 tuned root txt unknown /proc/871/task/1122/exe (readlink: Permission denied) 2024-05-08T23:18:01.367 INFO:tasks.workunit.client.0.smithi135.stdout:tuned 871 1122 tuned root NOFD /proc/871/task/1122/fd (opendir: Permission denied) 2024-05-08T23:18:01.368 INFO:tasks.workunit.client.0.smithi135.stdout:rhsmcertd 873 root cwd unknown /proc/873/cwd (readlink: Permission denied) 2024-05-08T23:18:01.368 INFO:tasks.workunit.client.0.smithi135.stdout:rhsmcertd 873 root rtd unknown /proc/873/root (readlink: Permission denied) 2024-05-08T23:18:01.368 INFO:tasks.workunit.client.0.smithi135.stdout:rhsmcertd 873 root txt unknown /proc/873/exe (readlink: Permission denied) 2024-05-08T23:18:01.368 INFO:tasks.workunit.client.0.smithi135.stdout:rhsmcertd 873 root NOFD /proc/873/fd (opendir: Permission denied) 2024-05-08T23:18:01.368 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 root cwd unknown /proc/882/cwd (readlink: Permission denied) 2024-05-08T23:18:01.368 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 root rtd unknown /proc/882/root (readlink: Permission denied) 2024-05-08T23:18:01.368 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 root txt unknown /proc/882/exe (readlink: Permission denied) 2024-05-08T23:18:01.368 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 root NOFD /proc/882/fd (opendir: Permission denied) 2024-05-08T23:18:01.368 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 883 gssproxy root cwd unknown /proc/882/task/883/cwd (readlink: Permission denied) 2024-05-08T23:18:01.368 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 883 gssproxy root rtd unknown /proc/882/task/883/root (readlink: Permission denied) 2024-05-08T23:18:01.368 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 883 gssproxy root txt unknown /proc/882/task/883/exe (readlink: Permission denied) 2024-05-08T23:18:01.368 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 883 gssproxy root NOFD /proc/882/task/883/fd (opendir: Permission denied) 2024-05-08T23:18:01.368 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 884 gssproxy root cwd unknown /proc/882/task/884/cwd (readlink: Permission denied) 2024-05-08T23:18:01.368 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 884 gssproxy root rtd unknown /proc/882/task/884/root (readlink: Permission denied) 2024-05-08T23:18:01.368 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 884 gssproxy root txt unknown /proc/882/task/884/exe (readlink: Permission denied) 2024-05-08T23:18:01.369 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 884 gssproxy root NOFD /proc/882/task/884/fd (opendir: Permission denied) 2024-05-08T23:18:01.369 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 885 gssproxy root cwd unknown /proc/882/task/885/cwd (readlink: Permission denied) 2024-05-08T23:18:01.369 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 885 gssproxy root rtd unknown /proc/882/task/885/root (readlink: Permission denied) 2024-05-08T23:18:01.369 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 885 gssproxy root txt unknown /proc/882/task/885/exe (readlink: Permission denied) 2024-05-08T23:18:01.369 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 885 gssproxy root NOFD /proc/882/task/885/fd (opendir: Permission denied) 2024-05-08T23:18:01.369 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 886 gssproxy root cwd unknown /proc/882/task/886/cwd (readlink: Permission denied) 2024-05-08T23:18:01.369 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 886 gssproxy root rtd unknown /proc/882/task/886/root (readlink: Permission denied) 2024-05-08T23:18:01.369 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 886 gssproxy root txt unknown /proc/882/task/886/exe (readlink: Permission denied) 2024-05-08T23:18:01.369 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 886 gssproxy root NOFD /proc/882/task/886/fd (opendir: Permission denied) 2024-05-08T23:18:01.369 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 887 gssproxy root cwd unknown /proc/882/task/887/cwd (readlink: Permission denied) 2024-05-08T23:18:01.369 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 887 gssproxy root rtd unknown /proc/882/task/887/root (readlink: Permission denied) 2024-05-08T23:18:01.369 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 887 gssproxy root txt unknown /proc/882/task/887/exe (readlink: Permission denied) 2024-05-08T23:18:01.369 INFO:tasks.workunit.client.0.smithi135.stdout:gssproxy 882 887 gssproxy root NOFD /proc/882/task/887/fd (opendir: Permission denied) 2024-05-08T23:18:01.369 INFO:tasks.workunit.client.0.smithi135.stdout:sssd_be 904 root cwd unknown /proc/904/cwd (readlink: Permission denied) 2024-05-08T23:18:01.370 INFO:tasks.workunit.client.0.smithi135.stdout:sssd_be 904 root rtd unknown /proc/904/root (readlink: Permission denied) 2024-05-08T23:18:01.370 INFO:tasks.workunit.client.0.smithi135.stdout:sssd_be 904 root txt unknown /proc/904/exe (readlink: Permission denied) 2024-05-08T23:18:01.370 INFO:tasks.workunit.client.0.smithi135.stdout:sssd_be 904 root NOFD /proc/904/fd (opendir: Permission denied) 2024-05-08T23:18:01.370 INFO:tasks.workunit.client.0.smithi135.stdout:sssd_nss 921 root cwd unknown /proc/921/cwd (readlink: Permission denied) 2024-05-08T23:18:01.370 INFO:tasks.workunit.client.0.smithi135.stdout:sssd_nss 921 root rtd unknown /proc/921/root (readlink: Permission denied) 2024-05-08T23:18:01.370 INFO:tasks.workunit.client.0.smithi135.stdout:sssd_nss 921 root txt unknown /proc/921/exe (readlink: Permission denied) 2024-05-08T23:18:01.370 INFO:tasks.workunit.client.0.smithi135.stdout:sssd_nss 921 root NOFD /proc/921/fd (opendir: Permission denied) 2024-05-08T23:18:01.370 INFO:tasks.workunit.client.0.smithi135.stdout:systemd-l 941 root cwd unknown /proc/941/cwd (readlink: Permission denied) 2024-05-08T23:18:01.370 INFO:tasks.workunit.client.0.smithi135.stdout:systemd-l 941 root rtd unknown /proc/941/root (readlink: Permission denied) 2024-05-08T23:18:01.370 INFO:tasks.workunit.client.0.smithi135.stdout:systemd-l 941 root txt unknown /proc/941/exe (readlink: Permission denied) 2024-05-08T23:18:01.370 INFO:tasks.workunit.client.0.smithi135.stdout:systemd-l 941 root NOFD /proc/941/fd (opendir: Permission denied) 2024-05-08T23:18:01.371 INFO:tasks.workunit.client.0.smithi135.stdout:cupsd 942 root cwd unknown /proc/942/cwd (readlink: Permission denied) 2024-05-08T23:18:01.371 INFO:tasks.workunit.client.0.smithi135.stdout:cupsd 942 root rtd unknown /proc/942/root (readlink: Permission denied) 2024-05-08T23:18:01.371 INFO:tasks.workunit.client.0.smithi135.stdout:cupsd 942 root txt unknown /proc/942/exe (readlink: Permission denied) 2024-05-08T23:18:01.371 INFO:tasks.workunit.client.0.smithi135.stdout:cupsd 942 root NOFD /proc/942/fd (opendir: Permission denied) 2024-05-08T23:18:01.371 INFO:tasks.workunit.client.0.smithi135.stdout:atd 945 root cwd unknown /proc/945/cwd (readlink: Permission denied) 2024-05-08T23:18:01.371 INFO:tasks.workunit.client.0.smithi135.stdout:atd 945 root rtd unknown /proc/945/root (readlink: Permission denied) 2024-05-08T23:18:01.371 INFO:tasks.workunit.client.0.smithi135.stdout:atd 945 root txt unknown /proc/945/exe (readlink: Permission denied) 2024-05-08T23:18:01.371 INFO:tasks.workunit.client.0.smithi135.stdout:atd 945 root NOFD /proc/945/fd (opendir: Permission denied) 2024-05-08T23:18:01.371 INFO:tasks.workunit.client.0.smithi135.stdout:crond 946 root cwd unknown /proc/946/cwd (readlink: Permission denied) 2024-05-08T23:18:01.371 INFO:tasks.workunit.client.0.smithi135.stdout:crond 946 root rtd unknown /proc/946/root (readlink: Permission denied) 2024-05-08T23:18:01.371 INFO:tasks.workunit.client.0.smithi135.stdout:crond 946 root txt unknown /proc/946/exe (readlink: Permission denied) 2024-05-08T23:18:01.371 INFO:tasks.workunit.client.0.smithi135.stdout:crond 946 root NOFD /proc/946/fd (opendir: Permission denied) 2024-05-08T23:18:01.371 INFO:tasks.workunit.client.0.smithi135.stdout:nrpe 1144 nrpe cwd unknown /proc/1144/cwd (readlink: Permission denied) 2024-05-08T23:18:01.371 INFO:tasks.workunit.client.0.smithi135.stdout:nrpe 1144 nrpe rtd unknown /proc/1144/root (readlink: Permission denied) 2024-05-08T23:18:01.372 INFO:tasks.workunit.client.0.smithi135.stdout:nrpe 1144 nrpe txt unknown /proc/1144/exe (readlink: Permission denied) 2024-05-08T23:18:01.372 INFO:tasks.workunit.client.0.smithi135.stdout:nrpe 1144 nrpe NOFD /proc/1144/fd (opendir: Permission denied) 2024-05-08T23:18:01.372 INFO:tasks.workunit.client.0.smithi135.stdout:agetty 5859 root cwd unknown /proc/5859/cwd (readlink: Permission denied) 2024-05-08T23:18:01.372 INFO:tasks.workunit.client.0.smithi135.stdout:agetty 5859 root rtd unknown /proc/5859/root (readlink: Permission denied) 2024-05-08T23:18:01.372 INFO:tasks.workunit.client.0.smithi135.stdout:agetty 5859 root txt unknown /proc/5859/exe (readlink: Permission denied) 2024-05-08T23:18:01.372 INFO:tasks.workunit.client.0.smithi135.stdout:agetty 5859 root NOFD /proc/5859/fd (opendir: Permission denied) 2024-05-08T23:18:01.372 INFO:tasks.workunit.client.0.smithi135.stdout:agetty 5860 root cwd unknown /proc/5860/cwd (readlink: Permission denied) 2024-05-08T23:18:01.372 INFO:tasks.workunit.client.0.smithi135.stdout:agetty 5860 root rtd unknown /proc/5860/root (readlink: Permission denied) 2024-05-08T23:18:01.372 INFO:tasks.workunit.client.0.smithi135.stdout:agetty 5860 root txt unknown /proc/5860/exe (readlink: Permission denied) 2024-05-08T23:18:01.372 INFO:tasks.workunit.client.0.smithi135.stdout:agetty 5860 root NOFD /proc/5860/fd (opendir: Permission denied) 2024-05-08T23:18:01.372 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu cwd DIR 8,1 4096 2 / 2024-05-08T23:18:01.372 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu rtd DIR 8,1 4096 2 / 2024-05-08T23:18:01.372 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu txt REG 8,1 1601312 8305 /usr/lib/systemd/systemd 2024-05-08T23:18:01.372 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 1598808 5171 /usr/lib64/libm-2.28.so 2024-05-08T23:18:01.372 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 636728 7430 /usr/lib64/libudev.so.1.6.11 2024-05-08T23:18:01.373 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 735192 5316 /usr/lib64/libsepol.so.1 2024-05-08T23:18:01.373 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 1760264 5414 /usr/lib64/libunistring.so.2.1.0 2024-05-08T23:18:01.373 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 144392 5392 /usr/lib64/libgpg-error.so.0.24.2 2024-05-08T23:18:01.373 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 66912 5574 /usr/lib64/libjson-c.so.4.0.0 2024-05-08T23:18:01.373 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 371224 7497 /usr/lib64/libdevmapper.so.1.02 2024-05-08T23:18:01.373 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 26192 5481 /usr/lib64/libattr.so.1.1.2448 2024-05-08T23:18:01.373 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu DEL REG 8,1 7507 /usr/lib64/libcrypto.so.1.1.1k 2024-05-08T23:18:01.373 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu DEL REG 8,1 7509 /usr/lib64/libssl.so.1.1.1k 2024-05-08T23:18:01.373 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 99600 5318 /usr/lib64/libz.so.1.2.11 2024-05-08T23:18:01.373 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 24928 5576 /usr/lib64/libcap-ng.so.0.0.0 2024-05-08T23:18:01.373 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu DEL REG 8,1 5382 /usr/lib64/libuuid.so.1.3.0 2024-05-08T23:18:01.373 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 19584 5169 /usr/lib64/libdl-2.28.so 2024-05-08T23:18:01.373 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 543160 4872 /usr/lib64/libpcre2-8.so.0.7.1 2024-05-08T23:18:01.373 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu DEL REG 8,1 7499 /usr/lib64/libblkid.so.1.1.0 2024-05-08T23:18:01.373 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 119760 5781 /usr/lib64/liblz4.so.1.8.3 2024-05-08T23:18:01.374 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 192016 5359 /usr/lib64/liblzma.so.5.2.4 2024-05-08T23:18:01.374 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 162224 5584 /usr/lib64/libidn2.so.0.3.6 2024-05-08T23:18:01.374 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 1187360 5616 /usr/lib64/libgcrypt.so.20.2.5 2024-05-08T23:18:01.374 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 526360 7535 /usr/lib64/libcryptsetup.so.12.6.0 2024-05-08T23:18:01.374 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 54816 5483 /usr/lib64/libacl.so.1.1.2253 2024-05-08T23:18:01.374 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 33752 5371 /usr/lib64/libcap.so.2.48 2024-05-08T23:18:01.374 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-05-08T23:18:01.374 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 149976 5181 /usr/lib64/libpthread-2.28.so 2024-05-08T23:18:01.374 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 99664 6703 /usr/lib64/libgcc_s-8-20210514.so.1 2024-05-08T23:18:01.374 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 100200 7532 /usr/lib64/libkmod.so.2.3.3 2024-05-08T23:18:01.374 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 135792 5578 /usr/lib64/libaudit.so.1.0.0 2024-05-08T23:18:01.374 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 66504 7674 /usr/lib64/libpam.so.0.84.2 2024-05-08T23:18:01.374 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu DEL REG 8,1 7306 /usr/lib64/libmount.so.1.1.0 2024-05-08T23:18:01.374 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 168536 4876 /usr/lib64/libselinux.so.1 2024-05-08T23:18:01.375 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 128784 6087 /usr/lib64/libseccomp.so.2.5.2 2024-05-08T23:18:01.375 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 42744 5185 /usr/lib64/librt-2.28.so 2024-05-08T23:18:01.375 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 2740672 8300 /usr/lib/systemd/libsystemd-shared-239.so 2024-05-08T23:18:01.375 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-05-08T23:18:01.375 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 0r CHR 1,3 0t0 2062 /dev/null 2024-05-08T23:18:01.375 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 1u unix 0x0000000000000000 0t0 32520 type=STREAM 2024-05-08T23:18:01.375 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 2u unix 0x0000000000000000 0t0 32520 type=STREAM 2024-05-08T23:18:01.375 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 3u unix 0x0000000000000000 0t0 35600 type=DGRAM 2024-05-08T23:18:01.375 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 4u a_inode 0,14 0 14577 [eventpoll] 2024-05-08T23:18:01.375 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 5u a_inode 0,14 0 14577 [signalfd] 2024-05-08T23:18:01.375 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 6r DIR 0,26 0 868 /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service 2024-05-08T23:18:01.375 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 7u a_inode 0,14 0 14577 [timerfd] 2024-05-08T23:18:01.375 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 8u netlink 0t0 42072 KOBJECT_UEVENT 2024-05-08T23:18:01.375 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 9u a_inode 0,14 0 14577 [eventpoll] 2024-05-08T23:18:01.375 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 10r a_inode 0,14 0 14577 inotify 2024-05-08T23:18:01.376 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 11u unix 0x0000000000000000 0t0 42090 /run/user/1000/bus type=STREAM 2024-05-08T23:18:01.376 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 12r REG 0,5 0 42077 /proc/5871/mountinfo 2024-05-08T23:18:01.376 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 13r a_inode 0,14 0 14577 inotify 2024-05-08T23:18:01.376 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 14r REG 0,5 0 4026532074 /proc/swaps 2024-05-08T23:18:01.376 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 15u unix 0x0000000000000000 0t0 42078 /run/user/1000/systemd/notify type=DGRAM 2024-05-08T23:18:01.376 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 16u unix 0x0000000000000000 0t0 42080 type=DGRAM 2024-05-08T23:18:01.376 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 17u unix 0x0000000000000000 0t0 42081 type=DGRAM 2024-05-08T23:18:01.376 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 18u unix 0x0000000000000000 0t0 42082 /run/user/1000/systemd/private type=STREAM 2024-05-08T23:18:01.376 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 19u unix 0x0000000000000000 0t0 42084 type=STREAM 2024-05-08T23:18:01.376 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 20u a_inode 0,14 0 14577 [timerfd] 2024-05-08T23:18:01.376 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 5871 ubuntu 26u netlink 0t0 42093 SELINUX 2024-05-08T23:18:01.376 INFO:tasks.workunit.client.0.smithi135.stdout:(sd-pam) 5874 ubuntu cwd unknown /proc/5874/cwd (readlink: Permission denied) 2024-05-08T23:18:01.376 INFO:tasks.workunit.client.0.smithi135.stdout:(sd-pam) 5874 ubuntu rtd unknown /proc/5874/root (readlink: Permission denied) 2024-05-08T23:18:01.376 INFO:tasks.workunit.client.0.smithi135.stdout:(sd-pam) 5874 ubuntu txt unknown /proc/5874/exe (readlink: Permission denied) 2024-05-08T23:18:01.376 INFO:tasks.workunit.client.0.smithi135.stdout:(sd-pam) 5874 ubuntu NOFD /proc/5874/fd (opendir: Permission denied) 2024-05-08T23:18:01.377 INFO:tasks.workunit.client.0.smithi135.stdout:rsyslogd 6616 root cwd unknown /proc/6616/cwd (readlink: Permission denied) 2024-05-08T23:18:01.377 INFO:tasks.workunit.client.0.smithi135.stdout:rsyslogd 6616 root rtd unknown /proc/6616/root (readlink: Permission denied) 2024-05-08T23:18:01.377 INFO:tasks.workunit.client.0.smithi135.stdout:rsyslogd 6616 root txt unknown /proc/6616/exe (readlink: Permission denied) 2024-05-08T23:18:01.377 INFO:tasks.workunit.client.0.smithi135.stdout:rsyslogd 6616 root NOFD /proc/6616/fd (opendir: Permission denied) 2024-05-08T23:18:01.377 INFO:tasks.workunit.client.0.smithi135.stdout:rsyslogd 6616 6618 in:imjour root cwd unknown /proc/6616/task/6618/cwd (readlink: Permission denied) 2024-05-08T23:18:01.377 INFO:tasks.workunit.client.0.smithi135.stdout:rsyslogd 6616 6618 in:imjour root rtd unknown /proc/6616/task/6618/root (readlink: Permission denied) 2024-05-08T23:18:01.377 INFO:tasks.workunit.client.0.smithi135.stdout:rsyslogd 6616 6618 in:imjour root txt unknown /proc/6616/task/6618/exe (readlink: Permission denied) 2024-05-08T23:18:01.377 INFO:tasks.workunit.client.0.smithi135.stdout:rsyslogd 6616 6618 in:imjour root NOFD /proc/6616/task/6618/fd (opendir: Permission denied) 2024-05-08T23:18:01.377 INFO:tasks.workunit.client.0.smithi135.stdout:rsyslogd 6616 6619 rs:main root cwd unknown /proc/6616/task/6619/cwd (readlink: Permission denied) 2024-05-08T23:18:01.377 INFO:tasks.workunit.client.0.smithi135.stdout:rsyslogd 6616 6619 rs:main root rtd unknown /proc/6616/task/6619/root (readlink: Permission denied) 2024-05-08T23:18:01.377 INFO:tasks.workunit.client.0.smithi135.stdout:rsyslogd 6616 6619 rs:main root txt unknown /proc/6616/task/6619/exe (readlink: Permission denied) 2024-05-08T23:18:01.377 INFO:tasks.workunit.client.0.smithi135.stdout:rsyslogd 6616 6619 rs:main root NOFD /proc/6616/task/6619/fd (opendir: Permission denied) 2024-05-08T23:18:01.377 INFO:tasks.workunit.client.0.smithi135.stdout:anacron 24556 root cwd unknown /proc/24556/cwd (readlink: Permission denied) 2024-05-08T23:18:01.377 INFO:tasks.workunit.client.0.smithi135.stdout:anacron 24556 root rtd unknown /proc/24556/root (readlink: Permission denied) 2024-05-08T23:18:01.378 INFO:tasks.workunit.client.0.smithi135.stdout:anacron 24556 root txt unknown /proc/24556/exe (readlink: Permission denied) 2024-05-08T23:18:01.378 INFO:tasks.workunit.client.0.smithi135.stdout:anacron 24556 root NOFD /proc/24556/fd (opendir: Permission denied) 2024-05-08T23:18:01.378 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 25829 root cwd unknown /proc/25829/cwd (readlink: Permission denied) 2024-05-08T23:18:01.378 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 25829 root rtd unknown /proc/25829/root (readlink: Permission denied) 2024-05-08T23:18:01.378 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 25829 root txt unknown /proc/25829/exe (readlink: Permission denied) 2024-05-08T23:18:01.378 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 25829 root NOFD /proc/25829/fd (opendir: Permission denied) 2024-05-08T23:18:01.378 INFO:tasks.workunit.client.0.smithi135.stdout:ksmtuned 25977 root cwd unknown /proc/25977/cwd (readlink: Permission denied) 2024-05-08T23:18:01.378 INFO:tasks.workunit.client.0.smithi135.stdout:ksmtuned 25977 root rtd unknown /proc/25977/root (readlink: Permission denied) 2024-05-08T23:18:01.378 INFO:tasks.workunit.client.0.smithi135.stdout:ksmtuned 25977 root txt unknown /proc/25977/exe (readlink: Permission denied) 2024-05-08T23:18:01.378 INFO:tasks.workunit.client.0.smithi135.stdout:ksmtuned 25977 root NOFD /proc/25977/fd (opendir: Permission denied) 2024-05-08T23:18:01.378 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 25980 root cwd unknown /proc/25980/cwd (readlink: Permission denied) 2024-05-08T23:18:01.378 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 25980 root rtd unknown /proc/25980/root (readlink: Permission denied) 2024-05-08T23:18:01.378 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 25980 root txt unknown /proc/25980/exe (readlink: Permission denied) 2024-05-08T23:18:01.378 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 25980 root NOFD /proc/25980/fd (opendir: Permission denied) 2024-05-08T23:18:01.379 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 27578 root cwd unknown /proc/27578/cwd (readlink: Permission denied) 2024-05-08T23:18:01.379 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 27578 root rtd unknown /proc/27578/root (readlink: Permission denied) 2024-05-08T23:18:01.379 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 27578 root txt unknown /proc/27578/exe (readlink: Permission denied) 2024-05-08T23:18:01.379 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 27578 root NOFD /proc/27578/fd (opendir: Permission denied) 2024-05-08T23:18:01.379 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28270 root cwd unknown /proc/28270/cwd (readlink: Permission denied) 2024-05-08T23:18:01.379 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28270 root rtd unknown /proc/28270/root (readlink: Permission denied) 2024-05-08T23:18:01.379 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28270 root txt unknown /proc/28270/exe (readlink: Permission denied) 2024-05-08T23:18:01.379 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28270 root NOFD /proc/28270/fd (opendir: Permission denied) 2024-05-08T23:18:01.379 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28306 root cwd unknown /proc/28306/cwd (readlink: Permission denied) 2024-05-08T23:18:01.379 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28306 root rtd unknown /proc/28306/root (readlink: Permission denied) 2024-05-08T23:18:01.379 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28306 root txt unknown /proc/28306/exe (readlink: Permission denied) 2024-05-08T23:18:01.379 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28306 root NOFD /proc/28306/fd (opendir: Permission denied) 2024-05-08T23:18:01.379 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28343 root cwd unknown /proc/28343/cwd (readlink: Permission denied) 2024-05-08T23:18:01.379 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28343 root rtd unknown /proc/28343/root (readlink: Permission denied) 2024-05-08T23:18:01.379 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28343 root txt unknown /proc/28343/exe (readlink: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28343 root NOFD /proc/28343/fd (opendir: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28380 root cwd unknown /proc/28380/cwd (readlink: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28380 root rtd unknown /proc/28380/root (readlink: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28380 root txt unknown /proc/28380/exe (readlink: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28380 root NOFD /proc/28380/fd (opendir: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28417 root cwd unknown /proc/28417/cwd (readlink: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28417 root rtd unknown /proc/28417/root (readlink: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28417 root txt unknown /proc/28417/exe (readlink: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:kdmflush/ 28417 root NOFD /proc/28417/fd (opendir: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:xfsalloc 28630 root cwd unknown /proc/28630/cwd (readlink: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:xfsalloc 28630 root rtd unknown /proc/28630/root (readlink: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:xfsalloc 28630 root txt unknown /proc/28630/exe (readlink: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:xfsalloc 28630 root NOFD /proc/28630/fd (opendir: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:xfs_mru_c 28631 root cwd unknown /proc/28631/cwd (readlink: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:xfs_mru_c 28631 root rtd unknown /proc/28631/root (readlink: Permission denied) 2024-05-08T23:18:01.380 INFO:tasks.workunit.client.0.smithi135.stdout:xfs_mru_c 28631 root txt unknown /proc/28631/exe (readlink: Permission denied) 2024-05-08T23:18:01.381 INFO:tasks.workunit.client.0.smithi135.stdout:xfs_mru_c 28631 root NOFD /proc/28631/fd (opendir: Permission denied) 2024-05-08T23:18:01.381 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-buf/d 28632 root cwd unknown /proc/28632/cwd (readlink: Permission denied) 2024-05-08T23:18:01.381 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-buf/d 28632 root rtd unknown /proc/28632/root (readlink: Permission denied) 2024-05-08T23:18:01.381 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-buf/d 28632 root txt unknown /proc/28632/exe (readlink: Permission denied) 2024-05-08T23:18:01.381 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-buf/d 28632 root NOFD /proc/28632/fd (opendir: Permission denied) 2024-05-08T23:18:01.381 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-conv/ 28633 root cwd unknown /proc/28633/cwd (readlink: Permission denied) 2024-05-08T23:18:01.381 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-conv/ 28633 root rtd unknown /proc/28633/root (readlink: Permission denied) 2024-05-08T23:18:01.381 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-conv/ 28633 root txt unknown /proc/28633/exe (readlink: Permission denied) 2024-05-08T23:18:01.381 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-conv/ 28633 root NOFD /proc/28633/fd (opendir: Permission denied) 2024-05-08T23:18:01.381 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-cil/d 28634 root cwd unknown /proc/28634/cwd (readlink: Permission denied) 2024-05-08T23:18:01.381 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-cil/d 28634 root rtd unknown /proc/28634/root (readlink: Permission denied) 2024-05-08T23:18:01.381 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-cil/d 28634 root txt unknown /proc/28634/exe (readlink: Permission denied) 2024-05-08T23:18:01.381 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-cil/d 28634 root NOFD /proc/28634/fd (opendir: Permission denied) 2024-05-08T23:18:01.381 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-recla 28635 root cwd unknown /proc/28635/cwd (readlink: Permission denied) 2024-05-08T23:18:01.382 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-recla 28635 root rtd unknown /proc/28635/root (readlink: Permission denied) 2024-05-08T23:18:01.382 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-recla 28635 root txt unknown /proc/28635/exe (readlink: Permission denied) 2024-05-08T23:18:01.382 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-recla 28635 root NOFD /proc/28635/fd (opendir: Permission denied) 2024-05-08T23:18:01.382 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-block 28636 root cwd unknown /proc/28636/cwd (readlink: Permission denied) 2024-05-08T23:18:01.382 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-block 28636 root rtd unknown /proc/28636/root (readlink: Permission denied) 2024-05-08T23:18:01.382 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-block 28636 root txt unknown /proc/28636/exe (readlink: Permission denied) 2024-05-08T23:18:01.382 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-block 28636 root NOFD /proc/28636/fd (opendir: Permission denied) 2024-05-08T23:18:01.382 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-log/d 28637 root cwd unknown /proc/28637/cwd (readlink: Permission denied) 2024-05-08T23:18:01.382 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-log/d 28637 root rtd unknown /proc/28637/root (readlink: Permission denied) 2024-05-08T23:18:01.382 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-log/d 28637 root txt unknown /proc/28637/exe (readlink: Permission denied) 2024-05-08T23:18:01.382 INFO:tasks.workunit.client.0.smithi135.stdout:xfs-log/d 28637 root NOFD /proc/28637/fd (opendir: Permission denied) 2024-05-08T23:18:01.382 INFO:tasks.workunit.client.0.smithi135.stdout:xfsaild/d 28638 root cwd unknown /proc/28638/cwd (readlink: Permission denied) 2024-05-08T23:18:01.382 INFO:tasks.workunit.client.0.smithi135.stdout:xfsaild/d 28638 root rtd unknown /proc/28638/root (readlink: Permission denied) 2024-05-08T23:18:01.382 INFO:tasks.workunit.client.0.smithi135.stdout:xfsaild/d 28638 root txt unknown /proc/28638/exe (readlink: Permission denied) 2024-05-08T23:18:01.382 INFO:tasks.workunit.client.0.smithi135.stdout:xfsaild/d 28638 root NOFD /proc/28638/fd (opendir: Permission denied) 2024-05-08T23:18:01.383 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 32313 root cwd unknown /proc/32313/cwd (readlink: Permission denied) 2024-05-08T23:18:01.383 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 32313 root rtd unknown /proc/32313/root (readlink: Permission denied) 2024-05-08T23:18:01.383 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 32313 root txt unknown /proc/32313/exe (readlink: Permission denied) 2024-05-08T23:18:01.383 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 32313 root NOFD /proc/32313/fd (opendir: Permission denied) 2024-05-08T23:18:01.383 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 32317 ubuntu cwd unknown /proc/32317/cwd (readlink: Permission denied) 2024-05-08T23:18:01.383 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 32317 ubuntu rtd unknown /proc/32317/root (readlink: Permission denied) 2024-05-08T23:18:01.383 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 32317 ubuntu txt unknown /proc/32317/exe (readlink: Permission denied) 2024-05-08T23:18:01.383 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 32317 ubuntu NOFD /proc/32317/fd (opendir: Permission denied) 2024-05-08T23:18:01.383 INFO:tasks.workunit.client.0.smithi135.stdout:chronyd 32388 chrony cwd unknown /proc/32388/cwd (readlink: Permission denied) 2024-05-08T23:18:01.383 INFO:tasks.workunit.client.0.smithi135.stdout:chronyd 32388 chrony rtd unknown /proc/32388/root (readlink: Permission denied) 2024-05-08T23:18:01.383 INFO:tasks.workunit.client.0.smithi135.stdout:chronyd 32388 chrony txt unknown /proc/32388/exe (readlink: Permission denied) 2024-05-08T23:18:01.383 INFO:tasks.workunit.client.0.smithi135.stdout:chronyd 32388 chrony NOFD /proc/32388/fd (opendir: Permission denied) 2024-05-08T23:18:01.383 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-cras 33581 ceph cwd unknown /proc/33581/cwd (readlink: Permission denied) 2024-05-08T23:18:01.383 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-cras 33581 ceph rtd unknown /proc/33581/root (readlink: Permission denied) 2024-05-08T23:18:01.384 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-cras 33581 ceph txt unknown /proc/33581/exe (readlink: Permission denied) 2024-05-08T23:18:01.384 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-cras 33581 ceph NOFD /proc/33581/fd (opendir: Permission denied) 2024-05-08T23:18:01.384 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 40656 root cwd unknown /proc/40656/cwd (readlink: Permission denied) 2024-05-08T23:18:01.384 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 40656 root rtd unknown /proc/40656/root (readlink: Permission denied) 2024-05-08T23:18:01.384 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 40656 root txt unknown /proc/40656/exe (readlink: Permission denied) 2024-05-08T23:18:01.384 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 40656 root NOFD /proc/40656/fd (opendir: Permission denied) 2024-05-08T23:18:01.384 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 40699 root cwd unknown /proc/40699/cwd (readlink: Permission denied) 2024-05-08T23:18:01.384 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 40699 root rtd unknown /proc/40699/root (readlink: Permission denied) 2024-05-08T23:18:01.384 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 40699 root txt unknown /proc/40699/exe (readlink: Permission denied) 2024-05-08T23:18:01.384 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 40699 root NOFD /proc/40699/fd (opendir: Permission denied) 2024-05-08T23:18:01.384 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 40700 root cwd unknown /proc/40700/cwd (readlink: Permission denied) 2024-05-08T23:18:01.384 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 40700 root rtd unknown /proc/40700/root (readlink: Permission denied) 2024-05-08T23:18:01.384 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 40700 root txt unknown /proc/40700/exe (readlink: Permission denied) 2024-05-08T23:18:01.384 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 40700 root NOFD /proc/40700/fd (opendir: Permission denied) 2024-05-08T23:18:01.384 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 41115 root cwd unknown /proc/41115/cwd (readlink: Permission denied) 2024-05-08T23:18:01.385 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 41115 root rtd unknown /proc/41115/root (readlink: Permission denied) 2024-05-08T23:18:01.385 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 41115 root txt unknown /proc/41115/exe (readlink: Permission denied) 2024-05-08T23:18:01.385 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 41115 root NOFD /proc/41115/fd (opendir: Permission denied) 2024-05-08T23:18:01.385 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 41135 root cwd unknown /proc/41135/cwd (readlink: Permission denied) 2024-05-08T23:18:01.385 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 41135 root rtd unknown /proc/41135/root (readlink: Permission denied) 2024-05-08T23:18:01.385 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 41135 root txt unknown /proc/41135/exe (readlink: Permission denied) 2024-05-08T23:18:01.385 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 41135 root NOFD /proc/41135/fd (opendir: Permission denied) 2024-05-08T23:18:01.385 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 41136 root cwd unknown /proc/41136/cwd (readlink: Permission denied) 2024-05-08T23:18:01.385 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 41136 root rtd unknown /proc/41136/root (readlink: Permission denied) 2024-05-08T23:18:01.386 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 41136 root txt unknown /proc/41136/exe (readlink: Permission denied) 2024-05-08T23:18:01.386 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 41136 root NOFD /proc/41136/fd (opendir: Permission denied) 2024-05-08T23:18:01.386 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 41156 root cwd unknown /proc/41156/cwd (readlink: Permission denied) 2024-05-08T23:18:01.386 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 41156 root rtd unknown /proc/41156/root (readlink: Permission denied) 2024-05-08T23:18:01.386 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 41156 root txt unknown /proc/41156/exe (readlink: Permission denied) 2024-05-08T23:18:01.386 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 41156 root NOFD /proc/41156/fd (opendir: Permission denied) 2024-05-08T23:18:01.386 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 41486 root cwd unknown /proc/41486/cwd (readlink: Permission denied) 2024-05-08T23:18:01.386 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 41486 root rtd unknown /proc/41486/root (readlink: Permission denied) 2024-05-08T23:18:01.386 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 41486 root txt unknown /proc/41486/exe (readlink: Permission denied) 2024-05-08T23:18:01.386 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 41486 root NOFD /proc/41486/fd (opendir: Permission denied) 2024-05-08T23:18:01.386 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 42416 root cwd unknown /proc/42416/cwd (readlink: Permission denied) 2024-05-08T23:18:01.387 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 42416 root rtd unknown /proc/42416/root (readlink: Permission denied) 2024-05-08T23:18:01.387 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 42416 root txt unknown /proc/42416/exe (readlink: Permission denied) 2024-05-08T23:18:01.387 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 42416 root NOFD /proc/42416/fd (opendir: Permission denied) 2024-05-08T23:18:01.387 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 42427 root cwd unknown /proc/42427/cwd (readlink: Permission denied) 2024-05-08T23:18:01.387 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 42427 root rtd unknown /proc/42427/root (readlink: Permission denied) 2024-05-08T23:18:01.387 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 42427 root txt unknown /proc/42427/exe (readlink: Permission denied) 2024-05-08T23:18:01.387 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 42427 root NOFD /proc/42427/fd (opendir: Permission denied) 2024-05-08T23:18:01.387 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 ceph cwd unknown /proc/42440/cwd (readlink: Permission denied) 2024-05-08T23:18:01.387 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 ceph rtd unknown /proc/42440/root (readlink: Permission denied) 2024-05-08T23:18:01.387 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 ceph txt unknown /proc/42440/exe (readlink: Permission denied) 2024-05-08T23:18:01.387 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 ceph NOFD /proc/42440/fd (opendir: Permission denied) 2024-05-08T23:18:01.387 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42441 log ceph cwd unknown /proc/42440/task/42441/cwd (readlink: Permission denied) 2024-05-08T23:18:01.387 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42441 log ceph rtd unknown /proc/42440/task/42441/root (readlink: Permission denied) 2024-05-08T23:18:01.387 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42441 log ceph txt unknown /proc/42440/task/42441/exe (readlink: Permission denied) 2024-05-08T23:18:01.387 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42441 log ceph NOFD /proc/42440/task/42441/fd (opendir: Permission denied) 2024-05-08T23:18:01.388 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42442 service ceph cwd unknown /proc/42440/task/42442/cwd (readlink: Permission denied) 2024-05-08T23:18:01.388 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42442 service ceph rtd unknown /proc/42440/task/42442/root (readlink: Permission denied) 2024-05-08T23:18:01.388 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42442 service ceph txt unknown /proc/42440/task/42442/exe (readlink: Permission denied) 2024-05-08T23:18:01.388 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42442 service ceph NOFD /proc/42440/task/42442/fd (opendir: Permission denied) 2024-05-08T23:18:01.388 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42443 admin_soc ceph cwd unknown /proc/42440/task/42443/cwd (readlink: Permission denied) 2024-05-08T23:18:01.388 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42443 admin_soc ceph rtd unknown /proc/42440/task/42443/root (readlink: Permission denied) 2024-05-08T23:18:01.388 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42443 admin_soc ceph txt unknown /proc/42440/task/42443/exe (readlink: Permission denied) 2024-05-08T23:18:01.388 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42443 admin_soc ceph NOFD /proc/42440/task/42443/fd (opendir: Permission denied) 2024-05-08T23:18:01.388 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42445 signal_ha ceph cwd unknown /proc/42440/task/42445/cwd (readlink: Permission denied) 2024-05-08T23:18:01.388 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42445 signal_ha ceph rtd unknown /proc/42440/task/42445/root (readlink: Permission denied) 2024-05-08T23:18:01.388 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42445 signal_ha ceph txt unknown /proc/42440/task/42445/exe (readlink: Permission denied) 2024-05-08T23:18:01.388 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42445 signal_ha ceph NOFD /proc/42440/task/42445/fd (opendir: Permission denied) 2024-05-08T23:18:01.388 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42446 rocksdb:l ceph cwd unknown /proc/42440/task/42446/cwd (readlink: Permission denied) 2024-05-08T23:18:01.388 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42446 rocksdb:l ceph rtd unknown /proc/42440/task/42446/root (readlink: Permission denied) 2024-05-08T23:18:01.388 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42446 rocksdb:l ceph txt unknown /proc/42440/task/42446/exe (readlink: Permission denied) 2024-05-08T23:18:01.389 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42446 rocksdb:l ceph NOFD /proc/42440/task/42446/fd (opendir: Permission denied) 2024-05-08T23:18:01.389 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42447 rocksdb:h ceph cwd unknown /proc/42440/task/42447/cwd (readlink: Permission denied) 2024-05-08T23:18:01.389 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42447 rocksdb:h ceph rtd unknown /proc/42440/task/42447/root (readlink: Permission denied) 2024-05-08T23:18:01.389 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42447 rocksdb:h ceph txt unknown /proc/42440/task/42447/exe (readlink: Permission denied) 2024-05-08T23:18:01.389 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42447 rocksdb:h ceph NOFD /proc/42440/task/42447/fd (opendir: Permission denied) 2024-05-08T23:18:01.389 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42463 ceph-mon ceph cwd unknown /proc/42440/task/42463/cwd (readlink: Permission denied) 2024-05-08T23:18:01.389 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42463 ceph-mon ceph rtd unknown /proc/42440/task/42463/root (readlink: Permission denied) 2024-05-08T23:18:01.389 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42463 ceph-mon ceph txt unknown /proc/42440/task/42463/exe (readlink: Permission denied) 2024-05-08T23:18:01.389 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42463 ceph-mon ceph NOFD /proc/42440/task/42463/fd (opendir: Permission denied) 2024-05-08T23:18:01.389 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42464 fn_monsto ceph cwd unknown /proc/42440/task/42464/cwd (readlink: Permission denied) 2024-05-08T23:18:01.389 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42464 fn_monsto ceph rtd unknown /proc/42440/task/42464/root (readlink: Permission denied) 2024-05-08T23:18:01.389 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42464 fn_monsto ceph txt unknown /proc/42440/task/42464/exe (readlink: Permission denied) 2024-05-08T23:18:01.389 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42464 fn_monsto ceph NOFD /proc/42440/task/42464/fd (opendir: Permission denied) 2024-05-08T23:18:01.389 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42465 msgr-work ceph cwd unknown /proc/42440/task/42465/cwd (readlink: Permission denied) 2024-05-08T23:18:01.390 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42465 msgr-work ceph rtd unknown /proc/42440/task/42465/root (readlink: Permission denied) 2024-05-08T23:18:01.390 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42465 msgr-work ceph txt unknown /proc/42440/task/42465/exe (readlink: Permission denied) 2024-05-08T23:18:01.390 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42465 msgr-work ceph NOFD /proc/42440/task/42465/fd (opendir: Permission denied) 2024-05-08T23:18:01.390 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42466 msgr-work ceph cwd unknown /proc/42440/task/42466/cwd (readlink: Permission denied) 2024-05-08T23:18:01.390 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42466 msgr-work ceph rtd unknown /proc/42440/task/42466/root (readlink: Permission denied) 2024-05-08T23:18:01.390 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42466 msgr-work ceph txt unknown /proc/42440/task/42466/exe (readlink: Permission denied) 2024-05-08T23:18:01.390 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42466 msgr-work ceph NOFD /proc/42440/task/42466/fd (opendir: Permission denied) 2024-05-08T23:18:01.390 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42467 msgr-work ceph cwd unknown /proc/42440/task/42467/cwd (readlink: Permission denied) 2024-05-08T23:18:01.390 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42467 msgr-work ceph rtd unknown /proc/42440/task/42467/root (readlink: Permission denied) 2024-05-08T23:18:01.390 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42467 msgr-work ceph txt unknown /proc/42440/task/42467/exe (readlink: Permission denied) 2024-05-08T23:18:01.390 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42467 msgr-work ceph NOFD /proc/42440/task/42467/fd (opendir: Permission denied) 2024-05-08T23:18:01.390 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42468 OpHistory ceph cwd unknown /proc/42440/task/42468/cwd (readlink: Permission denied) 2024-05-08T23:18:01.390 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42468 OpHistory ceph rtd unknown /proc/42440/task/42468/root (readlink: Permission denied) 2024-05-08T23:18:01.390 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42468 OpHistory ceph txt unknown /proc/42440/task/42468/exe (readlink: Permission denied) 2024-05-08T23:18:01.391 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42468 OpHistory ceph NOFD /proc/42440/task/42468/fd (opendir: Permission denied) 2024-05-08T23:18:01.391 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42471 fin ceph cwd unknown /proc/42440/task/42471/cwd (readlink: Permission denied) 2024-05-08T23:18:01.391 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42471 fin ceph rtd unknown /proc/42440/task/42471/root (readlink: Permission denied) 2024-05-08T23:18:01.391 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42471 fin ceph txt unknown /proc/42440/task/42471/exe (readlink: Permission denied) 2024-05-08T23:18:01.391 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42471 fin ceph NOFD /proc/42440/task/42471/fd (opendir: Permission denied) 2024-05-08T23:18:01.391 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42472 safe_time ceph cwd unknown /proc/42440/task/42472/cwd (readlink: Permission denied) 2024-05-08T23:18:01.391 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42472 safe_time ceph rtd unknown /proc/42440/task/42472/root (readlink: Permission denied) 2024-05-08T23:18:01.391 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42472 safe_time ceph txt unknown /proc/42440/task/42472/exe (readlink: Permission denied) 2024-05-08T23:18:01.391 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42472 safe_time ceph NOFD /proc/42440/task/42472/fd (opendir: Permission denied) 2024-05-08T23:18:01.391 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42473 cpu_tp ceph cwd unknown /proc/42440/task/42473/cwd (readlink: Permission denied) 2024-05-08T23:18:01.391 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42473 cpu_tp ceph rtd unknown /proc/42440/task/42473/root (readlink: Permission denied) 2024-05-08T23:18:01.391 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42473 cpu_tp ceph txt unknown /proc/42440/task/42473/exe (readlink: Permission denied) 2024-05-08T23:18:01.391 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42473 cpu_tp ceph NOFD /proc/42440/task/42473/fd (opendir: Permission denied) 2024-05-08T23:18:01.391 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42474 cpu_tp ceph cwd unknown /proc/42440/task/42474/cwd (readlink: Permission denied) 2024-05-08T23:18:01.391 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42474 cpu_tp ceph rtd unknown /proc/42440/task/42474/root (readlink: Permission denied) 2024-05-08T23:18:01.392 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42474 cpu_tp ceph txt unknown /proc/42440/task/42474/exe (readlink: Permission denied) 2024-05-08T23:18:01.392 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42474 cpu_tp ceph NOFD /proc/42440/task/42474/fd (opendir: Permission denied) 2024-05-08T23:18:01.392 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42475 cpu_tp ceph cwd unknown /proc/42440/task/42475/cwd (readlink: Permission denied) 2024-05-08T23:18:01.392 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42475 cpu_tp ceph rtd unknown /proc/42440/task/42475/root (readlink: Permission denied) 2024-05-08T23:18:01.392 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42475 cpu_tp ceph txt unknown /proc/42440/task/42475/exe (readlink: Permission denied) 2024-05-08T23:18:01.392 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42475 cpu_tp ceph NOFD /proc/42440/task/42475/fd (opendir: Permission denied) 2024-05-08T23:18:01.392 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42476 cpu_tp ceph cwd unknown /proc/42440/task/42476/cwd (readlink: Permission denied) 2024-05-08T23:18:01.392 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42476 cpu_tp ceph rtd unknown /proc/42440/task/42476/root (readlink: Permission denied) 2024-05-08T23:18:01.392 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42476 cpu_tp ceph txt unknown /proc/42440/task/42476/exe (readlink: Permission denied) 2024-05-08T23:18:01.392 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42476 cpu_tp ceph NOFD /proc/42440/task/42476/fd (opendir: Permission denied) 2024-05-08T23:18:01.392 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42477 ms_dispat ceph cwd unknown /proc/42440/task/42477/cwd (readlink: Permission denied) 2024-05-08T23:18:01.392 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42477 ms_dispat ceph rtd unknown /proc/42440/task/42477/root (readlink: Permission denied) 2024-05-08T23:18:01.392 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42477 ms_dispat ceph txt unknown /proc/42440/task/42477/exe (readlink: Permission denied) 2024-05-08T23:18:01.392 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42477 ms_dispat ceph NOFD /proc/42440/task/42477/fd (opendir: Permission denied) 2024-05-08T23:18:01.393 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42478 ms_local ceph cwd unknown /proc/42440/task/42478/cwd (readlink: Permission denied) 2024-05-08T23:18:01.393 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42478 ms_local ceph rtd unknown /proc/42440/task/42478/root (readlink: Permission denied) 2024-05-08T23:18:01.393 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42478 ms_local ceph txt unknown /proc/42440/task/42478/exe (readlink: Permission denied) 2024-05-08T23:18:01.393 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42478 ms_local ceph NOFD /proc/42440/task/42478/fd (opendir: Permission denied) 2024-05-08T23:18:01.393 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42479 safe_time ceph cwd unknown /proc/42440/task/42479/cwd (readlink: Permission denied) 2024-05-08T23:18:01.393 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42479 safe_time ceph rtd unknown /proc/42440/task/42479/root (readlink: Permission denied) 2024-05-08T23:18:01.393 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42479 safe_time ceph txt unknown /proc/42440/task/42479/exe (readlink: Permission denied) 2024-05-08T23:18:01.393 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42479 safe_time ceph NOFD /proc/42440/task/42479/fd (opendir: Permission denied) 2024-05-08T23:18:01.393 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42480 ms_dispat ceph cwd unknown /proc/42440/task/42480/cwd (readlink: Permission denied) 2024-05-08T23:18:01.393 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42480 ms_dispat ceph rtd unknown /proc/42440/task/42480/root (readlink: Permission denied) 2024-05-08T23:18:01.393 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42480 ms_dispat ceph txt unknown /proc/42440/task/42480/exe (readlink: Permission denied) 2024-05-08T23:18:01.393 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42480 ms_dispat ceph NOFD /proc/42440/task/42480/fd (opendir: Permission denied) 2024-05-08T23:18:01.393 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42481 ms_local ceph cwd unknown /proc/42440/task/42481/cwd (readlink: Permission denied) 2024-05-08T23:18:01.393 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42481 ms_local ceph rtd unknown /proc/42440/task/42481/root (readlink: Permission denied) 2024-05-08T23:18:01.393 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42481 ms_local ceph txt unknown /proc/42440/task/42481/exe (readlink: Permission denied) 2024-05-08T23:18:01.394 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 42481 ms_local ceph NOFD /proc/42440/task/42481/fd (opendir: Permission denied) 2024-05-08T23:18:01.394 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 92408 rstore_co ceph cwd unknown /proc/42440/task/92408/cwd (readlink: Permission denied) 2024-05-08T23:18:01.394 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 92408 rstore_co ceph rtd unknown /proc/42440/task/92408/root (readlink: Permission denied) 2024-05-08T23:18:01.394 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 92408 rstore_co ceph txt unknown /proc/42440/task/92408/exe (readlink: Permission denied) 2024-05-08T23:18:01.394 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mon 42440 92408 rstore_co ceph NOFD /proc/42440/task/92408/fd (opendir: Permission denied) 2024-05-08T23:18:01.394 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 42691 root cwd unknown /proc/42691/cwd (readlink: Permission denied) 2024-05-08T23:18:01.394 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 42691 root rtd unknown /proc/42691/root (readlink: Permission denied) 2024-05-08T23:18:01.394 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 42691 root txt unknown /proc/42691/exe (readlink: Permission denied) 2024-05-08T23:18:01.394 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 42691 root NOFD /proc/42691/fd (opendir: Permission denied) 2024-05-08T23:18:01.394 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 42702 root cwd unknown /proc/42702/cwd (readlink: Permission denied) 2024-05-08T23:18:01.394 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 42702 root rtd unknown /proc/42702/root (readlink: Permission denied) 2024-05-08T23:18:01.394 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 42702 root txt unknown /proc/42702/exe (readlink: Permission denied) 2024-05-08T23:18:01.394 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 42702 root NOFD /proc/42702/fd (opendir: Permission denied) 2024-05-08T23:18:01.394 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 ceph cwd unknown /proc/42714/cwd (readlink: Permission denied) 2024-05-08T23:18:01.395 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 ceph rtd unknown /proc/42714/root (readlink: Permission denied) 2024-05-08T23:18:01.395 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 ceph txt unknown /proc/42714/exe (readlink: Permission denied) 2024-05-08T23:18:01.395 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 ceph NOFD /proc/42714/fd (opendir: Permission denied) 2024-05-08T23:18:01.395 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45733 log ceph cwd unknown /proc/42714/task/45733/cwd (readlink: Permission denied) 2024-05-08T23:18:01.395 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45733 log ceph rtd unknown /proc/42714/task/45733/root (readlink: Permission denied) 2024-05-08T23:18:01.395 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45733 log ceph txt unknown /proc/42714/task/45733/exe (readlink: Permission denied) 2024-05-08T23:18:01.395 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45733 log ceph NOFD /proc/42714/task/45733/fd (opendir: Permission denied) 2024-05-08T23:18:01.395 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45735 msgr-work ceph cwd unknown /proc/42714/task/45735/cwd (readlink: Permission denied) 2024-05-08T23:18:01.395 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45735 msgr-work ceph rtd unknown /proc/42714/task/45735/root (readlink: Permission denied) 2024-05-08T23:18:01.395 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45735 msgr-work ceph txt unknown /proc/42714/task/45735/exe (readlink: Permission denied) 2024-05-08T23:18:01.395 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45735 msgr-work ceph NOFD /proc/42714/task/45735/fd (opendir: Permission denied) 2024-05-08T23:18:01.395 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45736 msgr-work ceph cwd unknown /proc/42714/task/45736/cwd (readlink: Permission denied) 2024-05-08T23:18:01.395 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45736 msgr-work ceph rtd unknown /proc/42714/task/45736/root (readlink: Permission denied) 2024-05-08T23:18:01.395 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45736 msgr-work ceph txt unknown /proc/42714/task/45736/exe (readlink: Permission denied) 2024-05-08T23:18:01.396 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45736 msgr-work ceph NOFD /proc/42714/task/45736/fd (opendir: Permission denied) 2024-05-08T23:18:01.396 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45737 msgr-work ceph cwd unknown /proc/42714/task/45737/cwd (readlink: Permission denied) 2024-05-08T23:18:01.396 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45737 msgr-work ceph rtd unknown /proc/42714/task/45737/root (readlink: Permission denied) 2024-05-08T23:18:01.396 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45737 msgr-work ceph txt unknown /proc/42714/task/45737/exe (readlink: Permission denied) 2024-05-08T23:18:01.396 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45737 msgr-work ceph NOFD /proc/42714/task/45737/fd (opendir: Permission denied) 2024-05-08T23:18:01.396 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45741 service ceph cwd unknown /proc/42714/task/45741/cwd (readlink: Permission denied) 2024-05-08T23:18:01.396 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45741 service ceph rtd unknown /proc/42714/task/45741/root (readlink: Permission denied) 2024-05-08T23:18:01.396 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45741 service ceph txt unknown /proc/42714/task/45741/exe (readlink: Permission denied) 2024-05-08T23:18:01.396 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45741 service ceph NOFD /proc/42714/task/45741/fd (opendir: Permission denied) 2024-05-08T23:18:01.396 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45742 admin_soc ceph cwd unknown /proc/42714/task/45742/cwd (readlink: Permission denied) 2024-05-08T23:18:01.396 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45742 admin_soc ceph rtd unknown /proc/42714/task/45742/root (readlink: Permission denied) 2024-05-08T23:18:01.396 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45742 admin_soc ceph txt unknown /proc/42714/task/45742/exe (readlink: Permission denied) 2024-05-08T23:18:01.396 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45742 admin_soc ceph NOFD /proc/42714/task/45742/fd (opendir: Permission denied) 2024-05-08T23:18:01.396 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45743 ceph_time ceph cwd unknown /proc/42714/task/45743/cwd (readlink: Permission denied) 2024-05-08T23:18:01.396 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45743 ceph_time ceph rtd unknown /proc/42714/task/45743/root (readlink: Permission denied) 2024-05-08T23:18:01.397 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45743 ceph_time ceph txt unknown /proc/42714/task/45743/exe (readlink: Permission denied) 2024-05-08T23:18:01.397 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45743 ceph_time ceph NOFD /proc/42714/task/45743/fd (opendir: Permission denied) 2024-05-08T23:18:01.397 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45744 fn_anonym ceph cwd unknown /proc/42714/task/45744/cwd (readlink: Permission denied) 2024-05-08T23:18:01.397 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45744 fn_anonym ceph rtd unknown /proc/42714/task/45744/root (readlink: Permission denied) 2024-05-08T23:18:01.397 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45744 fn_anonym ceph txt unknown /proc/42714/task/45744/exe (readlink: Permission denied) 2024-05-08T23:18:01.397 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45744 fn_anonym ceph NOFD /proc/42714/task/45744/fd (opendir: Permission denied) 2024-05-08T23:18:01.397 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45745 signal_ha ceph cwd unknown /proc/42714/task/45745/cwd (readlink: Permission denied) 2024-05-08T23:18:01.397 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45745 signal_ha ceph rtd unknown /proc/42714/task/45745/root (readlink: Permission denied) 2024-05-08T23:18:01.397 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45745 signal_ha ceph txt unknown /proc/42714/task/45745/exe (readlink: Permission denied) 2024-05-08T23:18:01.397 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45745 signal_ha ceph NOFD /proc/42714/task/45745/fd (opendir: Permission denied) 2024-05-08T23:18:01.397 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45746 mgrsb-fin ceph cwd unknown /proc/42714/task/45746/cwd (readlink: Permission denied) 2024-05-08T23:18:01.397 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45746 mgrsb-fin ceph rtd unknown /proc/42714/task/45746/root (readlink: Permission denied) 2024-05-08T23:18:01.397 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45746 mgrsb-fin ceph txt unknown /proc/42714/task/45746/exe (readlink: Permission denied) 2024-05-08T23:18:01.398 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45746 mgrsb-fin ceph NOFD /proc/42714/task/45746/fd (opendir: Permission denied) 2024-05-08T23:18:01.398 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45747 ms_dispat ceph cwd unknown /proc/42714/task/45747/cwd (readlink: Permission denied) 2024-05-08T23:18:01.398 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45747 ms_dispat ceph rtd unknown /proc/42714/task/45747/root (readlink: Permission denied) 2024-05-08T23:18:01.398 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45747 ms_dispat ceph txt unknown /proc/42714/task/45747/exe (readlink: Permission denied) 2024-05-08T23:18:01.398 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45747 ms_dispat ceph NOFD /proc/42714/task/45747/fd (opendir: Permission denied) 2024-05-08T23:18:01.398 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45748 ms_local ceph cwd unknown /proc/42714/task/45748/cwd (readlink: Permission denied) 2024-05-08T23:18:01.398 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45748 ms_local ceph rtd unknown /proc/42714/task/45748/root (readlink: Permission denied) 2024-05-08T23:18:01.398 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45748 ms_local ceph txt unknown /proc/42714/task/45748/exe (readlink: Permission denied) 2024-05-08T23:18:01.398 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45748 ms_local ceph NOFD /proc/42714/task/45748/fd (opendir: Permission denied) 2024-05-08T23:18:01.398 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45749 io_contex ceph cwd unknown /proc/42714/task/45749/cwd (readlink: Permission denied) 2024-05-08T23:18:01.398 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45749 io_contex ceph rtd unknown /proc/42714/task/45749/root (readlink: Permission denied) 2024-05-08T23:18:01.398 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45749 io_contex ceph txt unknown /proc/42714/task/45749/exe (readlink: Permission denied) 2024-05-08T23:18:01.398 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45749 io_contex ceph NOFD /proc/42714/task/45749/fd (opendir: Permission denied) 2024-05-08T23:18:01.398 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45750 io_contex ceph cwd unknown /proc/42714/task/45750/cwd (readlink: Permission denied) 2024-05-08T23:18:01.398 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45750 io_contex ceph rtd unknown /proc/42714/task/45750/root (readlink: Permission denied) 2024-05-08T23:18:01.399 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45750 io_contex ceph txt unknown /proc/42714/task/45750/exe (readlink: Permission denied) 2024-05-08T23:18:01.399 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45750 io_contex ceph NOFD /proc/42714/task/45750/fd (opendir: Permission denied) 2024-05-08T23:18:01.399 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45751 safe_time ceph cwd unknown /proc/42714/task/45751/cwd (readlink: Permission denied) 2024-05-08T23:18:01.399 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45751 safe_time ceph rtd unknown /proc/42714/task/45751/root (readlink: Permission denied) 2024-05-08T23:18:01.399 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45751 safe_time ceph txt unknown /proc/42714/task/45751/exe (readlink: Permission denied) 2024-05-08T23:18:01.399 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45751 safe_time ceph NOFD /proc/42714/task/45751/fd (opendir: Permission denied) 2024-05-08T23:18:01.399 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45752 safe_time ceph cwd unknown /proc/42714/task/45752/cwd (readlink: Permission denied) 2024-05-08T23:18:01.399 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45752 safe_time ceph rtd unknown /proc/42714/task/45752/root (readlink: Permission denied) 2024-05-08T23:18:01.399 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45752 safe_time ceph txt unknown /proc/42714/task/45752/exe (readlink: Permission denied) 2024-05-08T23:18:01.399 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45752 safe_time ceph NOFD /proc/42714/task/45752/fd (opendir: Permission denied) 2024-05-08T23:18:01.399 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45753 safe_time ceph cwd unknown /proc/42714/task/45753/cwd (readlink: Permission denied) 2024-05-08T23:18:01.399 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45753 safe_time ceph rtd unknown /proc/42714/task/45753/root (readlink: Permission denied) 2024-05-08T23:18:01.399 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45753 safe_time ceph txt unknown /proc/42714/task/45753/exe (readlink: Permission denied) 2024-05-08T23:18:01.399 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45753 safe_time ceph NOFD /proc/42714/task/45753/fd (opendir: Permission denied) 2024-05-08T23:18:01.399 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45754 fn_anonym ceph cwd unknown /proc/42714/task/45754/cwd (readlink: Permission denied) 2024-05-08T23:18:01.400 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45754 fn_anonym ceph rtd unknown /proc/42714/task/45754/root (readlink: Permission denied) 2024-05-08T23:18:01.400 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45754 fn_anonym ceph txt unknown /proc/42714/task/45754/exe (readlink: Permission denied) 2024-05-08T23:18:01.400 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45754 fn_anonym ceph NOFD /proc/42714/task/45754/fd (opendir: Permission denied) 2024-05-08T23:18:01.400 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45755 flusher ceph cwd unknown /proc/42714/task/45755/cwd (readlink: Permission denied) 2024-05-08T23:18:01.400 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45755 flusher ceph rtd unknown /proc/42714/task/45755/root (readlink: Permission denied) 2024-05-08T23:18:01.400 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45755 flusher ceph txt unknown /proc/42714/task/45755/exe (readlink: Permission denied) 2024-05-08T23:18:01.400 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45755 flusher ceph NOFD /proc/42714/task/45755/fd (opendir: Permission denied) 2024-05-08T23:18:01.400 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45756 safe_time ceph cwd unknown /proc/42714/task/45756/cwd (readlink: Permission denied) 2024-05-08T23:18:01.400 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45756 safe_time ceph rtd unknown /proc/42714/task/45756/root (readlink: Permission denied) 2024-05-08T23:18:01.400 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45756 safe_time ceph txt unknown /proc/42714/task/45756/exe (readlink: Permission denied) 2024-05-08T23:18:01.400 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45756 safe_time ceph NOFD /proc/42714/task/45756/fd (opendir: Permission denied) 2024-05-08T23:18:01.400 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45991 mgr-fin ceph cwd unknown /proc/42714/task/45991/cwd (readlink: Permission denied) 2024-05-08T23:18:01.400 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45991 mgr-fin ceph rtd unknown /proc/42714/task/45991/root (readlink: Permission denied) 2024-05-08T23:18:01.400 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45991 mgr-fin ceph txt unknown /proc/42714/task/45991/exe (readlink: Permission denied) 2024-05-08T23:18:01.400 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45991 mgr-fin ceph NOFD /proc/42714/task/45991/fd (opendir: Permission denied) 2024-05-08T23:18:01.401 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45992 ms_dispat ceph cwd unknown /proc/42714/task/45992/cwd (readlink: Permission denied) 2024-05-08T23:18:01.401 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45992 ms_dispat ceph rtd unknown /proc/42714/task/45992/root (readlink: Permission denied) 2024-05-08T23:18:01.401 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45992 ms_dispat ceph txt unknown /proc/42714/task/45992/exe (readlink: Permission denied) 2024-05-08T23:18:01.401 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45992 ms_dispat ceph NOFD /proc/42714/task/45992/fd (opendir: Permission denied) 2024-05-08T23:18:01.401 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45993 ms_local ceph cwd unknown /proc/42714/task/45993/cwd (readlink: Permission denied) 2024-05-08T23:18:01.401 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45993 ms_local ceph rtd unknown /proc/42714/task/45993/root (readlink: Permission denied) 2024-05-08T23:18:01.401 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45993 ms_local ceph txt unknown /proc/42714/task/45993/exe (readlink: Permission denied) 2024-05-08T23:18:01.401 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45993 ms_local ceph NOFD /proc/42714/task/45993/fd (opendir: Permission denied) 2024-05-08T23:18:01.401 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45994 safe_time ceph cwd unknown /proc/42714/task/45994/cwd (readlink: Permission denied) 2024-05-08T23:18:01.401 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45994 safe_time ceph rtd unknown /proc/42714/task/45994/root (readlink: Permission denied) 2024-05-08T23:18:01.401 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45994 safe_time ceph txt unknown /proc/42714/task/45994/exe (readlink: Permission denied) 2024-05-08T23:18:01.401 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45994 safe_time ceph NOFD /proc/42714/task/45994/fd (opendir: Permission denied) 2024-05-08T23:18:01.401 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45995 cmdfin ceph cwd unknown /proc/42714/task/45995/cwd (readlink: Permission denied) 2024-05-08T23:18:01.401 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45995 cmdfin ceph rtd unknown /proc/42714/task/45995/root (readlink: Permission denied) 2024-05-08T23:18:01.401 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45995 cmdfin ceph txt unknown /proc/42714/task/45995/exe (readlink: Permission denied) 2024-05-08T23:18:01.402 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45995 cmdfin ceph NOFD /proc/42714/task/45995/fd (opendir: Permission denied) 2024-05-08T23:18:01.402 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45999 io_contex ceph cwd unknown /proc/42714/task/45999/cwd (readlink: Permission denied) 2024-05-08T23:18:01.402 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45999 io_contex ceph rtd unknown /proc/42714/task/45999/root (readlink: Permission denied) 2024-05-08T23:18:01.402 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45999 io_contex ceph txt unknown /proc/42714/task/45999/exe (readlink: Permission denied) 2024-05-08T23:18:01.402 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 45999 io_contex ceph NOFD /proc/42714/task/45999/fd (opendir: Permission denied) 2024-05-08T23:18:01.402 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46000 io_contex ceph cwd unknown /proc/42714/task/46000/cwd (readlink: Permission denied) 2024-05-08T23:18:01.402 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46000 io_contex ceph rtd unknown /proc/42714/task/46000/root (readlink: Permission denied) 2024-05-08T23:18:01.402 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46000 io_contex ceph txt unknown /proc/42714/task/46000/exe (readlink: Permission denied) 2024-05-08T23:18:01.402 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46000 io_contex ceph NOFD /proc/42714/task/46000/fd (opendir: Permission denied) 2024-05-08T23:18:01.402 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46001 ceph_time ceph cwd unknown /proc/42714/task/46001/cwd (readlink: Permission denied) 2024-05-08T23:18:01.402 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46001 ceph_time ceph rtd unknown /proc/42714/task/46001/root (readlink: Permission denied) 2024-05-08T23:18:01.402 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46001 ceph_time ceph txt unknown /proc/42714/task/46001/exe (readlink: Permission denied) 2024-05-08T23:18:01.402 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46001 ceph_time ceph NOFD /proc/42714/task/46001/fd (opendir: Permission denied) 2024-05-08T23:18:01.402 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46002 ms_dispat ceph cwd unknown /proc/42714/task/46002/cwd (readlink: Permission denied) 2024-05-08T23:18:01.402 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46002 ms_dispat ceph rtd unknown /proc/42714/task/46002/root (readlink: Permission denied) 2024-05-08T23:18:01.403 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46002 ms_dispat ceph txt unknown /proc/42714/task/46002/exe (readlink: Permission denied) 2024-05-08T23:18:01.403 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46002 ms_dispat ceph NOFD /proc/42714/task/46002/fd (opendir: Permission denied) 2024-05-08T23:18:01.403 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46003 ms_local ceph cwd unknown /proc/42714/task/46003/cwd (readlink: Permission denied) 2024-05-08T23:18:01.403 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46003 ms_local ceph rtd unknown /proc/42714/task/46003/root (readlink: Permission denied) 2024-05-08T23:18:01.403 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46003 ms_local ceph txt unknown /proc/42714/task/46003/exe (readlink: Permission denied) 2024-05-08T23:18:01.403 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46003 ms_local ceph NOFD /proc/42714/task/46003/fd (opendir: Permission denied) 2024-05-08T23:18:01.403 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46004 safe_time ceph cwd unknown /proc/42714/task/46004/cwd (readlink: Permission denied) 2024-05-08T23:18:01.403 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46004 safe_time ceph rtd unknown /proc/42714/task/46004/root (readlink: Permission denied) 2024-05-08T23:18:01.403 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46004 safe_time ceph txt unknown /proc/42714/task/46004/exe (readlink: Permission denied) 2024-05-08T23:18:01.403 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46004 safe_time ceph NOFD /proc/42714/task/46004/fd (opendir: Permission denied) 2024-05-08T23:18:01.403 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46005 safe_time ceph cwd unknown /proc/42714/task/46005/cwd (readlink: Permission denied) 2024-05-08T23:18:01.403 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46005 safe_time ceph rtd unknown /proc/42714/task/46005/root (readlink: Permission denied) 2024-05-08T23:18:01.403 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46005 safe_time ceph txt unknown /proc/42714/task/46005/exe (readlink: Permission denied) 2024-05-08T23:18:01.403 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46005 safe_time ceph NOFD /proc/42714/task/46005/fd (opendir: Permission denied) 2024-05-08T23:18:01.404 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46006 balancer ceph cwd unknown /proc/42714/task/46006/cwd (readlink: Permission denied) 2024-05-08T23:18:01.404 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46006 balancer ceph rtd unknown /proc/42714/task/46006/root (readlink: Permission denied) 2024-05-08T23:18:01.404 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46006 balancer ceph txt unknown /proc/42714/task/46006/exe (readlink: Permission denied) 2024-05-08T23:18:01.404 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46006 balancer ceph NOFD /proc/42714/task/46006/fd (opendir: Permission denied) 2024-05-08T23:18:01.404 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46007 m-fin-bal ceph cwd unknown /proc/42714/task/46007/cwd (readlink: Permission denied) 2024-05-08T23:18:01.404 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46007 m-fin-bal ceph rtd unknown /proc/42714/task/46007/root (readlink: Permission denied) 2024-05-08T23:18:01.404 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46007 m-fin-bal ceph txt unknown /proc/42714/task/46007/exe (readlink: Permission denied) 2024-05-08T23:18:01.404 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46007 m-fin-bal ceph NOFD /proc/42714/task/46007/fd (opendir: Permission denied) 2024-05-08T23:18:01.404 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46008 mgr-fin ceph cwd unknown /proc/42714/task/46008/cwd (readlink: Permission denied) 2024-05-08T23:18:01.404 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46008 mgr-fin ceph rtd unknown /proc/42714/task/46008/root (readlink: Permission denied) 2024-05-08T23:18:01.404 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46008 mgr-fin ceph txt unknown /proc/42714/task/46008/exe (readlink: Permission denied) 2024-05-08T23:18:01.404 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46008 mgr-fin ceph NOFD /proc/42714/task/46008/fd (opendir: Permission denied) 2024-05-08T23:18:01.404 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46009 mgr-fin ceph cwd unknown /proc/42714/task/46009/cwd (readlink: Permission denied) 2024-05-08T23:18:01.404 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46009 mgr-fin ceph rtd unknown /proc/42714/task/46009/root (readlink: Permission denied) 2024-05-08T23:18:01.404 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46009 mgr-fin ceph txt unknown /proc/42714/task/46009/exe (readlink: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46009 mgr-fin ceph NOFD /proc/42714/task/46009/fd (opendir: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46010 mgr-fin ceph cwd unknown /proc/42714/task/46010/cwd (readlink: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46010 mgr-fin ceph rtd unknown /proc/42714/task/46010/root (readlink: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46010 mgr-fin ceph txt unknown /proc/42714/task/46010/exe (readlink: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46010 mgr-fin ceph NOFD /proc/42714/task/46010/fd (opendir: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46011 mgr-fin ceph cwd unknown /proc/42714/task/46011/cwd (readlink: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46011 mgr-fin ceph rtd unknown /proc/42714/task/46011/root (readlink: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46011 mgr-fin ceph txt unknown /proc/42714/task/46011/exe (readlink: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46011 mgr-fin ceph NOFD /proc/42714/task/46011/fd (opendir: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46012 mgr-fin ceph cwd unknown /proc/42714/task/46012/cwd (readlink: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46012 mgr-fin ceph rtd unknown /proc/42714/task/46012/root (readlink: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46012 mgr-fin ceph txt unknown /proc/42714/task/46012/exe (readlink: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46012 mgr-fin ceph NOFD /proc/42714/task/46012/fd (opendir: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46013 mgr-fin ceph cwd unknown /proc/42714/task/46013/cwd (readlink: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46013 mgr-fin ceph rtd unknown /proc/42714/task/46013/root (readlink: Permission denied) 2024-05-08T23:18:01.405 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46013 mgr-fin ceph txt unknown /proc/42714/task/46013/exe (readlink: Permission denied) 2024-05-08T23:18:01.406 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46013 mgr-fin ceph NOFD /proc/42714/task/46013/fd (opendir: Permission denied) 2024-05-08T23:18:01.406 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46014 mgr-fin ceph cwd unknown /proc/42714/task/46014/cwd (readlink: Permission denied) 2024-05-08T23:18:01.406 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46014 mgr-fin ceph rtd unknown /proc/42714/task/46014/root (readlink: Permission denied) 2024-05-08T23:18:01.406 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46014 mgr-fin ceph txt unknown /proc/42714/task/46014/exe (readlink: Permission denied) 2024-05-08T23:18:01.406 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46014 mgr-fin ceph NOFD /proc/42714/task/46014/fd (opendir: Permission denied) 2024-05-08T23:18:01.406 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46015 mgr-fin ceph cwd unknown /proc/42714/task/46015/cwd (readlink: Permission denied) 2024-05-08T23:18:01.406 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46015 mgr-fin ceph rtd unknown /proc/42714/task/46015/root (readlink: Permission denied) 2024-05-08T23:18:01.406 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46015 mgr-fin ceph txt unknown /proc/42714/task/46015/exe (readlink: Permission denied) 2024-05-08T23:18:01.406 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46015 mgr-fin ceph NOFD /proc/42714/task/46015/fd (opendir: Permission denied) 2024-05-08T23:18:01.406 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46016 mgr-fin ceph cwd unknown /proc/42714/task/46016/cwd (readlink: Permission denied) 2024-05-08T23:18:01.406 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46016 mgr-fin ceph rtd unknown /proc/42714/task/46016/root (readlink: Permission denied) 2024-05-08T23:18:01.406 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46016 mgr-fin ceph txt unknown /proc/42714/task/46016/exe (readlink: Permission denied) 2024-05-08T23:18:01.406 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46016 mgr-fin ceph NOFD /proc/42714/task/46016/fd (opendir: Permission denied) 2024-05-08T23:18:01.406 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46017 mgr-fin ceph cwd unknown /proc/42714/task/46017/cwd (readlink: Permission denied) 2024-05-08T23:18:01.407 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46017 mgr-fin ceph rtd unknown /proc/42714/task/46017/root (readlink: Permission denied) 2024-05-08T23:18:01.407 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46017 mgr-fin ceph txt unknown /proc/42714/task/46017/exe (readlink: Permission denied) 2024-05-08T23:18:01.407 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46017 mgr-fin ceph NOFD /proc/42714/task/46017/fd (opendir: Permission denied) 2024-05-08T23:18:01.407 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46018 mgr-fin ceph cwd unknown /proc/42714/task/46018/cwd (readlink: Permission denied) 2024-05-08T23:18:01.407 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46018 mgr-fin ceph rtd unknown /proc/42714/task/46018/root (readlink: Permission denied) 2024-05-08T23:18:01.407 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46018 mgr-fin ceph txt unknown /proc/42714/task/46018/exe (readlink: Permission denied) 2024-05-08T23:18:01.407 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46018 mgr-fin ceph NOFD /proc/42714/task/46018/fd (opendir: Permission denied) 2024-05-08T23:18:01.407 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46019 mgr-fin ceph cwd unknown /proc/42714/task/46019/cwd (readlink: Permission denied) 2024-05-08T23:18:01.407 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46019 mgr-fin ceph rtd unknown /proc/42714/task/46019/root (readlink: Permission denied) 2024-05-08T23:18:01.407 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46019 mgr-fin ceph txt unknown /proc/42714/task/46019/exe (readlink: Permission denied) 2024-05-08T23:18:01.407 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46019 mgr-fin ceph NOFD /proc/42714/task/46019/fd (opendir: Permission denied) 2024-05-08T23:18:01.407 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46020 mgr-fin ceph cwd unknown /proc/42714/task/46020/cwd (readlink: Permission denied) 2024-05-08T23:18:01.407 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46020 mgr-fin ceph rtd unknown /proc/42714/task/46020/root (readlink: Permission denied) 2024-05-08T23:18:01.407 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46020 mgr-fin ceph txt unknown /proc/42714/task/46020/exe (readlink: Permission denied) 2024-05-08T23:18:01.407 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46020 mgr-fin ceph NOFD /proc/42714/task/46020/fd (opendir: Permission denied) 2024-05-08T23:18:01.408 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46021 mgr-fin ceph cwd unknown /proc/42714/task/46021/cwd (readlink: Permission denied) 2024-05-08T23:18:01.408 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46021 mgr-fin ceph rtd unknown /proc/42714/task/46021/root (readlink: Permission denied) 2024-05-08T23:18:01.408 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46021 mgr-fin ceph txt unknown /proc/42714/task/46021/exe (readlink: Permission denied) 2024-05-08T23:18:01.408 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46021 mgr-fin ceph NOFD /proc/42714/task/46021/fd (opendir: Permission denied) 2024-05-08T23:18:01.408 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46022 mgr-fin ceph cwd unknown /proc/42714/task/46022/cwd (readlink: Permission denied) 2024-05-08T23:18:01.408 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46022 mgr-fin ceph rtd unknown /proc/42714/task/46022/root (readlink: Permission denied) 2024-05-08T23:18:01.408 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46022 mgr-fin ceph txt unknown /proc/42714/task/46022/exe (readlink: Permission denied) 2024-05-08T23:18:01.408 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46022 mgr-fin ceph NOFD /proc/42714/task/46022/fd (opendir: Permission denied) 2024-05-08T23:18:01.408 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46023 mgr-fin ceph cwd unknown /proc/42714/task/46023/cwd (readlink: Permission denied) 2024-05-08T23:18:01.408 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46023 mgr-fin ceph rtd unknown /proc/42714/task/46023/root (readlink: Permission denied) 2024-05-08T23:18:01.408 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46023 mgr-fin ceph txt unknown /proc/42714/task/46023/exe (readlink: Permission denied) 2024-05-08T23:18:01.408 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46023 mgr-fin ceph NOFD /proc/42714/task/46023/fd (opendir: Permission denied) 2024-05-08T23:18:01.408 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46024 cephadm ceph cwd unknown /proc/42714/task/46024/cwd (readlink: Permission denied) 2024-05-08T23:18:01.408 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46024 cephadm ceph rtd unknown /proc/42714/task/46024/root (readlink: Permission denied) 2024-05-08T23:18:01.408 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46024 cephadm ceph txt unknown /proc/42714/task/46024/exe (readlink: Permission denied) 2024-05-08T23:18:01.409 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46024 cephadm ceph NOFD /proc/42714/task/46024/fd (opendir: Permission denied) 2024-05-08T23:18:01.409 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46025 m-fin-cep ceph cwd unknown /proc/42714/task/46025/cwd (readlink: Permission denied) 2024-05-08T23:18:01.409 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46025 m-fin-cep ceph rtd unknown /proc/42714/task/46025/root (readlink: Permission denied) 2024-05-08T23:18:01.409 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46025 m-fin-cep ceph txt unknown /proc/42714/task/46025/exe (readlink: Permission denied) 2024-05-08T23:18:01.409 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46025 m-fin-cep ceph NOFD /proc/42714/task/46025/fd (opendir: Permission denied) 2024-05-08T23:18:01.409 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46026 mgr-fin ceph cwd unknown /proc/42714/task/46026/cwd (readlink: Permission denied) 2024-05-08T23:18:01.409 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46026 mgr-fin ceph rtd unknown /proc/42714/task/46026/root (readlink: Permission denied) 2024-05-08T23:18:01.409 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46026 mgr-fin ceph txt unknown /proc/42714/task/46026/exe (readlink: Permission denied) 2024-05-08T23:18:01.409 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46026 mgr-fin ceph NOFD /proc/42714/task/46026/fd (opendir: Permission denied) 2024-05-08T23:18:01.409 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46027 mgr-fin ceph cwd unknown /proc/42714/task/46027/cwd (readlink: Permission denied) 2024-05-08T23:18:01.409 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46027 mgr-fin ceph rtd unknown /proc/42714/task/46027/root (readlink: Permission denied) 2024-05-08T23:18:01.409 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46027 mgr-fin ceph txt unknown /proc/42714/task/46027/exe (readlink: Permission denied) 2024-05-08T23:18:01.409 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46027 mgr-fin ceph NOFD /proc/42714/task/46027/fd (opendir: Permission denied) 2024-05-08T23:18:01.409 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46028 cephadm ceph cwd unknown /proc/42714/task/46028/cwd (readlink: Permission denied) 2024-05-08T23:18:01.409 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46028 cephadm ceph rtd unknown /proc/42714/task/46028/root (readlink: Permission denied) 2024-05-08T23:18:01.410 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46028 cephadm ceph txt unknown /proc/42714/task/46028/exe (readlink: Permission denied) 2024-05-08T23:18:01.410 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46028 cephadm ceph NOFD /proc/42714/task/46028/fd (opendir: Permission denied) 2024-05-08T23:18:01.410 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46029 mgr-fin ceph cwd unknown /proc/42714/task/46029/cwd (readlink: Permission denied) 2024-05-08T23:18:01.410 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46029 mgr-fin ceph rtd unknown /proc/42714/task/46029/root (readlink: Permission denied) 2024-05-08T23:18:01.410 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46029 mgr-fin ceph txt unknown /proc/42714/task/46029/exe (readlink: Permission denied) 2024-05-08T23:18:01.410 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46029 mgr-fin ceph NOFD /proc/42714/task/46029/fd (opendir: Permission denied) 2024-05-08T23:18:01.410 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46030 crash ceph cwd unknown /proc/42714/task/46030/cwd (readlink: Permission denied) 2024-05-08T23:18:01.410 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46030 crash ceph rtd unknown /proc/42714/task/46030/root (readlink: Permission denied) 2024-05-08T23:18:01.410 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46030 crash ceph txt unknown /proc/42714/task/46030/exe (readlink: Permission denied) 2024-05-08T23:18:01.410 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46030 crash ceph NOFD /proc/42714/task/46030/fd (opendir: Permission denied) 2024-05-08T23:18:01.410 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46031 m-fin-cra ceph cwd unknown /proc/42714/task/46031/cwd (readlink: Permission denied) 2024-05-08T23:18:01.410 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46031 m-fin-cra ceph rtd unknown /proc/42714/task/46031/root (readlink: Permission denied) 2024-05-08T23:18:01.410 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46031 m-fin-cra ceph txt unknown /proc/42714/task/46031/exe (readlink: Permission denied) 2024-05-08T23:18:01.410 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46031 m-fin-cra ceph NOFD /proc/42714/task/46031/fd (opendir: Permission denied) 2024-05-08T23:18:01.410 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46032 mgr-fin ceph cwd unknown /proc/42714/task/46032/cwd (readlink: Permission denied) 2024-05-08T23:18:01.411 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46032 mgr-fin ceph rtd unknown /proc/42714/task/46032/root (readlink: Permission denied) 2024-05-08T23:18:01.411 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46032 mgr-fin ceph txt unknown /proc/42714/task/46032/exe (readlink: Permission denied) 2024-05-08T23:18:01.411 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46032 mgr-fin ceph NOFD /proc/42714/task/46032/fd (opendir: Permission denied) 2024-05-08T23:18:01.411 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46033 mgr-fin ceph cwd unknown /proc/42714/task/46033/cwd (readlink: Permission denied) 2024-05-08T23:18:01.411 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46033 mgr-fin ceph rtd unknown /proc/42714/task/46033/root (readlink: Permission denied) 2024-05-08T23:18:01.411 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46033 mgr-fin ceph txt unknown /proc/42714/task/46033/exe (readlink: Permission denied) 2024-05-08T23:18:01.411 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46033 mgr-fin ceph NOFD /proc/42714/task/46033/fd (opendir: Permission denied) 2024-05-08T23:18:01.411 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46034 dashboard ceph cwd unknown /proc/42714/task/46034/cwd (readlink: Permission denied) 2024-05-08T23:18:01.411 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46034 dashboard ceph rtd unknown /proc/42714/task/46034/root (readlink: Permission denied) 2024-05-08T23:18:01.411 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46034 dashboard ceph txt unknown /proc/42714/task/46034/exe (readlink: Permission denied) 2024-05-08T23:18:01.411 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46034 dashboard ceph NOFD /proc/42714/task/46034/fd (opendir: Permission denied) 2024-05-08T23:18:01.411 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46035 mgr-fin ceph cwd unknown /proc/42714/task/46035/cwd (readlink: Permission denied) 2024-05-08T23:18:01.411 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46035 mgr-fin ceph rtd unknown /proc/42714/task/46035/root (readlink: Permission denied) 2024-05-08T23:18:01.411 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46035 mgr-fin ceph txt unknown /proc/42714/task/46035/exe (readlink: Permission denied) 2024-05-08T23:18:01.411 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46035 mgr-fin ceph NOFD /proc/42714/task/46035/fd (opendir: Permission denied) 2024-05-08T23:18:01.412 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46036 m-fin-das ceph cwd unknown /proc/42714/task/46036/cwd (readlink: Permission denied) 2024-05-08T23:18:01.412 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46036 m-fin-das ceph rtd unknown /proc/42714/task/46036/root (readlink: Permission denied) 2024-05-08T23:18:01.412 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46036 m-fin-das ceph txt unknown /proc/42714/task/46036/exe (readlink: Permission denied) 2024-05-08T23:18:01.412 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46036 m-fin-das ceph NOFD /proc/42714/task/46036/fd (opendir: Permission denied) 2024-05-08T23:18:01.412 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46037 mgr-fin ceph cwd unknown /proc/42714/task/46037/cwd (readlink: Permission denied) 2024-05-08T23:18:01.412 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46037 mgr-fin ceph rtd unknown /proc/42714/task/46037/root (readlink: Permission denied) 2024-05-08T23:18:01.412 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46037 mgr-fin ceph txt unknown /proc/42714/task/46037/exe (readlink: Permission denied) 2024-05-08T23:18:01.412 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46037 mgr-fin ceph NOFD /proc/42714/task/46037/fd (opendir: Permission denied) 2024-05-08T23:18:01.412 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46038 mgr-fin ceph cwd unknown /proc/42714/task/46038/cwd (readlink: Permission denied) 2024-05-08T23:18:01.412 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46038 mgr-fin ceph rtd unknown /proc/42714/task/46038/root (readlink: Permission denied) 2024-05-08T23:18:01.412 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46038 mgr-fin ceph txt unknown /proc/42714/task/46038/exe (readlink: Permission denied) 2024-05-08T23:18:01.413 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46038 mgr-fin ceph NOFD /proc/42714/task/46038/fd (opendir: Permission denied) 2024-05-08T23:18:01.413 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46039 mgr-fin ceph cwd unknown /proc/42714/task/46039/cwd (readlink: Permission denied) 2024-05-08T23:18:01.413 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46039 mgr-fin ceph rtd unknown /proc/42714/task/46039/root (readlink: Permission denied) 2024-05-08T23:18:01.413 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46039 mgr-fin ceph txt unknown /proc/42714/task/46039/exe (readlink: Permission denied) 2024-05-08T23:18:01.413 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46039 mgr-fin ceph NOFD /proc/42714/task/46039/fd (opendir: Permission denied) 2024-05-08T23:18:01.413 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46040 devicehea ceph cwd unknown /proc/42714/task/46040/cwd (readlink: Permission denied) 2024-05-08T23:18:01.413 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46040 devicehea ceph rtd unknown /proc/42714/task/46040/root (readlink: Permission denied) 2024-05-08T23:18:01.413 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46040 devicehea ceph txt unknown /proc/42714/task/46040/exe (readlink: Permission denied) 2024-05-08T23:18:01.413 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46040 devicehea ceph NOFD /proc/42714/task/46040/fd (opendir: Permission denied) 2024-05-08T23:18:01.413 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46041 m-fin-dev ceph cwd unknown /proc/42714/task/46041/cwd (readlink: Permission denied) 2024-05-08T23:18:01.413 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46041 m-fin-dev ceph rtd unknown /proc/42714/task/46041/root (readlink: Permission denied) 2024-05-08T23:18:01.413 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46041 m-fin-dev ceph txt unknown /proc/42714/task/46041/exe (readlink: Permission denied) 2024-05-08T23:18:01.413 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46041 m-fin-dev ceph NOFD /proc/42714/task/46041/fd (opendir: Permission denied) 2024-05-08T23:18:01.413 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46043 m-fin-ios ceph cwd unknown /proc/42714/task/46043/cwd (readlink: Permission denied) 2024-05-08T23:18:01.413 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46043 m-fin-ios ceph rtd unknown /proc/42714/task/46043/root (readlink: Permission denied) 2024-05-08T23:18:01.414 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46043 m-fin-ios ceph txt unknown /proc/42714/task/46043/exe (readlink: Permission denied) 2024-05-08T23:18:01.414 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46043 m-fin-ios ceph NOFD /proc/42714/task/46043/fd (opendir: Permission denied) 2024-05-08T23:18:01.414 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46045 mgr-fin ceph cwd unknown /proc/42714/task/46045/cwd (readlink: Permission denied) 2024-05-08T23:18:01.414 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46045 mgr-fin ceph rtd unknown /proc/42714/task/46045/root (readlink: Permission denied) 2024-05-08T23:18:01.414 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46045 mgr-fin ceph txt unknown /proc/42714/task/46045/exe (readlink: Permission denied) 2024-05-08T23:18:01.414 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46045 mgr-fin ceph NOFD /proc/42714/task/46045/fd (opendir: Permission denied) 2024-05-08T23:18:01.414 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46046 m-fin-nfs ceph cwd unknown /proc/42714/task/46046/cwd (readlink: Permission denied) 2024-05-08T23:18:01.414 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46046 m-fin-nfs ceph rtd unknown /proc/42714/task/46046/root (readlink: Permission denied) 2024-05-08T23:18:01.414 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46046 m-fin-nfs ceph txt unknown /proc/42714/task/46046/exe (readlink: Permission denied) 2024-05-08T23:18:01.414 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46046 m-fin-nfs ceph NOFD /proc/42714/task/46046/fd (opendir: Permission denied) 2024-05-08T23:18:01.414 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46048 m-fin-orc ceph cwd unknown /proc/42714/task/46048/cwd (readlink: Permission denied) 2024-05-08T23:18:01.414 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46048 m-fin-orc ceph rtd unknown /proc/42714/task/46048/root (readlink: Permission denied) 2024-05-08T23:18:01.414 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46048 m-fin-orc ceph txt unknown /proc/42714/task/46048/exe (readlink: Permission denied) 2024-05-08T23:18:01.414 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46048 m-fin-orc ceph NOFD /proc/42714/task/46048/fd (opendir: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46049 pg_autosc ceph cwd unknown /proc/42714/task/46049/cwd (readlink: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46049 pg_autosc ceph rtd unknown /proc/42714/task/46049/root (readlink: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46049 pg_autosc ceph txt unknown /proc/42714/task/46049/exe (readlink: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46049 pg_autosc ceph NOFD /proc/42714/task/46049/fd (opendir: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46050 m-fin-pg_ ceph cwd unknown /proc/42714/task/46050/cwd (readlink: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46050 m-fin-pg_ ceph rtd unknown /proc/42714/task/46050/root (readlink: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46050 m-fin-pg_ ceph txt unknown /proc/42714/task/46050/exe (readlink: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46050 m-fin-pg_ ceph NOFD /proc/42714/task/46050/fd (opendir: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46051 mgr-fin ceph cwd unknown /proc/42714/task/46051/cwd (readlink: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46051 mgr-fin ceph rtd unknown /proc/42714/task/46051/root (readlink: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46051 mgr-fin ceph txt unknown /proc/42714/task/46051/exe (readlink: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46051 mgr-fin ceph NOFD /proc/42714/task/46051/fd (opendir: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46052 mgr-fin ceph cwd unknown /proc/42714/task/46052/cwd (readlink: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46052 mgr-fin ceph rtd unknown /proc/42714/task/46052/root (readlink: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46052 mgr-fin ceph txt unknown /proc/42714/task/46052/exe (readlink: Permission denied) 2024-05-08T23:18:01.415 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46052 mgr-fin ceph NOFD /proc/42714/task/46052/fd (opendir: Permission denied) 2024-05-08T23:18:01.416 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46053 progress ceph cwd unknown /proc/42714/task/46053/cwd (readlink: Permission denied) 2024-05-08T23:18:01.416 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46053 progress ceph rtd unknown /proc/42714/task/46053/root (readlink: Permission denied) 2024-05-08T23:18:01.416 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46053 progress ceph txt unknown /proc/42714/task/46053/exe (readlink: Permission denied) 2024-05-08T23:18:01.416 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46053 progress ceph NOFD /proc/42714/task/46053/fd (opendir: Permission denied) 2024-05-08T23:18:01.416 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46054 m-fin-pro ceph cwd unknown /proc/42714/task/46054/cwd (readlink: Permission denied) 2024-05-08T23:18:01.416 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46054 m-fin-pro ceph rtd unknown /proc/42714/task/46054/root (readlink: Permission denied) 2024-05-08T23:18:01.416 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46054 m-fin-pro ceph txt unknown /proc/42714/task/46054/exe (readlink: Permission denied) 2024-05-08T23:18:01.416 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46054 m-fin-pro ceph NOFD /proc/42714/task/46054/fd (opendir: Permission denied) 2024-05-08T23:18:01.416 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46058 io_contex ceph cwd unknown /proc/42714/task/46058/cwd (readlink: Permission denied) 2024-05-08T23:18:01.416 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46058 io_contex ceph rtd unknown /proc/42714/task/46058/root (readlink: Permission denied) 2024-05-08T23:18:01.416 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46058 io_contex ceph txt unknown /proc/42714/task/46058/exe (readlink: Permission denied) 2024-05-08T23:18:01.416 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46058 io_contex ceph NOFD /proc/42714/task/46058/fd (opendir: Permission denied) 2024-05-08T23:18:01.416 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46059 io_contex ceph cwd unknown /proc/42714/task/46059/cwd (readlink: Permission denied) 2024-05-08T23:18:01.416 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46059 io_contex ceph rtd unknown /proc/42714/task/46059/root (readlink: Permission denied) 2024-05-08T23:18:01.416 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46059 io_contex ceph txt unknown /proc/42714/task/46059/exe (readlink: Permission denied) 2024-05-08T23:18:01.417 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46059 io_contex ceph NOFD /proc/42714/task/46059/fd (opendir: Permission denied) 2024-05-08T23:18:01.417 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46060 ceph_time ceph cwd unknown /proc/42714/task/46060/cwd (readlink: Permission denied) 2024-05-08T23:18:01.417 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46060 ceph_time ceph rtd unknown /proc/42714/task/46060/root (readlink: Permission denied) 2024-05-08T23:18:01.417 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46060 ceph_time ceph txt unknown /proc/42714/task/46060/exe (readlink: Permission denied) 2024-05-08T23:18:01.417 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46060 ceph_time ceph NOFD /proc/42714/task/46060/fd (opendir: Permission denied) 2024-05-08T23:18:01.417 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46061 ms_dispat ceph cwd unknown /proc/42714/task/46061/cwd (readlink: Permission denied) 2024-05-08T23:18:01.417 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46061 ms_dispat ceph rtd unknown /proc/42714/task/46061/root (readlink: Permission denied) 2024-05-08T23:18:01.417 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46061 ms_dispat ceph txt unknown /proc/42714/task/46061/exe (readlink: Permission denied) 2024-05-08T23:18:01.417 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46061 ms_dispat ceph NOFD /proc/42714/task/46061/fd (opendir: Permission denied) 2024-05-08T23:18:01.417 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46062 ms_local ceph cwd unknown /proc/42714/task/46062/cwd (readlink: Permission denied) 2024-05-08T23:18:01.417 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46062 ms_local ceph rtd unknown /proc/42714/task/46062/root (readlink: Permission denied) 2024-05-08T23:18:01.417 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46062 ms_local ceph txt unknown /proc/42714/task/46062/exe (readlink: Permission denied) 2024-05-08T23:18:01.417 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46062 ms_local ceph NOFD /proc/42714/task/46062/fd (opendir: Permission denied) 2024-05-08T23:18:01.417 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46063 safe_time ceph cwd unknown /proc/42714/task/46063/cwd (readlink: Permission denied) 2024-05-08T23:18:01.417 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46063 safe_time ceph rtd unknown /proc/42714/task/46063/root (readlink: Permission denied) 2024-05-08T23:18:01.418 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46063 safe_time ceph txt unknown /proc/42714/task/46063/exe (readlink: Permission denied) 2024-05-08T23:18:01.418 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46063 safe_time ceph NOFD /proc/42714/task/46063/fd (opendir: Permission denied) 2024-05-08T23:18:01.418 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46064 safe_time ceph cwd unknown /proc/42714/task/46064/cwd (readlink: Permission denied) 2024-05-08T23:18:01.418 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46064 safe_time ceph rtd unknown /proc/42714/task/46064/root (readlink: Permission denied) 2024-05-08T23:18:01.418 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46064 safe_time ceph txt unknown /proc/42714/task/46064/exe (readlink: Permission denied) 2024-05-08T23:18:01.418 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46064 safe_time ceph NOFD /proc/42714/task/46064/fd (opendir: Permission denied) 2024-05-08T23:18:01.418 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46065 mgr-fin ceph cwd unknown /proc/42714/task/46065/cwd (readlink: Permission denied) 2024-05-08T23:18:01.418 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46065 mgr-fin ceph rtd unknown /proc/42714/task/46065/root (readlink: Permission denied) 2024-05-08T23:18:01.418 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46065 mgr-fin ceph txt unknown /proc/42714/task/46065/exe (readlink: Permission denied) 2024-05-08T23:18:01.418 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46065 mgr-fin ceph NOFD /proc/42714/task/46065/fd (opendir: Permission denied) 2024-05-08T23:18:01.418 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46067 m-fin-rbd ceph cwd unknown /proc/42714/task/46067/cwd (readlink: Permission denied) 2024-05-08T23:18:01.418 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46067 m-fin-rbd ceph rtd unknown /proc/42714/task/46067/root (readlink: Permission denied) 2024-05-08T23:18:01.418 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46067 m-fin-rbd ceph txt unknown /proc/42714/task/46067/exe (readlink: Permission denied) 2024-05-08T23:18:01.418 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46067 m-fin-rbd ceph NOFD /proc/42714/task/46067/fd (opendir: Permission denied) 2024-05-08T23:18:01.418 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46068 restful ceph cwd unknown /proc/42714/task/46068/cwd (readlink: Permission denied) 2024-05-08T23:18:01.419 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46068 restful ceph rtd unknown /proc/42714/task/46068/root (readlink: Permission denied) 2024-05-08T23:18:01.419 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46068 restful ceph txt unknown /proc/42714/task/46068/exe (readlink: Permission denied) 2024-05-08T23:18:01.419 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46068 restful ceph NOFD /proc/42714/task/46068/fd (opendir: Permission denied) 2024-05-08T23:18:01.419 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46069 m-fin-res ceph cwd unknown /proc/42714/task/46069/cwd (readlink: Permission denied) 2024-05-08T23:18:01.419 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46069 m-fin-res ceph rtd unknown /proc/42714/task/46069/root (readlink: Permission denied) 2024-05-08T23:18:01.419 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46069 m-fin-res ceph txt unknown /proc/42714/task/46069/exe (readlink: Permission denied) 2024-05-08T23:18:01.419 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46069 m-fin-res ceph NOFD /proc/42714/task/46069/fd (opendir: Permission denied) 2024-05-08T23:18:01.419 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46071 m-fin-sta ceph cwd unknown /proc/42714/task/46071/cwd (readlink: Permission denied) 2024-05-08T23:18:01.419 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46071 m-fin-sta ceph rtd unknown /proc/42714/task/46071/root (readlink: Permission denied) 2024-05-08T23:18:01.419 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46071 m-fin-sta ceph txt unknown /proc/42714/task/46071/exe (readlink: Permission denied) 2024-05-08T23:18:01.419 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46071 m-fin-sta ceph NOFD /proc/42714/task/46071/fd (opendir: Permission denied) 2024-05-08T23:18:01.419 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46072 mgr-fin ceph cwd unknown /proc/42714/task/46072/cwd (readlink: Permission denied) 2024-05-08T23:18:01.419 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46072 mgr-fin ceph rtd unknown /proc/42714/task/46072/root (readlink: Permission denied) 2024-05-08T23:18:01.419 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46072 mgr-fin ceph txt unknown /proc/42714/task/46072/exe (readlink: Permission denied) 2024-05-08T23:18:01.419 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46072 mgr-fin ceph NOFD /proc/42714/task/46072/fd (opendir: Permission denied) 2024-05-08T23:18:01.420 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46073 mgr-fin ceph cwd unknown /proc/42714/task/46073/cwd (readlink: Permission denied) 2024-05-08T23:18:01.420 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46073 mgr-fin ceph rtd unknown /proc/42714/task/46073/root (readlink: Permission denied) 2024-05-08T23:18:01.420 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46073 mgr-fin ceph txt unknown /proc/42714/task/46073/exe (readlink: Permission denied) 2024-05-08T23:18:01.420 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46073 mgr-fin ceph NOFD /proc/42714/task/46073/fd (opendir: Permission denied) 2024-05-08T23:18:01.420 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46074 mgr-fin ceph cwd unknown /proc/42714/task/46074/cwd (readlink: Permission denied) 2024-05-08T23:18:01.420 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46074 mgr-fin ceph rtd unknown /proc/42714/task/46074/root (readlink: Permission denied) 2024-05-08T23:18:01.420 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46074 mgr-fin ceph txt unknown /proc/42714/task/46074/exe (readlink: Permission denied) 2024-05-08T23:18:01.420 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46074 mgr-fin ceph NOFD /proc/42714/task/46074/fd (opendir: Permission denied) 2024-05-08T23:18:01.420 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46076 mgr-fin ceph cwd unknown /proc/42714/task/46076/cwd (readlink: Permission denied) 2024-05-08T23:18:01.420 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46076 mgr-fin ceph rtd unknown /proc/42714/task/46076/root (readlink: Permission denied) 2024-05-08T23:18:01.420 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46076 mgr-fin ceph txt unknown /proc/42714/task/46076/exe (readlink: Permission denied) 2024-05-08T23:18:01.420 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46076 mgr-fin ceph NOFD /proc/42714/task/46076/fd (opendir: Permission denied) 2024-05-08T23:18:01.420 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46077 telemetry ceph cwd unknown /proc/42714/task/46077/cwd (readlink: Permission denied) 2024-05-08T23:18:01.420 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46077 telemetry ceph rtd unknown /proc/42714/task/46077/root (readlink: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46077 telemetry ceph txt unknown /proc/42714/task/46077/exe (readlink: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46077 telemetry ceph NOFD /proc/42714/task/46077/fd (opendir: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46078 m-fin-tel ceph cwd unknown /proc/42714/task/46078/cwd (readlink: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46078 m-fin-tel ceph rtd unknown /proc/42714/task/46078/root (readlink: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46078 m-fin-tel ceph txt unknown /proc/42714/task/46078/exe (readlink: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46078 m-fin-tel ceph NOFD /proc/42714/task/46078/fd (opendir: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46079 mgr-fin ceph cwd unknown /proc/42714/task/46079/cwd (readlink: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46079 mgr-fin ceph rtd unknown /proc/42714/task/46079/root (readlink: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46079 mgr-fin ceph txt unknown /proc/42714/task/46079/exe (readlink: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46079 mgr-fin ceph NOFD /proc/42714/task/46079/fd (opendir: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46083 io_contex ceph cwd unknown /proc/42714/task/46083/cwd (readlink: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46083 io_contex ceph rtd unknown /proc/42714/task/46083/root (readlink: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46083 io_contex ceph txt unknown /proc/42714/task/46083/exe (readlink: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46083 io_contex ceph NOFD /proc/42714/task/46083/fd (opendir: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46084 io_contex ceph cwd unknown /proc/42714/task/46084/cwd (readlink: Permission denied) 2024-05-08T23:18:01.421 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46084 io_contex ceph rtd unknown /proc/42714/task/46084/root (readlink: Permission denied) 2024-05-08T23:18:01.422 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46084 io_contex ceph txt unknown /proc/42714/task/46084/exe (readlink: Permission denied) 2024-05-08T23:18:01.422 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46084 io_contex ceph NOFD /proc/42714/task/46084/fd (opendir: Permission denied) 2024-05-08T23:18:01.422 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46085 ceph_time ceph cwd unknown /proc/42714/task/46085/cwd (readlink: Permission denied) 2024-05-08T23:18:01.422 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46085 ceph_time ceph rtd unknown /proc/42714/task/46085/root (readlink: Permission denied) 2024-05-08T23:18:01.422 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46085 ceph_time ceph txt unknown /proc/42714/task/46085/exe (readlink: Permission denied) 2024-05-08T23:18:01.422 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46085 ceph_time ceph NOFD /proc/42714/task/46085/fd (opendir: Permission denied) 2024-05-08T23:18:01.422 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46086 ms_dispat ceph cwd unknown /proc/42714/task/46086/cwd (readlink: Permission denied) 2024-05-08T23:18:01.422 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46086 ms_dispat ceph rtd unknown /proc/42714/task/46086/root (readlink: Permission denied) 2024-05-08T23:18:01.422 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46086 ms_dispat ceph txt unknown /proc/42714/task/46086/exe (readlink: Permission denied) 2024-05-08T23:18:01.422 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46086 ms_dispat ceph NOFD /proc/42714/task/46086/fd (opendir: Permission denied) 2024-05-08T23:18:01.422 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46087 ms_local ceph cwd unknown /proc/42714/task/46087/cwd (readlink: Permission denied) 2024-05-08T23:18:01.422 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46087 ms_local ceph rtd unknown /proc/42714/task/46087/root (readlink: Permission denied) 2024-05-08T23:18:01.422 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46087 ms_local ceph txt unknown /proc/42714/task/46087/exe (readlink: Permission denied) 2024-05-08T23:18:01.422 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46087 ms_local ceph NOFD /proc/42714/task/46087/fd (opendir: Permission denied) 2024-05-08T23:18:01.422 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46088 safe_time ceph cwd unknown /proc/42714/task/46088/cwd (readlink: Permission denied) 2024-05-08T23:18:01.423 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46088 safe_time ceph rtd unknown /proc/42714/task/46088/root (readlink: Permission denied) 2024-05-08T23:18:01.423 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46088 safe_time ceph txt unknown /proc/42714/task/46088/exe (readlink: Permission denied) 2024-05-08T23:18:01.423 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46088 safe_time ceph NOFD /proc/42714/task/46088/fd (opendir: Permission denied) 2024-05-08T23:18:01.423 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46089 safe_time ceph cwd unknown /proc/42714/task/46089/cwd (readlink: Permission denied) 2024-05-08T23:18:01.423 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46089 safe_time ceph rtd unknown /proc/42714/task/46089/root (readlink: Permission denied) 2024-05-08T23:18:01.423 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46089 safe_time ceph txt unknown /proc/42714/task/46089/exe (readlink: Permission denied) 2024-05-08T23:18:01.423 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46089 safe_time ceph NOFD /proc/42714/task/46089/fd (opendir: Permission denied) 2024-05-08T23:18:01.423 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46090 mgr-fin ceph cwd unknown /proc/42714/task/46090/cwd (readlink: Permission denied) 2024-05-08T23:18:01.423 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46090 mgr-fin ceph rtd unknown /proc/42714/task/46090/root (readlink: Permission denied) 2024-05-08T23:18:01.423 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46090 mgr-fin ceph txt unknown /proc/42714/task/46090/exe (readlink: Permission denied) 2024-05-08T23:18:01.423 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46090 mgr-fin ceph NOFD /proc/42714/task/46090/fd (opendir: Permission denied) 2024-05-08T23:18:01.423 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46091 mgr-fin ceph cwd unknown /proc/42714/task/46091/cwd (readlink: Permission denied) 2024-05-08T23:18:01.423 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46091 mgr-fin ceph rtd unknown /proc/42714/task/46091/root (readlink: Permission denied) 2024-05-08T23:18:01.423 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46091 mgr-fin ceph txt unknown /proc/42714/task/46091/exe (readlink: Permission denied) 2024-05-08T23:18:01.424 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46091 mgr-fin ceph NOFD /proc/42714/task/46091/fd (opendir: Permission denied) 2024-05-08T23:18:01.424 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46092 mgr-fin ceph cwd unknown /proc/42714/task/46092/cwd (readlink: Permission denied) 2024-05-08T23:18:01.424 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46092 mgr-fin ceph rtd unknown /proc/42714/task/46092/root (readlink: Permission denied) 2024-05-08T23:18:01.424 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46092 mgr-fin ceph txt unknown /proc/42714/task/46092/exe (readlink: Permission denied) 2024-05-08T23:18:01.424 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46092 mgr-fin ceph NOFD /proc/42714/task/46092/fd (opendir: Permission denied) 2024-05-08T23:18:01.424 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46094 mgr-fin ceph cwd unknown /proc/42714/task/46094/cwd (readlink: Permission denied) 2024-05-08T23:18:01.424 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46094 mgr-fin ceph rtd unknown /proc/42714/task/46094/root (readlink: Permission denied) 2024-05-08T23:18:01.424 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46094 mgr-fin ceph txt unknown /proc/42714/task/46094/exe (readlink: Permission denied) 2024-05-08T23:18:01.424 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46094 mgr-fin ceph NOFD /proc/42714/task/46094/fd (opendir: Permission denied) 2024-05-08T23:18:01.424 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46095 mgr-fin ceph cwd unknown /proc/42714/task/46095/cwd (readlink: Permission denied) 2024-05-08T23:18:01.424 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46095 mgr-fin ceph rtd unknown /proc/42714/task/46095/root (readlink: Permission denied) 2024-05-08T23:18:01.424 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46095 mgr-fin ceph txt unknown /proc/42714/task/46095/exe (readlink: Permission denied) 2024-05-08T23:18:01.424 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46095 mgr-fin ceph NOFD /proc/42714/task/46095/fd (opendir: Permission denied) 2024-05-08T23:18:01.425 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46096 mgr-fin ceph cwd unknown /proc/42714/task/46096/cwd (readlink: Permission denied) 2024-05-08T23:18:01.425 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46096 mgr-fin ceph rtd unknown /proc/42714/task/46096/root (readlink: Permission denied) 2024-05-08T23:18:01.425 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46096 mgr-fin ceph txt unknown /proc/42714/task/46096/exe (readlink: Permission denied) 2024-05-08T23:18:01.425 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46096 mgr-fin ceph NOFD /proc/42714/task/46096/fd (opendir: Permission denied) 2024-05-08T23:18:01.425 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46097 mgr-fin ceph cwd unknown /proc/42714/task/46097/cwd (readlink: Permission denied) 2024-05-08T23:18:01.425 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46097 mgr-fin ceph rtd unknown /proc/42714/task/46097/root (readlink: Permission denied) 2024-05-08T23:18:01.425 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46097 mgr-fin ceph txt unknown /proc/42714/task/46097/exe (readlink: Permission denied) 2024-05-08T23:18:01.425 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46097 mgr-fin ceph NOFD /proc/42714/task/46097/fd (opendir: Permission denied) 2024-05-08T23:18:01.425 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46098 mgr-fin ceph cwd unknown /proc/42714/task/46098/cwd (readlink: Permission denied) 2024-05-08T23:18:01.425 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46098 mgr-fin ceph rtd unknown /proc/42714/task/46098/root (readlink: Permission denied) 2024-05-08T23:18:01.425 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46098 mgr-fin ceph txt unknown /proc/42714/task/46098/exe (readlink: Permission denied) 2024-05-08T23:18:01.425 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46098 mgr-fin ceph NOFD /proc/42714/task/46098/fd (opendir: Permission denied) 2024-05-08T23:18:01.425 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46099 mgr-fin ceph cwd unknown /proc/42714/task/46099/cwd (readlink: Permission denied) 2024-05-08T23:18:01.425 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46099 mgr-fin ceph rtd unknown /proc/42714/task/46099/root (readlink: Permission denied) 2024-05-08T23:18:01.425 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46099 mgr-fin ceph txt unknown /proc/42714/task/46099/exe (readlink: Permission denied) 2024-05-08T23:18:01.426 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46099 mgr-fin ceph NOFD /proc/42714/task/46099/fd (opendir: Permission denied) 2024-05-08T23:18:01.426 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46100 mgr-fin ceph cwd unknown /proc/42714/task/46100/cwd (readlink: Permission denied) 2024-05-08T23:18:01.426 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46100 mgr-fin ceph rtd unknown /proc/42714/task/46100/root (readlink: Permission denied) 2024-05-08T23:18:01.426 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46100 mgr-fin ceph txt unknown /proc/42714/task/46100/exe (readlink: Permission denied) 2024-05-08T23:18:01.426 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46100 mgr-fin ceph NOFD /proc/42714/task/46100/fd (opendir: Permission denied) 2024-05-08T23:18:01.426 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46101 mgr-fin ceph cwd unknown /proc/42714/task/46101/cwd (readlink: Permission denied) 2024-05-08T23:18:01.426 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46101 mgr-fin ceph rtd unknown /proc/42714/task/46101/root (readlink: Permission denied) 2024-05-08T23:18:01.426 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46101 mgr-fin ceph txt unknown /proc/42714/task/46101/exe (readlink: Permission denied) 2024-05-08T23:18:01.426 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46101 mgr-fin ceph NOFD /proc/42714/task/46101/fd (opendir: Permission denied) 2024-05-08T23:18:01.426 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46102 mgr-fin ceph cwd unknown /proc/42714/task/46102/cwd (readlink: Permission denied) 2024-05-08T23:18:01.426 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46102 mgr-fin ceph rtd unknown /proc/42714/task/46102/root (readlink: Permission denied) 2024-05-08T23:18:01.426 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46102 mgr-fin ceph txt unknown /proc/42714/task/46102/exe (readlink: Permission denied) 2024-05-08T23:18:01.426 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46102 mgr-fin ceph NOFD /proc/42714/task/46102/fd (opendir: Permission denied) 2024-05-08T23:18:01.426 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46104 m-fin-vol ceph cwd unknown /proc/42714/task/46104/cwd (readlink: Permission denied) 2024-05-08T23:18:01.427 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46104 m-fin-vol ceph rtd unknown /proc/42714/task/46104/root (readlink: Permission denied) 2024-05-08T23:18:01.427 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46104 m-fin-vol ceph txt unknown /proc/42714/task/46104/exe (readlink: Permission denied) 2024-05-08T23:18:01.427 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46104 m-fin-vol ceph NOFD /proc/42714/task/46104/fd (opendir: Permission denied) 2024-05-08T23:18:01.427 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46368 mgr-fin ceph cwd unknown /proc/42714/task/46368/cwd (readlink: Permission denied) 2024-05-08T23:18:01.427 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46368 mgr-fin ceph rtd unknown /proc/42714/task/46368/root (readlink: Permission denied) 2024-05-08T23:18:01.427 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46368 mgr-fin ceph txt unknown /proc/42714/task/46368/exe (readlink: Permission denied) 2024-05-08T23:18:01.427 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46368 mgr-fin ceph NOFD /proc/42714/task/46368/fd (opendir: Permission denied) 2024-05-08T23:18:01.427 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46369 mgr-fin ceph cwd unknown /proc/42714/task/46369/cwd (readlink: Permission denied) 2024-05-08T23:18:01.427 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46369 mgr-fin ceph rtd unknown /proc/42714/task/46369/root (readlink: Permission denied) 2024-05-08T23:18:01.427 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46369 mgr-fin ceph txt unknown /proc/42714/task/46369/exe (readlink: Permission denied) 2024-05-08T23:18:01.427 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46369 mgr-fin ceph NOFD /proc/42714/task/46369/fd (opendir: Permission denied) 2024-05-08T23:18:01.427 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46370 mgr-fin ceph cwd unknown /proc/42714/task/46370/cwd (readlink: Permission denied) 2024-05-08T23:18:01.427 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46370 mgr-fin ceph rtd unknown /proc/42714/task/46370/root (readlink: Permission denied) 2024-05-08T23:18:01.427 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46370 mgr-fin ceph txt unknown /proc/42714/task/46370/exe (readlink: Permission denied) 2024-05-08T23:18:01.427 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46370 mgr-fin ceph NOFD /proc/42714/task/46370/fd (opendir: Permission denied) 2024-05-08T23:18:01.428 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46371 mgr-fin ceph cwd unknown /proc/42714/task/46371/cwd (readlink: Permission denied) 2024-05-08T23:18:01.428 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46371 mgr-fin ceph rtd unknown /proc/42714/task/46371/root (readlink: Permission denied) 2024-05-08T23:18:01.428 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46371 mgr-fin ceph txt unknown /proc/42714/task/46371/exe (readlink: Permission denied) 2024-05-08T23:18:01.428 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46371 mgr-fin ceph NOFD /proc/42714/task/46371/fd (opendir: Permission denied) 2024-05-08T23:18:01.428 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46372 mgr-fin ceph cwd unknown /proc/42714/task/46372/cwd (readlink: Permission denied) 2024-05-08T23:18:01.428 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46372 mgr-fin ceph rtd unknown /proc/42714/task/46372/root (readlink: Permission denied) 2024-05-08T23:18:01.428 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46372 mgr-fin ceph txt unknown /proc/42714/task/46372/exe (readlink: Permission denied) 2024-05-08T23:18:01.428 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46372 mgr-fin ceph NOFD /proc/42714/task/46372/fd (opendir: Permission denied) 2024-05-08T23:18:01.428 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46373 mgr-fin ceph cwd unknown /proc/42714/task/46373/cwd (readlink: Permission denied) 2024-05-08T23:18:01.428 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46373 mgr-fin ceph rtd unknown /proc/42714/task/46373/root (readlink: Permission denied) 2024-05-08T23:18:01.428 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46373 mgr-fin ceph txt unknown /proc/42714/task/46373/exe (readlink: Permission denied) 2024-05-08T23:18:01.428 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46373 mgr-fin ceph NOFD /proc/42714/task/46373/fd (opendir: Permission denied) 2024-05-08T23:18:01.428 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46374 mgr-fin ceph cwd unknown /proc/42714/task/46374/cwd (readlink: Permission denied) 2024-05-08T23:18:01.428 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46374 mgr-fin ceph rtd unknown /proc/42714/task/46374/root (readlink: Permission denied) 2024-05-08T23:18:01.428 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46374 mgr-fin ceph txt unknown /proc/42714/task/46374/exe (readlink: Permission denied) 2024-05-08T23:18:01.429 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46374 mgr-fin ceph NOFD /proc/42714/task/46374/fd (opendir: Permission denied) 2024-05-08T23:18:01.429 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46375 mgr-fin ceph cwd unknown /proc/42714/task/46375/cwd (readlink: Permission denied) 2024-05-08T23:18:01.429 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46375 mgr-fin ceph rtd unknown /proc/42714/task/46375/root (readlink: Permission denied) 2024-05-08T23:18:01.429 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46375 mgr-fin ceph txt unknown /proc/42714/task/46375/exe (readlink: Permission denied) 2024-05-08T23:18:01.429 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46375 mgr-fin ceph NOFD /proc/42714/task/46375/fd (opendir: Permission denied) 2024-05-08T23:18:01.429 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46376 mgr-fin ceph cwd unknown /proc/42714/task/46376/cwd (readlink: Permission denied) 2024-05-08T23:18:01.429 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46376 mgr-fin ceph rtd unknown /proc/42714/task/46376/root (readlink: Permission denied) 2024-05-08T23:18:01.429 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46376 mgr-fin ceph txt unknown /proc/42714/task/46376/exe (readlink: Permission denied) 2024-05-08T23:18:01.429 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46376 mgr-fin ceph NOFD /proc/42714/task/46376/fd (opendir: Permission denied) 2024-05-08T23:18:01.429 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46377 mgr-fin ceph cwd unknown /proc/42714/task/46377/cwd (readlink: Permission denied) 2024-05-08T23:18:01.429 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46377 mgr-fin ceph rtd unknown /proc/42714/task/46377/root (readlink: Permission denied) 2024-05-08T23:18:01.429 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46377 mgr-fin ceph txt unknown /proc/42714/task/46377/exe (readlink: Permission denied) 2024-05-08T23:18:01.429 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46377 mgr-fin ceph NOFD /proc/42714/task/46377/fd (opendir: Permission denied) 2024-05-08T23:18:01.429 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46378 mgr-fin ceph cwd unknown /proc/42714/task/46378/cwd (readlink: Permission denied) 2024-05-08T23:18:01.429 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46378 mgr-fin ceph rtd unknown /proc/42714/task/46378/root (readlink: Permission denied) 2024-05-08T23:18:01.430 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46378 mgr-fin ceph txt unknown /proc/42714/task/46378/exe (readlink: Permission denied) 2024-05-08T23:18:01.430 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46378 mgr-fin ceph NOFD /proc/42714/task/46378/fd (opendir: Permission denied) 2024-05-08T23:18:01.430 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46394 mgr-fin ceph cwd unknown /proc/42714/task/46394/cwd (readlink: Permission denied) 2024-05-08T23:18:01.430 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46394 mgr-fin ceph rtd unknown /proc/42714/task/46394/root (readlink: Permission denied) 2024-05-08T23:18:01.430 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46394 mgr-fin ceph txt unknown /proc/42714/task/46394/exe (readlink: Permission denied) 2024-05-08T23:18:01.430 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46394 mgr-fin ceph NOFD /proc/42714/task/46394/fd (opendir: Permission denied) 2024-05-08T23:18:01.430 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46395 mgr-fin ceph cwd unknown /proc/42714/task/46395/cwd (readlink: Permission denied) 2024-05-08T23:18:01.430 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46395 mgr-fin ceph rtd unknown /proc/42714/task/46395/root (readlink: Permission denied) 2024-05-08T23:18:01.430 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46395 mgr-fin ceph txt unknown /proc/42714/task/46395/exe (readlink: Permission denied) 2024-05-08T23:18:01.430 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46395 mgr-fin ceph NOFD /proc/42714/task/46395/fd (opendir: Permission denied) 2024-05-08T23:18:01.430 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46396 mgr-fin ceph cwd unknown /proc/42714/task/46396/cwd (readlink: Permission denied) 2024-05-08T23:18:01.430 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46396 mgr-fin ceph rtd unknown /proc/42714/task/46396/root (readlink: Permission denied) 2024-05-08T23:18:01.430 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46396 mgr-fin ceph txt unknown /proc/42714/task/46396/exe (readlink: Permission denied) 2024-05-08T23:18:01.430 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46396 mgr-fin ceph NOFD /proc/42714/task/46396/fd (opendir: Permission denied) 2024-05-08T23:18:01.430 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46397 mgr-fin ceph cwd unknown /proc/42714/task/46397/cwd (readlink: Permission denied) 2024-05-08T23:18:01.431 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46397 mgr-fin ceph rtd unknown /proc/42714/task/46397/root (readlink: Permission denied) 2024-05-08T23:18:01.431 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46397 mgr-fin ceph txt unknown /proc/42714/task/46397/exe (readlink: Permission denied) 2024-05-08T23:18:01.431 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46397 mgr-fin ceph NOFD /proc/42714/task/46397/fd (opendir: Permission denied) 2024-05-08T23:18:01.431 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46398 mgr-fin ceph cwd unknown /proc/42714/task/46398/cwd (readlink: Permission denied) 2024-05-08T23:18:01.431 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46398 mgr-fin ceph rtd unknown /proc/42714/task/46398/root (readlink: Permission denied) 2024-05-08T23:18:01.431 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46398 mgr-fin ceph txt unknown /proc/42714/task/46398/exe (readlink: Permission denied) 2024-05-08T23:18:01.431 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46398 mgr-fin ceph NOFD /proc/42714/task/46398/fd (opendir: Permission denied) 2024-05-08T23:18:01.431 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46399 mgr-fin ceph cwd unknown /proc/42714/task/46399/cwd (readlink: Permission denied) 2024-05-08T23:18:01.431 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46399 mgr-fin ceph rtd unknown /proc/42714/task/46399/root (readlink: Permission denied) 2024-05-08T23:18:01.431 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46399 mgr-fin ceph txt unknown /proc/42714/task/46399/exe (readlink: Permission denied) 2024-05-08T23:18:01.431 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46399 mgr-fin ceph NOFD /proc/42714/task/46399/fd (opendir: Permission denied) 2024-05-08T23:18:01.431 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46400 mgr-fin ceph cwd unknown /proc/42714/task/46400/cwd (readlink: Permission denied) 2024-05-08T23:18:01.431 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46400 mgr-fin ceph rtd unknown /proc/42714/task/46400/root (readlink: Permission denied) 2024-05-08T23:18:01.431 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46400 mgr-fin ceph txt unknown /proc/42714/task/46400/exe (readlink: Permission denied) 2024-05-08T23:18:01.431 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46400 mgr-fin ceph NOFD /proc/42714/task/46400/fd (opendir: Permission denied) 2024-05-08T23:18:01.432 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46401 mgr-fin ceph cwd unknown /proc/42714/task/46401/cwd (readlink: Permission denied) 2024-05-08T23:18:01.432 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46401 mgr-fin ceph rtd unknown /proc/42714/task/46401/root (readlink: Permission denied) 2024-05-08T23:18:01.432 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46401 mgr-fin ceph txt unknown /proc/42714/task/46401/exe (readlink: Permission denied) 2024-05-08T23:18:01.432 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46401 mgr-fin ceph NOFD /proc/42714/task/46401/fd (opendir: Permission denied) 2024-05-08T23:18:01.432 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46402 mgr-fin ceph cwd unknown /proc/42714/task/46402/cwd (readlink: Permission denied) 2024-05-08T23:18:01.432 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46402 mgr-fin ceph rtd unknown /proc/42714/task/46402/root (readlink: Permission denied) 2024-05-08T23:18:01.432 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46402 mgr-fin ceph txt unknown /proc/42714/task/46402/exe (readlink: Permission denied) 2024-05-08T23:18:01.432 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46402 mgr-fin ceph NOFD /proc/42714/task/46402/fd (opendir: Permission denied) 2024-05-08T23:18:01.432 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46403 mgr-fin ceph cwd unknown /proc/42714/task/46403/cwd (readlink: Permission denied) 2024-05-08T23:18:01.432 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46403 mgr-fin ceph rtd unknown /proc/42714/task/46403/root (readlink: Permission denied) 2024-05-08T23:18:01.432 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46403 mgr-fin ceph txt unknown /proc/42714/task/46403/exe (readlink: Permission denied) 2024-05-08T23:18:01.432 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46403 mgr-fin ceph NOFD /proc/42714/task/46403/fd (opendir: Permission denied) 2024-05-08T23:18:01.432 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46404 mgr-fin ceph cwd unknown /proc/42714/task/46404/cwd (readlink: Permission denied) 2024-05-08T23:18:01.432 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46404 mgr-fin ceph rtd unknown /proc/42714/task/46404/root (readlink: Permission denied) 2024-05-08T23:18:01.432 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46404 mgr-fin ceph txt unknown /proc/42714/task/46404/exe (readlink: Permission denied) 2024-05-08T23:18:01.433 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46404 mgr-fin ceph NOFD /proc/42714/task/46404/fd (opendir: Permission denied) 2024-05-08T23:18:01.433 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46945 dashboard ceph cwd unknown /proc/42714/task/46945/cwd (readlink: Permission denied) 2024-05-08T23:18:01.433 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46945 dashboard ceph rtd unknown /proc/42714/task/46945/root (readlink: Permission denied) 2024-05-08T23:18:01.433 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46945 dashboard ceph txt unknown /proc/42714/task/46945/exe (readlink: Permission denied) 2024-05-08T23:18:01.433 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46945 dashboard ceph NOFD /proc/42714/task/46945/fd (opendir: Permission denied) 2024-05-08T23:18:01.433 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46946 dashboard ceph cwd unknown /proc/42714/task/46946/cwd (readlink: Permission denied) 2024-05-08T23:18:01.433 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46946 dashboard ceph rtd unknown /proc/42714/task/46946/root (readlink: Permission denied) 2024-05-08T23:18:01.433 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46946 dashboard ceph txt unknown /proc/42714/task/46946/exe (readlink: Permission denied) 2024-05-08T23:18:01.433 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46946 dashboard ceph NOFD /proc/42714/task/46946/fd (opendir: Permission denied) 2024-05-08T23:18:01.433 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46947 dashboard ceph cwd unknown /proc/42714/task/46947/cwd (readlink: Permission denied) 2024-05-08T23:18:01.433 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46947 dashboard ceph rtd unknown /proc/42714/task/46947/root (readlink: Permission denied) 2024-05-08T23:18:01.433 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46947 dashboard ceph txt unknown /proc/42714/task/46947/exe (readlink: Permission denied) 2024-05-08T23:18:01.433 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46947 dashboard ceph NOFD /proc/42714/task/46947/fd (opendir: Permission denied) 2024-05-08T23:18:01.433 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46948 dashboard ceph cwd unknown /proc/42714/task/46948/cwd (readlink: Permission denied) 2024-05-08T23:18:01.433 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46948 dashboard ceph rtd unknown /proc/42714/task/46948/root (readlink: Permission denied) 2024-05-08T23:18:01.434 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46948 dashboard ceph txt unknown /proc/42714/task/46948/exe (readlink: Permission denied) 2024-05-08T23:18:01.434 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46948 dashboard ceph NOFD /proc/42714/task/46948/fd (opendir: Permission denied) 2024-05-08T23:18:01.434 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46949 dashboard ceph cwd unknown /proc/42714/task/46949/cwd (readlink: Permission denied) 2024-05-08T23:18:01.434 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46949 dashboard ceph rtd unknown /proc/42714/task/46949/root (readlink: Permission denied) 2024-05-08T23:18:01.434 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46949 dashboard ceph txt unknown /proc/42714/task/46949/exe (readlink: Permission denied) 2024-05-08T23:18:01.434 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46949 dashboard ceph NOFD /proc/42714/task/46949/fd (opendir: Permission denied) 2024-05-08T23:18:01.434 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46950 dashboard ceph cwd unknown /proc/42714/task/46950/cwd (readlink: Permission denied) 2024-05-08T23:18:01.434 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46950 dashboard ceph rtd unknown /proc/42714/task/46950/root (readlink: Permission denied) 2024-05-08T23:18:01.434 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46950 dashboard ceph txt unknown /proc/42714/task/46950/exe (readlink: Permission denied) 2024-05-08T23:18:01.434 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46950 dashboard ceph NOFD /proc/42714/task/46950/fd (opendir: Permission denied) 2024-05-08T23:18:01.434 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46951 dashboard ceph cwd unknown /proc/42714/task/46951/cwd (readlink: Permission denied) 2024-05-08T23:18:01.434 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46951 dashboard ceph rtd unknown /proc/42714/task/46951/root (readlink: Permission denied) 2024-05-08T23:18:01.434 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46951 dashboard ceph txt unknown /proc/42714/task/46951/exe (readlink: Permission denied) 2024-05-08T23:18:01.434 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46951 dashboard ceph NOFD /proc/42714/task/46951/fd (opendir: Permission denied) 2024-05-08T23:18:01.435 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46952 dashboard ceph cwd unknown /proc/42714/task/46952/cwd (readlink: Permission denied) 2024-05-08T23:18:01.435 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46952 dashboard ceph rtd unknown /proc/42714/task/46952/root (readlink: Permission denied) 2024-05-08T23:18:01.435 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46952 dashboard ceph txt unknown /proc/42714/task/46952/exe (readlink: Permission denied) 2024-05-08T23:18:01.435 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46952 dashboard ceph NOFD /proc/42714/task/46952/fd (opendir: Permission denied) 2024-05-08T23:18:01.435 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46953 dashboard ceph cwd unknown /proc/42714/task/46953/cwd (readlink: Permission denied) 2024-05-08T23:18:01.435 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46953 dashboard ceph rtd unknown /proc/42714/task/46953/root (readlink: Permission denied) 2024-05-08T23:18:01.435 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46953 dashboard ceph txt unknown /proc/42714/task/46953/exe (readlink: Permission denied) 2024-05-08T23:18:01.435 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46953 dashboard ceph NOFD /proc/42714/task/46953/fd (opendir: Permission denied) 2024-05-08T23:18:01.435 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46954 dashboard ceph cwd unknown /proc/42714/task/46954/cwd (readlink: Permission denied) 2024-05-08T23:18:01.435 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46954 dashboard ceph rtd unknown /proc/42714/task/46954/root (readlink: Permission denied) 2024-05-08T23:18:01.435 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46954 dashboard ceph txt unknown /proc/42714/task/46954/exe (readlink: Permission denied) 2024-05-08T23:18:01.435 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46954 dashboard ceph NOFD /proc/42714/task/46954/fd (opendir: Permission denied) 2024-05-08T23:18:01.435 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46955 dashboard ceph cwd unknown /proc/42714/task/46955/cwd (readlink: Permission denied) 2024-05-08T23:18:01.435 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46955 dashboard ceph rtd unknown /proc/42714/task/46955/root (readlink: Permission denied) 2024-05-08T23:18:01.435 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46955 dashboard ceph txt unknown /proc/42714/task/46955/exe (readlink: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46955 dashboard ceph NOFD /proc/42714/task/46955/fd (opendir: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46967 dashboard ceph cwd unknown /proc/42714/task/46967/cwd (readlink: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46967 dashboard ceph rtd unknown /proc/42714/task/46967/root (readlink: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46967 dashboard ceph txt unknown /proc/42714/task/46967/exe (readlink: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 46967 dashboard ceph NOFD /proc/42714/task/46967/fd (opendir: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54754 cephadm ceph cwd unknown /proc/42714/task/54754/cwd (readlink: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54754 cephadm ceph rtd unknown /proc/42714/task/54754/root (readlink: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54754 cephadm ceph txt unknown /proc/42714/task/54754/exe (readlink: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54754 cephadm ceph NOFD /proc/42714/task/54754/fd (opendir: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54755 cephadm ceph cwd unknown /proc/42714/task/54755/cwd (readlink: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54755 cephadm ceph rtd unknown /proc/42714/task/54755/root (readlink: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54755 cephadm ceph txt unknown /proc/42714/task/54755/exe (readlink: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54755 cephadm ceph NOFD /proc/42714/task/54755/fd (opendir: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54756 cephadm ceph cwd unknown /proc/42714/task/54756/cwd (readlink: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54756 cephadm ceph rtd unknown /proc/42714/task/54756/root (readlink: Permission denied) 2024-05-08T23:18:01.436 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54756 cephadm ceph txt unknown /proc/42714/task/54756/exe (readlink: Permission denied) 2024-05-08T23:18:01.437 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54756 cephadm ceph NOFD /proc/42714/task/54756/fd (opendir: Permission denied) 2024-05-08T23:18:01.437 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54757 cephadm ceph cwd unknown /proc/42714/task/54757/cwd (readlink: Permission denied) 2024-05-08T23:18:01.437 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54757 cephadm ceph rtd unknown /proc/42714/task/54757/root (readlink: Permission denied) 2024-05-08T23:18:01.437 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54757 cephadm ceph txt unknown /proc/42714/task/54757/exe (readlink: Permission denied) 2024-05-08T23:18:01.437 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54757 cephadm ceph NOFD /proc/42714/task/54757/fd (opendir: Permission denied) 2024-05-08T23:18:01.437 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54758 cephadm ceph cwd unknown /proc/42714/task/54758/cwd (readlink: Permission denied) 2024-05-08T23:18:01.437 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54758 cephadm ceph rtd unknown /proc/42714/task/54758/root (readlink: Permission denied) 2024-05-08T23:18:01.437 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54758 cephadm ceph txt unknown /proc/42714/task/54758/exe (readlink: Permission denied) 2024-05-08T23:18:01.437 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54758 cephadm ceph NOFD /proc/42714/task/54758/fd (opendir: Permission denied) 2024-05-08T23:18:01.437 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54759 cephadm ceph cwd unknown /proc/42714/task/54759/cwd (readlink: Permission denied) 2024-05-08T23:18:01.437 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54759 cephadm ceph rtd unknown /proc/42714/task/54759/root (readlink: Permission denied) 2024-05-08T23:18:01.437 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54759 cephadm ceph txt unknown /proc/42714/task/54759/exe (readlink: Permission denied) 2024-05-08T23:18:01.437 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54759 cephadm ceph NOFD /proc/42714/task/54759/fd (opendir: Permission denied) 2024-05-08T23:18:01.437 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54760 cephadm ceph cwd unknown /proc/42714/task/54760/cwd (readlink: Permission denied) 2024-05-08T23:18:01.438 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54760 cephadm ceph rtd unknown /proc/42714/task/54760/root (readlink: Permission denied) 2024-05-08T23:18:01.438 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54760 cephadm ceph txt unknown /proc/42714/task/54760/exe (readlink: Permission denied) 2024-05-08T23:18:01.438 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54760 cephadm ceph NOFD /proc/42714/task/54760/fd (opendir: Permission denied) 2024-05-08T23:18:01.438 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54761 cephadm ceph cwd unknown /proc/42714/task/54761/cwd (readlink: Permission denied) 2024-05-08T23:18:01.438 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54761 cephadm ceph rtd unknown /proc/42714/task/54761/root (readlink: Permission denied) 2024-05-08T23:18:01.438 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54761 cephadm ceph txt unknown /proc/42714/task/54761/exe (readlink: Permission denied) 2024-05-08T23:18:01.438 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54761 cephadm ceph NOFD /proc/42714/task/54761/fd (opendir: Permission denied) 2024-05-08T23:18:01.438 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54762 cephadm ceph cwd unknown /proc/42714/task/54762/cwd (readlink: Permission denied) 2024-05-08T23:18:01.438 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54762 cephadm ceph rtd unknown /proc/42714/task/54762/root (readlink: Permission denied) 2024-05-08T23:18:01.438 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54762 cephadm ceph txt unknown /proc/42714/task/54762/exe (readlink: Permission denied) 2024-05-08T23:18:01.438 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54762 cephadm ceph NOFD /proc/42714/task/54762/fd (opendir: Permission denied) 2024-05-08T23:18:01.438 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54763 cephadm ceph cwd unknown /proc/42714/task/54763/cwd (readlink: Permission denied) 2024-05-08T23:18:01.438 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54763 cephadm ceph rtd unknown /proc/42714/task/54763/root (readlink: Permission denied) 2024-05-08T23:18:01.438 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54763 cephadm ceph txt unknown /proc/42714/task/54763/exe (readlink: Permission denied) 2024-05-08T23:18:01.438 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 54763 cephadm ceph NOFD /proc/42714/task/54763/fd (opendir: Permission denied) 2024-05-08T23:18:01.439 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55197 cephadm ceph cwd unknown /proc/42714/task/55197/cwd (readlink: Permission denied) 2024-05-08T23:18:01.439 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55197 cephadm ceph rtd unknown /proc/42714/task/55197/root (readlink: Permission denied) 2024-05-08T23:18:01.439 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55197 cephadm ceph txt unknown /proc/42714/task/55197/exe (readlink: Permission denied) 2024-05-08T23:18:01.439 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55197 cephadm ceph NOFD /proc/42714/task/55197/fd (opendir: Permission denied) 2024-05-08T23:18:01.439 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55198 cephadm ceph cwd unknown /proc/42714/task/55198/cwd (readlink: Permission denied) 2024-05-08T23:18:01.439 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55198 cephadm ceph rtd unknown /proc/42714/task/55198/root (readlink: Permission denied) 2024-05-08T23:18:01.439 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55198 cephadm ceph txt unknown /proc/42714/task/55198/exe (readlink: Permission denied) 2024-05-08T23:18:01.439 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55198 cephadm ceph NOFD /proc/42714/task/55198/fd (opendir: Permission denied) 2024-05-08T23:18:01.439 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55199 cephadm ceph cwd unknown /proc/42714/task/55199/cwd (readlink: Permission denied) 2024-05-08T23:18:01.439 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55199 cephadm ceph rtd unknown /proc/42714/task/55199/root (readlink: Permission denied) 2024-05-08T23:18:01.439 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55199 cephadm ceph txt unknown /proc/42714/task/55199/exe (readlink: Permission denied) 2024-05-08T23:18:01.439 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55199 cephadm ceph NOFD /proc/42714/task/55199/fd (opendir: Permission denied) 2024-05-08T23:18:01.439 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55200 cephadm ceph cwd unknown /proc/42714/task/55200/cwd (readlink: Permission denied) 2024-05-08T23:18:01.439 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55200 cephadm ceph rtd unknown /proc/42714/task/55200/root (readlink: Permission denied) 2024-05-08T23:18:01.439 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55200 cephadm ceph txt unknown /proc/42714/task/55200/exe (readlink: Permission denied) 2024-05-08T23:18:01.440 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55200 cephadm ceph NOFD /proc/42714/task/55200/fd (opendir: Permission denied) 2024-05-08T23:18:01.440 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55201 cephadm ceph cwd unknown /proc/42714/task/55201/cwd (readlink: Permission denied) 2024-05-08T23:18:01.440 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55201 cephadm ceph rtd unknown /proc/42714/task/55201/root (readlink: Permission denied) 2024-05-08T23:18:01.440 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55201 cephadm ceph txt unknown /proc/42714/task/55201/exe (readlink: Permission denied) 2024-05-08T23:18:01.440 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55201 cephadm ceph NOFD /proc/42714/task/55201/fd (opendir: Permission denied) 2024-05-08T23:18:01.440 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55202 cephadm ceph cwd unknown /proc/42714/task/55202/cwd (readlink: Permission denied) 2024-05-08T23:18:01.440 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55202 cephadm ceph rtd unknown /proc/42714/task/55202/root (readlink: Permission denied) 2024-05-08T23:18:01.440 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55202 cephadm ceph txt unknown /proc/42714/task/55202/exe (readlink: Permission denied) 2024-05-08T23:18:01.440 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55202 cephadm ceph NOFD /proc/42714/task/55202/fd (opendir: Permission denied) 2024-05-08T23:18:01.440 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55203 cephadm ceph cwd unknown /proc/42714/task/55203/cwd (readlink: Permission denied) 2024-05-08T23:18:01.440 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55203 cephadm ceph rtd unknown /proc/42714/task/55203/root (readlink: Permission denied) 2024-05-08T23:18:01.440 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55203 cephadm ceph txt unknown /proc/42714/task/55203/exe (readlink: Permission denied) 2024-05-08T23:18:01.440 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55203 cephadm ceph NOFD /proc/42714/task/55203/fd (opendir: Permission denied) 2024-05-08T23:18:01.440 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55204 cephadm ceph cwd unknown /proc/42714/task/55204/cwd (readlink: Permission denied) 2024-05-08T23:18:01.440 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55204 cephadm ceph rtd unknown /proc/42714/task/55204/root (readlink: Permission denied) 2024-05-08T23:18:01.441 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55204 cephadm ceph txt unknown /proc/42714/task/55204/exe (readlink: Permission denied) 2024-05-08T23:18:01.441 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55204 cephadm ceph NOFD /proc/42714/task/55204/fd (opendir: Permission denied) 2024-05-08T23:18:01.441 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55205 cephadm ceph cwd unknown /proc/42714/task/55205/cwd (readlink: Permission denied) 2024-05-08T23:18:01.441 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55205 cephadm ceph rtd unknown /proc/42714/task/55205/root (readlink: Permission denied) 2024-05-08T23:18:01.441 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55205 cephadm ceph txt unknown /proc/42714/task/55205/exe (readlink: Permission denied) 2024-05-08T23:18:01.441 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55205 cephadm ceph NOFD /proc/42714/task/55205/fd (opendir: Permission denied) 2024-05-08T23:18:01.441 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55236 cephadm ceph cwd unknown /proc/42714/task/55236/cwd (readlink: Permission denied) 2024-05-08T23:18:01.441 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55236 cephadm ceph rtd unknown /proc/42714/task/55236/root (readlink: Permission denied) 2024-05-08T23:18:01.441 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55236 cephadm ceph txt unknown /proc/42714/task/55236/exe (readlink: Permission denied) 2024-05-08T23:18:01.441 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 55236 cephadm ceph NOFD /proc/42714/task/55236/fd (opendir: Permission denied) 2024-05-08T23:18:01.441 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66444 devicehea ceph cwd unknown /proc/42714/task/66444/cwd (readlink: Permission denied) 2024-05-08T23:18:01.441 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66444 devicehea ceph rtd unknown /proc/42714/task/66444/root (readlink: Permission denied) 2024-05-08T23:18:01.441 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66444 devicehea ceph txt unknown /proc/42714/task/66444/exe (readlink: Permission denied) 2024-05-08T23:18:01.441 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66444 devicehea ceph NOFD /proc/42714/task/66444/fd (opendir: Permission denied) 2024-05-08T23:18:01.441 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66632 io_contex ceph cwd unknown /proc/42714/task/66632/cwd (readlink: Permission denied) 2024-05-08T23:18:01.442 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66632 io_contex ceph rtd unknown /proc/42714/task/66632/root (readlink: Permission denied) 2024-05-08T23:18:01.442 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66632 io_contex ceph txt unknown /proc/42714/task/66632/exe (readlink: Permission denied) 2024-05-08T23:18:01.442 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66632 io_contex ceph NOFD /proc/42714/task/66632/fd (opendir: Permission denied) 2024-05-08T23:18:01.442 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66633 io_contex ceph cwd unknown /proc/42714/task/66633/cwd (readlink: Permission denied) 2024-05-08T23:18:01.442 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66633 io_contex ceph rtd unknown /proc/42714/task/66633/root (readlink: Permission denied) 2024-05-08T23:18:01.442 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66633 io_contex ceph txt unknown /proc/42714/task/66633/exe (readlink: Permission denied) 2024-05-08T23:18:01.442 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66633 io_contex ceph NOFD /proc/42714/task/66633/fd (opendir: Permission denied) 2024-05-08T23:18:01.442 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66634 ceph_time ceph cwd unknown /proc/42714/task/66634/cwd (readlink: Permission denied) 2024-05-08T23:18:01.442 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66634 ceph_time ceph rtd unknown /proc/42714/task/66634/root (readlink: Permission denied) 2024-05-08T23:18:01.442 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66634 ceph_time ceph txt unknown /proc/42714/task/66634/exe (readlink: Permission denied) 2024-05-08T23:18:01.442 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66634 ceph_time ceph NOFD /proc/42714/task/66634/fd (opendir: Permission denied) 2024-05-08T23:18:01.442 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66635 ms_dispat ceph cwd unknown /proc/42714/task/66635/cwd (readlink: Permission denied) 2024-05-08T23:18:01.442 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66635 ms_dispat ceph rtd unknown /proc/42714/task/66635/root (readlink: Permission denied) 2024-05-08T23:18:01.442 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66635 ms_dispat ceph txt unknown /proc/42714/task/66635/exe (readlink: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66635 ms_dispat ceph NOFD /proc/42714/task/66635/fd (opendir: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66636 ms_local ceph cwd unknown /proc/42714/task/66636/cwd (readlink: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66636 ms_local ceph rtd unknown /proc/42714/task/66636/root (readlink: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66636 ms_local ceph txt unknown /proc/42714/task/66636/exe (readlink: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66636 ms_local ceph NOFD /proc/42714/task/66636/fd (opendir: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66637 safe_time ceph cwd unknown /proc/42714/task/66637/cwd (readlink: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66637 safe_time ceph rtd unknown /proc/42714/task/66637/root (readlink: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66637 safe_time ceph txt unknown /proc/42714/task/66637/exe (readlink: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66637 safe_time ceph NOFD /proc/42714/task/66637/fd (opendir: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66638 safe_time ceph cwd unknown /proc/42714/task/66638/cwd (readlink: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66638 safe_time ceph rtd unknown /proc/42714/task/66638/root (readlink: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66638 safe_time ceph txt unknown /proc/42714/task/66638/exe (readlink: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mgr 42714 66638 safe_time ceph NOFD /proc/42714/task/66638/fd (opendir: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 42821 root cwd unknown /proc/42821/cwd (readlink: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 42821 root rtd unknown /proc/42821/root (readlink: Permission denied) 2024-05-08T23:18:01.443 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 42821 root txt unknown /proc/42821/exe (readlink: Permission denied) 2024-05-08T23:18:01.444 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 42821 root NOFD /proc/42821/fd (opendir: Permission denied) 2024-05-08T23:18:01.444 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 44017 root cwd unknown /proc/44017/cwd (readlink: Permission denied) 2024-05-08T23:18:01.444 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 44017 root rtd unknown /proc/44017/root (readlink: Permission denied) 2024-05-08T23:18:01.444 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 44017 root txt unknown /proc/44017/exe (readlink: Permission denied) 2024-05-08T23:18:01.444 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 44017 root NOFD /proc/44017/fd (opendir: Permission denied) 2024-05-08T23:18:01.444 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 44100 root cwd unknown /proc/44100/cwd (readlink: Permission denied) 2024-05-08T23:18:01.444 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 44100 root rtd unknown /proc/44100/root (readlink: Permission denied) 2024-05-08T23:18:01.444 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 44100 root txt unknown /proc/44100/exe (readlink: Permission denied) 2024-05-08T23:18:01.444 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/2 44100 root NOFD /proc/44100/fd (opendir: Permission denied) 2024-05-08T23:18:01.444 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 44189 root cwd unknown /proc/44189/cwd (readlink: Permission denied) 2024-05-08T23:18:01.444 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 44189 root rtd unknown /proc/44189/root (readlink: Permission denied) 2024-05-08T23:18:01.444 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 44189 root txt unknown /proc/44189/exe (readlink: Permission denied) 2024-05-08T23:18:01.444 INFO:tasks.workunit.client.0.smithi135.stdout:systemd 44189 root NOFD /proc/44189/fd (opendir: Permission denied) 2024-05-08T23:18:01.444 INFO:tasks.workunit.client.0.smithi135.stdout:(sd-pam) 44193 root cwd unknown /proc/44193/cwd (readlink: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:(sd-pam) 44193 root rtd unknown /proc/44193/root (readlink: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:(sd-pam) 44193 root txt unknown /proc/44193/exe (readlink: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:(sd-pam) 44193 root NOFD /proc/44193/fd (opendir: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 44203 root cwd unknown /proc/44203/cwd (readlink: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 44203 root rtd unknown /proc/44203/root (readlink: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 44203 root txt unknown /proc/44203/exe (readlink: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 44203 root NOFD /proc/44203/fd (opendir: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 45617 root cwd unknown /proc/45617/cwd (readlink: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 45617 root rtd unknown /proc/45617/root (readlink: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 45617 root txt unknown /proc/45617/exe (readlink: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/1 45617 root NOFD /proc/45617/fd (opendir: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 45730 root cwd unknown /proc/45730/cwd (readlink: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 45730 root rtd unknown /proc/45730/root (readlink: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 45730 root txt unknown /proc/45730/exe (readlink: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 45730 root NOFD /proc/45730/fd (opendir: Permission denied) 2024-05-08T23:18:01.445 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 46075 root cwd unknown /proc/46075/cwd (readlink: Permission denied) 2024-05-08T23:18:01.446 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 46075 root rtd unknown /proc/46075/root (readlink: Permission denied) 2024-05-08T23:18:01.446 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 46075 root txt unknown /proc/46075/exe (readlink: Permission denied) 2024-05-08T23:18:01.446 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 46075 root NOFD /proc/46075/fd (opendir: Permission denied) 2024-05-08T23:18:01.446 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 46106 root cwd unknown /proc/46106/cwd (readlink: Permission denied) 2024-05-08T23:18:01.446 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 46106 root rtd unknown /proc/46106/root (readlink: Permission denied) 2024-05-08T23:18:01.446 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 46106 root txt unknown /proc/46106/exe (readlink: Permission denied) 2024-05-08T23:18:01.446 INFO:tasks.workunit.client.0.smithi135.stdout:sshd 46106 root NOFD /proc/46106/fd (opendir: Permission denied) 2024-05-08T23:18:01.446 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 46425 root cwd unknown /proc/46425/cwd (readlink: Permission denied) 2024-05-08T23:18:01.446 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 46425 root rtd unknown /proc/46425/root (readlink: Permission denied) 2024-05-08T23:18:01.446 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 46425 root txt unknown /proc/46425/exe (readlink: Permission denied) 2024-05-08T23:18:01.446 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 46425 root NOFD /proc/46425/fd (opendir: Permission denied) 2024-05-08T23:18:01.446 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 59712 root cwd unknown /proc/59712/cwd (readlink: Permission denied) 2024-05-08T23:18:01.446 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 59712 root rtd unknown /proc/59712/root (readlink: Permission denied) 2024-05-08T23:18:01.446 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 59712 root txt unknown /proc/59712/exe (readlink: Permission denied) 2024-05-08T23:18:01.447 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/3 59712 root NOFD /proc/59712/fd (opendir: Permission denied) 2024-05-08T23:18:01.447 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 60145 root cwd unknown /proc/60145/cwd (readlink: Permission denied) 2024-05-08T23:18:01.447 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 60145 root rtd unknown /proc/60145/root (readlink: Permission denied) 2024-05-08T23:18:01.447 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 60145 root txt unknown /proc/60145/exe (readlink: Permission denied) 2024-05-08T23:18:01.447 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 60145 root NOFD /proc/60145/fd (opendir: Permission denied) 2024-05-08T23:18:01.447 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 60156 root cwd unknown /proc/60156/cwd (readlink: Permission denied) 2024-05-08T23:18:01.447 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 60156 root rtd unknown /proc/60156/root (readlink: Permission denied) 2024-05-08T23:18:01.447 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 60156 root txt unknown /proc/60156/exe (readlink: Permission denied) 2024-05-08T23:18:01.447 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 60156 root NOFD /proc/60156/fd (opendir: Permission denied) 2024-05-08T23:18:01.447 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 ceph cwd unknown /proc/60168/cwd (readlink: Permission denied) 2024-05-08T23:18:01.447 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 ceph rtd unknown /proc/60168/root (readlink: Permission denied) 2024-05-08T23:18:01.447 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 ceph txt unknown /proc/60168/exe (readlink: Permission denied) 2024-05-08T23:18:01.447 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 ceph NOFD /proc/60168/fd (opendir: Permission denied) 2024-05-08T23:18:01.447 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60169 log ceph cwd unknown /proc/60168/task/60169/cwd (readlink: Permission denied) 2024-05-08T23:18:01.447 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60169 log ceph rtd unknown /proc/60168/task/60169/root (readlink: Permission denied) 2024-05-08T23:18:01.448 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60169 log ceph txt unknown /proc/60168/task/60169/exe (readlink: Permission denied) 2024-05-08T23:18:01.448 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60169 log ceph NOFD /proc/60168/task/60169/fd (opendir: Permission denied) 2024-05-08T23:18:01.448 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60171 msgr-work ceph cwd unknown /proc/60168/task/60171/cwd (readlink: Permission denied) 2024-05-08T23:18:01.448 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60171 msgr-work ceph rtd unknown /proc/60168/task/60171/root (readlink: Permission denied) 2024-05-08T23:18:01.448 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60171 msgr-work ceph txt unknown /proc/60168/task/60171/exe (readlink: Permission denied) 2024-05-08T23:18:01.448 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60171 msgr-work ceph NOFD /proc/60168/task/60171/fd (opendir: Permission denied) 2024-05-08T23:18:01.448 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60172 msgr-work ceph cwd unknown /proc/60168/task/60172/cwd (readlink: Permission denied) 2024-05-08T23:18:01.448 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60172 msgr-work ceph rtd unknown /proc/60168/task/60172/root (readlink: Permission denied) 2024-05-08T23:18:01.448 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60172 msgr-work ceph txt unknown /proc/60168/task/60172/exe (readlink: Permission denied) 2024-05-08T23:18:01.448 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60172 msgr-work ceph NOFD /proc/60168/task/60172/fd (opendir: Permission denied) 2024-05-08T23:18:01.448 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60173 msgr-work ceph cwd unknown /proc/60168/task/60173/cwd (readlink: Permission denied) 2024-05-08T23:18:01.448 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60173 msgr-work ceph rtd unknown /proc/60168/task/60173/root (readlink: Permission denied) 2024-05-08T23:18:01.448 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60173 msgr-work ceph txt unknown /proc/60168/task/60173/exe (readlink: Permission denied) 2024-05-08T23:18:01.448 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60173 msgr-work ceph NOFD /proc/60168/task/60173/fd (opendir: Permission denied) 2024-05-08T23:18:01.448 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60177 service ceph cwd unknown /proc/60168/task/60177/cwd (readlink: Permission denied) 2024-05-08T23:18:01.449 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60177 service ceph rtd unknown /proc/60168/task/60177/root (readlink: Permission denied) 2024-05-08T23:18:01.449 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60177 service ceph txt unknown /proc/60168/task/60177/exe (readlink: Permission denied) 2024-05-08T23:18:01.449 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60177 service ceph NOFD /proc/60168/task/60177/fd (opendir: Permission denied) 2024-05-08T23:18:01.449 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60178 admin_soc ceph cwd unknown /proc/60168/task/60178/cwd (readlink: Permission denied) 2024-05-08T23:18:01.449 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60178 admin_soc ceph rtd unknown /proc/60168/task/60178/root (readlink: Permission denied) 2024-05-08T23:18:01.449 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60178 admin_soc ceph txt unknown /proc/60168/task/60178/exe (readlink: Permission denied) 2024-05-08T23:18:01.449 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60178 admin_soc ceph NOFD /proc/60168/task/60178/fd (opendir: Permission denied) 2024-05-08T23:18:01.449 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60435 signal_ha ceph cwd unknown /proc/60168/task/60435/cwd (readlink: Permission denied) 2024-05-08T23:18:01.449 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60435 signal_ha ceph rtd unknown /proc/60168/task/60435/root (readlink: Permission denied) 2024-05-08T23:18:01.449 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60435 signal_ha ceph txt unknown /proc/60168/task/60435/exe (readlink: Permission denied) 2024-05-08T23:18:01.449 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60435 signal_ha ceph NOFD /proc/60168/task/60435/fd (opendir: Permission denied) 2024-05-08T23:18:01.449 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60436 io_contex ceph cwd unknown /proc/60168/task/60436/cwd (readlink: Permission denied) 2024-05-08T23:18:01.449 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60436 io_contex ceph rtd unknown /proc/60168/task/60436/root (readlink: Permission denied) 2024-05-08T23:18:01.449 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60436 io_contex ceph txt unknown /proc/60168/task/60436/exe (readlink: Permission denied) 2024-05-08T23:18:01.449 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60436 io_contex ceph NOFD /proc/60168/task/60436/fd (opendir: Permission denied) 2024-05-08T23:18:01.450 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60437 io_contex ceph cwd unknown /proc/60168/task/60437/cwd (readlink: Permission denied) 2024-05-08T23:18:01.450 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60437 io_contex ceph rtd unknown /proc/60168/task/60437/root (readlink: Permission denied) 2024-05-08T23:18:01.450 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60437 io_contex ceph txt unknown /proc/60168/task/60437/exe (readlink: Permission denied) 2024-05-08T23:18:01.450 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60437 io_contex ceph NOFD /proc/60168/task/60437/fd (opendir: Permission denied) 2024-05-08T23:18:01.450 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60526 OpHistory ceph cwd unknown /proc/60168/task/60526/cwd (readlink: Permission denied) 2024-05-08T23:18:01.450 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60526 OpHistory ceph rtd unknown /proc/60168/task/60526/root (readlink: Permission denied) 2024-05-08T23:18:01.450 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60526 OpHistory ceph txt unknown /proc/60168/task/60526/exe (readlink: Permission denied) 2024-05-08T23:18:01.450 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60526 OpHistory ceph NOFD /proc/60168/task/60526/fd (opendir: Permission denied) 2024-05-08T23:18:01.450 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60527 ceph_time ceph cwd unknown /proc/60168/task/60527/cwd (readlink: Permission denied) 2024-05-08T23:18:01.450 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60527 ceph_time ceph rtd unknown /proc/60168/task/60527/root (readlink: Permission denied) 2024-05-08T23:18:01.450 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60527 ceph_time ceph txt unknown /proc/60168/task/60527/exe (readlink: Permission denied) 2024-05-08T23:18:01.450 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 60527 ceph_time ceph NOFD /proc/60168/task/60527/fd (opendir: Permission denied) 2024-05-08T23:18:01.450 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61033 ceph-osd ceph cwd unknown /proc/60168/task/61033/cwd (readlink: Permission denied) 2024-05-08T23:18:01.450 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61033 ceph-osd ceph rtd unknown /proc/60168/task/61033/root (readlink: Permission denied) 2024-05-08T23:18:01.450 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61033 ceph-osd ceph txt unknown /proc/60168/task/61033/exe (readlink: Permission denied) 2024-05-08T23:18:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61033 ceph-osd ceph NOFD /proc/60168/task/61033/fd (opendir: Permission denied) 2024-05-08T23:18:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61034 safe_time ceph cwd unknown /proc/60168/task/61034/cwd (readlink: Permission denied) 2024-05-08T23:18:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61034 safe_time ceph rtd unknown /proc/60168/task/61034/root (readlink: Permission denied) 2024-05-08T23:18:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61034 safe_time ceph txt unknown /proc/60168/task/61034/exe (readlink: Permission denied) 2024-05-08T23:18:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61034 safe_time ceph NOFD /proc/60168/task/61034/fd (opendir: Permission denied) 2024-05-08T23:18:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61035 safe_time ceph cwd unknown /proc/60168/task/61035/cwd (readlink: Permission denied) 2024-05-08T23:18:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61035 safe_time ceph rtd unknown /proc/60168/task/61035/root (readlink: Permission denied) 2024-05-08T23:18:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61035 safe_time ceph txt unknown /proc/60168/task/61035/exe (readlink: Permission denied) 2024-05-08T23:18:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61035 safe_time ceph NOFD /proc/60168/task/61035/fd (opendir: Permission denied) 2024-05-08T23:18:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61036 safe_time ceph cwd unknown /proc/60168/task/61036/cwd (readlink: Permission denied) 2024-05-08T23:18:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61036 safe_time ceph rtd unknown /proc/60168/task/61036/root (readlink: Permission denied) 2024-05-08T23:18:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61036 safe_time ceph txt unknown /proc/60168/task/61036/exe (readlink: Permission denied) 2024-05-08T23:18:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61036 safe_time ceph NOFD /proc/60168/task/61036/fd (opendir: Permission denied) 2024-05-08T23:18:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61037 safe_time ceph cwd unknown /proc/60168/task/61037/cwd (readlink: Permission denied) 2024-05-08T23:18:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61037 safe_time ceph rtd unknown /proc/60168/task/61037/root (readlink: Permission denied) 2024-05-08T23:18:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61037 safe_time ceph txt unknown /proc/60168/task/61037/exe (readlink: Permission denied) 2024-05-08T23:18:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61037 safe_time ceph NOFD /proc/60168/task/61037/fd (opendir: Permission denied) 2024-05-08T23:18:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61038 fn_anonym ceph cwd unknown /proc/60168/task/61038/cwd (readlink: Permission denied) 2024-05-08T23:18:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61038 fn_anonym ceph rtd unknown /proc/60168/task/61038/root (readlink: Permission denied) 2024-05-08T23:18:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61038 fn_anonym ceph txt unknown /proc/60168/task/61038/exe (readlink: Permission denied) 2024-05-08T23:18:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61038 fn_anonym ceph NOFD /proc/60168/task/61038/fd (opendir: Permission denied) 2024-05-08T23:18:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61041 rocksdb:l ceph cwd unknown /proc/60168/task/61041/cwd (readlink: Permission denied) 2024-05-08T23:18:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61041 rocksdb:l ceph rtd unknown /proc/60168/task/61041/root (readlink: Permission denied) 2024-05-08T23:18:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61041 rocksdb:l ceph txt unknown /proc/60168/task/61041/exe (readlink: Permission denied) 2024-05-08T23:18:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61041 rocksdb:l ceph NOFD /proc/60168/task/61041/fd (opendir: Permission denied) 2024-05-08T23:18:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61042 rocksdb:l ceph cwd unknown /proc/60168/task/61042/cwd (readlink: Permission denied) 2024-05-08T23:18:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61042 rocksdb:l ceph rtd unknown /proc/60168/task/61042/root (readlink: Permission denied) 2024-05-08T23:18:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61042 rocksdb:l ceph txt unknown /proc/60168/task/61042/exe (readlink: Permission denied) 2024-05-08T23:18:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61042 rocksdb:l ceph NOFD /proc/60168/task/61042/fd (opendir: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61043 rocksdb:l ceph cwd unknown /proc/60168/task/61043/cwd (readlink: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61043 rocksdb:l ceph rtd unknown /proc/60168/task/61043/root (readlink: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61043 rocksdb:l ceph txt unknown /proc/60168/task/61043/exe (readlink: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61043 rocksdb:l ceph NOFD /proc/60168/task/61043/fd (opendir: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61044 rocksdb:h ceph cwd unknown /proc/60168/task/61044/cwd (readlink: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61044 rocksdb:h ceph rtd unknown /proc/60168/task/61044/root (readlink: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61044 rocksdb:h ceph txt unknown /proc/60168/task/61044/exe (readlink: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61044 rocksdb:h ceph NOFD /proc/60168/task/61044/fd (opendir: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61470 bstore_ai ceph cwd unknown /proc/60168/task/61470/cwd (readlink: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61470 bstore_ai ceph rtd unknown /proc/60168/task/61470/root (readlink: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61470 bstore_ai ceph txt unknown /proc/60168/task/61470/exe (readlink: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61470 bstore_ai ceph NOFD /proc/60168/task/61470/fd (opendir: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61824 bstore_ai ceph cwd unknown /proc/60168/task/61824/cwd (readlink: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61824 bstore_ai ceph rtd unknown /proc/60168/task/61824/root (readlink: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61824 bstore_ai ceph txt unknown /proc/60168/task/61824/exe (readlink: Permission denied) 2024-05-08T23:18:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 61824 bstore_ai ceph NOFD /proc/60168/task/61824/fd (opendir: Permission denied) 2024-05-08T23:18:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62130 ceph-osd ceph cwd unknown /proc/60168/task/62130/cwd (readlink: Permission denied) 2024-05-08T23:18:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62130 ceph-osd ceph rtd unknown /proc/60168/task/62130/root (readlink: Permission denied) 2024-05-08T23:18:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62130 ceph-osd ceph txt unknown /proc/60168/task/62130/exe (readlink: Permission denied) 2024-05-08T23:18:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62130 ceph-osd ceph NOFD /proc/60168/task/62130/fd (opendir: Permission denied) 2024-05-08T23:18:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62135 cfin ceph cwd unknown /proc/60168/task/62135/cwd (readlink: Permission denied) 2024-05-08T23:18:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62135 cfin ceph rtd unknown /proc/60168/task/62135/root (readlink: Permission denied) 2024-05-08T23:18:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62135 cfin ceph txt unknown /proc/60168/task/62135/exe (readlink: Permission denied) 2024-05-08T23:18:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62135 cfin ceph NOFD /proc/60168/task/62135/fd (opendir: Permission denied) 2024-05-08T23:18:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62136 bstore_kv ceph cwd unknown /proc/60168/task/62136/cwd (readlink: Permission denied) 2024-05-08T23:18:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62136 bstore_kv ceph rtd unknown /proc/60168/task/62136/root (readlink: Permission denied) 2024-05-08T23:18:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62136 bstore_kv ceph txt unknown /proc/60168/task/62136/exe (readlink: Permission denied) 2024-05-08T23:18:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62136 bstore_kv ceph NOFD /proc/60168/task/62136/fd (opendir: Permission denied) 2024-05-08T23:18:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62137 bstore_kv ceph cwd unknown /proc/60168/task/62137/cwd (readlink: Permission denied) 2024-05-08T23:18:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62137 bstore_kv ceph rtd unknown /proc/60168/task/62137/root (readlink: Permission denied) 2024-05-08T23:18:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62137 bstore_kv ceph txt unknown /proc/60168/task/62137/exe (readlink: Permission denied) 2024-05-08T23:18:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62137 bstore_kv ceph NOFD /proc/60168/task/62137/fd (opendir: Permission denied) 2024-05-08T23:18:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62139 bstore_me ceph cwd unknown /proc/60168/task/62139/cwd (readlink: Permission denied) 2024-05-08T23:18:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62139 bstore_me ceph rtd unknown /proc/60168/task/62139/root (readlink: Permission denied) 2024-05-08T23:18:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62139 bstore_me ceph txt unknown /proc/60168/task/62139/exe (readlink: Permission denied) 2024-05-08T23:18:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62139 bstore_me ceph NOFD /proc/60168/task/62139/fd (opendir: Permission denied) 2024-05-08T23:18:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62254 ms_dispat ceph cwd unknown /proc/60168/task/62254/cwd (readlink: Permission denied) 2024-05-08T23:18:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62254 ms_dispat ceph rtd unknown /proc/60168/task/62254/root (readlink: Permission denied) 2024-05-08T23:18:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62254 ms_dispat ceph txt unknown /proc/60168/task/62254/exe (readlink: Permission denied) 2024-05-08T23:18:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62254 ms_dispat ceph NOFD /proc/60168/task/62254/fd (opendir: Permission denied) 2024-05-08T23:18:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62255 ms_local ceph cwd unknown /proc/60168/task/62255/cwd (readlink: Permission denied) 2024-05-08T23:18:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62255 ms_local ceph rtd unknown /proc/60168/task/62255/root (readlink: Permission denied) 2024-05-08T23:18:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62255 ms_local ceph txt unknown /proc/60168/task/62255/exe (readlink: Permission denied) 2024-05-08T23:18:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62255 ms_local ceph NOFD /proc/60168/task/62255/fd (opendir: Permission denied) 2024-05-08T23:18:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62256 safe_time ceph cwd unknown /proc/60168/task/62256/cwd (readlink: Permission denied) 2024-05-08T23:18:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62256 safe_time ceph rtd unknown /proc/60168/task/62256/root (readlink: Permission denied) 2024-05-08T23:18:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62256 safe_time ceph txt unknown /proc/60168/task/62256/exe (readlink: Permission denied) 2024-05-08T23:18:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62256 safe_time ceph NOFD /proc/60168/task/62256/fd (opendir: Permission denied) 2024-05-08T23:18:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62258 safe_time ceph cwd unknown /proc/60168/task/62258/cwd (readlink: Permission denied) 2024-05-08T23:18:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62258 safe_time ceph rtd unknown /proc/60168/task/62258/root (readlink: Permission denied) 2024-05-08T23:18:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62258 safe_time ceph txt unknown /proc/60168/task/62258/exe (readlink: Permission denied) 2024-05-08T23:18:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62258 safe_time ceph NOFD /proc/60168/task/62258/fd (opendir: Permission denied) 2024-05-08T23:18:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62260 ms_dispat ceph cwd unknown /proc/60168/task/62260/cwd (readlink: Permission denied) 2024-05-08T23:18:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62260 ms_dispat ceph rtd unknown /proc/60168/task/62260/root (readlink: Permission denied) 2024-05-08T23:18:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62260 ms_dispat ceph txt unknown /proc/60168/task/62260/exe (readlink: Permission denied) 2024-05-08T23:18:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62260 ms_dispat ceph NOFD /proc/60168/task/62260/fd (opendir: Permission denied) 2024-05-08T23:18:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62261 ms_local ceph cwd unknown /proc/60168/task/62261/cwd (readlink: Permission denied) 2024-05-08T23:18:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62261 ms_local ceph rtd unknown /proc/60168/task/62261/root (readlink: Permission denied) 2024-05-08T23:18:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62261 ms_local ceph txt unknown /proc/60168/task/62261/exe (readlink: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62261 ms_local ceph NOFD /proc/60168/task/62261/fd (opendir: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62262 ms_dispat ceph cwd unknown /proc/60168/task/62262/cwd (readlink: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62262 ms_dispat ceph rtd unknown /proc/60168/task/62262/root (readlink: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62262 ms_dispat ceph txt unknown /proc/60168/task/62262/exe (readlink: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62262 ms_dispat ceph NOFD /proc/60168/task/62262/fd (opendir: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62263 ms_local ceph cwd unknown /proc/60168/task/62263/cwd (readlink: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62263 ms_local ceph rtd unknown /proc/60168/task/62263/root (readlink: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62263 ms_local ceph txt unknown /proc/60168/task/62263/exe (readlink: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62263 ms_local ceph NOFD /proc/60168/task/62263/fd (opendir: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62265 ms_dispat ceph cwd unknown /proc/60168/task/62265/cwd (readlink: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62265 ms_dispat ceph rtd unknown /proc/60168/task/62265/root (readlink: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62265 ms_dispat ceph txt unknown /proc/60168/task/62265/exe (readlink: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62265 ms_dispat ceph NOFD /proc/60168/task/62265/fd (opendir: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62266 ms_local ceph cwd unknown /proc/60168/task/62266/cwd (readlink: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62266 ms_local ceph rtd unknown /proc/60168/task/62266/root (readlink: Permission denied) 2024-05-08T23:18:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62266 ms_local ceph txt unknown /proc/60168/task/62266/exe (readlink: Permission denied) 2024-05-08T23:18:01.458 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62266 ms_local ceph NOFD /proc/60168/task/62266/fd (opendir: Permission denied) 2024-05-08T23:18:01.458 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62267 ms_dispat ceph cwd unknown /proc/60168/task/62267/cwd (readlink: Permission denied) 2024-05-08T23:18:01.458 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62267 ms_dispat ceph rtd unknown /proc/60168/task/62267/root (readlink: Permission denied) 2024-05-08T23:18:01.458 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62267 ms_dispat ceph txt unknown /proc/60168/task/62267/exe (readlink: Permission denied) 2024-05-08T23:18:01.458 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62267 ms_dispat ceph NOFD /proc/60168/task/62267/fd (opendir: Permission denied) 2024-05-08T23:18:01.458 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62269 ms_local ceph cwd unknown /proc/60168/task/62269/cwd (readlink: Permission denied) 2024-05-08T23:18:01.458 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62269 ms_local ceph rtd unknown /proc/60168/task/62269/root (readlink: Permission denied) 2024-05-08T23:18:01.458 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62269 ms_local ceph txt unknown /proc/60168/task/62269/exe (readlink: Permission denied) 2024-05-08T23:18:01.458 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62269 ms_local ceph NOFD /proc/60168/task/62269/fd (opendir: Permission denied) 2024-05-08T23:18:01.458 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62270 ms_dispat ceph cwd unknown /proc/60168/task/62270/cwd (readlink: Permission denied) 2024-05-08T23:18:01.458 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62270 ms_dispat ceph rtd unknown /proc/60168/task/62270/root (readlink: Permission denied) 2024-05-08T23:18:01.458 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62270 ms_dispat ceph txt unknown /proc/60168/task/62270/exe (readlink: Permission denied) 2024-05-08T23:18:01.458 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62270 ms_dispat ceph NOFD /proc/60168/task/62270/fd (opendir: Permission denied) 2024-05-08T23:18:01.459 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62271 ms_local ceph cwd unknown /proc/60168/task/62271/cwd (readlink: Permission denied) 2024-05-08T23:18:01.459 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62271 ms_local ceph rtd unknown /proc/60168/task/62271/root (readlink: Permission denied) 2024-05-08T23:18:01.459 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62271 ms_local ceph txt unknown /proc/60168/task/62271/exe (readlink: Permission denied) 2024-05-08T23:18:01.459 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62271 ms_local ceph NOFD /proc/60168/task/62271/fd (opendir: Permission denied) 2024-05-08T23:18:01.459 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62273 ms_dispat ceph cwd unknown /proc/60168/task/62273/cwd (readlink: Permission denied) 2024-05-08T23:18:01.459 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62273 ms_dispat ceph rtd unknown /proc/60168/task/62273/root (readlink: Permission denied) 2024-05-08T23:18:01.459 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62273 ms_dispat ceph txt unknown /proc/60168/task/62273/exe (readlink: Permission denied) 2024-05-08T23:18:01.459 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62273 ms_dispat ceph NOFD /proc/60168/task/62273/fd (opendir: Permission denied) 2024-05-08T23:18:01.459 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62274 ms_local ceph cwd unknown /proc/60168/task/62274/cwd (readlink: Permission denied) 2024-05-08T23:18:01.459 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62274 ms_local ceph rtd unknown /proc/60168/task/62274/root (readlink: Permission denied) 2024-05-08T23:18:01.459 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62274 ms_local ceph txt unknown /proc/60168/task/62274/exe (readlink: Permission denied) 2024-05-08T23:18:01.459 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62274 ms_local ceph NOFD /proc/60168/task/62274/fd (opendir: Permission denied) 2024-05-08T23:18:01.459 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62275 fn_anonym ceph cwd unknown /proc/60168/task/62275/cwd (readlink: Permission denied) 2024-05-08T23:18:01.459 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62275 fn_anonym ceph rtd unknown /proc/60168/task/62275/root (readlink: Permission denied) 2024-05-08T23:18:01.459 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62275 fn_anonym ceph txt unknown /proc/60168/task/62275/exe (readlink: Permission denied) 2024-05-08T23:18:01.460 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62275 fn_anonym ceph NOFD /proc/60168/task/62275/fd (opendir: Permission denied) 2024-05-08T23:18:01.460 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62277 finisher ceph cwd unknown /proc/60168/task/62277/cwd (readlink: Permission denied) 2024-05-08T23:18:01.460 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62277 finisher ceph rtd unknown /proc/60168/task/62277/root (readlink: Permission denied) 2024-05-08T23:18:01.460 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62277 finisher ceph txt unknown /proc/60168/task/62277/exe (readlink: Permission denied) 2024-05-08T23:18:01.460 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62277 finisher ceph NOFD /proc/60168/task/62277/fd (opendir: Permission denied) 2024-05-08T23:18:01.460 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62278 safe_time ceph cwd unknown /proc/60168/task/62278/cwd (readlink: Permission denied) 2024-05-08T23:18:01.460 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62278 safe_time ceph rtd unknown /proc/60168/task/62278/root (readlink: Permission denied) 2024-05-08T23:18:01.460 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62278 safe_time ceph txt unknown /proc/60168/task/62278/exe (readlink: Permission denied) 2024-05-08T23:18:01.460 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62278 safe_time ceph NOFD /proc/60168/task/62278/fd (opendir: Permission denied) 2024-05-08T23:18:01.460 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62279 safe_time ceph cwd unknown /proc/60168/task/62279/cwd (readlink: Permission denied) 2024-05-08T23:18:01.460 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62279 safe_time ceph rtd unknown /proc/60168/task/62279/root (readlink: Permission denied) 2024-05-08T23:18:01.460 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62279 safe_time ceph txt unknown /proc/60168/task/62279/exe (readlink: Permission denied) 2024-05-08T23:18:01.460 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62279 safe_time ceph NOFD /proc/60168/task/62279/fd (opendir: Permission denied) 2024-05-08T23:18:01.460 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62280 ceph-osd ceph cwd unknown /proc/60168/task/62280/cwd (readlink: Permission denied) 2024-05-08T23:18:01.460 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62280 ceph-osd ceph rtd unknown /proc/60168/task/62280/root (readlink: Permission denied) 2024-05-08T23:18:01.461 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62280 ceph-osd ceph txt unknown /proc/60168/task/62280/exe (readlink: Permission denied) 2024-05-08T23:18:01.461 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62280 ceph-osd ceph NOFD /proc/60168/task/62280/fd (opendir: Permission denied) 2024-05-08T23:18:01.461 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62282 osd_srv_a ceph cwd unknown /proc/60168/task/62282/cwd (readlink: Permission denied) 2024-05-08T23:18:01.461 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62282 osd_srv_a ceph rtd unknown /proc/60168/task/62282/root (readlink: Permission denied) 2024-05-08T23:18:01.461 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62282 osd_srv_a ceph txt unknown /proc/60168/task/62282/exe (readlink: Permission denied) 2024-05-08T23:18:01.461 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62282 osd_srv_a ceph NOFD /proc/60168/task/62282/fd (opendir: Permission denied) 2024-05-08T23:18:01.461 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62283 tp_osd_tp ceph cwd unknown /proc/60168/task/62283/cwd (readlink: Permission denied) 2024-05-08T23:18:01.461 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62283 tp_osd_tp ceph rtd unknown /proc/60168/task/62283/root (readlink: Permission denied) 2024-05-08T23:18:01.461 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62283 tp_osd_tp ceph txt unknown /proc/60168/task/62283/exe (readlink: Permission denied) 2024-05-08T23:18:01.461 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62283 tp_osd_tp ceph NOFD /proc/60168/task/62283/fd (opendir: Permission denied) 2024-05-08T23:18:01.461 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62284 tp_osd_tp ceph cwd unknown /proc/60168/task/62284/cwd (readlink: Permission denied) 2024-05-08T23:18:01.461 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62284 tp_osd_tp ceph rtd unknown /proc/60168/task/62284/root (readlink: Permission denied) 2024-05-08T23:18:01.461 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62284 tp_osd_tp ceph txt unknown /proc/60168/task/62284/exe (readlink: Permission denied) 2024-05-08T23:18:01.461 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62284 tp_osd_tp ceph NOFD /proc/60168/task/62284/fd (opendir: Permission denied) 2024-05-08T23:18:01.462 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62285 tp_osd_tp ceph cwd unknown /proc/60168/task/62285/cwd (readlink: Permission denied) 2024-05-08T23:18:01.462 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62285 tp_osd_tp ceph rtd unknown /proc/60168/task/62285/root (readlink: Permission denied) 2024-05-08T23:18:01.462 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62285 tp_osd_tp ceph txt unknown /proc/60168/task/62285/exe (readlink: Permission denied) 2024-05-08T23:18:01.462 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62285 tp_osd_tp ceph NOFD /proc/60168/task/62285/fd (opendir: Permission denied) 2024-05-08T23:18:01.462 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62287 tp_osd_tp ceph cwd unknown /proc/60168/task/62287/cwd (readlink: Permission denied) 2024-05-08T23:18:01.462 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62287 tp_osd_tp ceph rtd unknown /proc/60168/task/62287/root (readlink: Permission denied) 2024-05-08T23:18:01.462 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62287 tp_osd_tp ceph txt unknown /proc/60168/task/62287/exe (readlink: Permission denied) 2024-05-08T23:18:01.462 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62287 tp_osd_tp ceph NOFD /proc/60168/task/62287/fd (opendir: Permission denied) 2024-05-08T23:18:01.462 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62288 tp_osd_tp ceph cwd unknown /proc/60168/task/62288/cwd (readlink: Permission denied) 2024-05-08T23:18:01.462 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62288 tp_osd_tp ceph rtd unknown /proc/60168/task/62288/root (readlink: Permission denied) 2024-05-08T23:18:01.462 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62288 tp_osd_tp ceph txt unknown /proc/60168/task/62288/exe (readlink: Permission denied) 2024-05-08T23:18:01.462 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62288 tp_osd_tp ceph NOFD /proc/60168/task/62288/fd (opendir: Permission denied) 2024-05-08T23:18:01.462 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62289 tp_osd_tp ceph cwd unknown /proc/60168/task/62289/cwd (readlink: Permission denied) 2024-05-08T23:18:01.462 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62289 tp_osd_tp ceph rtd unknown /proc/60168/task/62289/root (readlink: Permission denied) 2024-05-08T23:18:01.462 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62289 tp_osd_tp ceph txt unknown /proc/60168/task/62289/exe (readlink: Permission denied) 2024-05-08T23:18:01.463 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62289 tp_osd_tp ceph NOFD /proc/60168/task/62289/fd (opendir: Permission denied) 2024-05-08T23:18:01.463 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62290 tp_osd_tp ceph cwd unknown /proc/60168/task/62290/cwd (readlink: Permission denied) 2024-05-08T23:18:01.463 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62290 tp_osd_tp ceph rtd unknown /proc/60168/task/62290/root (readlink: Permission denied) 2024-05-08T23:18:01.463 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62290 tp_osd_tp ceph txt unknown /proc/60168/task/62290/exe (readlink: Permission denied) 2024-05-08T23:18:01.463 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62290 tp_osd_tp ceph NOFD /proc/60168/task/62290/fd (opendir: Permission denied) 2024-05-08T23:18:01.463 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62292 tp_osd_tp ceph cwd unknown /proc/60168/task/62292/cwd (readlink: Permission denied) 2024-05-08T23:18:01.463 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62292 tp_osd_tp ceph rtd unknown /proc/60168/task/62292/root (readlink: Permission denied) 2024-05-08T23:18:01.463 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62292 tp_osd_tp ceph txt unknown /proc/60168/task/62292/exe (readlink: Permission denied) 2024-05-08T23:18:01.463 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62292 tp_osd_tp ceph NOFD /proc/60168/task/62292/fd (opendir: Permission denied) 2024-05-08T23:18:01.463 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62293 tp_osd_tp ceph cwd unknown /proc/60168/task/62293/cwd (readlink: Permission denied) 2024-05-08T23:18:01.463 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62293 tp_osd_tp ceph rtd unknown /proc/60168/task/62293/root (readlink: Permission denied) 2024-05-08T23:18:01.463 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62293 tp_osd_tp ceph txt unknown /proc/60168/task/62293/exe (readlink: Permission denied) 2024-05-08T23:18:01.463 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62293 tp_osd_tp ceph NOFD /proc/60168/task/62293/fd (opendir: Permission denied) 2024-05-08T23:18:01.463 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62294 tp_osd_tp ceph cwd unknown /proc/60168/task/62294/cwd (readlink: Permission denied) 2024-05-08T23:18:01.463 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62294 tp_osd_tp ceph rtd unknown /proc/60168/task/62294/root (readlink: Permission denied) 2024-05-08T23:18:01.464 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62294 tp_osd_tp ceph txt unknown /proc/60168/task/62294/exe (readlink: Permission denied) 2024-05-08T23:18:01.464 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62294 tp_osd_tp ceph NOFD /proc/60168/task/62294/fd (opendir: Permission denied) 2024-05-08T23:18:01.464 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62295 tp_osd_tp ceph cwd unknown /proc/60168/task/62295/cwd (readlink: Permission denied) 2024-05-08T23:18:01.464 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62295 tp_osd_tp ceph rtd unknown /proc/60168/task/62295/root (readlink: Permission denied) 2024-05-08T23:18:01.464 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62295 tp_osd_tp ceph txt unknown /proc/60168/task/62295/exe (readlink: Permission denied) 2024-05-08T23:18:01.464 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62295 tp_osd_tp ceph NOFD /proc/60168/task/62295/fd (opendir: Permission denied) 2024-05-08T23:18:01.464 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62296 tp_osd_tp ceph cwd unknown /proc/60168/task/62296/cwd (readlink: Permission denied) 2024-05-08T23:18:01.464 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62296 tp_osd_tp ceph rtd unknown /proc/60168/task/62296/root (readlink: Permission denied) 2024-05-08T23:18:01.464 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62296 tp_osd_tp ceph txt unknown /proc/60168/task/62296/exe (readlink: Permission denied) 2024-05-08T23:18:01.464 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62296 tp_osd_tp ceph NOFD /proc/60168/task/62296/fd (opendir: Permission denied) 2024-05-08T23:18:01.464 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62297 tp_osd_tp ceph cwd unknown /proc/60168/task/62297/cwd (readlink: Permission denied) 2024-05-08T23:18:01.464 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62297 tp_osd_tp ceph rtd unknown /proc/60168/task/62297/root (readlink: Permission denied) 2024-05-08T23:18:01.464 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62297 tp_osd_tp ceph txt unknown /proc/60168/task/62297/exe (readlink: Permission denied) 2024-05-08T23:18:01.464 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62297 tp_osd_tp ceph NOFD /proc/60168/task/62297/fd (opendir: Permission denied) 2024-05-08T23:18:01.464 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62298 tp_osd_tp ceph cwd unknown /proc/60168/task/62298/cwd (readlink: Permission denied) 2024-05-08T23:18:01.465 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62298 tp_osd_tp ceph rtd unknown /proc/60168/task/62298/root (readlink: Permission denied) 2024-05-08T23:18:01.465 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62298 tp_osd_tp ceph txt unknown /proc/60168/task/62298/exe (readlink: Permission denied) 2024-05-08T23:18:01.465 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62298 tp_osd_tp ceph NOFD /proc/60168/task/62298/fd (opendir: Permission denied) 2024-05-08T23:18:01.465 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62300 tp_osd_tp ceph cwd unknown /proc/60168/task/62300/cwd (readlink: Permission denied) 2024-05-08T23:18:01.465 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62300 tp_osd_tp ceph rtd unknown /proc/60168/task/62300/root (readlink: Permission denied) 2024-05-08T23:18:01.465 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62300 tp_osd_tp ceph txt unknown /proc/60168/task/62300/exe (readlink: Permission denied) 2024-05-08T23:18:01.465 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62300 tp_osd_tp ceph NOFD /proc/60168/task/62300/fd (opendir: Permission denied) 2024-05-08T23:18:01.465 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62301 tp_osd_tp ceph cwd unknown /proc/60168/task/62301/cwd (readlink: Permission denied) 2024-05-08T23:18:01.465 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62301 tp_osd_tp ceph rtd unknown /proc/60168/task/62301/root (readlink: Permission denied) 2024-05-08T23:18:01.465 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62301 tp_osd_tp ceph txt unknown /proc/60168/task/62301/exe (readlink: Permission denied) 2024-05-08T23:18:01.465 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62301 tp_osd_tp ceph NOFD /proc/60168/task/62301/fd (opendir: Permission denied) 2024-05-08T23:18:01.465 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62302 osd_srv_h ceph cwd unknown /proc/60168/task/62302/cwd (readlink: Permission denied) 2024-05-08T23:18:01.465 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62302 osd_srv_h ceph rtd unknown /proc/60168/task/62302/root (readlink: Permission denied) 2024-05-08T23:18:01.465 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62302 osd_srv_h ceph txt unknown /proc/60168/task/62302/exe (readlink: Permission denied) 2024-05-08T23:18:01.466 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 60168 62302 osd_srv_h ceph NOFD /proc/60168/task/62302/fd (opendir: Permission denied) 2024-05-08T23:18:01.466 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 60502 root cwd unknown /proc/60502/cwd (readlink: Permission denied) 2024-05-08T23:18:01.466 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 60502 root rtd unknown /proc/60502/root (readlink: Permission denied) 2024-05-08T23:18:01.466 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 60502 root txt unknown /proc/60502/exe (readlink: Permission denied) 2024-05-08T23:18:01.466 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 60502 root NOFD /proc/60502/fd (opendir: Permission denied) 2024-05-08T23:18:01.466 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 60960 root cwd unknown /proc/60960/cwd (readlink: Permission denied) 2024-05-08T23:18:01.466 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 60960 root rtd unknown /proc/60960/root (readlink: Permission denied) 2024-05-08T23:18:01.466 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 60960 root txt unknown /proc/60960/exe (readlink: Permission denied) 2024-05-08T23:18:01.466 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 60960 root NOFD /proc/60960/fd (opendir: Permission denied) 2024-05-08T23:18:01.466 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 60980 root cwd unknown /proc/60980/cwd (readlink: Permission denied) 2024-05-08T23:18:01.466 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 60980 root rtd unknown /proc/60980/root (readlink: Permission denied) 2024-05-08T23:18:01.466 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 60980 root txt unknown /proc/60980/exe (readlink: Permission denied) 2024-05-08T23:18:01.466 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 60980 root NOFD /proc/60980/fd (opendir: Permission denied) 2024-05-08T23:18:01.466 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 68042 root cwd unknown /proc/68042/cwd (readlink: Permission denied) 2024-05-08T23:18:01.466 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 68042 root rtd unknown /proc/68042/root (readlink: Permission denied) 2024-05-08T23:18:01.467 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 68042 root txt unknown /proc/68042/exe (readlink: Permission denied) 2024-05-08T23:18:01.467 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 68042 root NOFD /proc/68042/fd (opendir: Permission denied) 2024-05-08T23:18:01.467 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 68054 root cwd unknown /proc/68054/cwd (readlink: Permission denied) 2024-05-08T23:18:01.467 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 68054 root rtd unknown /proc/68054/root (readlink: Permission denied) 2024-05-08T23:18:01.467 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 68054 root txt unknown /proc/68054/exe (readlink: Permission denied) 2024-05-08T23:18:01.467 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 68054 root NOFD /proc/68054/fd (opendir: Permission denied) 2024-05-08T23:18:01.467 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 ceph cwd unknown /proc/68066/cwd (readlink: Permission denied) 2024-05-08T23:18:01.467 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 ceph rtd unknown /proc/68066/root (readlink: Permission denied) 2024-05-08T23:18:01.467 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 ceph txt unknown /proc/68066/exe (readlink: Permission denied) 2024-05-08T23:18:01.467 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 ceph NOFD /proc/68066/fd (opendir: Permission denied) 2024-05-08T23:18:01.467 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68067 log ceph cwd unknown /proc/68066/task/68067/cwd (readlink: Permission denied) 2024-05-08T23:18:01.467 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68067 log ceph rtd unknown /proc/68066/task/68067/root (readlink: Permission denied) 2024-05-08T23:18:01.467 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68067 log ceph txt unknown /proc/68066/task/68067/exe (readlink: Permission denied) 2024-05-08T23:18:01.467 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68067 log ceph NOFD /proc/68066/task/68067/fd (opendir: Permission denied) 2024-05-08T23:18:01.468 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68069 msgr-work ceph cwd unknown /proc/68066/task/68069/cwd (readlink: Permission denied) 2024-05-08T23:18:01.468 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68069 msgr-work ceph rtd unknown /proc/68066/task/68069/root (readlink: Permission denied) 2024-05-08T23:18:01.468 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68069 msgr-work ceph txt unknown /proc/68066/task/68069/exe (readlink: Permission denied) 2024-05-08T23:18:01.468 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68069 msgr-work ceph NOFD /proc/68066/task/68069/fd (opendir: Permission denied) 2024-05-08T23:18:01.468 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68070 msgr-work ceph cwd unknown /proc/68066/task/68070/cwd (readlink: Permission denied) 2024-05-08T23:18:01.468 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68070 msgr-work ceph rtd unknown /proc/68066/task/68070/root (readlink: Permission denied) 2024-05-08T23:18:01.468 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68070 msgr-work ceph txt unknown /proc/68066/task/68070/exe (readlink: Permission denied) 2024-05-08T23:18:01.468 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68070 msgr-work ceph NOFD /proc/68066/task/68070/fd (opendir: Permission denied) 2024-05-08T23:18:01.468 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68071 msgr-work ceph cwd unknown /proc/68066/task/68071/cwd (readlink: Permission denied) 2024-05-08T23:18:01.468 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68071 msgr-work ceph rtd unknown /proc/68066/task/68071/root (readlink: Permission denied) 2024-05-08T23:18:01.468 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68071 msgr-work ceph txt unknown /proc/68066/task/68071/exe (readlink: Permission denied) 2024-05-08T23:18:01.468 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68071 msgr-work ceph NOFD /proc/68066/task/68071/fd (opendir: Permission denied) 2024-05-08T23:18:01.468 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68075 service ceph cwd unknown /proc/68066/task/68075/cwd (readlink: Permission denied) 2024-05-08T23:18:01.468 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68075 service ceph rtd unknown /proc/68066/task/68075/root (readlink: Permission denied) 2024-05-08T23:18:01.468 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68075 service ceph txt unknown /proc/68066/task/68075/exe (readlink: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68075 service ceph NOFD /proc/68066/task/68075/fd (opendir: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68076 admin_soc ceph cwd unknown /proc/68066/task/68076/cwd (readlink: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68076 admin_soc ceph rtd unknown /proc/68066/task/68076/root (readlink: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68076 admin_soc ceph txt unknown /proc/68066/task/68076/exe (readlink: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68076 admin_soc ceph NOFD /proc/68066/task/68076/fd (opendir: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68308 signal_ha ceph cwd unknown /proc/68066/task/68308/cwd (readlink: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68308 signal_ha ceph rtd unknown /proc/68066/task/68308/root (readlink: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68308 signal_ha ceph txt unknown /proc/68066/task/68308/exe (readlink: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68308 signal_ha ceph NOFD /proc/68066/task/68308/fd (opendir: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68309 io_contex ceph cwd unknown /proc/68066/task/68309/cwd (readlink: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68309 io_contex ceph rtd unknown /proc/68066/task/68309/root (readlink: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68309 io_contex ceph txt unknown /proc/68066/task/68309/exe (readlink: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68309 io_contex ceph NOFD /proc/68066/task/68309/fd (opendir: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68310 io_contex ceph cwd unknown /proc/68066/task/68310/cwd (readlink: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68310 io_contex ceph rtd unknown /proc/68066/task/68310/root (readlink: Permission denied) 2024-05-08T23:18:01.469 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68310 io_contex ceph txt unknown /proc/68066/task/68310/exe (readlink: Permission denied) 2024-05-08T23:18:01.470 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68310 io_contex ceph NOFD /proc/68066/task/68310/fd (opendir: Permission denied) 2024-05-08T23:18:01.470 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68374 OpHistory ceph cwd unknown /proc/68066/task/68374/cwd (readlink: Permission denied) 2024-05-08T23:18:01.470 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68374 OpHistory ceph rtd unknown /proc/68066/task/68374/root (readlink: Permission denied) 2024-05-08T23:18:01.470 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68374 OpHistory ceph txt unknown /proc/68066/task/68374/exe (readlink: Permission denied) 2024-05-08T23:18:01.470 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68374 OpHistory ceph NOFD /proc/68066/task/68374/fd (opendir: Permission denied) 2024-05-08T23:18:01.470 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68375 ceph_time ceph cwd unknown /proc/68066/task/68375/cwd (readlink: Permission denied) 2024-05-08T23:18:01.470 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68375 ceph_time ceph rtd unknown /proc/68066/task/68375/root (readlink: Permission denied) 2024-05-08T23:18:01.470 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68375 ceph_time ceph txt unknown /proc/68066/task/68375/exe (readlink: Permission denied) 2024-05-08T23:18:01.470 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68375 ceph_time ceph NOFD /proc/68066/task/68375/fd (opendir: Permission denied) 2024-05-08T23:18:01.470 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68406 ceph-osd ceph cwd unknown /proc/68066/task/68406/cwd (readlink: Permission denied) 2024-05-08T23:18:01.470 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68406 ceph-osd ceph rtd unknown /proc/68066/task/68406/root (readlink: Permission denied) 2024-05-08T23:18:01.470 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68406 ceph-osd ceph txt unknown /proc/68066/task/68406/exe (readlink: Permission denied) 2024-05-08T23:18:01.470 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68406 ceph-osd ceph NOFD /proc/68066/task/68406/fd (opendir: Permission denied) 2024-05-08T23:18:01.470 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68463 ceph-osd ceph cwd unknown /proc/68066/task/68463/cwd (readlink: Permission denied) 2024-05-08T23:18:01.471 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68463 ceph-osd ceph rtd unknown /proc/68066/task/68463/root (readlink: Permission denied) 2024-05-08T23:18:01.471 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68463 ceph-osd ceph txt unknown /proc/68066/task/68463/exe (readlink: Permission denied) 2024-05-08T23:18:01.471 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68463 ceph-osd ceph NOFD /proc/68066/task/68463/fd (opendir: Permission denied) 2024-05-08T23:18:01.471 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68542 ceph-osd ceph cwd unknown /proc/68066/task/68542/cwd (readlink: Permission denied) 2024-05-08T23:18:01.471 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68542 ceph-osd ceph rtd unknown /proc/68066/task/68542/root (readlink: Permission denied) 2024-05-08T23:18:01.471 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68542 ceph-osd ceph txt unknown /proc/68066/task/68542/exe (readlink: Permission denied) 2024-05-08T23:18:01.471 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68542 ceph-osd ceph NOFD /proc/68066/task/68542/fd (opendir: Permission denied) 2024-05-08T23:18:01.471 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68587 ceph-osd ceph cwd unknown /proc/68066/task/68587/cwd (readlink: Permission denied) 2024-05-08T23:18:01.471 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68587 ceph-osd ceph rtd unknown /proc/68066/task/68587/root (readlink: Permission denied) 2024-05-08T23:18:01.471 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68587 ceph-osd ceph txt unknown /proc/68066/task/68587/exe (readlink: Permission denied) 2024-05-08T23:18:01.471 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68587 ceph-osd ceph NOFD /proc/68066/task/68587/fd (opendir: Permission denied) 2024-05-08T23:18:01.471 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68628 ceph-osd ceph cwd unknown /proc/68066/task/68628/cwd (readlink: Permission denied) 2024-05-08T23:18:01.471 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68628 ceph-osd ceph rtd unknown /proc/68066/task/68628/root (readlink: Permission denied) 2024-05-08T23:18:01.471 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68628 ceph-osd ceph txt unknown /proc/68066/task/68628/exe (readlink: Permission denied) 2024-05-08T23:18:01.471 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68628 ceph-osd ceph NOFD /proc/68066/task/68628/fd (opendir: Permission denied) 2024-05-08T23:18:01.472 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68641 ceph-osd ceph cwd unknown /proc/68066/task/68641/cwd (readlink: Permission denied) 2024-05-08T23:18:01.472 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68641 ceph-osd ceph rtd unknown /proc/68066/task/68641/root (readlink: Permission denied) 2024-05-08T23:18:01.472 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68641 ceph-osd ceph txt unknown /proc/68066/task/68641/exe (readlink: Permission denied) 2024-05-08T23:18:01.472 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68641 ceph-osd ceph NOFD /proc/68066/task/68641/fd (opendir: Permission denied) 2024-05-08T23:18:01.472 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68731 ceph-osd ceph cwd unknown /proc/68066/task/68731/cwd (readlink: Permission denied) 2024-05-08T23:18:01.472 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68731 ceph-osd ceph rtd unknown /proc/68066/task/68731/root (readlink: Permission denied) 2024-05-08T23:18:01.472 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68731 ceph-osd ceph txt unknown /proc/68066/task/68731/exe (readlink: Permission denied) 2024-05-08T23:18:01.472 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68731 ceph-osd ceph NOFD /proc/68066/task/68731/fd (opendir: Permission denied) 2024-05-08T23:18:01.472 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68789 ceph-osd ceph cwd unknown /proc/68066/task/68789/cwd (readlink: Permission denied) 2024-05-08T23:18:01.472 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68789 ceph-osd ceph rtd unknown /proc/68066/task/68789/root (readlink: Permission denied) 2024-05-08T23:18:01.472 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68789 ceph-osd ceph txt unknown /proc/68066/task/68789/exe (readlink: Permission denied) 2024-05-08T23:18:01.472 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68789 ceph-osd ceph NOFD /proc/68066/task/68789/fd (opendir: Permission denied) 2024-05-08T23:18:01.472 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68791 ceph-osd ceph cwd unknown /proc/68066/task/68791/cwd (readlink: Permission denied) 2024-05-08T23:18:01.472 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68791 ceph-osd ceph rtd unknown /proc/68066/task/68791/root (readlink: Permission denied) 2024-05-08T23:18:01.472 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68791 ceph-osd ceph txt unknown /proc/68066/task/68791/exe (readlink: Permission denied) 2024-05-08T23:18:01.473 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68791 ceph-osd ceph NOFD /proc/68066/task/68791/fd (opendir: Permission denied) 2024-05-08T23:18:01.473 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68792 safe_time ceph cwd unknown /proc/68066/task/68792/cwd (readlink: Permission denied) 2024-05-08T23:18:01.473 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68792 safe_time ceph rtd unknown /proc/68066/task/68792/root (readlink: Permission denied) 2024-05-08T23:18:01.473 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68792 safe_time ceph txt unknown /proc/68066/task/68792/exe (readlink: Permission denied) 2024-05-08T23:18:01.473 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68792 safe_time ceph NOFD /proc/68066/task/68792/fd (opendir: Permission denied) 2024-05-08T23:18:01.473 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68793 safe_time ceph cwd unknown /proc/68066/task/68793/cwd (readlink: Permission denied) 2024-05-08T23:18:01.473 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68793 safe_time ceph rtd unknown /proc/68066/task/68793/root (readlink: Permission denied) 2024-05-08T23:18:01.473 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68793 safe_time ceph txt unknown /proc/68066/task/68793/exe (readlink: Permission denied) 2024-05-08T23:18:01.473 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68793 safe_time ceph NOFD /proc/68066/task/68793/fd (opendir: Permission denied) 2024-05-08T23:18:01.473 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68795 safe_time ceph cwd unknown /proc/68066/task/68795/cwd (readlink: Permission denied) 2024-05-08T23:18:01.473 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68795 safe_time ceph rtd unknown /proc/68066/task/68795/root (readlink: Permission denied) 2024-05-08T23:18:01.473 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68795 safe_time ceph txt unknown /proc/68066/task/68795/exe (readlink: Permission denied) 2024-05-08T23:18:01.473 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68795 safe_time ceph NOFD /proc/68066/task/68795/fd (opendir: Permission denied) 2024-05-08T23:18:01.473 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68796 safe_time ceph cwd unknown /proc/68066/task/68796/cwd (readlink: Permission denied) 2024-05-08T23:18:01.473 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68796 safe_time ceph rtd unknown /proc/68066/task/68796/root (readlink: Permission denied) 2024-05-08T23:18:01.474 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68796 safe_time ceph txt unknown /proc/68066/task/68796/exe (readlink: Permission denied) 2024-05-08T23:18:01.474 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68796 safe_time ceph NOFD /proc/68066/task/68796/fd (opendir: Permission denied) 2024-05-08T23:18:01.474 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68797 fn_anonym ceph cwd unknown /proc/68066/task/68797/cwd (readlink: Permission denied) 2024-05-08T23:18:01.474 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68797 fn_anonym ceph rtd unknown /proc/68066/task/68797/root (readlink: Permission denied) 2024-05-08T23:18:01.474 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68797 fn_anonym ceph txt unknown /proc/68066/task/68797/exe (readlink: Permission denied) 2024-05-08T23:18:01.474 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68797 fn_anonym ceph NOFD /proc/68066/task/68797/fd (opendir: Permission denied) 2024-05-08T23:18:01.474 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68800 rocksdb:l ceph cwd unknown /proc/68066/task/68800/cwd (readlink: Permission denied) 2024-05-08T23:18:01.474 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68800 rocksdb:l ceph rtd unknown /proc/68066/task/68800/root (readlink: Permission denied) 2024-05-08T23:18:01.474 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68800 rocksdb:l ceph txt unknown /proc/68066/task/68800/exe (readlink: Permission denied) 2024-05-08T23:18:01.474 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68800 rocksdb:l ceph NOFD /proc/68066/task/68800/fd (opendir: Permission denied) 2024-05-08T23:18:01.474 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68801 rocksdb:l ceph cwd unknown /proc/68066/task/68801/cwd (readlink: Permission denied) 2024-05-08T23:18:01.474 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68801 rocksdb:l ceph rtd unknown /proc/68066/task/68801/root (readlink: Permission denied) 2024-05-08T23:18:01.474 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68801 rocksdb:l ceph txt unknown /proc/68066/task/68801/exe (readlink: Permission denied) 2024-05-08T23:18:01.474 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68801 rocksdb:l ceph NOFD /proc/68066/task/68801/fd (opendir: Permission denied) 2024-05-08T23:18:01.475 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68802 rocksdb:l ceph cwd unknown /proc/68066/task/68802/cwd (readlink: Permission denied) 2024-05-08T23:18:01.475 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68802 rocksdb:l ceph rtd unknown /proc/68066/task/68802/root (readlink: Permission denied) 2024-05-08T23:18:01.475 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68802 rocksdb:l ceph txt unknown /proc/68066/task/68802/exe (readlink: Permission denied) 2024-05-08T23:18:01.475 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68802 rocksdb:l ceph NOFD /proc/68066/task/68802/fd (opendir: Permission denied) 2024-05-08T23:18:01.475 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68803 rocksdb:h ceph cwd unknown /proc/68066/task/68803/cwd (readlink: Permission denied) 2024-05-08T23:18:01.475 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68803 rocksdb:h ceph rtd unknown /proc/68066/task/68803/root (readlink: Permission denied) 2024-05-08T23:18:01.475 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68803 rocksdb:h ceph txt unknown /proc/68066/task/68803/exe (readlink: Permission denied) 2024-05-08T23:18:01.475 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 68803 rocksdb:h ceph NOFD /proc/68066/task/68803/fd (opendir: Permission denied) 2024-05-08T23:18:01.475 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69280 bstore_ai ceph cwd unknown /proc/68066/task/69280/cwd (readlink: Permission denied) 2024-05-08T23:18:01.475 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69280 bstore_ai ceph rtd unknown /proc/68066/task/69280/root (readlink: Permission denied) 2024-05-08T23:18:01.475 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69280 bstore_ai ceph txt unknown /proc/68066/task/69280/exe (readlink: Permission denied) 2024-05-08T23:18:01.475 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69280 bstore_ai ceph NOFD /proc/68066/task/69280/fd (opendir: Permission denied) 2024-05-08T23:18:01.475 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69477 bstore_ai ceph cwd unknown /proc/68066/task/69477/cwd (readlink: Permission denied) 2024-05-08T23:18:01.475 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69477 bstore_ai ceph rtd unknown /proc/68066/task/69477/root (readlink: Permission denied) 2024-05-08T23:18:01.475 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69477 bstore_ai ceph txt unknown /proc/68066/task/69477/exe (readlink: Permission denied) 2024-05-08T23:18:01.476 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69477 bstore_ai ceph NOFD /proc/68066/task/69477/fd (opendir: Permission denied) 2024-05-08T23:18:01.476 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69660 ceph-osd ceph cwd unknown /proc/68066/task/69660/cwd (readlink: Permission denied) 2024-05-08T23:18:01.476 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69660 ceph-osd ceph rtd unknown /proc/68066/task/69660/root (readlink: Permission denied) 2024-05-08T23:18:01.476 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69660 ceph-osd ceph txt unknown /proc/68066/task/69660/exe (readlink: Permission denied) 2024-05-08T23:18:01.476 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69660 ceph-osd ceph NOFD /proc/68066/task/69660/fd (opendir: Permission denied) 2024-05-08T23:18:01.476 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69661 cfin ceph cwd unknown /proc/68066/task/69661/cwd (readlink: Permission denied) 2024-05-08T23:18:01.476 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69661 cfin ceph rtd unknown /proc/68066/task/69661/root (readlink: Permission denied) 2024-05-08T23:18:01.476 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69661 cfin ceph txt unknown /proc/68066/task/69661/exe (readlink: Permission denied) 2024-05-08T23:18:01.476 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69661 cfin ceph NOFD /proc/68066/task/69661/fd (opendir: Permission denied) 2024-05-08T23:18:01.476 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69662 bstore_kv ceph cwd unknown /proc/68066/task/69662/cwd (readlink: Permission denied) 2024-05-08T23:18:01.476 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69662 bstore_kv ceph rtd unknown /proc/68066/task/69662/root (readlink: Permission denied) 2024-05-08T23:18:01.476 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69662 bstore_kv ceph txt unknown /proc/68066/task/69662/exe (readlink: Permission denied) 2024-05-08T23:18:01.476 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69662 bstore_kv ceph NOFD /proc/68066/task/69662/fd (opendir: Permission denied) 2024-05-08T23:18:01.476 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69663 bstore_kv ceph cwd unknown /proc/68066/task/69663/cwd (readlink: Permission denied) 2024-05-08T23:18:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69663 bstore_kv ceph rtd unknown /proc/68066/task/69663/root (readlink: Permission denied) 2024-05-08T23:18:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69663 bstore_kv ceph txt unknown /proc/68066/task/69663/exe (readlink: Permission denied) 2024-05-08T23:18:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69663 bstore_kv ceph NOFD /proc/68066/task/69663/fd (opendir: Permission denied) 2024-05-08T23:18:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69664 bstore_me ceph cwd unknown /proc/68066/task/69664/cwd (readlink: Permission denied) 2024-05-08T23:18:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69664 bstore_me ceph rtd unknown /proc/68066/task/69664/root (readlink: Permission denied) 2024-05-08T23:18:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69664 bstore_me ceph txt unknown /proc/68066/task/69664/exe (readlink: Permission denied) 2024-05-08T23:18:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69664 bstore_me ceph NOFD /proc/68066/task/69664/fd (opendir: Permission denied) 2024-05-08T23:18:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69667 ms_dispat ceph cwd unknown /proc/68066/task/69667/cwd (readlink: Permission denied) 2024-05-08T23:18:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69667 ms_dispat ceph rtd unknown /proc/68066/task/69667/root (readlink: Permission denied) 2024-05-08T23:18:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69667 ms_dispat ceph txt unknown /proc/68066/task/69667/exe (readlink: Permission denied) 2024-05-08T23:18:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69667 ms_dispat ceph NOFD /proc/68066/task/69667/fd (opendir: Permission denied) 2024-05-08T23:18:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69668 ms_local ceph cwd unknown /proc/68066/task/69668/cwd (readlink: Permission denied) 2024-05-08T23:18:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69668 ms_local ceph rtd unknown /proc/68066/task/69668/root (readlink: Permission denied) 2024-05-08T23:18:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69668 ms_local ceph txt unknown /proc/68066/task/69668/exe (readlink: Permission denied) 2024-05-08T23:18:01.477 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69668 ms_local ceph NOFD /proc/68066/task/69668/fd (opendir: Permission denied) 2024-05-08T23:18:01.478 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69669 safe_time ceph cwd unknown /proc/68066/task/69669/cwd (readlink: Permission denied) 2024-05-08T23:18:01.478 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69669 safe_time ceph rtd unknown /proc/68066/task/69669/root (readlink: Permission denied) 2024-05-08T23:18:01.478 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69669 safe_time ceph txt unknown /proc/68066/task/69669/exe (readlink: Permission denied) 2024-05-08T23:18:01.478 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69669 safe_time ceph NOFD /proc/68066/task/69669/fd (opendir: Permission denied) 2024-05-08T23:18:01.478 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69670 safe_time ceph cwd unknown /proc/68066/task/69670/cwd (readlink: Permission denied) 2024-05-08T23:18:01.478 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69670 safe_time ceph rtd unknown /proc/68066/task/69670/root (readlink: Permission denied) 2024-05-08T23:18:01.478 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69670 safe_time ceph txt unknown /proc/68066/task/69670/exe (readlink: Permission denied) 2024-05-08T23:18:01.478 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69670 safe_time ceph NOFD /proc/68066/task/69670/fd (opendir: Permission denied) 2024-05-08T23:18:01.478 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69671 ms_dispat ceph cwd unknown /proc/68066/task/69671/cwd (readlink: Permission denied) 2024-05-08T23:18:01.478 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69671 ms_dispat ceph rtd unknown /proc/68066/task/69671/root (readlink: Permission denied) 2024-05-08T23:18:01.478 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69671 ms_dispat ceph txt unknown /proc/68066/task/69671/exe (readlink: Permission denied) 2024-05-08T23:18:01.478 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69671 ms_dispat ceph NOFD /proc/68066/task/69671/fd (opendir: Permission denied) 2024-05-08T23:18:01.478 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69672 ms_local ceph cwd unknown /proc/68066/task/69672/cwd (readlink: Permission denied) 2024-05-08T23:18:01.478 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69672 ms_local ceph rtd unknown /proc/68066/task/69672/root (readlink: Permission denied) 2024-05-08T23:18:01.479 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69672 ms_local ceph txt unknown /proc/68066/task/69672/exe (readlink: Permission denied) 2024-05-08T23:18:01.479 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69672 ms_local ceph NOFD /proc/68066/task/69672/fd (opendir: Permission denied) 2024-05-08T23:18:01.479 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69673 ms_dispat ceph cwd unknown /proc/68066/task/69673/cwd (readlink: Permission denied) 2024-05-08T23:18:01.479 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69673 ms_dispat ceph rtd unknown /proc/68066/task/69673/root (readlink: Permission denied) 2024-05-08T23:18:01.479 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69673 ms_dispat ceph txt unknown /proc/68066/task/69673/exe (readlink: Permission denied) 2024-05-08T23:18:01.479 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69673 ms_dispat ceph NOFD /proc/68066/task/69673/fd (opendir: Permission denied) 2024-05-08T23:18:01.479 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69674 ms_local ceph cwd unknown /proc/68066/task/69674/cwd (readlink: Permission denied) 2024-05-08T23:18:01.479 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69674 ms_local ceph rtd unknown /proc/68066/task/69674/root (readlink: Permission denied) 2024-05-08T23:18:01.479 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69674 ms_local ceph txt unknown /proc/68066/task/69674/exe (readlink: Permission denied) 2024-05-08T23:18:01.479 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69674 ms_local ceph NOFD /proc/68066/task/69674/fd (opendir: Permission denied) 2024-05-08T23:18:01.479 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69675 ms_dispat ceph cwd unknown /proc/68066/task/69675/cwd (readlink: Permission denied) 2024-05-08T23:18:01.479 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69675 ms_dispat ceph rtd unknown /proc/68066/task/69675/root (readlink: Permission denied) 2024-05-08T23:18:01.479 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69675 ms_dispat ceph txt unknown /proc/68066/task/69675/exe (readlink: Permission denied) 2024-05-08T23:18:01.479 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69675 ms_dispat ceph NOFD /proc/68066/task/69675/fd (opendir: Permission denied) 2024-05-08T23:18:01.479 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69676 ms_local ceph cwd unknown /proc/68066/task/69676/cwd (readlink: Permission denied) 2024-05-08T23:18:01.480 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69676 ms_local ceph rtd unknown /proc/68066/task/69676/root (readlink: Permission denied) 2024-05-08T23:18:01.480 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69676 ms_local ceph txt unknown /proc/68066/task/69676/exe (readlink: Permission denied) 2024-05-08T23:18:01.480 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69676 ms_local ceph NOFD /proc/68066/task/69676/fd (opendir: Permission denied) 2024-05-08T23:18:01.480 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69677 ms_dispat ceph cwd unknown /proc/68066/task/69677/cwd (readlink: Permission denied) 2024-05-08T23:18:01.480 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69677 ms_dispat ceph rtd unknown /proc/68066/task/69677/root (readlink: Permission denied) 2024-05-08T23:18:01.480 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69677 ms_dispat ceph txt unknown /proc/68066/task/69677/exe (readlink: Permission denied) 2024-05-08T23:18:01.480 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69677 ms_dispat ceph NOFD /proc/68066/task/69677/fd (opendir: Permission denied) 2024-05-08T23:18:01.480 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69678 ms_local ceph cwd unknown /proc/68066/task/69678/cwd (readlink: Permission denied) 2024-05-08T23:18:01.480 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69678 ms_local ceph rtd unknown /proc/68066/task/69678/root (readlink: Permission denied) 2024-05-08T23:18:01.480 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69678 ms_local ceph txt unknown /proc/68066/task/69678/exe (readlink: Permission denied) 2024-05-08T23:18:01.480 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69678 ms_local ceph NOFD /proc/68066/task/69678/fd (opendir: Permission denied) 2024-05-08T23:18:01.480 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69679 ms_dispat ceph cwd unknown /proc/68066/task/69679/cwd (readlink: Permission denied) 2024-05-08T23:18:01.480 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69679 ms_dispat ceph rtd unknown /proc/68066/task/69679/root (readlink: Permission denied) 2024-05-08T23:18:01.480 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69679 ms_dispat ceph txt unknown /proc/68066/task/69679/exe (readlink: Permission denied) 2024-05-08T23:18:01.480 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69679 ms_dispat ceph NOFD /proc/68066/task/69679/fd (opendir: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69680 ms_local ceph cwd unknown /proc/68066/task/69680/cwd (readlink: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69680 ms_local ceph rtd unknown /proc/68066/task/69680/root (readlink: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69680 ms_local ceph txt unknown /proc/68066/task/69680/exe (readlink: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69680 ms_local ceph NOFD /proc/68066/task/69680/fd (opendir: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69681 ms_dispat ceph cwd unknown /proc/68066/task/69681/cwd (readlink: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69681 ms_dispat ceph rtd unknown /proc/68066/task/69681/root (readlink: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69681 ms_dispat ceph txt unknown /proc/68066/task/69681/exe (readlink: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69681 ms_dispat ceph NOFD /proc/68066/task/69681/fd (opendir: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69682 ms_local ceph cwd unknown /proc/68066/task/69682/cwd (readlink: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69682 ms_local ceph rtd unknown /proc/68066/task/69682/root (readlink: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69682 ms_local ceph txt unknown /proc/68066/task/69682/exe (readlink: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69682 ms_local ceph NOFD /proc/68066/task/69682/fd (opendir: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69683 fn_anonym ceph cwd unknown /proc/68066/task/69683/cwd (readlink: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69683 fn_anonym ceph rtd unknown /proc/68066/task/69683/root (readlink: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69683 fn_anonym ceph txt unknown /proc/68066/task/69683/exe (readlink: Permission denied) 2024-05-08T23:18:01.481 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69683 fn_anonym ceph NOFD /proc/68066/task/69683/fd (opendir: Permission denied) 2024-05-08T23:18:01.482 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69684 finisher ceph cwd unknown /proc/68066/task/69684/cwd (readlink: Permission denied) 2024-05-08T23:18:01.482 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69684 finisher ceph rtd unknown /proc/68066/task/69684/root (readlink: Permission denied) 2024-05-08T23:18:01.482 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69684 finisher ceph txt unknown /proc/68066/task/69684/exe (readlink: Permission denied) 2024-05-08T23:18:01.482 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69684 finisher ceph NOFD /proc/68066/task/69684/fd (opendir: Permission denied) 2024-05-08T23:18:01.482 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69685 safe_time ceph cwd unknown /proc/68066/task/69685/cwd (readlink: Permission denied) 2024-05-08T23:18:01.482 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69685 safe_time ceph rtd unknown /proc/68066/task/69685/root (readlink: Permission denied) 2024-05-08T23:18:01.482 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69685 safe_time ceph txt unknown /proc/68066/task/69685/exe (readlink: Permission denied) 2024-05-08T23:18:01.482 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69685 safe_time ceph NOFD /proc/68066/task/69685/fd (opendir: Permission denied) 2024-05-08T23:18:01.482 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69686 safe_time ceph cwd unknown /proc/68066/task/69686/cwd (readlink: Permission denied) 2024-05-08T23:18:01.482 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69686 safe_time ceph rtd unknown /proc/68066/task/69686/root (readlink: Permission denied) 2024-05-08T23:18:01.482 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69686 safe_time ceph txt unknown /proc/68066/task/69686/exe (readlink: Permission denied) 2024-05-08T23:18:01.482 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69686 safe_time ceph NOFD /proc/68066/task/69686/fd (opendir: Permission denied) 2024-05-08T23:18:01.482 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69687 ceph-osd ceph cwd unknown /proc/68066/task/69687/cwd (readlink: Permission denied) 2024-05-08T23:18:01.482 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69687 ceph-osd ceph rtd unknown /proc/68066/task/69687/root (readlink: Permission denied) 2024-05-08T23:18:01.483 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69687 ceph-osd ceph txt unknown /proc/68066/task/69687/exe (readlink: Permission denied) 2024-05-08T23:18:01.483 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69687 ceph-osd ceph NOFD /proc/68066/task/69687/fd (opendir: Permission denied) 2024-05-08T23:18:01.483 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69688 osd_srv_a ceph cwd unknown /proc/68066/task/69688/cwd (readlink: Permission denied) 2024-05-08T23:18:01.483 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69688 osd_srv_a ceph rtd unknown /proc/68066/task/69688/root (readlink: Permission denied) 2024-05-08T23:18:01.483 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69688 osd_srv_a ceph txt unknown /proc/68066/task/69688/exe (readlink: Permission denied) 2024-05-08T23:18:01.483 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69688 osd_srv_a ceph NOFD /proc/68066/task/69688/fd (opendir: Permission denied) 2024-05-08T23:18:01.483 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69689 tp_osd_tp ceph cwd unknown /proc/68066/task/69689/cwd (readlink: Permission denied) 2024-05-08T23:18:01.483 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69689 tp_osd_tp ceph rtd unknown /proc/68066/task/69689/root (readlink: Permission denied) 2024-05-08T23:18:01.483 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69689 tp_osd_tp ceph txt unknown /proc/68066/task/69689/exe (readlink: Permission denied) 2024-05-08T23:18:01.483 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69689 tp_osd_tp ceph NOFD /proc/68066/task/69689/fd (opendir: Permission denied) 2024-05-08T23:18:01.483 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69690 tp_osd_tp ceph cwd unknown /proc/68066/task/69690/cwd (readlink: Permission denied) 2024-05-08T23:18:01.483 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69690 tp_osd_tp ceph rtd unknown /proc/68066/task/69690/root (readlink: Permission denied) 2024-05-08T23:18:01.483 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69690 tp_osd_tp ceph txt unknown /proc/68066/task/69690/exe (readlink: Permission denied) 2024-05-08T23:18:01.483 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69690 tp_osd_tp ceph NOFD /proc/68066/task/69690/fd (opendir: Permission denied) 2024-05-08T23:18:01.483 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69691 tp_osd_tp ceph cwd unknown /proc/68066/task/69691/cwd (readlink: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69691 tp_osd_tp ceph rtd unknown /proc/68066/task/69691/root (readlink: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69691 tp_osd_tp ceph txt unknown /proc/68066/task/69691/exe (readlink: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69691 tp_osd_tp ceph NOFD /proc/68066/task/69691/fd (opendir: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69692 tp_osd_tp ceph cwd unknown /proc/68066/task/69692/cwd (readlink: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69692 tp_osd_tp ceph rtd unknown /proc/68066/task/69692/root (readlink: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69692 tp_osd_tp ceph txt unknown /proc/68066/task/69692/exe (readlink: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69692 tp_osd_tp ceph NOFD /proc/68066/task/69692/fd (opendir: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69693 tp_osd_tp ceph cwd unknown /proc/68066/task/69693/cwd (readlink: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69693 tp_osd_tp ceph rtd unknown /proc/68066/task/69693/root (readlink: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69693 tp_osd_tp ceph txt unknown /proc/68066/task/69693/exe (readlink: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69693 tp_osd_tp ceph NOFD /proc/68066/task/69693/fd (opendir: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69694 tp_osd_tp ceph cwd unknown /proc/68066/task/69694/cwd (readlink: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69694 tp_osd_tp ceph rtd unknown /proc/68066/task/69694/root (readlink: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69694 tp_osd_tp ceph txt unknown /proc/68066/task/69694/exe (readlink: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69694 tp_osd_tp ceph NOFD /proc/68066/task/69694/fd (opendir: Permission denied) 2024-05-08T23:18:01.484 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69695 tp_osd_tp ceph cwd unknown /proc/68066/task/69695/cwd (readlink: Permission denied) 2024-05-08T23:18:01.485 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69695 tp_osd_tp ceph rtd unknown /proc/68066/task/69695/root (readlink: Permission denied) 2024-05-08T23:18:01.485 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69695 tp_osd_tp ceph txt unknown /proc/68066/task/69695/exe (readlink: Permission denied) 2024-05-08T23:18:01.485 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69695 tp_osd_tp ceph NOFD /proc/68066/task/69695/fd (opendir: Permission denied) 2024-05-08T23:18:01.485 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69696 tp_osd_tp ceph cwd unknown /proc/68066/task/69696/cwd (readlink: Permission denied) 2024-05-08T23:18:01.485 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69696 tp_osd_tp ceph rtd unknown /proc/68066/task/69696/root (readlink: Permission denied) 2024-05-08T23:18:01.485 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69696 tp_osd_tp ceph txt unknown /proc/68066/task/69696/exe (readlink: Permission denied) 2024-05-08T23:18:01.485 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69696 tp_osd_tp ceph NOFD /proc/68066/task/69696/fd (opendir: Permission denied) 2024-05-08T23:18:01.485 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69697 tp_osd_tp ceph cwd unknown /proc/68066/task/69697/cwd (readlink: Permission denied) 2024-05-08T23:18:01.485 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69697 tp_osd_tp ceph rtd unknown /proc/68066/task/69697/root (readlink: Permission denied) 2024-05-08T23:18:01.485 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69697 tp_osd_tp ceph txt unknown /proc/68066/task/69697/exe (readlink: Permission denied) 2024-05-08T23:18:01.485 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69697 tp_osd_tp ceph NOFD /proc/68066/task/69697/fd (opendir: Permission denied) 2024-05-08T23:18:01.485 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69698 tp_osd_tp ceph cwd unknown /proc/68066/task/69698/cwd (readlink: Permission denied) 2024-05-08T23:18:01.485 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69698 tp_osd_tp ceph rtd unknown /proc/68066/task/69698/root (readlink: Permission denied) 2024-05-08T23:18:01.485 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69698 tp_osd_tp ceph txt unknown /proc/68066/task/69698/exe (readlink: Permission denied) 2024-05-08T23:18:01.486 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69698 tp_osd_tp ceph NOFD /proc/68066/task/69698/fd (opendir: Permission denied) 2024-05-08T23:18:01.486 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69699 tp_osd_tp ceph cwd unknown /proc/68066/task/69699/cwd (readlink: Permission denied) 2024-05-08T23:18:01.486 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69699 tp_osd_tp ceph rtd unknown /proc/68066/task/69699/root (readlink: Permission denied) 2024-05-08T23:18:01.486 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69699 tp_osd_tp ceph txt unknown /proc/68066/task/69699/exe (readlink: Permission denied) 2024-05-08T23:18:01.486 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69699 tp_osd_tp ceph NOFD /proc/68066/task/69699/fd (opendir: Permission denied) 2024-05-08T23:18:01.486 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69700 tp_osd_tp ceph cwd unknown /proc/68066/task/69700/cwd (readlink: Permission denied) 2024-05-08T23:18:01.486 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69700 tp_osd_tp ceph rtd unknown /proc/68066/task/69700/root (readlink: Permission denied) 2024-05-08T23:18:01.486 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69700 tp_osd_tp ceph txt unknown /proc/68066/task/69700/exe (readlink: Permission denied) 2024-05-08T23:18:01.486 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69700 tp_osd_tp ceph NOFD /proc/68066/task/69700/fd (opendir: Permission denied) 2024-05-08T23:18:01.486 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69701 tp_osd_tp ceph cwd unknown /proc/68066/task/69701/cwd (readlink: Permission denied) 2024-05-08T23:18:01.486 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69701 tp_osd_tp ceph rtd unknown /proc/68066/task/69701/root (readlink: Permission denied) 2024-05-08T23:18:01.486 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69701 tp_osd_tp ceph txt unknown /proc/68066/task/69701/exe (readlink: Permission denied) 2024-05-08T23:18:01.486 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69701 tp_osd_tp ceph NOFD /proc/68066/task/69701/fd (opendir: Permission denied) 2024-05-08T23:18:01.486 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69702 tp_osd_tp ceph cwd unknown /proc/68066/task/69702/cwd (readlink: Permission denied) 2024-05-08T23:18:01.486 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69702 tp_osd_tp ceph rtd unknown /proc/68066/task/69702/root (readlink: Permission denied) 2024-05-08T23:18:01.487 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69702 tp_osd_tp ceph txt unknown /proc/68066/task/69702/exe (readlink: Permission denied) 2024-05-08T23:18:01.487 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69702 tp_osd_tp ceph NOFD /proc/68066/task/69702/fd (opendir: Permission denied) 2024-05-08T23:18:01.487 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69703 tp_osd_tp ceph cwd unknown /proc/68066/task/69703/cwd (readlink: Permission denied) 2024-05-08T23:18:01.487 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69703 tp_osd_tp ceph rtd unknown /proc/68066/task/69703/root (readlink: Permission denied) 2024-05-08T23:18:01.487 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69703 tp_osd_tp ceph txt unknown /proc/68066/task/69703/exe (readlink: Permission denied) 2024-05-08T23:18:01.487 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69703 tp_osd_tp ceph NOFD /proc/68066/task/69703/fd (opendir: Permission denied) 2024-05-08T23:18:01.487 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69704 tp_osd_tp ceph cwd unknown /proc/68066/task/69704/cwd (readlink: Permission denied) 2024-05-08T23:18:01.487 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69704 tp_osd_tp ceph rtd unknown /proc/68066/task/69704/root (readlink: Permission denied) 2024-05-08T23:18:01.487 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69704 tp_osd_tp ceph txt unknown /proc/68066/task/69704/exe (readlink: Permission denied) 2024-05-08T23:18:01.487 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69704 tp_osd_tp ceph NOFD /proc/68066/task/69704/fd (opendir: Permission denied) 2024-05-08T23:18:01.487 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69705 osd_srv_h ceph cwd unknown /proc/68066/task/69705/cwd (readlink: Permission denied) 2024-05-08T23:18:01.487 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69705 osd_srv_h ceph rtd unknown /proc/68066/task/69705/root (readlink: Permission denied) 2024-05-08T23:18:01.487 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69705 osd_srv_h ceph txt unknown /proc/68066/task/69705/exe (readlink: Permission denied) 2024-05-08T23:18:01.487 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 68066 69705 osd_srv_h ceph NOFD /proc/68066/task/69705/fd (opendir: Permission denied) 2024-05-08T23:18:01.487 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 68985 root cwd unknown /proc/68985/cwd (readlink: Permission denied) 2024-05-08T23:18:01.488 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 68985 root rtd unknown /proc/68985/root (readlink: Permission denied) 2024-05-08T23:18:01.488 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 68985 root txt unknown /proc/68985/exe (readlink: Permission denied) 2024-05-08T23:18:01.488 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 68985 root NOFD /proc/68985/fd (opendir: Permission denied) 2024-05-08T23:18:01.488 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 69023 root cwd unknown /proc/69023/cwd (readlink: Permission denied) 2024-05-08T23:18:01.488 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 69023 root rtd unknown /proc/69023/root (readlink: Permission denied) 2024-05-08T23:18:01.488 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 69023 root txt unknown /proc/69023/exe (readlink: Permission denied) 2024-05-08T23:18:01.488 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 69023 root NOFD /proc/69023/fd (opendir: Permission denied) 2024-05-08T23:18:01.488 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 76606 root cwd unknown /proc/76606/cwd (readlink: Permission denied) 2024-05-08T23:18:01.488 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 76606 root rtd unknown /proc/76606/root (readlink: Permission denied) 2024-05-08T23:18:01.488 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 76606 root txt unknown /proc/76606/exe (readlink: Permission denied) 2024-05-08T23:18:01.488 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 76606 root NOFD /proc/76606/fd (opendir: Permission denied) 2024-05-08T23:18:01.488 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 76617 root cwd unknown /proc/76617/cwd (readlink: Permission denied) 2024-05-08T23:18:01.488 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 76617 root rtd unknown /proc/76617/root (readlink: Permission denied) 2024-05-08T23:18:01.488 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 76617 root txt unknown /proc/76617/exe (readlink: Permission denied) 2024-05-08T23:18:01.488 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 76617 root NOFD /proc/76617/fd (opendir: Permission denied) 2024-05-08T23:18:01.489 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 ceph cwd unknown /proc/76629/cwd (readlink: Permission denied) 2024-05-08T23:18:01.489 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 ceph rtd unknown /proc/76629/root (readlink: Permission denied) 2024-05-08T23:18:01.489 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 ceph txt unknown /proc/76629/exe (readlink: Permission denied) 2024-05-08T23:18:01.489 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 ceph NOFD /proc/76629/fd (opendir: Permission denied) 2024-05-08T23:18:01.489 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76630 log ceph cwd unknown /proc/76629/task/76630/cwd (readlink: Permission denied) 2024-05-08T23:18:01.489 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76630 log ceph rtd unknown /proc/76629/task/76630/root (readlink: Permission denied) 2024-05-08T23:18:01.489 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76630 log ceph txt unknown /proc/76629/task/76630/exe (readlink: Permission denied) 2024-05-08T23:18:01.489 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76630 log ceph NOFD /proc/76629/task/76630/fd (opendir: Permission denied) 2024-05-08T23:18:01.489 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76632 msgr-work ceph cwd unknown /proc/76629/task/76632/cwd (readlink: Permission denied) 2024-05-08T23:18:01.489 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76632 msgr-work ceph rtd unknown /proc/76629/task/76632/root (readlink: Permission denied) 2024-05-08T23:18:01.489 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76632 msgr-work ceph txt unknown /proc/76629/task/76632/exe (readlink: Permission denied) 2024-05-08T23:18:01.489 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76632 msgr-work ceph NOFD /proc/76629/task/76632/fd (opendir: Permission denied) 2024-05-08T23:18:01.489 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76633 msgr-work ceph cwd unknown /proc/76629/task/76633/cwd (readlink: Permission denied) 2024-05-08T23:18:01.489 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76633 msgr-work ceph rtd unknown /proc/76629/task/76633/root (readlink: Permission denied) 2024-05-08T23:18:01.489 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76633 msgr-work ceph txt unknown /proc/76629/task/76633/exe (readlink: Permission denied) 2024-05-08T23:18:01.490 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76633 msgr-work ceph NOFD /proc/76629/task/76633/fd (opendir: Permission denied) 2024-05-08T23:18:01.490 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76634 msgr-work ceph cwd unknown /proc/76629/task/76634/cwd (readlink: Permission denied) 2024-05-08T23:18:01.490 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76634 msgr-work ceph rtd unknown /proc/76629/task/76634/root (readlink: Permission denied) 2024-05-08T23:18:01.490 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76634 msgr-work ceph txt unknown /proc/76629/task/76634/exe (readlink: Permission denied) 2024-05-08T23:18:01.490 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76634 msgr-work ceph NOFD /proc/76629/task/76634/fd (opendir: Permission denied) 2024-05-08T23:18:01.490 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76638 service ceph cwd unknown /proc/76629/task/76638/cwd (readlink: Permission denied) 2024-05-08T23:18:01.490 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76638 service ceph rtd unknown /proc/76629/task/76638/root (readlink: Permission denied) 2024-05-08T23:18:01.490 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76638 service ceph txt unknown /proc/76629/task/76638/exe (readlink: Permission denied) 2024-05-08T23:18:01.490 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76638 service ceph NOFD /proc/76629/task/76638/fd (opendir: Permission denied) 2024-05-08T23:18:01.490 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76639 admin_soc ceph cwd unknown /proc/76629/task/76639/cwd (readlink: Permission denied) 2024-05-08T23:18:01.490 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76639 admin_soc ceph rtd unknown /proc/76629/task/76639/root (readlink: Permission denied) 2024-05-08T23:18:01.490 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76639 admin_soc ceph txt unknown /proc/76629/task/76639/exe (readlink: Permission denied) 2024-05-08T23:18:01.490 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76639 admin_soc ceph NOFD /proc/76629/task/76639/fd (opendir: Permission denied) 2024-05-08T23:18:01.490 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76874 signal_ha ceph cwd unknown /proc/76629/task/76874/cwd (readlink: Permission denied) 2024-05-08T23:18:01.490 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76874 signal_ha ceph rtd unknown /proc/76629/task/76874/root (readlink: Permission denied) 2024-05-08T23:18:01.491 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76874 signal_ha ceph txt unknown /proc/76629/task/76874/exe (readlink: Permission denied) 2024-05-08T23:18:01.491 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76874 signal_ha ceph NOFD /proc/76629/task/76874/fd (opendir: Permission denied) 2024-05-08T23:18:01.491 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76875 io_contex ceph cwd unknown /proc/76629/task/76875/cwd (readlink: Permission denied) 2024-05-08T23:18:01.491 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76875 io_contex ceph rtd unknown /proc/76629/task/76875/root (readlink: Permission denied) 2024-05-08T23:18:01.491 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76875 io_contex ceph txt unknown /proc/76629/task/76875/exe (readlink: Permission denied) 2024-05-08T23:18:01.491 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76875 io_contex ceph NOFD /proc/76629/task/76875/fd (opendir: Permission denied) 2024-05-08T23:18:01.491 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76876 io_contex ceph cwd unknown /proc/76629/task/76876/cwd (readlink: Permission denied) 2024-05-08T23:18:01.491 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76876 io_contex ceph rtd unknown /proc/76629/task/76876/root (readlink: Permission denied) 2024-05-08T23:18:01.491 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76876 io_contex ceph txt unknown /proc/76629/task/76876/exe (readlink: Permission denied) 2024-05-08T23:18:01.491 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76876 io_contex ceph NOFD /proc/76629/task/76876/fd (opendir: Permission denied) 2024-05-08T23:18:01.491 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76919 OpHistory ceph cwd unknown /proc/76629/task/76919/cwd (readlink: Permission denied) 2024-05-08T23:18:01.491 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76919 OpHistory ceph rtd unknown /proc/76629/task/76919/root (readlink: Permission denied) 2024-05-08T23:18:01.491 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76919 OpHistory ceph txt unknown /proc/76629/task/76919/exe (readlink: Permission denied) 2024-05-08T23:18:01.491 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76919 OpHistory ceph NOFD /proc/76629/task/76919/fd (opendir: Permission denied) 2024-05-08T23:18:01.491 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76920 ceph_time ceph cwd unknown /proc/76629/task/76920/cwd (readlink: Permission denied) 2024-05-08T23:18:01.492 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76920 ceph_time ceph rtd unknown /proc/76629/task/76920/root (readlink: Permission denied) 2024-05-08T23:18:01.492 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76920 ceph_time ceph txt unknown /proc/76629/task/76920/exe (readlink: Permission denied) 2024-05-08T23:18:01.492 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 76920 ceph_time ceph NOFD /proc/76629/task/76920/fd (opendir: Permission denied) 2024-05-08T23:18:01.492 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77004 ceph-osd ceph cwd unknown /proc/76629/task/77004/cwd (readlink: Permission denied) 2024-05-08T23:18:01.492 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77004 ceph-osd ceph rtd unknown /proc/76629/task/77004/root (readlink: Permission denied) 2024-05-08T23:18:01.492 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77004 ceph-osd ceph txt unknown /proc/76629/task/77004/exe (readlink: Permission denied) 2024-05-08T23:18:01.492 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77004 ceph-osd ceph NOFD /proc/76629/task/77004/fd (opendir: Permission denied) 2024-05-08T23:18:01.492 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77056 ceph-osd ceph cwd unknown /proc/76629/task/77056/cwd (readlink: Permission denied) 2024-05-08T23:18:01.492 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77056 ceph-osd ceph rtd unknown /proc/76629/task/77056/root (readlink: Permission denied) 2024-05-08T23:18:01.492 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77056 ceph-osd ceph txt unknown /proc/76629/task/77056/exe (readlink: Permission denied) 2024-05-08T23:18:01.492 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77056 ceph-osd ceph NOFD /proc/76629/task/77056/fd (opendir: Permission denied) 2024-05-08T23:18:01.492 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77151 ceph-osd ceph cwd unknown /proc/76629/task/77151/cwd (readlink: Permission denied) 2024-05-08T23:18:01.492 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77151 ceph-osd ceph rtd unknown /proc/76629/task/77151/root (readlink: Permission denied) 2024-05-08T23:18:01.492 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77151 ceph-osd ceph txt unknown /proc/76629/task/77151/exe (readlink: Permission denied) 2024-05-08T23:18:01.492 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77151 ceph-osd ceph NOFD /proc/76629/task/77151/fd (opendir: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77214 ceph-osd ceph cwd unknown /proc/76629/task/77214/cwd (readlink: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77214 ceph-osd ceph rtd unknown /proc/76629/task/77214/root (readlink: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77214 ceph-osd ceph txt unknown /proc/76629/task/77214/exe (readlink: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77214 ceph-osd ceph NOFD /proc/76629/task/77214/fd (opendir: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77283 ceph-osd ceph cwd unknown /proc/76629/task/77283/cwd (readlink: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77283 ceph-osd ceph rtd unknown /proc/76629/task/77283/root (readlink: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77283 ceph-osd ceph txt unknown /proc/76629/task/77283/exe (readlink: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77283 ceph-osd ceph NOFD /proc/76629/task/77283/fd (opendir: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77331 ceph-osd ceph cwd unknown /proc/76629/task/77331/cwd (readlink: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77331 ceph-osd ceph rtd unknown /proc/76629/task/77331/root (readlink: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77331 ceph-osd ceph txt unknown /proc/76629/task/77331/exe (readlink: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77331 ceph-osd ceph NOFD /proc/76629/task/77331/fd (opendir: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77408 ceph-osd ceph cwd unknown /proc/76629/task/77408/cwd (readlink: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77408 ceph-osd ceph rtd unknown /proc/76629/task/77408/root (readlink: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77408 ceph-osd ceph txt unknown /proc/76629/task/77408/exe (readlink: Permission denied) 2024-05-08T23:18:01.493 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77408 ceph-osd ceph NOFD /proc/76629/task/77408/fd (opendir: Permission denied) 2024-05-08T23:18:01.494 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77440 ceph-osd ceph cwd unknown /proc/76629/task/77440/cwd (readlink: Permission denied) 2024-05-08T23:18:01.494 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77440 ceph-osd ceph rtd unknown /proc/76629/task/77440/root (readlink: Permission denied) 2024-05-08T23:18:01.494 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77440 ceph-osd ceph txt unknown /proc/76629/task/77440/exe (readlink: Permission denied) 2024-05-08T23:18:01.494 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77440 ceph-osd ceph NOFD /proc/76629/task/77440/fd (opendir: Permission denied) 2024-05-08T23:18:01.494 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77442 ceph-osd ceph cwd unknown /proc/76629/task/77442/cwd (readlink: Permission denied) 2024-05-08T23:18:01.494 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77442 ceph-osd ceph rtd unknown /proc/76629/task/77442/root (readlink: Permission denied) 2024-05-08T23:18:01.494 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77442 ceph-osd ceph txt unknown /proc/76629/task/77442/exe (readlink: Permission denied) 2024-05-08T23:18:01.494 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77442 ceph-osd ceph NOFD /proc/76629/task/77442/fd (opendir: Permission denied) 2024-05-08T23:18:01.494 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77443 safe_time ceph cwd unknown /proc/76629/task/77443/cwd (readlink: Permission denied) 2024-05-08T23:18:01.494 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77443 safe_time ceph rtd unknown /proc/76629/task/77443/root (readlink: Permission denied) 2024-05-08T23:18:01.494 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77443 safe_time ceph txt unknown /proc/76629/task/77443/exe (readlink: Permission denied) 2024-05-08T23:18:01.494 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77443 safe_time ceph NOFD /proc/76629/task/77443/fd (opendir: Permission denied) 2024-05-08T23:18:01.494 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77444 safe_time ceph cwd unknown /proc/76629/task/77444/cwd (readlink: Permission denied) 2024-05-08T23:18:01.494 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77444 safe_time ceph rtd unknown /proc/76629/task/77444/root (readlink: Permission denied) 2024-05-08T23:18:01.494 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77444 safe_time ceph txt unknown /proc/76629/task/77444/exe (readlink: Permission denied) 2024-05-08T23:18:01.495 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77444 safe_time ceph NOFD /proc/76629/task/77444/fd (opendir: Permission denied) 2024-05-08T23:18:01.495 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77445 safe_time ceph cwd unknown /proc/76629/task/77445/cwd (readlink: Permission denied) 2024-05-08T23:18:01.495 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77445 safe_time ceph rtd unknown /proc/76629/task/77445/root (readlink: Permission denied) 2024-05-08T23:18:01.495 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77445 safe_time ceph txt unknown /proc/76629/task/77445/exe (readlink: Permission denied) 2024-05-08T23:18:01.495 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77445 safe_time ceph NOFD /proc/76629/task/77445/fd (opendir: Permission denied) 2024-05-08T23:18:01.495 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77446 safe_time ceph cwd unknown /proc/76629/task/77446/cwd (readlink: Permission denied) 2024-05-08T23:18:01.495 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77446 safe_time ceph rtd unknown /proc/76629/task/77446/root (readlink: Permission denied) 2024-05-08T23:18:01.495 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77446 safe_time ceph txt unknown /proc/76629/task/77446/exe (readlink: Permission denied) 2024-05-08T23:18:01.495 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77446 safe_time ceph NOFD /proc/76629/task/77446/fd (opendir: Permission denied) 2024-05-08T23:18:01.495 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77448 fn_anonym ceph cwd unknown /proc/76629/task/77448/cwd (readlink: Permission denied) 2024-05-08T23:18:01.495 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77448 fn_anonym ceph rtd unknown /proc/76629/task/77448/root (readlink: Permission denied) 2024-05-08T23:18:01.495 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77448 fn_anonym ceph txt unknown /proc/76629/task/77448/exe (readlink: Permission denied) 2024-05-08T23:18:01.495 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77448 fn_anonym ceph NOFD /proc/76629/task/77448/fd (opendir: Permission denied) 2024-05-08T23:18:01.495 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77451 rocksdb:l ceph cwd unknown /proc/76629/task/77451/cwd (readlink: Permission denied) 2024-05-08T23:18:01.496 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77451 rocksdb:l ceph rtd unknown /proc/76629/task/77451/root (readlink: Permission denied) 2024-05-08T23:18:01.496 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77451 rocksdb:l ceph txt unknown /proc/76629/task/77451/exe (readlink: Permission denied) 2024-05-08T23:18:01.496 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77451 rocksdb:l ceph NOFD /proc/76629/task/77451/fd (opendir: Permission denied) 2024-05-08T23:18:01.496 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77452 rocksdb:l ceph cwd unknown /proc/76629/task/77452/cwd (readlink: Permission denied) 2024-05-08T23:18:01.496 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77452 rocksdb:l ceph rtd unknown /proc/76629/task/77452/root (readlink: Permission denied) 2024-05-08T23:18:01.496 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77452 rocksdb:l ceph txt unknown /proc/76629/task/77452/exe (readlink: Permission denied) 2024-05-08T23:18:01.496 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77452 rocksdb:l ceph NOFD /proc/76629/task/77452/fd (opendir: Permission denied) 2024-05-08T23:18:01.496 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77453 rocksdb:l ceph cwd unknown /proc/76629/task/77453/cwd (readlink: Permission denied) 2024-05-08T23:18:01.496 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77453 rocksdb:l ceph rtd unknown /proc/76629/task/77453/root (readlink: Permission denied) 2024-05-08T23:18:01.496 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77453 rocksdb:l ceph txt unknown /proc/76629/task/77453/exe (readlink: Permission denied) 2024-05-08T23:18:01.496 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77453 rocksdb:l ceph NOFD /proc/76629/task/77453/fd (opendir: Permission denied) 2024-05-08T23:18:01.496 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77454 rocksdb:h ceph cwd unknown /proc/76629/task/77454/cwd (readlink: Permission denied) 2024-05-08T23:18:01.496 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77454 rocksdb:h ceph rtd unknown /proc/76629/task/77454/root (readlink: Permission denied) 2024-05-08T23:18:01.496 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77454 rocksdb:h ceph txt unknown /proc/76629/task/77454/exe (readlink: Permission denied) 2024-05-08T23:18:01.496 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77454 rocksdb:h ceph NOFD /proc/76629/task/77454/fd (opendir: Permission denied) 2024-05-08T23:18:01.497 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77887 bstore_ai ceph cwd unknown /proc/76629/task/77887/cwd (readlink: Permission denied) 2024-05-08T23:18:01.497 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77887 bstore_ai ceph rtd unknown /proc/76629/task/77887/root (readlink: Permission denied) 2024-05-08T23:18:01.497 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77887 bstore_ai ceph txt unknown /proc/76629/task/77887/exe (readlink: Permission denied) 2024-05-08T23:18:01.497 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 77887 bstore_ai ceph NOFD /proc/76629/task/77887/fd (opendir: Permission denied) 2024-05-08T23:18:01.497 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79012 bstore_ai ceph cwd unknown /proc/76629/task/79012/cwd (readlink: Permission denied) 2024-05-08T23:18:01.497 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79012 bstore_ai ceph rtd unknown /proc/76629/task/79012/root (readlink: Permission denied) 2024-05-08T23:18:01.497 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79012 bstore_ai ceph txt unknown /proc/76629/task/79012/exe (readlink: Permission denied) 2024-05-08T23:18:01.497 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79012 bstore_ai ceph NOFD /proc/76629/task/79012/fd (opendir: Permission denied) 2024-05-08T23:18:01.497 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79326 ceph-osd ceph cwd unknown /proc/76629/task/79326/cwd (readlink: Permission denied) 2024-05-08T23:18:01.497 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79326 ceph-osd ceph rtd unknown /proc/76629/task/79326/root (readlink: Permission denied) 2024-05-08T23:18:01.497 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79326 ceph-osd ceph txt unknown /proc/76629/task/79326/exe (readlink: Permission denied) 2024-05-08T23:18:01.497 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79326 ceph-osd ceph NOFD /proc/76629/task/79326/fd (opendir: Permission denied) 2024-05-08T23:18:01.497 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79329 cfin ceph cwd unknown /proc/76629/task/79329/cwd (readlink: Permission denied) 2024-05-08T23:18:01.497 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79329 cfin ceph rtd unknown /proc/76629/task/79329/root (readlink: Permission denied) 2024-05-08T23:18:01.497 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79329 cfin ceph txt unknown /proc/76629/task/79329/exe (readlink: Permission denied) 2024-05-08T23:18:01.498 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79329 cfin ceph NOFD /proc/76629/task/79329/fd (opendir: Permission denied) 2024-05-08T23:18:01.498 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79330 bstore_kv ceph cwd unknown /proc/76629/task/79330/cwd (readlink: Permission denied) 2024-05-08T23:18:01.498 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79330 bstore_kv ceph rtd unknown /proc/76629/task/79330/root (readlink: Permission denied) 2024-05-08T23:18:01.498 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79330 bstore_kv ceph txt unknown /proc/76629/task/79330/exe (readlink: Permission denied) 2024-05-08T23:18:01.498 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79330 bstore_kv ceph NOFD /proc/76629/task/79330/fd (opendir: Permission denied) 2024-05-08T23:18:01.498 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79331 bstore_kv ceph cwd unknown /proc/76629/task/79331/cwd (readlink: Permission denied) 2024-05-08T23:18:01.498 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79331 bstore_kv ceph rtd unknown /proc/76629/task/79331/root (readlink: Permission denied) 2024-05-08T23:18:01.498 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79331 bstore_kv ceph txt unknown /proc/76629/task/79331/exe (readlink: Permission denied) 2024-05-08T23:18:01.498 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79331 bstore_kv ceph NOFD /proc/76629/task/79331/fd (opendir: Permission denied) 2024-05-08T23:18:01.498 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79332 bstore_me ceph cwd unknown /proc/76629/task/79332/cwd (readlink: Permission denied) 2024-05-08T23:18:01.498 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79332 bstore_me ceph rtd unknown /proc/76629/task/79332/root (readlink: Permission denied) 2024-05-08T23:18:01.498 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79332 bstore_me ceph txt unknown /proc/76629/task/79332/exe (readlink: Permission denied) 2024-05-08T23:18:01.498 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79332 bstore_me ceph NOFD /proc/76629/task/79332/fd (opendir: Permission denied) 2024-05-08T23:18:01.498 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79438 ms_dispat ceph cwd unknown /proc/76629/task/79438/cwd (readlink: Permission denied) 2024-05-08T23:18:01.498 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79438 ms_dispat ceph rtd unknown /proc/76629/task/79438/root (readlink: Permission denied) 2024-05-08T23:18:01.499 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79438 ms_dispat ceph txt unknown /proc/76629/task/79438/exe (readlink: Permission denied) 2024-05-08T23:18:01.499 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79438 ms_dispat ceph NOFD /proc/76629/task/79438/fd (opendir: Permission denied) 2024-05-08T23:18:01.499 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79440 ms_local ceph cwd unknown /proc/76629/task/79440/cwd (readlink: Permission denied) 2024-05-08T23:18:01.499 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79440 ms_local ceph rtd unknown /proc/76629/task/79440/root (readlink: Permission denied) 2024-05-08T23:18:01.499 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79440 ms_local ceph txt unknown /proc/76629/task/79440/exe (readlink: Permission denied) 2024-05-08T23:18:01.499 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79440 ms_local ceph NOFD /proc/76629/task/79440/fd (opendir: Permission denied) 2024-05-08T23:18:01.499 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79441 safe_time ceph cwd unknown /proc/76629/task/79441/cwd (readlink: Permission denied) 2024-05-08T23:18:01.499 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79441 safe_time ceph rtd unknown /proc/76629/task/79441/root (readlink: Permission denied) 2024-05-08T23:18:01.499 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79441 safe_time ceph txt unknown /proc/76629/task/79441/exe (readlink: Permission denied) 2024-05-08T23:18:01.499 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79441 safe_time ceph NOFD /proc/76629/task/79441/fd (opendir: Permission denied) 2024-05-08T23:18:01.499 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79442 safe_time ceph cwd unknown /proc/76629/task/79442/cwd (readlink: Permission denied) 2024-05-08T23:18:01.499 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79442 safe_time ceph rtd unknown /proc/76629/task/79442/root (readlink: Permission denied) 2024-05-08T23:18:01.499 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79442 safe_time ceph txt unknown /proc/76629/task/79442/exe (readlink: Permission denied) 2024-05-08T23:18:01.499 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79442 safe_time ceph NOFD /proc/76629/task/79442/fd (opendir: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79444 ms_dispat ceph cwd unknown /proc/76629/task/79444/cwd (readlink: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79444 ms_dispat ceph rtd unknown /proc/76629/task/79444/root (readlink: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79444 ms_dispat ceph txt unknown /proc/76629/task/79444/exe (readlink: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79444 ms_dispat ceph NOFD /proc/76629/task/79444/fd (opendir: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79445 ms_local ceph cwd unknown /proc/76629/task/79445/cwd (readlink: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79445 ms_local ceph rtd unknown /proc/76629/task/79445/root (readlink: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79445 ms_local ceph txt unknown /proc/76629/task/79445/exe (readlink: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79445 ms_local ceph NOFD /proc/76629/task/79445/fd (opendir: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79446 ms_dispat ceph cwd unknown /proc/76629/task/79446/cwd (readlink: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79446 ms_dispat ceph rtd unknown /proc/76629/task/79446/root (readlink: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79446 ms_dispat ceph txt unknown /proc/76629/task/79446/exe (readlink: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79446 ms_dispat ceph NOFD /proc/76629/task/79446/fd (opendir: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79447 ms_local ceph cwd unknown /proc/76629/task/79447/cwd (readlink: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79447 ms_local ceph rtd unknown /proc/76629/task/79447/root (readlink: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79447 ms_local ceph txt unknown /proc/76629/task/79447/exe (readlink: Permission denied) 2024-05-08T23:18:01.500 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79447 ms_local ceph NOFD /proc/76629/task/79447/fd (opendir: Permission denied) 2024-05-08T23:18:01.501 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79448 ms_dispat ceph cwd unknown /proc/76629/task/79448/cwd (readlink: Permission denied) 2024-05-08T23:18:01.501 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79448 ms_dispat ceph rtd unknown /proc/76629/task/79448/root (readlink: Permission denied) 2024-05-08T23:18:01.501 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79448 ms_dispat ceph txt unknown /proc/76629/task/79448/exe (readlink: Permission denied) 2024-05-08T23:18:01.501 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79448 ms_dispat ceph NOFD /proc/76629/task/79448/fd (opendir: Permission denied) 2024-05-08T23:18:01.501 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79449 ms_local ceph cwd unknown /proc/76629/task/79449/cwd (readlink: Permission denied) 2024-05-08T23:18:01.501 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79449 ms_local ceph rtd unknown /proc/76629/task/79449/root (readlink: Permission denied) 2024-05-08T23:18:01.501 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79449 ms_local ceph txt unknown /proc/76629/task/79449/exe (readlink: Permission denied) 2024-05-08T23:18:01.501 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79449 ms_local ceph NOFD /proc/76629/task/79449/fd (opendir: Permission denied) 2024-05-08T23:18:01.501 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79451 ms_dispat ceph cwd unknown /proc/76629/task/79451/cwd (readlink: Permission denied) 2024-05-08T23:18:01.501 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79451 ms_dispat ceph rtd unknown /proc/76629/task/79451/root (readlink: Permission denied) 2024-05-08T23:18:01.501 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79451 ms_dispat ceph txt unknown /proc/76629/task/79451/exe (readlink: Permission denied) 2024-05-08T23:18:01.501 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79451 ms_dispat ceph NOFD /proc/76629/task/79451/fd (opendir: Permission denied) 2024-05-08T23:18:01.501 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79452 ms_local ceph cwd unknown /proc/76629/task/79452/cwd (readlink: Permission denied) 2024-05-08T23:18:01.501 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79452 ms_local ceph rtd unknown /proc/76629/task/79452/root (readlink: Permission denied) 2024-05-08T23:18:01.501 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79452 ms_local ceph txt unknown /proc/76629/task/79452/exe (readlink: Permission denied) 2024-05-08T23:18:01.502 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79452 ms_local ceph NOFD /proc/76629/task/79452/fd (opendir: Permission denied) 2024-05-08T23:18:01.502 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79453 ms_dispat ceph cwd unknown /proc/76629/task/79453/cwd (readlink: Permission denied) 2024-05-08T23:18:01.502 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79453 ms_dispat ceph rtd unknown /proc/76629/task/79453/root (readlink: Permission denied) 2024-05-08T23:18:01.502 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79453 ms_dispat ceph txt unknown /proc/76629/task/79453/exe (readlink: Permission denied) 2024-05-08T23:18:01.502 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79453 ms_dispat ceph NOFD /proc/76629/task/79453/fd (opendir: Permission denied) 2024-05-08T23:18:01.502 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79454 ms_local ceph cwd unknown /proc/76629/task/79454/cwd (readlink: Permission denied) 2024-05-08T23:18:01.502 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79454 ms_local ceph rtd unknown /proc/76629/task/79454/root (readlink: Permission denied) 2024-05-08T23:18:01.502 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79454 ms_local ceph txt unknown /proc/76629/task/79454/exe (readlink: Permission denied) 2024-05-08T23:18:01.502 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79454 ms_local ceph NOFD /proc/76629/task/79454/fd (opendir: Permission denied) 2024-05-08T23:18:01.502 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79456 ms_dispat ceph cwd unknown /proc/76629/task/79456/cwd (readlink: Permission denied) 2024-05-08T23:18:01.502 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79456 ms_dispat ceph rtd unknown /proc/76629/task/79456/root (readlink: Permission denied) 2024-05-08T23:18:01.502 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79456 ms_dispat ceph txt unknown /proc/76629/task/79456/exe (readlink: Permission denied) 2024-05-08T23:18:01.502 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79456 ms_dispat ceph NOFD /proc/76629/task/79456/fd (opendir: Permission denied) 2024-05-08T23:18:01.502 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79457 ms_local ceph cwd unknown /proc/76629/task/79457/cwd (readlink: Permission denied) 2024-05-08T23:18:01.503 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79457 ms_local ceph rtd unknown /proc/76629/task/79457/root (readlink: Permission denied) 2024-05-08T23:18:01.503 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79457 ms_local ceph txt unknown /proc/76629/task/79457/exe (readlink: Permission denied) 2024-05-08T23:18:01.503 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79457 ms_local ceph NOFD /proc/76629/task/79457/fd (opendir: Permission denied) 2024-05-08T23:18:01.503 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79458 fn_anonym ceph cwd unknown /proc/76629/task/79458/cwd (readlink: Permission denied) 2024-05-08T23:18:01.503 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79458 fn_anonym ceph rtd unknown /proc/76629/task/79458/root (readlink: Permission denied) 2024-05-08T23:18:01.503 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79458 fn_anonym ceph txt unknown /proc/76629/task/79458/exe (readlink: Permission denied) 2024-05-08T23:18:01.503 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79458 fn_anonym ceph NOFD /proc/76629/task/79458/fd (opendir: Permission denied) 2024-05-08T23:18:01.503 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79459 finisher ceph cwd unknown /proc/76629/task/79459/cwd (readlink: Permission denied) 2024-05-08T23:18:01.503 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79459 finisher ceph rtd unknown /proc/76629/task/79459/root (readlink: Permission denied) 2024-05-08T23:18:01.503 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79459 finisher ceph txt unknown /proc/76629/task/79459/exe (readlink: Permission denied) 2024-05-08T23:18:01.503 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79459 finisher ceph NOFD /proc/76629/task/79459/fd (opendir: Permission denied) 2024-05-08T23:18:01.503 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79460 safe_time ceph cwd unknown /proc/76629/task/79460/cwd (readlink: Permission denied) 2024-05-08T23:18:01.503 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79460 safe_time ceph rtd unknown /proc/76629/task/79460/root (readlink: Permission denied) 2024-05-08T23:18:01.503 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79460 safe_time ceph txt unknown /proc/76629/task/79460/exe (readlink: Permission denied) 2024-05-08T23:18:01.503 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79460 safe_time ceph NOFD /proc/76629/task/79460/fd (opendir: Permission denied) 2024-05-08T23:18:01.504 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79461 safe_time ceph cwd unknown /proc/76629/task/79461/cwd (readlink: Permission denied) 2024-05-08T23:18:01.504 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79461 safe_time ceph rtd unknown /proc/76629/task/79461/root (readlink: Permission denied) 2024-05-08T23:18:01.504 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79461 safe_time ceph txt unknown /proc/76629/task/79461/exe (readlink: Permission denied) 2024-05-08T23:18:01.504 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79461 safe_time ceph NOFD /proc/76629/task/79461/fd (opendir: Permission denied) 2024-05-08T23:18:01.504 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79463 ceph-osd ceph cwd unknown /proc/76629/task/79463/cwd (readlink: Permission denied) 2024-05-08T23:18:01.504 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79463 ceph-osd ceph rtd unknown /proc/76629/task/79463/root (readlink: Permission denied) 2024-05-08T23:18:01.504 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79463 ceph-osd ceph txt unknown /proc/76629/task/79463/exe (readlink: Permission denied) 2024-05-08T23:18:01.504 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79463 ceph-osd ceph NOFD /proc/76629/task/79463/fd (opendir: Permission denied) 2024-05-08T23:18:01.504 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79464 osd_srv_a ceph cwd unknown /proc/76629/task/79464/cwd (readlink: Permission denied) 2024-05-08T23:18:01.504 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79464 osd_srv_a ceph rtd unknown /proc/76629/task/79464/root (readlink: Permission denied) 2024-05-08T23:18:01.504 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79464 osd_srv_a ceph txt unknown /proc/76629/task/79464/exe (readlink: Permission denied) 2024-05-08T23:18:01.504 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79464 osd_srv_a ceph NOFD /proc/76629/task/79464/fd (opendir: Permission denied) 2024-05-08T23:18:01.504 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79465 tp_osd_tp ceph cwd unknown /proc/76629/task/79465/cwd (readlink: Permission denied) 2024-05-08T23:18:01.504 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79465 tp_osd_tp ceph rtd unknown /proc/76629/task/79465/root (readlink: Permission denied) 2024-05-08T23:18:01.504 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79465 tp_osd_tp ceph txt unknown /proc/76629/task/79465/exe (readlink: Permission denied) 2024-05-08T23:18:01.505 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79465 tp_osd_tp ceph NOFD /proc/76629/task/79465/fd (opendir: Permission denied) 2024-05-08T23:18:01.505 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79466 tp_osd_tp ceph cwd unknown /proc/76629/task/79466/cwd (readlink: Permission denied) 2024-05-08T23:18:01.505 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79466 tp_osd_tp ceph rtd unknown /proc/76629/task/79466/root (readlink: Permission denied) 2024-05-08T23:18:01.505 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79466 tp_osd_tp ceph txt unknown /proc/76629/task/79466/exe (readlink: Permission denied) 2024-05-08T23:18:01.505 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79466 tp_osd_tp ceph NOFD /proc/76629/task/79466/fd (opendir: Permission denied) 2024-05-08T23:18:01.505 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79467 tp_osd_tp ceph cwd unknown /proc/76629/task/79467/cwd (readlink: Permission denied) 2024-05-08T23:18:01.505 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79467 tp_osd_tp ceph rtd unknown /proc/76629/task/79467/root (readlink: Permission denied) 2024-05-08T23:18:01.505 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79467 tp_osd_tp ceph txt unknown /proc/76629/task/79467/exe (readlink: Permission denied) 2024-05-08T23:18:01.505 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79467 tp_osd_tp ceph NOFD /proc/76629/task/79467/fd (opendir: Permission denied) 2024-05-08T23:18:01.505 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79469 tp_osd_tp ceph cwd unknown /proc/76629/task/79469/cwd (readlink: Permission denied) 2024-05-08T23:18:01.505 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79469 tp_osd_tp ceph rtd unknown /proc/76629/task/79469/root (readlink: Permission denied) 2024-05-08T23:18:01.505 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79469 tp_osd_tp ceph txt unknown /proc/76629/task/79469/exe (readlink: Permission denied) 2024-05-08T23:18:01.505 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79469 tp_osd_tp ceph NOFD /proc/76629/task/79469/fd (opendir: Permission denied) 2024-05-08T23:18:01.505 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79470 tp_osd_tp ceph cwd unknown /proc/76629/task/79470/cwd (readlink: Permission denied) 2024-05-08T23:18:01.505 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79470 tp_osd_tp ceph rtd unknown /proc/76629/task/79470/root (readlink: Permission denied) 2024-05-08T23:18:01.506 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79470 tp_osd_tp ceph txt unknown /proc/76629/task/79470/exe (readlink: Permission denied) 2024-05-08T23:18:01.506 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79470 tp_osd_tp ceph NOFD /proc/76629/task/79470/fd (opendir: Permission denied) 2024-05-08T23:18:01.506 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79471 tp_osd_tp ceph cwd unknown /proc/76629/task/79471/cwd (readlink: Permission denied) 2024-05-08T23:18:01.506 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79471 tp_osd_tp ceph rtd unknown /proc/76629/task/79471/root (readlink: Permission denied) 2024-05-08T23:18:01.506 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79471 tp_osd_tp ceph txt unknown /proc/76629/task/79471/exe (readlink: Permission denied) 2024-05-08T23:18:01.506 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79471 tp_osd_tp ceph NOFD /proc/76629/task/79471/fd (opendir: Permission denied) 2024-05-08T23:18:01.506 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79472 tp_osd_tp ceph cwd unknown /proc/76629/task/79472/cwd (readlink: Permission denied) 2024-05-08T23:18:01.506 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79472 tp_osd_tp ceph rtd unknown /proc/76629/task/79472/root (readlink: Permission denied) 2024-05-08T23:18:01.506 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79472 tp_osd_tp ceph txt unknown /proc/76629/task/79472/exe (readlink: Permission denied) 2024-05-08T23:18:01.506 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79472 tp_osd_tp ceph NOFD /proc/76629/task/79472/fd (opendir: Permission denied) 2024-05-08T23:18:01.506 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79473 tp_osd_tp ceph cwd unknown /proc/76629/task/79473/cwd (readlink: Permission denied) 2024-05-08T23:18:01.506 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79473 tp_osd_tp ceph rtd unknown /proc/76629/task/79473/root (readlink: Permission denied) 2024-05-08T23:18:01.506 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79473 tp_osd_tp ceph txt unknown /proc/76629/task/79473/exe (readlink: Permission denied) 2024-05-08T23:18:01.506 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79473 tp_osd_tp ceph NOFD /proc/76629/task/79473/fd (opendir: Permission denied) 2024-05-08T23:18:01.507 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79474 tp_osd_tp ceph cwd unknown /proc/76629/task/79474/cwd (readlink: Permission denied) 2024-05-08T23:18:01.507 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79474 tp_osd_tp ceph rtd unknown /proc/76629/task/79474/root (readlink: Permission denied) 2024-05-08T23:18:01.507 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79474 tp_osd_tp ceph txt unknown /proc/76629/task/79474/exe (readlink: Permission denied) 2024-05-08T23:18:01.507 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79474 tp_osd_tp ceph NOFD /proc/76629/task/79474/fd (opendir: Permission denied) 2024-05-08T23:18:01.507 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79475 tp_osd_tp ceph cwd unknown /proc/76629/task/79475/cwd (readlink: Permission denied) 2024-05-08T23:18:01.507 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79475 tp_osd_tp ceph rtd unknown /proc/76629/task/79475/root (readlink: Permission denied) 2024-05-08T23:18:01.507 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79475 tp_osd_tp ceph txt unknown /proc/76629/task/79475/exe (readlink: Permission denied) 2024-05-08T23:18:01.507 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79475 tp_osd_tp ceph NOFD /proc/76629/task/79475/fd (opendir: Permission denied) 2024-05-08T23:18:01.507 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79476 tp_osd_tp ceph cwd unknown /proc/76629/task/79476/cwd (readlink: Permission denied) 2024-05-08T23:18:01.507 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79476 tp_osd_tp ceph rtd unknown /proc/76629/task/79476/root (readlink: Permission denied) 2024-05-08T23:18:01.507 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79476 tp_osd_tp ceph txt unknown /proc/76629/task/79476/exe (readlink: Permission denied) 2024-05-08T23:18:01.507 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79476 tp_osd_tp ceph NOFD /proc/76629/task/79476/fd (opendir: Permission denied) 2024-05-08T23:18:01.507 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79477 tp_osd_tp ceph cwd unknown /proc/76629/task/79477/cwd (readlink: Permission denied) 2024-05-08T23:18:01.507 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79477 tp_osd_tp ceph rtd unknown /proc/76629/task/79477/root (readlink: Permission denied) 2024-05-08T23:18:01.507 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79477 tp_osd_tp ceph txt unknown /proc/76629/task/79477/exe (readlink: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79477 tp_osd_tp ceph NOFD /proc/76629/task/79477/fd (opendir: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79478 tp_osd_tp ceph cwd unknown /proc/76629/task/79478/cwd (readlink: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79478 tp_osd_tp ceph rtd unknown /proc/76629/task/79478/root (readlink: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79478 tp_osd_tp ceph txt unknown /proc/76629/task/79478/exe (readlink: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79478 tp_osd_tp ceph NOFD /proc/76629/task/79478/fd (opendir: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79479 tp_osd_tp ceph cwd unknown /proc/76629/task/79479/cwd (readlink: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79479 tp_osd_tp ceph rtd unknown /proc/76629/task/79479/root (readlink: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79479 tp_osd_tp ceph txt unknown /proc/76629/task/79479/exe (readlink: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79479 tp_osd_tp ceph NOFD /proc/76629/task/79479/fd (opendir: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79480 tp_osd_tp ceph cwd unknown /proc/76629/task/79480/cwd (readlink: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79480 tp_osd_tp ceph rtd unknown /proc/76629/task/79480/root (readlink: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79480 tp_osd_tp ceph txt unknown /proc/76629/task/79480/exe (readlink: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79480 tp_osd_tp ceph NOFD /proc/76629/task/79480/fd (opendir: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79481 tp_osd_tp ceph cwd unknown /proc/76629/task/79481/cwd (readlink: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79481 tp_osd_tp ceph rtd unknown /proc/76629/task/79481/root (readlink: Permission denied) 2024-05-08T23:18:01.508 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79481 tp_osd_tp ceph txt unknown /proc/76629/task/79481/exe (readlink: Permission denied) 2024-05-08T23:18:01.509 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79481 tp_osd_tp ceph NOFD /proc/76629/task/79481/fd (opendir: Permission denied) 2024-05-08T23:18:01.509 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79482 osd_srv_h ceph cwd unknown /proc/76629/task/79482/cwd (readlink: Permission denied) 2024-05-08T23:18:01.509 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79482 osd_srv_h ceph rtd unknown /proc/76629/task/79482/root (readlink: Permission denied) 2024-05-08T23:18:01.509 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79482 osd_srv_h ceph txt unknown /proc/76629/task/79482/exe (readlink: Permission denied) 2024-05-08T23:18:01.509 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 76629 79482 osd_srv_h ceph NOFD /proc/76629/task/79482/fd (opendir: Permission denied) 2024-05-08T23:18:01.509 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 77355 root cwd unknown /proc/77355/cwd (readlink: Permission denied) 2024-05-08T23:18:01.509 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 77355 root rtd unknown /proc/77355/root (readlink: Permission denied) 2024-05-08T23:18:01.509 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 77355 root txt unknown /proc/77355/exe (readlink: Permission denied) 2024-05-08T23:18:01.509 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 77355 root NOFD /proc/77355/fd (opendir: Permission denied) 2024-05-08T23:18:01.509 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 77387 root cwd unknown /proc/77387/cwd (readlink: Permission denied) 2024-05-08T23:18:01.509 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 77387 root rtd unknown /proc/77387/root (readlink: Permission denied) 2024-05-08T23:18:01.509 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 77387 root txt unknown /proc/77387/exe (readlink: Permission denied) 2024-05-08T23:18:01.509 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 77387 root NOFD /proc/77387/fd (opendir: Permission denied) 2024-05-08T23:18:01.509 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 84576 root cwd unknown /proc/84576/cwd (readlink: Permission denied) 2024-05-08T23:18:01.510 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 84576 root rtd unknown /proc/84576/root (readlink: Permission denied) 2024-05-08T23:18:01.510 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 84576 root txt unknown /proc/84576/exe (readlink: Permission denied) 2024-05-08T23:18:01.510 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 84576 root NOFD /proc/84576/fd (opendir: Permission denied) 2024-05-08T23:18:01.510 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 84587 root cwd unknown /proc/84587/cwd (readlink: Permission denied) 2024-05-08T23:18:01.510 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 84587 root rtd unknown /proc/84587/root (readlink: Permission denied) 2024-05-08T23:18:01.510 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 84587 root txt unknown /proc/84587/exe (readlink: Permission denied) 2024-05-08T23:18:01.510 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 84587 root NOFD /proc/84587/fd (opendir: Permission denied) 2024-05-08T23:18:01.510 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 ceph cwd unknown /proc/84599/cwd (readlink: Permission denied) 2024-05-08T23:18:01.510 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 ceph rtd unknown /proc/84599/root (readlink: Permission denied) 2024-05-08T23:18:01.510 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 ceph txt unknown /proc/84599/exe (readlink: Permission denied) 2024-05-08T23:18:01.510 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 ceph NOFD /proc/84599/fd (opendir: Permission denied) 2024-05-08T23:18:01.510 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84600 log ceph cwd unknown /proc/84599/task/84600/cwd (readlink: Permission denied) 2024-05-08T23:18:01.510 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84600 log ceph rtd unknown /proc/84599/task/84600/root (readlink: Permission denied) 2024-05-08T23:18:01.510 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84600 log ceph txt unknown /proc/84599/task/84600/exe (readlink: Permission denied) 2024-05-08T23:18:01.510 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84600 log ceph NOFD /proc/84599/task/84600/fd (opendir: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84602 msgr-work ceph cwd unknown /proc/84599/task/84602/cwd (readlink: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84602 msgr-work ceph rtd unknown /proc/84599/task/84602/root (readlink: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84602 msgr-work ceph txt unknown /proc/84599/task/84602/exe (readlink: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84602 msgr-work ceph NOFD /proc/84599/task/84602/fd (opendir: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84603 msgr-work ceph cwd unknown /proc/84599/task/84603/cwd (readlink: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84603 msgr-work ceph rtd unknown /proc/84599/task/84603/root (readlink: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84603 msgr-work ceph txt unknown /proc/84599/task/84603/exe (readlink: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84603 msgr-work ceph NOFD /proc/84599/task/84603/fd (opendir: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84604 msgr-work ceph cwd unknown /proc/84599/task/84604/cwd (readlink: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84604 msgr-work ceph rtd unknown /proc/84599/task/84604/root (readlink: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84604 msgr-work ceph txt unknown /proc/84599/task/84604/exe (readlink: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84604 msgr-work ceph NOFD /proc/84599/task/84604/fd (opendir: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84608 service ceph cwd unknown /proc/84599/task/84608/cwd (readlink: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84608 service ceph rtd unknown /proc/84599/task/84608/root (readlink: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84608 service ceph txt unknown /proc/84599/task/84608/exe (readlink: Permission denied) 2024-05-08T23:18:01.511 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84608 service ceph NOFD /proc/84599/task/84608/fd (opendir: Permission denied) 2024-05-08T23:18:01.512 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84609 admin_soc ceph cwd unknown /proc/84599/task/84609/cwd (readlink: Permission denied) 2024-05-08T23:18:01.512 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84609 admin_soc ceph rtd unknown /proc/84599/task/84609/root (readlink: Permission denied) 2024-05-08T23:18:01.512 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84609 admin_soc ceph txt unknown /proc/84599/task/84609/exe (readlink: Permission denied) 2024-05-08T23:18:01.512 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84609 admin_soc ceph NOFD /proc/84599/task/84609/fd (opendir: Permission denied) 2024-05-08T23:18:01.512 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84884 signal_ha ceph cwd unknown /proc/84599/task/84884/cwd (readlink: Permission denied) 2024-05-08T23:18:01.512 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84884 signal_ha ceph rtd unknown /proc/84599/task/84884/root (readlink: Permission denied) 2024-05-08T23:18:01.512 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84884 signal_ha ceph txt unknown /proc/84599/task/84884/exe (readlink: Permission denied) 2024-05-08T23:18:01.512 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84884 signal_ha ceph NOFD /proc/84599/task/84884/fd (opendir: Permission denied) 2024-05-08T23:18:01.512 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84885 io_contex ceph cwd unknown /proc/84599/task/84885/cwd (readlink: Permission denied) 2024-05-08T23:18:01.512 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84885 io_contex ceph rtd unknown /proc/84599/task/84885/root (readlink: Permission denied) 2024-05-08T23:18:01.512 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84885 io_contex ceph txt unknown /proc/84599/task/84885/exe (readlink: Permission denied) 2024-05-08T23:18:01.513 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84885 io_contex ceph NOFD /proc/84599/task/84885/fd (opendir: Permission denied) 2024-05-08T23:18:01.513 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84886 io_contex ceph cwd unknown /proc/84599/task/84886/cwd (readlink: Permission denied) 2024-05-08T23:18:01.513 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84886 io_contex ceph rtd unknown /proc/84599/task/84886/root (readlink: Permission denied) 2024-05-08T23:18:01.513 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84886 io_contex ceph txt unknown /proc/84599/task/84886/exe (readlink: Permission denied) 2024-05-08T23:18:01.513 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84886 io_contex ceph NOFD /proc/84599/task/84886/fd (opendir: Permission denied) 2024-05-08T23:18:01.513 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84934 OpHistory ceph cwd unknown /proc/84599/task/84934/cwd (readlink: Permission denied) 2024-05-08T23:18:01.513 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84934 OpHistory ceph rtd unknown /proc/84599/task/84934/root (readlink: Permission denied) 2024-05-08T23:18:01.513 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84934 OpHistory ceph txt unknown /proc/84599/task/84934/exe (readlink: Permission denied) 2024-05-08T23:18:01.513 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84934 OpHistory ceph NOFD /proc/84599/task/84934/fd (opendir: Permission denied) 2024-05-08T23:18:01.513 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84935 ceph_time ceph cwd unknown /proc/84599/task/84935/cwd (readlink: Permission denied) 2024-05-08T23:18:01.513 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84935 ceph_time ceph rtd unknown /proc/84599/task/84935/root (readlink: Permission denied) 2024-05-08T23:18:01.513 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84935 ceph_time ceph txt unknown /proc/84599/task/84935/exe (readlink: Permission denied) 2024-05-08T23:18:01.513 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84935 ceph_time ceph NOFD /proc/84599/task/84935/fd (opendir: Permission denied) 2024-05-08T23:18:01.513 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84967 ceph-osd ceph cwd unknown /proc/84599/task/84967/cwd (readlink: Permission denied) 2024-05-08T23:18:01.513 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84967 ceph-osd ceph rtd unknown /proc/84599/task/84967/root (readlink: Permission denied) 2024-05-08T23:18:01.514 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84967 ceph-osd ceph txt unknown /proc/84599/task/84967/exe (readlink: Permission denied) 2024-05-08T23:18:01.514 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 84967 ceph-osd ceph NOFD /proc/84599/task/84967/fd (opendir: Permission denied) 2024-05-08T23:18:01.514 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85046 ceph-osd ceph cwd unknown /proc/84599/task/85046/cwd (readlink: Permission denied) 2024-05-08T23:18:01.514 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85046 ceph-osd ceph rtd unknown /proc/84599/task/85046/root (readlink: Permission denied) 2024-05-08T23:18:01.514 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85046 ceph-osd ceph txt unknown /proc/84599/task/85046/exe (readlink: Permission denied) 2024-05-08T23:18:01.514 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85046 ceph-osd ceph NOFD /proc/84599/task/85046/fd (opendir: Permission denied) 2024-05-08T23:18:01.514 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85144 ceph-osd ceph cwd unknown /proc/84599/task/85144/cwd (readlink: Permission denied) 2024-05-08T23:18:01.514 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85144 ceph-osd ceph rtd unknown /proc/84599/task/85144/root (readlink: Permission denied) 2024-05-08T23:18:01.514 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85144 ceph-osd ceph txt unknown /proc/84599/task/85144/exe (readlink: Permission denied) 2024-05-08T23:18:01.514 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85144 ceph-osd ceph NOFD /proc/84599/task/85144/fd (opendir: Permission denied) 2024-05-08T23:18:01.514 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85168 ceph-osd ceph cwd unknown /proc/84599/task/85168/cwd (readlink: Permission denied) 2024-05-08T23:18:01.514 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85168 ceph-osd ceph rtd unknown /proc/84599/task/85168/root (readlink: Permission denied) 2024-05-08T23:18:01.514 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85168 ceph-osd ceph txt unknown /proc/84599/task/85168/exe (readlink: Permission denied) 2024-05-08T23:18:01.514 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85168 ceph-osd ceph NOFD /proc/84599/task/85168/fd (opendir: Permission denied) 2024-05-08T23:18:01.515 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85200 ceph-osd ceph cwd unknown /proc/84599/task/85200/cwd (readlink: Permission denied) 2024-05-08T23:18:01.515 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85200 ceph-osd ceph rtd unknown /proc/84599/task/85200/root (readlink: Permission denied) 2024-05-08T23:18:01.515 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85200 ceph-osd ceph txt unknown /proc/84599/task/85200/exe (readlink: Permission denied) 2024-05-08T23:18:01.515 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85200 ceph-osd ceph NOFD /proc/84599/task/85200/fd (opendir: Permission denied) 2024-05-08T23:18:01.515 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85279 ceph-osd ceph cwd unknown /proc/84599/task/85279/cwd (readlink: Permission denied) 2024-05-08T23:18:01.515 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85279 ceph-osd ceph rtd unknown /proc/84599/task/85279/root (readlink: Permission denied) 2024-05-08T23:18:01.515 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85279 ceph-osd ceph txt unknown /proc/84599/task/85279/exe (readlink: Permission denied) 2024-05-08T23:18:01.515 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85279 ceph-osd ceph NOFD /proc/84599/task/85279/fd (opendir: Permission denied) 2024-05-08T23:18:01.515 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85308 ceph-osd ceph cwd unknown /proc/84599/task/85308/cwd (readlink: Permission denied) 2024-05-08T23:18:01.515 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85308 ceph-osd ceph rtd unknown /proc/84599/task/85308/root (readlink: Permission denied) 2024-05-08T23:18:01.515 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85308 ceph-osd ceph txt unknown /proc/84599/task/85308/exe (readlink: Permission denied) 2024-05-08T23:18:01.515 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85308 ceph-osd ceph NOFD /proc/84599/task/85308/fd (opendir: Permission denied) 2024-05-08T23:18:01.515 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85394 ceph-osd ceph cwd unknown /proc/84599/task/85394/cwd (readlink: Permission denied) 2024-05-08T23:18:01.515 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85394 ceph-osd ceph rtd unknown /proc/84599/task/85394/root (readlink: Permission denied) 2024-05-08T23:18:01.515 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85394 ceph-osd ceph txt unknown /proc/84599/task/85394/exe (readlink: Permission denied) 2024-05-08T23:18:01.516 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85394 ceph-osd ceph NOFD /proc/84599/task/85394/fd (opendir: Permission denied) 2024-05-08T23:18:01.516 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85396 ceph-osd ceph cwd unknown /proc/84599/task/85396/cwd (readlink: Permission denied) 2024-05-08T23:18:01.516 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85396 ceph-osd ceph rtd unknown /proc/84599/task/85396/root (readlink: Permission denied) 2024-05-08T23:18:01.516 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85396 ceph-osd ceph txt unknown /proc/84599/task/85396/exe (readlink: Permission denied) 2024-05-08T23:18:01.516 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85396 ceph-osd ceph NOFD /proc/84599/task/85396/fd (opendir: Permission denied) 2024-05-08T23:18:01.516 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85397 safe_time ceph cwd unknown /proc/84599/task/85397/cwd (readlink: Permission denied) 2024-05-08T23:18:01.516 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85397 safe_time ceph rtd unknown /proc/84599/task/85397/root (readlink: Permission denied) 2024-05-08T23:18:01.516 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85397 safe_time ceph txt unknown /proc/84599/task/85397/exe (readlink: Permission denied) 2024-05-08T23:18:01.516 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85397 safe_time ceph NOFD /proc/84599/task/85397/fd (opendir: Permission denied) 2024-05-08T23:18:01.516 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85398 safe_time ceph cwd unknown /proc/84599/task/85398/cwd (readlink: Permission denied) 2024-05-08T23:18:01.516 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85398 safe_time ceph rtd unknown /proc/84599/task/85398/root (readlink: Permission denied) 2024-05-08T23:18:01.516 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85398 safe_time ceph txt unknown /proc/84599/task/85398/exe (readlink: Permission denied) 2024-05-08T23:18:01.516 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85398 safe_time ceph NOFD /proc/84599/task/85398/fd (opendir: Permission denied) 2024-05-08T23:18:01.516 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85399 safe_time ceph cwd unknown /proc/84599/task/85399/cwd (readlink: Permission denied) 2024-05-08T23:18:01.516 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85399 safe_time ceph rtd unknown /proc/84599/task/85399/root (readlink: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85399 safe_time ceph txt unknown /proc/84599/task/85399/exe (readlink: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85399 safe_time ceph NOFD /proc/84599/task/85399/fd (opendir: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85400 safe_time ceph cwd unknown /proc/84599/task/85400/cwd (readlink: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85400 safe_time ceph rtd unknown /proc/84599/task/85400/root (readlink: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85400 safe_time ceph txt unknown /proc/84599/task/85400/exe (readlink: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85400 safe_time ceph NOFD /proc/84599/task/85400/fd (opendir: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85401 fn_anonym ceph cwd unknown /proc/84599/task/85401/cwd (readlink: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85401 fn_anonym ceph rtd unknown /proc/84599/task/85401/root (readlink: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85401 fn_anonym ceph txt unknown /proc/84599/task/85401/exe (readlink: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85401 fn_anonym ceph NOFD /proc/84599/task/85401/fd (opendir: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85405 rocksdb:l ceph cwd unknown /proc/84599/task/85405/cwd (readlink: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85405 rocksdb:l ceph rtd unknown /proc/84599/task/85405/root (readlink: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85405 rocksdb:l ceph txt unknown /proc/84599/task/85405/exe (readlink: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85405 rocksdb:l ceph NOFD /proc/84599/task/85405/fd (opendir: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85406 rocksdb:l ceph cwd unknown /proc/84599/task/85406/cwd (readlink: Permission denied) 2024-05-08T23:18:01.517 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85406 rocksdb:l ceph rtd unknown /proc/84599/task/85406/root (readlink: Permission denied) 2024-05-08T23:18:01.518 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85406 rocksdb:l ceph txt unknown /proc/84599/task/85406/exe (readlink: Permission denied) 2024-05-08T23:18:01.518 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85406 rocksdb:l ceph NOFD /proc/84599/task/85406/fd (opendir: Permission denied) 2024-05-08T23:18:01.518 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85407 rocksdb:l ceph cwd unknown /proc/84599/task/85407/cwd (readlink: Permission denied) 2024-05-08T23:18:01.518 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85407 rocksdb:l ceph rtd unknown /proc/84599/task/85407/root (readlink: Permission denied) 2024-05-08T23:18:01.518 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85407 rocksdb:l ceph txt unknown /proc/84599/task/85407/exe (readlink: Permission denied) 2024-05-08T23:18:01.518 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85407 rocksdb:l ceph NOFD /proc/84599/task/85407/fd (opendir: Permission denied) 2024-05-08T23:18:01.518 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85408 rocksdb:h ceph cwd unknown /proc/84599/task/85408/cwd (readlink: Permission denied) 2024-05-08T23:18:01.518 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85408 rocksdb:h ceph rtd unknown /proc/84599/task/85408/root (readlink: Permission denied) 2024-05-08T23:18:01.518 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85408 rocksdb:h ceph txt unknown /proc/84599/task/85408/exe (readlink: Permission denied) 2024-05-08T23:18:01.518 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85408 rocksdb:h ceph NOFD /proc/84599/task/85408/fd (opendir: Permission denied) 2024-05-08T23:18:01.518 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85855 bstore_ai ceph cwd unknown /proc/84599/task/85855/cwd (readlink: Permission denied) 2024-05-08T23:18:01.518 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85855 bstore_ai ceph rtd unknown /proc/84599/task/85855/root (readlink: Permission denied) 2024-05-08T23:18:01.518 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85855 bstore_ai ceph txt unknown /proc/84599/task/85855/exe (readlink: Permission denied) 2024-05-08T23:18:01.518 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 85855 bstore_ai ceph NOFD /proc/84599/task/85855/fd (opendir: Permission denied) 2024-05-08T23:18:01.518 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86052 bstore_ai ceph cwd unknown /proc/84599/task/86052/cwd (readlink: Permission denied) 2024-05-08T23:18:01.519 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86052 bstore_ai ceph rtd unknown /proc/84599/task/86052/root (readlink: Permission denied) 2024-05-08T23:18:01.519 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86052 bstore_ai ceph txt unknown /proc/84599/task/86052/exe (readlink: Permission denied) 2024-05-08T23:18:01.519 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86052 bstore_ai ceph NOFD /proc/84599/task/86052/fd (opendir: Permission denied) 2024-05-08T23:18:01.519 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86237 ceph-osd ceph cwd unknown /proc/84599/task/86237/cwd (readlink: Permission denied) 2024-05-08T23:18:01.519 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86237 ceph-osd ceph rtd unknown /proc/84599/task/86237/root (readlink: Permission denied) 2024-05-08T23:18:01.519 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86237 ceph-osd ceph txt unknown /proc/84599/task/86237/exe (readlink: Permission denied) 2024-05-08T23:18:01.519 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86237 ceph-osd ceph NOFD /proc/84599/task/86237/fd (opendir: Permission denied) 2024-05-08T23:18:01.519 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86238 cfin ceph cwd unknown /proc/84599/task/86238/cwd (readlink: Permission denied) 2024-05-08T23:18:01.519 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86238 cfin ceph rtd unknown /proc/84599/task/86238/root (readlink: Permission denied) 2024-05-08T23:18:01.519 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86238 cfin ceph txt unknown /proc/84599/task/86238/exe (readlink: Permission denied) 2024-05-08T23:18:01.519 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86238 cfin ceph NOFD /proc/84599/task/86238/fd (opendir: Permission denied) 2024-05-08T23:18:01.519 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86239 bstore_kv ceph cwd unknown /proc/84599/task/86239/cwd (readlink: Permission denied) 2024-05-08T23:18:01.519 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86239 bstore_kv ceph rtd unknown /proc/84599/task/86239/root (readlink: Permission denied) 2024-05-08T23:18:01.519 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86239 bstore_kv ceph txt unknown /proc/84599/task/86239/exe (readlink: Permission denied) 2024-05-08T23:18:01.519 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86239 bstore_kv ceph NOFD /proc/84599/task/86239/fd (opendir: Permission denied) 2024-05-08T23:18:01.520 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86240 bstore_kv ceph cwd unknown /proc/84599/task/86240/cwd (readlink: Permission denied) 2024-05-08T23:18:01.520 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86240 bstore_kv ceph rtd unknown /proc/84599/task/86240/root (readlink: Permission denied) 2024-05-08T23:18:01.520 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86240 bstore_kv ceph txt unknown /proc/84599/task/86240/exe (readlink: Permission denied) 2024-05-08T23:18:01.520 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86240 bstore_kv ceph NOFD /proc/84599/task/86240/fd (opendir: Permission denied) 2024-05-08T23:18:01.520 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86241 bstore_me ceph cwd unknown /proc/84599/task/86241/cwd (readlink: Permission denied) 2024-05-08T23:18:01.520 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86241 bstore_me ceph rtd unknown /proc/84599/task/86241/root (readlink: Permission denied) 2024-05-08T23:18:01.520 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86241 bstore_me ceph txt unknown /proc/84599/task/86241/exe (readlink: Permission denied) 2024-05-08T23:18:01.520 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86241 bstore_me ceph NOFD /proc/84599/task/86241/fd (opendir: Permission denied) 2024-05-08T23:18:01.520 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86245 ms_dispat ceph cwd unknown /proc/84599/task/86245/cwd (readlink: Permission denied) 2024-05-08T23:18:01.520 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86245 ms_dispat ceph rtd unknown /proc/84599/task/86245/root (readlink: Permission denied) 2024-05-08T23:18:01.520 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86245 ms_dispat ceph txt unknown /proc/84599/task/86245/exe (readlink: Permission denied) 2024-05-08T23:18:01.520 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86245 ms_dispat ceph NOFD /proc/84599/task/86245/fd (opendir: Permission denied) 2024-05-08T23:18:01.520 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86246 ms_local ceph cwd unknown /proc/84599/task/86246/cwd (readlink: Permission denied) 2024-05-08T23:18:01.520 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86246 ms_local ceph rtd unknown /proc/84599/task/86246/root (readlink: Permission denied) 2024-05-08T23:18:01.520 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86246 ms_local ceph txt unknown /proc/84599/task/86246/exe (readlink: Permission denied) 2024-05-08T23:18:01.521 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86246 ms_local ceph NOFD /proc/84599/task/86246/fd (opendir: Permission denied) 2024-05-08T23:18:01.521 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86247 safe_time ceph cwd unknown /proc/84599/task/86247/cwd (readlink: Permission denied) 2024-05-08T23:18:01.521 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86247 safe_time ceph rtd unknown /proc/84599/task/86247/root (readlink: Permission denied) 2024-05-08T23:18:01.521 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86247 safe_time ceph txt unknown /proc/84599/task/86247/exe (readlink: Permission denied) 2024-05-08T23:18:01.521 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86247 safe_time ceph NOFD /proc/84599/task/86247/fd (opendir: Permission denied) 2024-05-08T23:18:01.521 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86248 safe_time ceph cwd unknown /proc/84599/task/86248/cwd (readlink: Permission denied) 2024-05-08T23:18:01.521 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86248 safe_time ceph rtd unknown /proc/84599/task/86248/root (readlink: Permission denied) 2024-05-08T23:18:01.521 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86248 safe_time ceph txt unknown /proc/84599/task/86248/exe (readlink: Permission denied) 2024-05-08T23:18:01.521 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86248 safe_time ceph NOFD /proc/84599/task/86248/fd (opendir: Permission denied) 2024-05-08T23:18:01.521 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86249 ms_dispat ceph cwd unknown /proc/84599/task/86249/cwd (readlink: Permission denied) 2024-05-08T23:18:01.521 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86249 ms_dispat ceph rtd unknown /proc/84599/task/86249/root (readlink: Permission denied) 2024-05-08T23:18:01.521 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86249 ms_dispat ceph txt unknown /proc/84599/task/86249/exe (readlink: Permission denied) 2024-05-08T23:18:01.521 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86249 ms_dispat ceph NOFD /proc/84599/task/86249/fd (opendir: Permission denied) 2024-05-08T23:18:01.521 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86250 ms_local ceph cwd unknown /proc/84599/task/86250/cwd (readlink: Permission denied) 2024-05-08T23:18:01.521 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86250 ms_local ceph rtd unknown /proc/84599/task/86250/root (readlink: Permission denied) 2024-05-08T23:18:01.522 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86250 ms_local ceph txt unknown /proc/84599/task/86250/exe (readlink: Permission denied) 2024-05-08T23:18:01.522 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86250 ms_local ceph NOFD /proc/84599/task/86250/fd (opendir: Permission denied) 2024-05-08T23:18:01.522 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86251 ms_dispat ceph cwd unknown /proc/84599/task/86251/cwd (readlink: Permission denied) 2024-05-08T23:18:01.522 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86251 ms_dispat ceph rtd unknown /proc/84599/task/86251/root (readlink: Permission denied) 2024-05-08T23:18:01.522 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86251 ms_dispat ceph txt unknown /proc/84599/task/86251/exe (readlink: Permission denied) 2024-05-08T23:18:01.522 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86251 ms_dispat ceph NOFD /proc/84599/task/86251/fd (opendir: Permission denied) 2024-05-08T23:18:01.522 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86252 ms_local ceph cwd unknown /proc/84599/task/86252/cwd (readlink: Permission denied) 2024-05-08T23:18:01.522 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86252 ms_local ceph rtd unknown /proc/84599/task/86252/root (readlink: Permission denied) 2024-05-08T23:18:01.522 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86252 ms_local ceph txt unknown /proc/84599/task/86252/exe (readlink: Permission denied) 2024-05-08T23:18:01.522 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86252 ms_local ceph NOFD /proc/84599/task/86252/fd (opendir: Permission denied) 2024-05-08T23:18:01.522 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86253 ms_dispat ceph cwd unknown /proc/84599/task/86253/cwd (readlink: Permission denied) 2024-05-08T23:18:01.522 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86253 ms_dispat ceph rtd unknown /proc/84599/task/86253/root (readlink: Permission denied) 2024-05-08T23:18:01.522 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86253 ms_dispat ceph txt unknown /proc/84599/task/86253/exe (readlink: Permission denied) 2024-05-08T23:18:01.522 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86253 ms_dispat ceph NOFD /proc/84599/task/86253/fd (opendir: Permission denied) 2024-05-08T23:18:01.522 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86254 ms_local ceph cwd unknown /proc/84599/task/86254/cwd (readlink: Permission denied) 2024-05-08T23:18:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86254 ms_local ceph rtd unknown /proc/84599/task/86254/root (readlink: Permission denied) 2024-05-08T23:18:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86254 ms_local ceph txt unknown /proc/84599/task/86254/exe (readlink: Permission denied) 2024-05-08T23:18:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86254 ms_local ceph NOFD /proc/84599/task/86254/fd (opendir: Permission denied) 2024-05-08T23:18:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86255 ms_dispat ceph cwd unknown /proc/84599/task/86255/cwd (readlink: Permission denied) 2024-05-08T23:18:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86255 ms_dispat ceph rtd unknown /proc/84599/task/86255/root (readlink: Permission denied) 2024-05-08T23:18:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86255 ms_dispat ceph txt unknown /proc/84599/task/86255/exe (readlink: Permission denied) 2024-05-08T23:18:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86255 ms_dispat ceph NOFD /proc/84599/task/86255/fd (opendir: Permission denied) 2024-05-08T23:18:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86256 ms_local ceph cwd unknown /proc/84599/task/86256/cwd (readlink: Permission denied) 2024-05-08T23:18:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86256 ms_local ceph rtd unknown /proc/84599/task/86256/root (readlink: Permission denied) 2024-05-08T23:18:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86256 ms_local ceph txt unknown /proc/84599/task/86256/exe (readlink: Permission denied) 2024-05-08T23:18:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86256 ms_local ceph NOFD /proc/84599/task/86256/fd (opendir: Permission denied) 2024-05-08T23:18:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86257 ms_dispat ceph cwd unknown /proc/84599/task/86257/cwd (readlink: Permission denied) 2024-05-08T23:18:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86257 ms_dispat ceph rtd unknown /proc/84599/task/86257/root (readlink: Permission denied) 2024-05-08T23:18:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86257 ms_dispat ceph txt unknown /proc/84599/task/86257/exe (readlink: Permission denied) 2024-05-08T23:18:01.523 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86257 ms_dispat ceph NOFD /proc/84599/task/86257/fd (opendir: Permission denied) 2024-05-08T23:18:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86258 ms_local ceph cwd unknown /proc/84599/task/86258/cwd (readlink: Permission denied) 2024-05-08T23:18:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86258 ms_local ceph rtd unknown /proc/84599/task/86258/root (readlink: Permission denied) 2024-05-08T23:18:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86258 ms_local ceph txt unknown /proc/84599/task/86258/exe (readlink: Permission denied) 2024-05-08T23:18:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86258 ms_local ceph NOFD /proc/84599/task/86258/fd (opendir: Permission denied) 2024-05-08T23:18:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86259 ms_dispat ceph cwd unknown /proc/84599/task/86259/cwd (readlink: Permission denied) 2024-05-08T23:18:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86259 ms_dispat ceph rtd unknown /proc/84599/task/86259/root (readlink: Permission denied) 2024-05-08T23:18:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86259 ms_dispat ceph txt unknown /proc/84599/task/86259/exe (readlink: Permission denied) 2024-05-08T23:18:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86259 ms_dispat ceph NOFD /proc/84599/task/86259/fd (opendir: Permission denied) 2024-05-08T23:18:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86260 ms_local ceph cwd unknown /proc/84599/task/86260/cwd (readlink: Permission denied) 2024-05-08T23:18:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86260 ms_local ceph rtd unknown /proc/84599/task/86260/root (readlink: Permission denied) 2024-05-08T23:18:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86260 ms_local ceph txt unknown /proc/84599/task/86260/exe (readlink: Permission denied) 2024-05-08T23:18:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86260 ms_local ceph NOFD /proc/84599/task/86260/fd (opendir: Permission denied) 2024-05-08T23:18:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86261 fn_anonym ceph cwd unknown /proc/84599/task/86261/cwd (readlink: Permission denied) 2024-05-08T23:18:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86261 fn_anonym ceph rtd unknown /proc/84599/task/86261/root (readlink: Permission denied) 2024-05-08T23:18:01.524 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86261 fn_anonym ceph txt unknown /proc/84599/task/86261/exe (readlink: Permission denied) 2024-05-08T23:18:01.525 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86261 fn_anonym ceph NOFD /proc/84599/task/86261/fd (opendir: Permission denied) 2024-05-08T23:18:01.525 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86262 finisher ceph cwd unknown /proc/84599/task/86262/cwd (readlink: Permission denied) 2024-05-08T23:18:01.525 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86262 finisher ceph rtd unknown /proc/84599/task/86262/root (readlink: Permission denied) 2024-05-08T23:18:01.525 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86262 finisher ceph txt unknown /proc/84599/task/86262/exe (readlink: Permission denied) 2024-05-08T23:18:01.525 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86262 finisher ceph NOFD /proc/84599/task/86262/fd (opendir: Permission denied) 2024-05-08T23:18:01.525 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86263 safe_time ceph cwd unknown /proc/84599/task/86263/cwd (readlink: Permission denied) 2024-05-08T23:18:01.525 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86263 safe_time ceph rtd unknown /proc/84599/task/86263/root (readlink: Permission denied) 2024-05-08T23:18:01.525 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86263 safe_time ceph txt unknown /proc/84599/task/86263/exe (readlink: Permission denied) 2024-05-08T23:18:01.525 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86263 safe_time ceph NOFD /proc/84599/task/86263/fd (opendir: Permission denied) 2024-05-08T23:18:01.525 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86264 safe_time ceph cwd unknown /proc/84599/task/86264/cwd (readlink: Permission denied) 2024-05-08T23:18:01.525 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86264 safe_time ceph rtd unknown /proc/84599/task/86264/root (readlink: Permission denied) 2024-05-08T23:18:01.525 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86264 safe_time ceph txt unknown /proc/84599/task/86264/exe (readlink: Permission denied) 2024-05-08T23:18:01.525 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86264 safe_time ceph NOFD /proc/84599/task/86264/fd (opendir: Permission denied) 2024-05-08T23:18:01.525 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86265 ceph-osd ceph cwd unknown /proc/84599/task/86265/cwd (readlink: Permission denied) 2024-05-08T23:18:01.525 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86265 ceph-osd ceph rtd unknown /proc/84599/task/86265/root (readlink: Permission denied) 2024-05-08T23:18:01.526 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86265 ceph-osd ceph txt unknown /proc/84599/task/86265/exe (readlink: Permission denied) 2024-05-08T23:18:01.526 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86265 ceph-osd ceph NOFD /proc/84599/task/86265/fd (opendir: Permission denied) 2024-05-08T23:18:01.526 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86266 osd_srv_a ceph cwd unknown /proc/84599/task/86266/cwd (readlink: Permission denied) 2024-05-08T23:18:01.526 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86266 osd_srv_a ceph rtd unknown /proc/84599/task/86266/root (readlink: Permission denied) 2024-05-08T23:18:01.526 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86266 osd_srv_a ceph txt unknown /proc/84599/task/86266/exe (readlink: Permission denied) 2024-05-08T23:18:01.526 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86266 osd_srv_a ceph NOFD /proc/84599/task/86266/fd (opendir: Permission denied) 2024-05-08T23:18:01.526 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86267 tp_osd_tp ceph cwd unknown /proc/84599/task/86267/cwd (readlink: Permission denied) 2024-05-08T23:18:01.526 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86267 tp_osd_tp ceph rtd unknown /proc/84599/task/86267/root (readlink: Permission denied) 2024-05-08T23:18:01.526 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86267 tp_osd_tp ceph txt unknown /proc/84599/task/86267/exe (readlink: Permission denied) 2024-05-08T23:18:01.526 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86267 tp_osd_tp ceph NOFD /proc/84599/task/86267/fd (opendir: Permission denied) 2024-05-08T23:18:01.526 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86268 tp_osd_tp ceph cwd unknown /proc/84599/task/86268/cwd (readlink: Permission denied) 2024-05-08T23:18:01.526 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86268 tp_osd_tp ceph rtd unknown /proc/84599/task/86268/root (readlink: Permission denied) 2024-05-08T23:18:01.526 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86268 tp_osd_tp ceph txt unknown /proc/84599/task/86268/exe (readlink: Permission denied) 2024-05-08T23:18:01.526 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86268 tp_osd_tp ceph NOFD /proc/84599/task/86268/fd (opendir: Permission denied) 2024-05-08T23:18:01.526 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86269 tp_osd_tp ceph cwd unknown /proc/84599/task/86269/cwd (readlink: Permission denied) 2024-05-08T23:18:01.527 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86269 tp_osd_tp ceph rtd unknown /proc/84599/task/86269/root (readlink: Permission denied) 2024-05-08T23:18:01.527 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86269 tp_osd_tp ceph txt unknown /proc/84599/task/86269/exe (readlink: Permission denied) 2024-05-08T23:18:01.527 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86269 tp_osd_tp ceph NOFD /proc/84599/task/86269/fd (opendir: Permission denied) 2024-05-08T23:18:01.527 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86270 tp_osd_tp ceph cwd unknown /proc/84599/task/86270/cwd (readlink: Permission denied) 2024-05-08T23:18:01.527 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86270 tp_osd_tp ceph rtd unknown /proc/84599/task/86270/root (readlink: Permission denied) 2024-05-08T23:18:01.527 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86270 tp_osd_tp ceph txt unknown /proc/84599/task/86270/exe (readlink: Permission denied) 2024-05-08T23:18:01.527 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86270 tp_osd_tp ceph NOFD /proc/84599/task/86270/fd (opendir: Permission denied) 2024-05-08T23:18:01.527 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86271 tp_osd_tp ceph cwd unknown /proc/84599/task/86271/cwd (readlink: Permission denied) 2024-05-08T23:18:01.527 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86271 tp_osd_tp ceph rtd unknown /proc/84599/task/86271/root (readlink: Permission denied) 2024-05-08T23:18:01.527 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86271 tp_osd_tp ceph txt unknown /proc/84599/task/86271/exe (readlink: Permission denied) 2024-05-08T23:18:01.527 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86271 tp_osd_tp ceph NOFD /proc/84599/task/86271/fd (opendir: Permission denied) 2024-05-08T23:18:01.527 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86272 tp_osd_tp ceph cwd unknown /proc/84599/task/86272/cwd (readlink: Permission denied) 2024-05-08T23:18:01.527 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86272 tp_osd_tp ceph rtd unknown /proc/84599/task/86272/root (readlink: Permission denied) 2024-05-08T23:18:01.527 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86272 tp_osd_tp ceph txt unknown /proc/84599/task/86272/exe (readlink: Permission denied) 2024-05-08T23:18:01.527 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86272 tp_osd_tp ceph NOFD /proc/84599/task/86272/fd (opendir: Permission denied) 2024-05-08T23:18:01.528 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86273 tp_osd_tp ceph cwd unknown /proc/84599/task/86273/cwd (readlink: Permission denied) 2024-05-08T23:18:01.528 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86273 tp_osd_tp ceph rtd unknown /proc/84599/task/86273/root (readlink: Permission denied) 2024-05-08T23:18:01.528 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86273 tp_osd_tp ceph txt unknown /proc/84599/task/86273/exe (readlink: Permission denied) 2024-05-08T23:18:01.528 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86273 tp_osd_tp ceph NOFD /proc/84599/task/86273/fd (opendir: Permission denied) 2024-05-08T23:18:01.528 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86274 tp_osd_tp ceph cwd unknown /proc/84599/task/86274/cwd (readlink: Permission denied) 2024-05-08T23:18:01.528 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86274 tp_osd_tp ceph rtd unknown /proc/84599/task/86274/root (readlink: Permission denied) 2024-05-08T23:18:01.528 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86274 tp_osd_tp ceph txt unknown /proc/84599/task/86274/exe (readlink: Permission denied) 2024-05-08T23:18:01.528 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86274 tp_osd_tp ceph NOFD /proc/84599/task/86274/fd (opendir: Permission denied) 2024-05-08T23:18:01.528 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86275 tp_osd_tp ceph cwd unknown /proc/84599/task/86275/cwd (readlink: Permission denied) 2024-05-08T23:18:01.528 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86275 tp_osd_tp ceph rtd unknown /proc/84599/task/86275/root (readlink: Permission denied) 2024-05-08T23:18:01.528 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86275 tp_osd_tp ceph txt unknown /proc/84599/task/86275/exe (readlink: Permission denied) 2024-05-08T23:18:01.528 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86275 tp_osd_tp ceph NOFD /proc/84599/task/86275/fd (opendir: Permission denied) 2024-05-08T23:18:01.528 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86276 tp_osd_tp ceph cwd unknown /proc/84599/task/86276/cwd (readlink: Permission denied) 2024-05-08T23:18:01.528 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86276 tp_osd_tp ceph rtd unknown /proc/84599/task/86276/root (readlink: Permission denied) 2024-05-08T23:18:01.528 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86276 tp_osd_tp ceph txt unknown /proc/84599/task/86276/exe (readlink: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86276 tp_osd_tp ceph NOFD /proc/84599/task/86276/fd (opendir: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86277 tp_osd_tp ceph cwd unknown /proc/84599/task/86277/cwd (readlink: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86277 tp_osd_tp ceph rtd unknown /proc/84599/task/86277/root (readlink: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86277 tp_osd_tp ceph txt unknown /proc/84599/task/86277/exe (readlink: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86277 tp_osd_tp ceph NOFD /proc/84599/task/86277/fd (opendir: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86278 tp_osd_tp ceph cwd unknown /proc/84599/task/86278/cwd (readlink: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86278 tp_osd_tp ceph rtd unknown /proc/84599/task/86278/root (readlink: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86278 tp_osd_tp ceph txt unknown /proc/84599/task/86278/exe (readlink: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86278 tp_osd_tp ceph NOFD /proc/84599/task/86278/fd (opendir: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86279 tp_osd_tp ceph cwd unknown /proc/84599/task/86279/cwd (readlink: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86279 tp_osd_tp ceph rtd unknown /proc/84599/task/86279/root (readlink: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86279 tp_osd_tp ceph txt unknown /proc/84599/task/86279/exe (readlink: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86279 tp_osd_tp ceph NOFD /proc/84599/task/86279/fd (opendir: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86280 tp_osd_tp ceph cwd unknown /proc/84599/task/86280/cwd (readlink: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86280 tp_osd_tp ceph rtd unknown /proc/84599/task/86280/root (readlink: Permission denied) 2024-05-08T23:18:01.529 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86280 tp_osd_tp ceph txt unknown /proc/84599/task/86280/exe (readlink: Permission denied) 2024-05-08T23:18:01.530 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86280 tp_osd_tp ceph NOFD /proc/84599/task/86280/fd (opendir: Permission denied) 2024-05-08T23:18:01.530 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86281 tp_osd_tp ceph cwd unknown /proc/84599/task/86281/cwd (readlink: Permission denied) 2024-05-08T23:18:01.530 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86281 tp_osd_tp ceph rtd unknown /proc/84599/task/86281/root (readlink: Permission denied) 2024-05-08T23:18:01.530 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86281 tp_osd_tp ceph txt unknown /proc/84599/task/86281/exe (readlink: Permission denied) 2024-05-08T23:18:01.530 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86281 tp_osd_tp ceph NOFD /proc/84599/task/86281/fd (opendir: Permission denied) 2024-05-08T23:18:01.530 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86282 tp_osd_tp ceph cwd unknown /proc/84599/task/86282/cwd (readlink: Permission denied) 2024-05-08T23:18:01.530 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86282 tp_osd_tp ceph rtd unknown /proc/84599/task/86282/root (readlink: Permission denied) 2024-05-08T23:18:01.530 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86282 tp_osd_tp ceph txt unknown /proc/84599/task/86282/exe (readlink: Permission denied) 2024-05-08T23:18:01.530 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86282 tp_osd_tp ceph NOFD /proc/84599/task/86282/fd (opendir: Permission denied) 2024-05-08T23:18:01.530 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86283 osd_srv_h ceph cwd unknown /proc/84599/task/86283/cwd (readlink: Permission denied) 2024-05-08T23:18:01.530 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86283 osd_srv_h ceph rtd unknown /proc/84599/task/86283/root (readlink: Permission denied) 2024-05-08T23:18:01.530 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86283 osd_srv_h ceph txt unknown /proc/84599/task/86283/exe (readlink: Permission denied) 2024-05-08T23:18:01.530 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-osd 84599 86283 osd_srv_h ceph NOFD /proc/84599/task/86283/fd (opendir: Permission denied) 2024-05-08T23:18:01.530 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 85337 root cwd unknown /proc/85337/cwd (readlink: Permission denied) 2024-05-08T23:18:01.531 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 85337 root rtd unknown /proc/85337/root (readlink: Permission denied) 2024-05-08T23:18:01.531 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 85337 root txt unknown /proc/85337/exe (readlink: Permission denied) 2024-05-08T23:18:01.531 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 85337 root NOFD /proc/85337/fd (opendir: Permission denied) 2024-05-08T23:18:01.531 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 85370 root cwd unknown /proc/85370/cwd (readlink: Permission denied) 2024-05-08T23:18:01.531 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 85370 root rtd unknown /proc/85370/root (readlink: Permission denied) 2024-05-08T23:18:01.531 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 85370 root txt unknown /proc/85370/exe (readlink: Permission denied) 2024-05-08T23:18:01.531 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 85370 root NOFD /proc/85370/fd (opendir: Permission denied) 2024-05-08T23:18:01.531 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91234 root cwd unknown /proc/91234/cwd (readlink: Permission denied) 2024-05-08T23:18:01.531 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91234 root rtd unknown /proc/91234/root (readlink: Permission denied) 2024-05-08T23:18:01.531 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91234 root txt unknown /proc/91234/exe (readlink: Permission denied) 2024-05-08T23:18:01.531 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91234 root NOFD /proc/91234/fd (opendir: Permission denied) 2024-05-08T23:18:01.531 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91254 root cwd unknown /proc/91254/cwd (readlink: Permission denied) 2024-05-08T23:18:01.531 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91254 root rtd unknown /proc/91254/root (readlink: Permission denied) 2024-05-08T23:18:01.531 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91254 root txt unknown /proc/91254/exe (readlink: Permission denied) 2024-05-08T23:18:01.531 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91254 root NOFD /proc/91254/fd (opendir: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91255 root cwd unknown /proc/91255/cwd (readlink: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91255 root rtd unknown /proc/91255/root (readlink: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91255 root txt unknown /proc/91255/exe (readlink: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91255 root NOFD /proc/91255/fd (opendir: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91275 root cwd unknown /proc/91275/cwd (readlink: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91275 root rtd unknown /proc/91275/root (readlink: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91275 root txt unknown /proc/91275/exe (readlink: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91275 root NOFD /proc/91275/fd (opendir: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91276 root cwd unknown /proc/91276/cwd (readlink: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91276 root rtd unknown /proc/91276/root (readlink: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91276 root txt unknown /proc/91276/exe (readlink: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91276 root NOFD /proc/91276/fd (opendir: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91296 root cwd unknown /proc/91296/cwd (readlink: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91296 root rtd unknown /proc/91296/root (readlink: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91296 root txt unknown /proc/91296/exe (readlink: Permission denied) 2024-05-08T23:18:01.532 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91296 root NOFD /proc/91296/fd (opendir: Permission denied) 2024-05-08T23:18:01.533 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91297 root cwd unknown /proc/91297/cwd (readlink: Permission denied) 2024-05-08T23:18:01.533 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91297 root rtd unknown /proc/91297/root (readlink: Permission denied) 2024-05-08T23:18:01.533 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91297 root txt unknown /proc/91297/exe (readlink: Permission denied) 2024-05-08T23:18:01.533 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 91297 root NOFD /proc/91297/fd (opendir: Permission denied) 2024-05-08T23:18:01.533 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91317 root cwd unknown /proc/91317/cwd (readlink: Permission denied) 2024-05-08T23:18:01.533 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91317 root rtd unknown /proc/91317/root (readlink: Permission denied) 2024-05-08T23:18:01.533 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91317 root txt unknown /proc/91317/exe (readlink: Permission denied) 2024-05-08T23:18:01.533 INFO:tasks.workunit.client.0.smithi135.stdout:journalct 91317 root NOFD /proc/91317/fd (opendir: Permission denied) 2024-05-08T23:18:01.533 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 91645 root cwd unknown /proc/91645/cwd (readlink: Permission denied) 2024-05-08T23:18:01.533 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 91645 root rtd unknown /proc/91645/root (readlink: Permission denied) 2024-05-08T23:18:01.533 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 91645 root txt unknown /proc/91645/exe (readlink: Permission denied) 2024-05-08T23:18:01.533 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/6 91645 root NOFD /proc/91645/fd (opendir: Permission denied) 2024-05-08T23:18:01.533 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 91794 root cwd unknown /proc/91794/cwd (readlink: Permission denied) 2024-05-08T23:18:01.533 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 91794 root rtd unknown /proc/91794/root (readlink: Permission denied) 2024-05-08T23:18:01.533 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 91794 root txt unknown /proc/91794/exe (readlink: Permission denied) 2024-05-08T23:18:01.534 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 91794 root NOFD /proc/91794/fd (opendir: Permission denied) 2024-05-08T23:18:01.534 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 91805 root cwd unknown /proc/91805/cwd (readlink: Permission denied) 2024-05-08T23:18:01.534 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 91805 root rtd unknown /proc/91805/root (readlink: Permission denied) 2024-05-08T23:18:01.534 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 91805 root txt unknown /proc/91805/exe (readlink: Permission denied) 2024-05-08T23:18:01.534 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 91805 root NOFD /proc/91805/fd (opendir: Permission denied) 2024-05-08T23:18:01.534 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 ceph cwd unknown /proc/91817/cwd (readlink: Permission denied) 2024-05-08T23:18:01.534 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 ceph rtd unknown /proc/91817/root (readlink: Permission denied) 2024-05-08T23:18:01.534 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 ceph txt unknown /proc/91817/exe (readlink: Permission denied) 2024-05-08T23:18:01.534 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 ceph NOFD /proc/91817/fd (opendir: Permission denied) 2024-05-08T23:18:01.534 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91818 log ceph cwd unknown /proc/91817/task/91818/cwd (readlink: Permission denied) 2024-05-08T23:18:01.534 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91818 log ceph rtd unknown /proc/91817/task/91818/root (readlink: Permission denied) 2024-05-08T23:18:01.534 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91818 log ceph txt unknown /proc/91817/task/91818/exe (readlink: Permission denied) 2024-05-08T23:18:01.534 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91818 log ceph NOFD /proc/91817/task/91818/fd (opendir: Permission denied) 2024-05-08T23:18:01.534 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91820 msgr-work ceph cwd unknown /proc/91817/task/91820/cwd (readlink: Permission denied) 2024-05-08T23:18:01.534 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91820 msgr-work ceph rtd unknown /proc/91817/task/91820/root (readlink: Permission denied) 2024-05-08T23:18:01.535 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91820 msgr-work ceph txt unknown /proc/91817/task/91820/exe (readlink: Permission denied) 2024-05-08T23:18:01.535 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91820 msgr-work ceph NOFD /proc/91817/task/91820/fd (opendir: Permission denied) 2024-05-08T23:18:01.535 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91821 msgr-work ceph cwd unknown /proc/91817/task/91821/cwd (readlink: Permission denied) 2024-05-08T23:18:01.535 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91821 msgr-work ceph rtd unknown /proc/91817/task/91821/root (readlink: Permission denied) 2024-05-08T23:18:01.535 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91821 msgr-work ceph txt unknown /proc/91817/task/91821/exe (readlink: Permission denied) 2024-05-08T23:18:01.535 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91821 msgr-work ceph NOFD /proc/91817/task/91821/fd (opendir: Permission denied) 2024-05-08T23:18:01.535 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91822 msgr-work ceph cwd unknown /proc/91817/task/91822/cwd (readlink: Permission denied) 2024-05-08T23:18:01.535 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91822 msgr-work ceph rtd unknown /proc/91817/task/91822/root (readlink: Permission denied) 2024-05-08T23:18:01.535 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91822 msgr-work ceph txt unknown /proc/91817/task/91822/exe (readlink: Permission denied) 2024-05-08T23:18:01.535 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91822 msgr-work ceph NOFD /proc/91817/task/91822/fd (opendir: Permission denied) 2024-05-08T23:18:01.535 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91826 service ceph cwd unknown /proc/91817/task/91826/cwd (readlink: Permission denied) 2024-05-08T23:18:01.535 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91826 service ceph rtd unknown /proc/91817/task/91826/root (readlink: Permission denied) 2024-05-08T23:18:01.535 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91826 service ceph txt unknown /proc/91817/task/91826/exe (readlink: Permission denied) 2024-05-08T23:18:01.535 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91826 service ceph NOFD /proc/91817/task/91826/fd (opendir: Permission denied) 2024-05-08T23:18:01.535 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91827 admin_soc ceph cwd unknown /proc/91817/task/91827/cwd (readlink: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91827 admin_soc ceph rtd unknown /proc/91817/task/91827/root (readlink: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91827 admin_soc ceph txt unknown /proc/91817/task/91827/exe (readlink: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91827 admin_soc ceph NOFD /proc/91817/task/91827/fd (opendir: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91828 signal_ha ceph cwd unknown /proc/91817/task/91828/cwd (readlink: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91828 signal_ha ceph rtd unknown /proc/91817/task/91828/root (readlink: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91828 signal_ha ceph txt unknown /proc/91817/task/91828/exe (readlink: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91828 signal_ha ceph NOFD /proc/91817/task/91828/fd (opendir: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91829 io_contex ceph cwd unknown /proc/91817/task/91829/cwd (readlink: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91829 io_contex ceph rtd unknown /proc/91817/task/91829/root (readlink: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91829 io_contex ceph txt unknown /proc/91817/task/91829/exe (readlink: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91829 io_contex ceph NOFD /proc/91817/task/91829/fd (opendir: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91830 io_contex ceph cwd unknown /proc/91817/task/91830/cwd (readlink: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91830 io_contex ceph rtd unknown /proc/91817/task/91830/root (readlink: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91830 io_contex ceph txt unknown /proc/91817/task/91830/exe (readlink: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91830 io_contex ceph NOFD /proc/91817/task/91830/fd (opendir: Permission denied) 2024-05-08T23:18:01.536 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91831 ms_dispat ceph cwd unknown /proc/91817/task/91831/cwd (readlink: Permission denied) 2024-05-08T23:18:01.537 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91831 ms_dispat ceph rtd unknown /proc/91817/task/91831/root (readlink: Permission denied) 2024-05-08T23:18:01.537 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91831 ms_dispat ceph txt unknown /proc/91817/task/91831/exe (readlink: Permission denied) 2024-05-08T23:18:01.537 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91831 ms_dispat ceph NOFD /proc/91817/task/91831/fd (opendir: Permission denied) 2024-05-08T23:18:01.537 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91832 ms_local ceph cwd unknown /proc/91817/task/91832/cwd (readlink: Permission denied) 2024-05-08T23:18:01.537 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91832 ms_local ceph rtd unknown /proc/91817/task/91832/root (readlink: Permission denied) 2024-05-08T23:18:01.537 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91832 ms_local ceph txt unknown /proc/91817/task/91832/exe (readlink: Permission denied) 2024-05-08T23:18:01.537 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91832 ms_local ceph NOFD /proc/91817/task/91832/fd (opendir: Permission denied) 2024-05-08T23:18:01.537 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91833 safe_time ceph cwd unknown /proc/91817/task/91833/cwd (readlink: Permission denied) 2024-05-08T23:18:01.537 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91833 safe_time ceph rtd unknown /proc/91817/task/91833/root (readlink: Permission denied) 2024-05-08T23:18:01.537 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91833 safe_time ceph txt unknown /proc/91817/task/91833/exe (readlink: Permission denied) 2024-05-08T23:18:01.537 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91833 safe_time ceph NOFD /proc/91817/task/91833/fd (opendir: Permission denied) 2024-05-08T23:18:01.537 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91834 safe_time ceph cwd unknown /proc/91817/task/91834/cwd (readlink: Permission denied) 2024-05-08T23:18:01.537 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91834 safe_time ceph rtd unknown /proc/91817/task/91834/root (readlink: Permission denied) 2024-05-08T23:18:01.537 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91834 safe_time ceph txt unknown /proc/91817/task/91834/exe (readlink: Permission denied) 2024-05-08T23:18:01.537 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91834 safe_time ceph NOFD /proc/91817/task/91834/fd (opendir: Permission denied) 2024-05-08T23:18:01.538 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91835 ceph-mds ceph cwd unknown /proc/91817/task/91835/cwd (readlink: Permission denied) 2024-05-08T23:18:01.538 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91835 ceph-mds ceph rtd unknown /proc/91817/task/91835/root (readlink: Permission denied) 2024-05-08T23:18:01.538 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91835 ceph-mds ceph txt unknown /proc/91817/task/91835/exe (readlink: Permission denied) 2024-05-08T23:18:01.538 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91835 ceph-mds ceph NOFD /proc/91817/task/91835/fd (opendir: Permission denied) 2024-05-08T23:18:01.538 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91993 safe_time ceph cwd unknown /proc/91817/task/91993/cwd (readlink: Permission denied) 2024-05-08T23:18:01.538 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91993 safe_time ceph rtd unknown /proc/91817/task/91993/root (readlink: Permission denied) 2024-05-08T23:18:01.538 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91993 safe_time ceph txt unknown /proc/91817/task/91993/exe (readlink: Permission denied) 2024-05-08T23:18:01.538 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 91817 91993 safe_time ceph NOFD /proc/91817/task/91993/fd (opendir: Permission denied) 2024-05-08T23:18:01.538 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 92182 root cwd unknown /proc/92182/cwd (readlink: Permission denied) 2024-05-08T23:18:01.538 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 92182 root rtd unknown /proc/92182/root (readlink: Permission denied) 2024-05-08T23:18:01.538 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 92182 root txt unknown /proc/92182/exe (readlink: Permission denied) 2024-05-08T23:18:01.538 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 92182 root NOFD /proc/92182/fd (opendir: Permission denied) 2024-05-08T23:18:01.538 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 92193 root cwd unknown /proc/92193/cwd (readlink: Permission denied) 2024-05-08T23:18:01.538 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 92193 root rtd unknown /proc/92193/root (readlink: Permission denied) 2024-05-08T23:18:01.538 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 92193 root txt unknown /proc/92193/exe (readlink: Permission denied) 2024-05-08T23:18:01.539 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 92193 root NOFD /proc/92193/fd (opendir: Permission denied) 2024-05-08T23:18:01.539 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 ceph cwd unknown /proc/92204/cwd (readlink: Permission denied) 2024-05-08T23:18:01.539 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 ceph rtd unknown /proc/92204/root (readlink: Permission denied) 2024-05-08T23:18:01.539 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 ceph txt unknown /proc/92204/exe (readlink: Permission denied) 2024-05-08T23:18:01.539 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 ceph NOFD /proc/92204/fd (opendir: Permission denied) 2024-05-08T23:18:01.539 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92205 log ceph cwd unknown /proc/92204/task/92205/cwd (readlink: Permission denied) 2024-05-08T23:18:01.539 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92205 log ceph rtd unknown /proc/92204/task/92205/root (readlink: Permission denied) 2024-05-08T23:18:01.539 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92205 log ceph txt unknown /proc/92204/task/92205/exe (readlink: Permission denied) 2024-05-08T23:18:01.539 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92205 log ceph NOFD /proc/92204/task/92205/fd (opendir: Permission denied) 2024-05-08T23:18:01.539 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92207 msgr-work ceph cwd unknown /proc/92204/task/92207/cwd (readlink: Permission denied) 2024-05-08T23:18:01.539 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92207 msgr-work ceph rtd unknown /proc/92204/task/92207/root (readlink: Permission denied) 2024-05-08T23:18:01.539 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92207 msgr-work ceph txt unknown /proc/92204/task/92207/exe (readlink: Permission denied) 2024-05-08T23:18:01.539 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92207 msgr-work ceph NOFD /proc/92204/task/92207/fd (opendir: Permission denied) 2024-05-08T23:18:01.539 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92208 msgr-work ceph cwd unknown /proc/92204/task/92208/cwd (readlink: Permission denied) 2024-05-08T23:18:01.539 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92208 msgr-work ceph rtd unknown /proc/92204/task/92208/root (readlink: Permission denied) 2024-05-08T23:18:01.540 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92208 msgr-work ceph txt unknown /proc/92204/task/92208/exe (readlink: Permission denied) 2024-05-08T23:18:01.540 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92208 msgr-work ceph NOFD /proc/92204/task/92208/fd (opendir: Permission denied) 2024-05-08T23:18:01.540 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92209 msgr-work ceph cwd unknown /proc/92204/task/92209/cwd (readlink: Permission denied) 2024-05-08T23:18:01.540 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92209 msgr-work ceph rtd unknown /proc/92204/task/92209/root (readlink: Permission denied) 2024-05-08T23:18:01.540 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92209 msgr-work ceph txt unknown /proc/92204/task/92209/exe (readlink: Permission denied) 2024-05-08T23:18:01.540 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92209 msgr-work ceph NOFD /proc/92204/task/92209/fd (opendir: Permission denied) 2024-05-08T23:18:01.540 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92213 service ceph cwd unknown /proc/92204/task/92213/cwd (readlink: Permission denied) 2024-05-08T23:18:01.540 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92213 service ceph rtd unknown /proc/92204/task/92213/root (readlink: Permission denied) 2024-05-08T23:18:01.540 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92213 service ceph txt unknown /proc/92204/task/92213/exe (readlink: Permission denied) 2024-05-08T23:18:01.540 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92213 service ceph NOFD /proc/92204/task/92213/fd (opendir: Permission denied) 2024-05-08T23:18:01.540 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92214 admin_soc ceph cwd unknown /proc/92204/task/92214/cwd (readlink: Permission denied) 2024-05-08T23:18:01.540 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92214 admin_soc ceph rtd unknown /proc/92204/task/92214/root (readlink: Permission denied) 2024-05-08T23:18:01.540 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92214 admin_soc ceph txt unknown /proc/92204/task/92214/exe (readlink: Permission denied) 2024-05-08T23:18:01.540 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92214 admin_soc ceph NOFD /proc/92204/task/92214/fd (opendir: Permission denied) 2024-05-08T23:18:01.540 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92215 signal_ha ceph cwd unknown /proc/92204/task/92215/cwd (readlink: Permission denied) 2024-05-08T23:18:01.541 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92215 signal_ha ceph rtd unknown /proc/92204/task/92215/root (readlink: Permission denied) 2024-05-08T23:18:01.541 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92215 signal_ha ceph txt unknown /proc/92204/task/92215/exe (readlink: Permission denied) 2024-05-08T23:18:01.541 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92215 signal_ha ceph NOFD /proc/92204/task/92215/fd (opendir: Permission denied) 2024-05-08T23:18:01.541 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92216 io_contex ceph cwd unknown /proc/92204/task/92216/cwd (readlink: Permission denied) 2024-05-08T23:18:01.541 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92216 io_contex ceph rtd unknown /proc/92204/task/92216/root (readlink: Permission denied) 2024-05-08T23:18:01.541 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92216 io_contex ceph txt unknown /proc/92204/task/92216/exe (readlink: Permission denied) 2024-05-08T23:18:01.541 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92216 io_contex ceph NOFD /proc/92204/task/92216/fd (opendir: Permission denied) 2024-05-08T23:18:01.541 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92217 io_contex ceph cwd unknown /proc/92204/task/92217/cwd (readlink: Permission denied) 2024-05-08T23:18:01.541 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92217 io_contex ceph rtd unknown /proc/92204/task/92217/root (readlink: Permission denied) 2024-05-08T23:18:01.541 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92217 io_contex ceph txt unknown /proc/92204/task/92217/exe (readlink: Permission denied) 2024-05-08T23:18:01.541 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92217 io_contex ceph NOFD /proc/92204/task/92217/fd (opendir: Permission denied) 2024-05-08T23:18:01.541 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92218 ms_dispat ceph cwd unknown /proc/92204/task/92218/cwd (readlink: Permission denied) 2024-05-08T23:18:01.541 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92218 ms_dispat ceph rtd unknown /proc/92204/task/92218/root (readlink: Permission denied) 2024-05-08T23:18:01.541 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92218 ms_dispat ceph txt unknown /proc/92204/task/92218/exe (readlink: Permission denied) 2024-05-08T23:18:01.541 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92218 ms_dispat ceph NOFD /proc/92204/task/92218/fd (opendir: Permission denied) 2024-05-08T23:18:01.542 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92219 ms_local ceph cwd unknown /proc/92204/task/92219/cwd (readlink: Permission denied) 2024-05-08T23:18:01.542 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92219 ms_local ceph rtd unknown /proc/92204/task/92219/root (readlink: Permission denied) 2024-05-08T23:18:01.542 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92219 ms_local ceph txt unknown /proc/92204/task/92219/exe (readlink: Permission denied) 2024-05-08T23:18:01.542 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92219 ms_local ceph NOFD /proc/92204/task/92219/fd (opendir: Permission denied) 2024-05-08T23:18:01.542 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92220 safe_time ceph cwd unknown /proc/92204/task/92220/cwd (readlink: Permission denied) 2024-05-08T23:18:01.542 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92220 safe_time ceph rtd unknown /proc/92204/task/92220/root (readlink: Permission denied) 2024-05-08T23:18:01.542 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92220 safe_time ceph txt unknown /proc/92204/task/92220/exe (readlink: Permission denied) 2024-05-08T23:18:01.542 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92220 safe_time ceph NOFD /proc/92204/task/92220/fd (opendir: Permission denied) 2024-05-08T23:18:01.542 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92221 safe_time ceph cwd unknown /proc/92204/task/92221/cwd (readlink: Permission denied) 2024-05-08T23:18:01.542 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92221 safe_time ceph rtd unknown /proc/92204/task/92221/root (readlink: Permission denied) 2024-05-08T23:18:01.542 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92221 safe_time ceph txt unknown /proc/92204/task/92221/exe (readlink: Permission denied) 2024-05-08T23:18:01.542 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92221 safe_time ceph NOFD /proc/92204/task/92221/fd (opendir: Permission denied) 2024-05-08T23:18:01.542 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92222 ceph-mds ceph cwd unknown /proc/92204/task/92222/cwd (readlink: Permission denied) 2024-05-08T23:18:01.542 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92222 ceph-mds ceph rtd unknown /proc/92204/task/92222/root (readlink: Permission denied) 2024-05-08T23:18:01.542 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92222 ceph-mds ceph txt unknown /proc/92204/task/92222/exe (readlink: Permission denied) 2024-05-08T23:18:01.543 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92222 ceph-mds ceph NOFD /proc/92204/task/92222/fd (opendir: Permission denied) 2024-05-08T23:18:01.543 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92227 safe_time ceph cwd unknown /proc/92204/task/92227/cwd (readlink: Permission denied) 2024-05-08T23:18:01.543 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92227 safe_time ceph rtd unknown /proc/92204/task/92227/root (readlink: Permission denied) 2024-05-08T23:18:01.543 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92227 safe_time ceph txt unknown /proc/92204/task/92227/exe (readlink: Permission denied) 2024-05-08T23:18:01.543 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92204 92227 safe_time ceph NOFD /proc/92204/task/92227/fd (opendir: Permission denied) 2024-05-08T23:18:01.543 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 92554 root cwd unknown /proc/92554/cwd (readlink: Permission denied) 2024-05-08T23:18:01.543 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 92554 root rtd unknown /proc/92554/root (readlink: Permission denied) 2024-05-08T23:18:01.543 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 92554 root txt unknown /proc/92554/exe (readlink: Permission denied) 2024-05-08T23:18:01.543 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 92554 root NOFD /proc/92554/fd (opendir: Permission denied) 2024-05-08T23:18:01.543 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 92555 root cwd unknown /proc/92555/cwd (readlink: Permission denied) 2024-05-08T23:18:01.543 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 92555 root rtd unknown /proc/92555/root (readlink: Permission denied) 2024-05-08T23:18:01.543 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 92555 root txt unknown /proc/92555/exe (readlink: Permission denied) 2024-05-08T23:18:01.543 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/7 92555 root NOFD /proc/92555/fd (opendir: Permission denied) 2024-05-08T23:18:01.543 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 92725 root cwd unknown /proc/92725/cwd (readlink: Permission denied) 2024-05-08T23:18:01.543 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 92725 root rtd unknown /proc/92725/root (readlink: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 92725 root txt unknown /proc/92725/exe (readlink: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 92725 root NOFD /proc/92725/fd (opendir: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 92737 root cwd unknown /proc/92737/cwd (readlink: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 92737 root rtd unknown /proc/92737/root (readlink: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 92737 root txt unknown /proc/92737/exe (readlink: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 92737 root NOFD /proc/92737/fd (opendir: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 ceph cwd unknown /proc/92768/cwd (readlink: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 ceph rtd unknown /proc/92768/root (readlink: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 ceph txt unknown /proc/92768/exe (readlink: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 ceph NOFD /proc/92768/fd (opendir: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92769 log ceph cwd unknown /proc/92768/task/92769/cwd (readlink: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92769 log ceph rtd unknown /proc/92768/task/92769/root (readlink: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92769 log ceph txt unknown /proc/92768/task/92769/exe (readlink: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92769 log ceph NOFD /proc/92768/task/92769/fd (opendir: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92771 msgr-work ceph cwd unknown /proc/92768/task/92771/cwd (readlink: Permission denied) 2024-05-08T23:18:01.544 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92771 msgr-work ceph rtd unknown /proc/92768/task/92771/root (readlink: Permission denied) 2024-05-08T23:18:01.545 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92771 msgr-work ceph txt unknown /proc/92768/task/92771/exe (readlink: Permission denied) 2024-05-08T23:18:01.545 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92771 msgr-work ceph NOFD /proc/92768/task/92771/fd (opendir: Permission denied) 2024-05-08T23:18:01.545 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92772 msgr-work ceph cwd unknown /proc/92768/task/92772/cwd (readlink: Permission denied) 2024-05-08T23:18:01.545 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92772 msgr-work ceph rtd unknown /proc/92768/task/92772/root (readlink: Permission denied) 2024-05-08T23:18:01.545 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92772 msgr-work ceph txt unknown /proc/92768/task/92772/exe (readlink: Permission denied) 2024-05-08T23:18:01.545 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92772 msgr-work ceph NOFD /proc/92768/task/92772/fd (opendir: Permission denied) 2024-05-08T23:18:01.545 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92773 msgr-work ceph cwd unknown /proc/92768/task/92773/cwd (readlink: Permission denied) 2024-05-08T23:18:01.545 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92773 msgr-work ceph rtd unknown /proc/92768/task/92773/root (readlink: Permission denied) 2024-05-08T23:18:01.545 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92773 msgr-work ceph txt unknown /proc/92768/task/92773/exe (readlink: Permission denied) 2024-05-08T23:18:01.545 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92773 msgr-work ceph NOFD /proc/92768/task/92773/fd (opendir: Permission denied) 2024-05-08T23:18:01.545 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92777 service ceph cwd unknown /proc/92768/task/92777/cwd (readlink: Permission denied) 2024-05-08T23:18:01.545 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92777 service ceph rtd unknown /proc/92768/task/92777/root (readlink: Permission denied) 2024-05-08T23:18:01.545 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92777 service ceph txt unknown /proc/92768/task/92777/exe (readlink: Permission denied) 2024-05-08T23:18:01.545 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92777 service ceph NOFD /proc/92768/task/92777/fd (opendir: Permission denied) 2024-05-08T23:18:01.545 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92778 admin_soc ceph cwd unknown /proc/92768/task/92778/cwd (readlink: Permission denied) 2024-05-08T23:18:01.546 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92778 admin_soc ceph rtd unknown /proc/92768/task/92778/root (readlink: Permission denied) 2024-05-08T23:18:01.546 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92778 admin_soc ceph txt unknown /proc/92768/task/92778/exe (readlink: Permission denied) 2024-05-08T23:18:01.546 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92778 admin_soc ceph NOFD /proc/92768/task/92778/fd (opendir: Permission denied) 2024-05-08T23:18:01.546 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92779 signal_ha ceph cwd unknown /proc/92768/task/92779/cwd (readlink: Permission denied) 2024-05-08T23:18:01.546 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92779 signal_ha ceph rtd unknown /proc/92768/task/92779/root (readlink: Permission denied) 2024-05-08T23:18:01.546 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92779 signal_ha ceph txt unknown /proc/92768/task/92779/exe (readlink: Permission denied) 2024-05-08T23:18:01.546 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92779 signal_ha ceph NOFD /proc/92768/task/92779/fd (opendir: Permission denied) 2024-05-08T23:18:01.546 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92780 io_contex ceph cwd unknown /proc/92768/task/92780/cwd (readlink: Permission denied) 2024-05-08T23:18:01.546 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92780 io_contex ceph rtd unknown /proc/92768/task/92780/root (readlink: Permission denied) 2024-05-08T23:18:01.546 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92780 io_contex ceph txt unknown /proc/92768/task/92780/exe (readlink: Permission denied) 2024-05-08T23:18:01.546 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92780 io_contex ceph NOFD /proc/92768/task/92780/fd (opendir: Permission denied) 2024-05-08T23:18:01.546 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92781 io_contex ceph cwd unknown /proc/92768/task/92781/cwd (readlink: Permission denied) 2024-05-08T23:18:01.546 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92781 io_contex ceph rtd unknown /proc/92768/task/92781/root (readlink: Permission denied) 2024-05-08T23:18:01.546 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92781 io_contex ceph txt unknown /proc/92768/task/92781/exe (readlink: Permission denied) 2024-05-08T23:18:01.546 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92781 io_contex ceph NOFD /proc/92768/task/92781/fd (opendir: Permission denied) 2024-05-08T23:18:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92782 ms_dispat ceph cwd unknown /proc/92768/task/92782/cwd (readlink: Permission denied) 2024-05-08T23:18:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92782 ms_dispat ceph rtd unknown /proc/92768/task/92782/root (readlink: Permission denied) 2024-05-08T23:18:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92782 ms_dispat ceph txt unknown /proc/92768/task/92782/exe (readlink: Permission denied) 2024-05-08T23:18:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92782 ms_dispat ceph NOFD /proc/92768/task/92782/fd (opendir: Permission denied) 2024-05-08T23:18:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92783 ms_local ceph cwd unknown /proc/92768/task/92783/cwd (readlink: Permission denied) 2024-05-08T23:18:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92783 ms_local ceph rtd unknown /proc/92768/task/92783/root (readlink: Permission denied) 2024-05-08T23:18:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92783 ms_local ceph txt unknown /proc/92768/task/92783/exe (readlink: Permission denied) 2024-05-08T23:18:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92783 ms_local ceph NOFD /proc/92768/task/92783/fd (opendir: Permission denied) 2024-05-08T23:18:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92784 safe_time ceph cwd unknown /proc/92768/task/92784/cwd (readlink: Permission denied) 2024-05-08T23:18:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92784 safe_time ceph rtd unknown /proc/92768/task/92784/root (readlink: Permission denied) 2024-05-08T23:18:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92784 safe_time ceph txt unknown /proc/92768/task/92784/exe (readlink: Permission denied) 2024-05-08T23:18:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92784 safe_time ceph NOFD /proc/92768/task/92784/fd (opendir: Permission denied) 2024-05-08T23:18:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92785 safe_time ceph cwd unknown /proc/92768/task/92785/cwd (readlink: Permission denied) 2024-05-08T23:18:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92785 safe_time ceph rtd unknown /proc/92768/task/92785/root (readlink: Permission denied) 2024-05-08T23:18:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92785 safe_time ceph txt unknown /proc/92768/task/92785/exe (readlink: Permission denied) 2024-05-08T23:18:01.548 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92785 safe_time ceph NOFD /proc/92768/task/92785/fd (opendir: Permission denied) 2024-05-08T23:18:01.548 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92786 ceph-mds ceph cwd unknown /proc/92768/task/92786/cwd (readlink: Permission denied) 2024-05-08T23:18:01.548 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92786 ceph-mds ceph rtd unknown /proc/92768/task/92786/root (readlink: Permission denied) 2024-05-08T23:18:01.548 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92786 ceph-mds ceph txt unknown /proc/92768/task/92786/exe (readlink: Permission denied) 2024-05-08T23:18:01.548 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92786 ceph-mds ceph NOFD /proc/92768/task/92786/fd (opendir: Permission denied) 2024-05-08T23:18:01.548 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92873 safe_time ceph cwd unknown /proc/92768/task/92873/cwd (readlink: Permission denied) 2024-05-08T23:18:01.548 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92873 safe_time ceph rtd unknown /proc/92768/task/92873/root (readlink: Permission denied) 2024-05-08T23:18:01.548 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92873 safe_time ceph txt unknown /proc/92768/task/92873/exe (readlink: Permission denied) 2024-05-08T23:18:01.548 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 92873 safe_time ceph NOFD /proc/92768/task/92873/fd (opendir: Permission denied) 2024-05-08T23:18:01.548 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94605 ceph_time ceph cwd unknown /proc/92768/task/94605/cwd (readlink: Permission denied) 2024-05-08T23:18:01.548 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94605 ceph_time ceph rtd unknown /proc/92768/task/94605/root (readlink: Permission denied) 2024-05-08T23:18:01.548 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94605 ceph_time ceph txt unknown /proc/92768/task/94605/exe (readlink: Permission denied) 2024-05-08T23:18:01.548 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94605 ceph_time ceph NOFD /proc/92768/task/94605/fd (opendir: Permission denied) 2024-05-08T23:18:01.548 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94608 OpHistory ceph cwd unknown /proc/92768/task/94608/cwd (readlink: Permission denied) 2024-05-08T23:18:01.548 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94608 OpHistory ceph rtd unknown /proc/92768/task/94608/root (readlink: Permission denied) 2024-05-08T23:18:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94608 OpHistory ceph txt unknown /proc/92768/task/94608/exe (readlink: Permission denied) 2024-05-08T23:18:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94608 OpHistory ceph NOFD /proc/92768/task/94608/fd (opendir: Permission denied) 2024-05-08T23:18:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94609 ms_dispat ceph cwd unknown /proc/92768/task/94609/cwd (readlink: Permission denied) 2024-05-08T23:18:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94609 ms_dispat ceph rtd unknown /proc/92768/task/94609/root (readlink: Permission denied) 2024-05-08T23:18:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94609 ms_dispat ceph txt unknown /proc/92768/task/94609/exe (readlink: Permission denied) 2024-05-08T23:18:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94609 ms_dispat ceph NOFD /proc/92768/task/94609/fd (opendir: Permission denied) 2024-05-08T23:18:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94611 mds_rank_ ceph cwd unknown /proc/92768/task/94611/cwd (readlink: Permission denied) 2024-05-08T23:18:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94611 mds_rank_ ceph rtd unknown /proc/92768/task/94611/root (readlink: Permission denied) 2024-05-08T23:18:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94611 mds_rank_ ceph txt unknown /proc/92768/task/94611/exe (readlink: Permission denied) 2024-05-08T23:18:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94611 mds_rank_ ceph NOFD /proc/92768/task/94611/fd (opendir: Permission denied) 2024-05-08T23:18:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94613 PQ_Finish ceph cwd unknown /proc/92768/task/94613/cwd (readlink: Permission denied) 2024-05-08T23:18:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94613 PQ_Finish ceph rtd unknown /proc/92768/task/94613/root (readlink: Permission denied) 2024-05-08T23:18:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94613 PQ_Finish ceph txt unknown /proc/92768/task/94613/exe (readlink: Permission denied) 2024-05-08T23:18:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94613 PQ_Finish ceph NOFD /proc/92768/task/94613/fd (opendir: Permission denied) 2024-05-08T23:18:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94615 safe_time ceph cwd unknown /proc/92768/task/94615/cwd (readlink: Permission denied) 2024-05-08T23:18:01.550 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94615 safe_time ceph rtd unknown /proc/92768/task/94615/root (readlink: Permission denied) 2024-05-08T23:18:01.550 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94615 safe_time ceph txt unknown /proc/92768/task/94615/exe (readlink: Permission denied) 2024-05-08T23:18:01.550 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94615 safe_time ceph NOFD /proc/92768/task/94615/fd (opendir: Permission denied) 2024-05-08T23:18:01.550 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94618 MR_Finish ceph cwd unknown /proc/92768/task/94618/cwd (readlink: Permission denied) 2024-05-08T23:18:01.550 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94618 MR_Finish ceph rtd unknown /proc/92768/task/94618/root (readlink: Permission denied) 2024-05-08T23:18:01.550 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94618 MR_Finish ceph txt unknown /proc/92768/task/94618/exe (readlink: Permission denied) 2024-05-08T23:18:01.550 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94618 MR_Finish ceph NOFD /proc/92768/task/94618/fd (opendir: Permission denied) 2024-05-08T23:18:01.550 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94621 md_submit ceph cwd unknown /proc/92768/task/94621/cwd (readlink: Permission denied) 2024-05-08T23:18:01.550 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94621 md_submit ceph rtd unknown /proc/92768/task/94621/root (readlink: Permission denied) 2024-05-08T23:18:01.550 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94621 md_submit ceph txt unknown /proc/92768/task/94621/exe (readlink: Permission denied) 2024-05-08T23:18:01.550 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 92768 94621 md_submit ceph NOFD /proc/92768/task/94621/fd (opendir: Permission denied) 2024-05-08T23:18:01.550 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 93089 root cwd unknown /proc/93089/cwd (readlink: Permission denied) 2024-05-08T23:18:01.550 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 93089 root rtd unknown /proc/93089/root (readlink: Permission denied) 2024-05-08T23:18:01.550 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 93089 root txt unknown /proc/93089/exe (readlink: Permission denied) 2024-05-08T23:18:01.550 INFO:tasks.workunit.client.0.smithi135.stdout:conmon 93089 root NOFD /proc/93089/fd (opendir: Permission denied) 2024-05-08T23:18:01.551 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 93100 root cwd unknown /proc/93100/cwd (readlink: Permission denied) 2024-05-08T23:18:01.551 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 93100 root rtd unknown /proc/93100/root (readlink: Permission denied) 2024-05-08T23:18:01.551 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 93100 root txt unknown /proc/93100/exe (readlink: Permission denied) 2024-05-08T23:18:01.551 INFO:tasks.workunit.client.0.smithi135.stdout:podman-in 93100 root NOFD /proc/93100/fd (opendir: Permission denied) 2024-05-08T23:18:01.551 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 ceph cwd unknown /proc/93112/cwd (readlink: Permission denied) 2024-05-08T23:18:01.551 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 ceph rtd unknown /proc/93112/root (readlink: Permission denied) 2024-05-08T23:18:01.551 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 ceph txt unknown /proc/93112/exe (readlink: Permission denied) 2024-05-08T23:18:01.551 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 ceph NOFD /proc/93112/fd (opendir: Permission denied) 2024-05-08T23:18:01.551 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93113 log ceph cwd unknown /proc/93112/task/93113/cwd (readlink: Permission denied) 2024-05-08T23:18:01.551 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93113 log ceph rtd unknown /proc/93112/task/93113/root (readlink: Permission denied) 2024-05-08T23:18:01.551 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93113 log ceph txt unknown /proc/93112/task/93113/exe (readlink: Permission denied) 2024-05-08T23:18:01.551 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93113 log ceph NOFD /proc/93112/task/93113/fd (opendir: Permission denied) 2024-05-08T23:18:01.551 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93115 msgr-work ceph cwd unknown /proc/93112/task/93115/cwd (readlink: Permission denied) 2024-05-08T23:18:01.551 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93115 msgr-work ceph rtd unknown /proc/93112/task/93115/root (readlink: Permission denied) 2024-05-08T23:18:01.551 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93115 msgr-work ceph txt unknown /proc/93112/task/93115/exe (readlink: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93115 msgr-work ceph NOFD /proc/93112/task/93115/fd (opendir: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93116 msgr-work ceph cwd unknown /proc/93112/task/93116/cwd (readlink: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93116 msgr-work ceph rtd unknown /proc/93112/task/93116/root (readlink: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93116 msgr-work ceph txt unknown /proc/93112/task/93116/exe (readlink: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93116 msgr-work ceph NOFD /proc/93112/task/93116/fd (opendir: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93117 msgr-work ceph cwd unknown /proc/93112/task/93117/cwd (readlink: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93117 msgr-work ceph rtd unknown /proc/93112/task/93117/root (readlink: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93117 msgr-work ceph txt unknown /proc/93112/task/93117/exe (readlink: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93117 msgr-work ceph NOFD /proc/93112/task/93117/fd (opendir: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93121 service ceph cwd unknown /proc/93112/task/93121/cwd (readlink: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93121 service ceph rtd unknown /proc/93112/task/93121/root (readlink: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93121 service ceph txt unknown /proc/93112/task/93121/exe (readlink: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93121 service ceph NOFD /proc/93112/task/93121/fd (opendir: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93122 admin_soc ceph cwd unknown /proc/93112/task/93122/cwd (readlink: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93122 admin_soc ceph rtd unknown /proc/93112/task/93122/root (readlink: Permission denied) 2024-05-08T23:18:01.552 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93122 admin_soc ceph txt unknown /proc/93112/task/93122/exe (readlink: Permission denied) 2024-05-08T23:18:01.553 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93122 admin_soc ceph NOFD /proc/93112/task/93122/fd (opendir: Permission denied) 2024-05-08T23:18:01.553 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93123 signal_ha ceph cwd unknown /proc/93112/task/93123/cwd (readlink: Permission denied) 2024-05-08T23:18:01.553 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93123 signal_ha ceph rtd unknown /proc/93112/task/93123/root (readlink: Permission denied) 2024-05-08T23:18:01.553 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93123 signal_ha ceph txt unknown /proc/93112/task/93123/exe (readlink: Permission denied) 2024-05-08T23:18:01.553 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93123 signal_ha ceph NOFD /proc/93112/task/93123/fd (opendir: Permission denied) 2024-05-08T23:18:01.553 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93124 io_contex ceph cwd unknown /proc/93112/task/93124/cwd (readlink: Permission denied) 2024-05-08T23:18:01.553 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93124 io_contex ceph rtd unknown /proc/93112/task/93124/root (readlink: Permission denied) 2024-05-08T23:18:01.553 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93124 io_contex ceph txt unknown /proc/93112/task/93124/exe (readlink: Permission denied) 2024-05-08T23:18:01.553 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93124 io_contex ceph NOFD /proc/93112/task/93124/fd (opendir: Permission denied) 2024-05-08T23:18:01.553 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93125 io_contex ceph cwd unknown /proc/93112/task/93125/cwd (readlink: Permission denied) 2024-05-08T23:18:01.553 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93125 io_contex ceph rtd unknown /proc/93112/task/93125/root (readlink: Permission denied) 2024-05-08T23:18:01.553 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93125 io_contex ceph txt unknown /proc/93112/task/93125/exe (readlink: Permission denied) 2024-05-08T23:18:01.553 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93125 io_contex ceph NOFD /proc/93112/task/93125/fd (opendir: Permission denied) 2024-05-08T23:18:01.553 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93126 ms_dispat ceph cwd unknown /proc/93112/task/93126/cwd (readlink: Permission denied) 2024-05-08T23:18:01.553 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93126 ms_dispat ceph rtd unknown /proc/93112/task/93126/root (readlink: Permission denied) 2024-05-08T23:18:01.554 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93126 ms_dispat ceph txt unknown /proc/93112/task/93126/exe (readlink: Permission denied) 2024-05-08T23:18:01.554 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93126 ms_dispat ceph NOFD /proc/93112/task/93126/fd (opendir: Permission denied) 2024-05-08T23:18:01.554 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93127 ms_local ceph cwd unknown /proc/93112/task/93127/cwd (readlink: Permission denied) 2024-05-08T23:18:01.554 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93127 ms_local ceph rtd unknown /proc/93112/task/93127/root (readlink: Permission denied) 2024-05-08T23:18:01.554 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93127 ms_local ceph txt unknown /proc/93112/task/93127/exe (readlink: Permission denied) 2024-05-08T23:18:01.554 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93127 ms_local ceph NOFD /proc/93112/task/93127/fd (opendir: Permission denied) 2024-05-08T23:18:01.554 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93128 safe_time ceph cwd unknown /proc/93112/task/93128/cwd (readlink: Permission denied) 2024-05-08T23:18:01.554 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93128 safe_time ceph rtd unknown /proc/93112/task/93128/root (readlink: Permission denied) 2024-05-08T23:18:01.554 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93128 safe_time ceph txt unknown /proc/93112/task/93128/exe (readlink: Permission denied) 2024-05-08T23:18:01.554 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93128 safe_time ceph NOFD /proc/93112/task/93128/fd (opendir: Permission denied) 2024-05-08T23:18:01.554 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93129 safe_time ceph cwd unknown /proc/93112/task/93129/cwd (readlink: Permission denied) 2024-05-08T23:18:01.554 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93129 safe_time ceph rtd unknown /proc/93112/task/93129/root (readlink: Permission denied) 2024-05-08T23:18:01.554 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93129 safe_time ceph txt unknown /proc/93112/task/93129/exe (readlink: Permission denied) 2024-05-08T23:18:01.554 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93129 safe_time ceph NOFD /proc/93112/task/93129/fd (opendir: Permission denied) 2024-05-08T23:18:01.555 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93130 ceph-mds ceph cwd unknown /proc/93112/task/93130/cwd (readlink: Permission denied) 2024-05-08T23:18:01.555 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93130 ceph-mds ceph rtd unknown /proc/93112/task/93130/root (readlink: Permission denied) 2024-05-08T23:18:01.555 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93130 ceph-mds ceph txt unknown /proc/93112/task/93130/exe (readlink: Permission denied) 2024-05-08T23:18:01.555 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93130 ceph-mds ceph NOFD /proc/93112/task/93130/fd (opendir: Permission denied) 2024-05-08T23:18:01.555 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93178 safe_time ceph cwd unknown /proc/93112/task/93178/cwd (readlink: Permission denied) 2024-05-08T23:18:01.555 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93178 safe_time ceph rtd unknown /proc/93112/task/93178/root (readlink: Permission denied) 2024-05-08T23:18:01.555 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93178 safe_time ceph txt unknown /proc/93112/task/93178/exe (readlink: Permission denied) 2024-05-08T23:18:01.555 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 93178 safe_time ceph NOFD /proc/93112/task/93178/fd (opendir: Permission denied) 2024-05-08T23:18:01.555 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94606 ceph_time ceph cwd unknown /proc/93112/task/94606/cwd (readlink: Permission denied) 2024-05-08T23:18:01.555 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94606 ceph_time ceph rtd unknown /proc/93112/task/94606/root (readlink: Permission denied) 2024-05-08T23:18:01.555 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94606 ceph_time ceph txt unknown /proc/93112/task/94606/exe (readlink: Permission denied) 2024-05-08T23:18:01.555 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94606 ceph_time ceph NOFD /proc/93112/task/94606/fd (opendir: Permission denied) 2024-05-08T23:18:01.555 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94607 OpHistory ceph cwd unknown /proc/93112/task/94607/cwd (readlink: Permission denied) 2024-05-08T23:18:01.555 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94607 OpHistory ceph rtd unknown /proc/93112/task/94607/root (readlink: Permission denied) 2024-05-08T23:18:01.555 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94607 OpHistory ceph txt unknown /proc/93112/task/94607/exe (readlink: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94607 OpHistory ceph NOFD /proc/93112/task/94607/fd (opendir: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94610 ms_dispat ceph cwd unknown /proc/93112/task/94610/cwd (readlink: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94610 ms_dispat ceph rtd unknown /proc/93112/task/94610/root (readlink: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94610 ms_dispat ceph txt unknown /proc/93112/task/94610/exe (readlink: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94610 ms_dispat ceph NOFD /proc/93112/task/94610/fd (opendir: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94612 mds_rank_ ceph cwd unknown /proc/93112/task/94612/cwd (readlink: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94612 mds_rank_ ceph rtd unknown /proc/93112/task/94612/root (readlink: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94612 mds_rank_ ceph txt unknown /proc/93112/task/94612/exe (readlink: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94612 mds_rank_ ceph NOFD /proc/93112/task/94612/fd (opendir: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94614 PQ_Finish ceph cwd unknown /proc/93112/task/94614/cwd (readlink: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94614 PQ_Finish ceph rtd unknown /proc/93112/task/94614/root (readlink: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94614 PQ_Finish ceph txt unknown /proc/93112/task/94614/exe (readlink: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94614 PQ_Finish ceph NOFD /proc/93112/task/94614/fd (opendir: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94616 safe_time ceph cwd unknown /proc/93112/task/94616/cwd (readlink: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94616 safe_time ceph rtd unknown /proc/93112/task/94616/root (readlink: Permission denied) 2024-05-08T23:18:01.556 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94616 safe_time ceph txt unknown /proc/93112/task/94616/exe (readlink: Permission denied) 2024-05-08T23:18:01.557 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94616 safe_time ceph NOFD /proc/93112/task/94616/fd (opendir: Permission denied) 2024-05-08T23:18:01.557 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94617 MR_Finish ceph cwd unknown /proc/93112/task/94617/cwd (readlink: Permission denied) 2024-05-08T23:18:01.557 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94617 MR_Finish ceph rtd unknown /proc/93112/task/94617/root (readlink: Permission denied) 2024-05-08T23:18:01.557 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94617 MR_Finish ceph txt unknown /proc/93112/task/94617/exe (readlink: Permission denied) 2024-05-08T23:18:01.557 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94617 MR_Finish ceph NOFD /proc/93112/task/94617/fd (opendir: Permission denied) 2024-05-08T23:18:01.557 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94622 md_submit ceph cwd unknown /proc/93112/task/94622/cwd (readlink: Permission denied) 2024-05-08T23:18:01.557 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94622 md_submit ceph rtd unknown /proc/93112/task/94622/root (readlink: Permission denied) 2024-05-08T23:18:01.557 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94622 md_submit ceph txt unknown /proc/93112/task/94622/exe (readlink: Permission denied) 2024-05-08T23:18:01.557 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-mds 93112 94622 md_submit ceph NOFD /proc/93112/task/94622/fd (opendir: Permission denied) 2024-05-08T23:18:01.557 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 95758 root cwd unknown /proc/95758/cwd (readlink: Permission denied) 2024-05-08T23:18:01.557 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 95758 root rtd unknown /proc/95758/root (readlink: Permission denied) 2024-05-08T23:18:01.557 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 95758 root txt unknown /proc/95758/exe (readlink: Permission denied) 2024-05-08T23:18:01.557 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/4 95758 root NOFD /proc/95758/fd (opendir: Permission denied) 2024-05-08T23:18:01.557 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 96682 root cwd unknown /proc/96682/cwd (readlink: Permission denied) 2024-05-08T23:18:01.558 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 96682 root rtd unknown /proc/96682/root (readlink: Permission denied) 2024-05-08T23:18:01.558 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 96682 root txt unknown /proc/96682/exe (readlink: Permission denied) 2024-05-08T23:18:01.558 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/5 96682 root NOFD /proc/96682/fd (opendir: Permission denied) 2024-05-08T23:18:01.558 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 105379 root cwd unknown /proc/105379/cwd (readlink: Permission denied) 2024-05-08T23:18:01.558 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 105379 root rtd unknown /proc/105379/root (readlink: Permission denied) 2024-05-08T23:18:01.558 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 105379 root txt unknown /proc/105379/exe (readlink: Permission denied) 2024-05-08T23:18:01.558 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/0 105379 root NOFD /proc/105379/fd (opendir: Permission denied) 2024-05-08T23:18:01.558 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-msgr 105957 root cwd unknown /proc/105957/cwd (readlink: Permission denied) 2024-05-08T23:18:01.558 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-msgr 105957 root rtd unknown /proc/105957/root (readlink: Permission denied) 2024-05-08T23:18:01.558 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-msgr 105957 root txt unknown /proc/105957/exe (readlink: Permission denied) 2024-05-08T23:18:01.558 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-msgr 105957 root NOFD /proc/105957/fd (opendir: Permission denied) 2024-05-08T23:18:01.558 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-watc 105959 root cwd unknown /proc/105959/cwd (readlink: Permission denied) 2024-05-08T23:18:01.558 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-watc 105959 root rtd unknown /proc/105959/root (readlink: Permission denied) 2024-05-08T23:18:01.558 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-watc 105959 root txt unknown /proc/105959/exe (readlink: Permission denied) 2024-05-08T23:18:01.558 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-watc 105959 root NOFD /proc/105959/fd (opendir: Permission denied) 2024-05-08T23:18:01.559 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-comp 105960 root cwd unknown /proc/105960/cwd (readlink: Permission denied) 2024-05-08T23:18:01.559 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-comp 105960 root rtd unknown /proc/105960/root (readlink: Permission denied) 2024-05-08T23:18:01.559 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-comp 105960 root txt unknown /proc/105960/exe (readlink: Permission denied) 2024-05-08T23:18:01.559 INFO:tasks.workunit.client.0.smithi135.stdout:ceph-comp 105960 root NOFD /proc/105960/fd (opendir: Permission denied) 2024-05-08T23:18:01.559 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 106243 root cwd unknown /proc/106243/cwd (readlink: Permission denied) 2024-05-08T23:18:01.559 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 106243 root rtd unknown /proc/106243/root (readlink: Permission denied) 2024-05-08T23:18:01.559 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 106243 root txt unknown /proc/106243/exe (readlink: Permission denied) 2024-05-08T23:18:01.559 INFO:tasks.workunit.client.0.smithi135.stdout:sudo 106243 root NOFD /proc/106243/fd (opendir: Permission denied) 2024-05-08T23:18:01.559 INFO:tasks.workunit.client.0.smithi135.stdout:daemon-he 106274 root cwd unknown /proc/106274/cwd (readlink: Permission denied) 2024-05-08T23:18:01.559 INFO:tasks.workunit.client.0.smithi135.stdout:daemon-he 106274 root rtd unknown /proc/106274/root (readlink: Permission denied) 2024-05-08T23:18:01.559 INFO:tasks.workunit.client.0.smithi135.stdout:daemon-he 106274 root txt unknown /proc/106274/exe (readlink: Permission denied) 2024-05-08T23:18:01.559 INFO:tasks.workunit.client.0.smithi135.stdout:daemon-he 106274 root NOFD /proc/106274/fd (opendir: Permission denied) 2024-05-08T23:18:01.559 INFO:tasks.workunit.client.0.smithi135.stdout:bash 106283 root cwd unknown /proc/106283/cwd (readlink: Permission denied) 2024-05-08T23:18:01.559 INFO:tasks.workunit.client.0.smithi135.stdout:bash 106283 root rtd unknown /proc/106283/root (readlink: Permission denied) 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:bash 106283 root txt unknown /proc/106283/exe (readlink: Permission denied) 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:bash 106283 root NOFD /proc/106283/fd (opendir: Permission denied) 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu cwd DIR 0,124 4 1099511629283 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu rtd DIR 8,1 4096 2 / 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu txt REG 8,1 42840 7406 /usr/bin/timeout 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 2586930 18369 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 149976 5181 /usr/lib64/libpthread-2.28.so 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 42744 5185 /usr/lib64/librt-2.28.so 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 337024 18370 /usr/lib/locale/en_US.utf8/LC_CTYPE 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 54 18374 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 3316 18324 /usr/lib/locale/en_US.utf8/LC_TIME 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 286 18408 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 57 18372 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-05-08T23:18:01.560 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 34 18389 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-05-08T23:18:01.561 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 77 18373 /usr/lib/locale/en_US.utf8/LC_NAME 2024-05-08T23:18:01.561 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 167 18405 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-05-08T23:18:01.561 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 59 18409 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-05-08T23:18:01.561 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 23 18407 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-05-08T23:18:01.561 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 26998 5205 /usr/lib64/gconv/gconv-modules.cache 2024-05-08T23:18:01.561 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu mem REG 8,1 368 18406 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-05-08T23:18:01.561 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu 0r FIFO 0,13 0t0 436264 pipe 2024-05-08T23:18:01.561 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu 1w FIFO 0,13 0t0 436265 pipe 2024-05-08T23:18:01.561 INFO:tasks.workunit.client.0.smithi135.stdout:timeout 107208 ubuntu 2w FIFO 0,13 0t0 436266 pipe 2024-05-08T23:18:01.561 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu cwd DIR 0,124 4 1099511629283 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T23:18:01.561 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu rtd DIR 8,1 4096 2 / 2024-05-08T23:18:01.561 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu txt REG 8,1 1150584 5206 /usr/bin/bash 2024-05-08T23:18:01.561 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 2586930 18369 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-05-08T23:18:01.561 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-05-08T23:18:01.562 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 19584 5169 /usr/lib64/libdl-2.28.so 2024-05-08T23:18:01.562 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 187552 4894 /usr/lib64/libtinfo.so.6.1 2024-05-08T23:18:01.562 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-05-08T23:18:01.562 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 337024 18370 /usr/lib/locale/en_US.utf8/LC_CTYPE 2024-05-08T23:18:01.562 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 54 18374 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-05-08T23:18:01.562 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 3316 18324 /usr/lib/locale/en_US.utf8/LC_TIME 2024-05-08T23:18:01.562 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 286 18408 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-05-08T23:18:01.562 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 57 18372 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-05-08T23:18:01.562 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 34 18389 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-05-08T23:18:01.562 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 77 18373 /usr/lib/locale/en_US.utf8/LC_NAME 2024-05-08T23:18:01.562 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 167 18405 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-05-08T23:18:01.562 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 59 18409 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-05-08T23:18:01.562 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 23 18407 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-05-08T23:18:01.562 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 26998 5205 /usr/lib64/gconv/gconv-modules.cache 2024-05-08T23:18:01.562 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu mem REG 8,1 368 18406 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-05-08T23:18:01.563 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu 0r FIFO 0,13 0t0 436264 pipe 2024-05-08T23:18:01.563 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu 1w FIFO 0,13 0t0 436265 pipe 2024-05-08T23:18:01.563 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu 2w FIFO 0,13 0t0 436266 pipe 2024-05-08T23:18:01.563 INFO:tasks.workunit.client.0.smithi135.stdout:fsync-tes 107229 ubuntu 255r REG 8,1 209 1966761 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-05-08T23:18:01.563 INFO:tasks.workunit.client.0.smithi135.stdout:sleep 107293 root cwd unknown /proc/107293/cwd (readlink: Permission denied) 2024-05-08T23:18:01.563 INFO:tasks.workunit.client.0.smithi135.stdout:sleep 107293 root rtd unknown /proc/107293/root (readlink: Permission denied) 2024-05-08T23:18:01.563 INFO:tasks.workunit.client.0.smithi135.stdout:sleep 107293 root txt unknown /proc/107293/exe (readlink: Permission denied) 2024-05-08T23:18:01.563 INFO:tasks.workunit.client.0.smithi135.stdout:sleep 107293 root NOFD /proc/107293/fd (opendir: Permission denied) 2024-05-08T23:18:01.563 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 107467 root cwd unknown /proc/107467/cwd (readlink: Permission denied) 2024-05-08T23:18:01.563 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 107467 root rtd unknown /proc/107467/root (readlink: Permission denied) 2024-05-08T23:18:01.563 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 107467 root txt unknown /proc/107467/exe (readlink: Permission denied) 2024-05-08T23:18:01.563 INFO:tasks.workunit.client.0.smithi135.stdout:kworker/u 107467 root NOFD /proc/107467/fd (opendir: Permission denied) 2024-05-08T23:18:01.563 INFO:tasks.workunit.client.0.smithi135.stdout:sleep 107611 root cwd unknown /proc/107611/cwd (readlink: Permission denied) 2024-05-08T23:18:01.563 INFO:tasks.workunit.client.0.smithi135.stdout:sleep 107611 root rtd unknown /proc/107611/root (readlink: Permission denied) 2024-05-08T23:18:01.563 INFO:tasks.workunit.client.0.smithi135.stdout:sleep 107611 root txt unknown /proc/107611/exe (readlink: Permission denied) 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:sleep 107611 root NOFD /proc/107611/fd (opendir: Permission denied) 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu cwd DIR 0,124 4 1099511629283 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu rtd DIR 8,1 4096 2 / 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu txt REG 8,1 179672 11587 /usr/bin/lsof 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 99600 5318 /usr/lib64/libz.so.1.2.11 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 88824 5183 /usr/lib64/libresolv-2.28.so 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 3087848 2384 /usr/lib64/libcrypto.so.1.1.1k 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 16192 5609 /usr/lib64/libkeyutils.so.1.6 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 71464 7213 /usr/lib64/libkrb5support.so.0.1 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 149976 5181 /usr/lib64/libpthread-2.28.so 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 16792 5320 /usr/lib64/libcom_err.so.2.1 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 96272 7207 /usr/lib64/libk5crypto.so.3.1 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 975608 7212 /usr/lib64/libkrb5.so.3.3 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 355960 7204 /usr/lib64/libgssapi_krb5.so.2.2 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 19584 5169 /usr/lib64/libdl-2.28.so 2024-05-08T23:18:01.564 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 543160 4872 /usr/lib64/libpcre2-8.so.0.7.1 2024-05-08T23:18:01.565 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-05-08T23:18:01.565 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 213592 7222 /usr/lib64/libtirpc.so.3.0.0 2024-05-08T23:18:01.565 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 168536 4876 /usr/lib64/libselinux.so.1 2024-05-08T23:18:01.565 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-05-08T23:18:01.565 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 337024 18370 /usr/lib/locale/en_US.utf8/LC_CTYPE 2024-05-08T23:18:01.565 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu mem REG 8,1 26998 5205 /usr/lib64/gconv/gconv-modules.cache 2024-05-08T23:18:01.565 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu 0r FIFO 0,13 0t0 436264 pipe 2024-05-08T23:18:01.565 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu 1w FIFO 0,13 0t0 436265 pipe 2024-05-08T23:18:01.566 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu 2w FIFO 0,13 0t0 436266 pipe 2024-05-08T23:18:01.566 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu 3r DIR 0,5 0 1 /proc 2024-05-08T23:18:01.566 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu 4r DIR 0,5 0 432804 /proc/107613/fd 2024-05-08T23:18:01.566 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu 5w FIFO 0,13 0t0 432809 pipe 2024-05-08T23:18:01.566 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107613 ubuntu 6r FIFO 0,13 0t0 432810 pipe 2024-05-08T23:18:01.566 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu cwd DIR 0,124 4 1099511629283 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T23:18:01.566 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu rtd DIR 8,1 4096 2 / 2024-05-08T23:18:01.566 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu txt REG 8,1 179672 11587 /usr/bin/lsof 2024-05-08T23:18:01.566 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 99600 5318 /usr/lib64/libz.so.1.2.11 2024-05-08T23:18:01.566 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 88824 5183 /usr/lib64/libresolv-2.28.so 2024-05-08T23:18:01.566 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 3087848 2384 /usr/lib64/libcrypto.so.1.1.1k 2024-05-08T23:18:01.566 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 16192 5609 /usr/lib64/libkeyutils.so.1.6 2024-05-08T23:18:01.566 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 71464 7213 /usr/lib64/libkrb5support.so.0.1 2024-05-08T23:18:01.566 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 149976 5181 /usr/lib64/libpthread-2.28.so 2024-05-08T23:18:01.567 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 16792 5320 /usr/lib64/libcom_err.so.2.1 2024-05-08T23:18:01.567 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 96272 7207 /usr/lib64/libk5crypto.so.3.1 2024-05-08T23:18:01.567 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 975608 7212 /usr/lib64/libkrb5.so.3.3 2024-05-08T23:18:01.567 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 355960 7204 /usr/lib64/libgssapi_krb5.so.2.2 2024-05-08T23:18:01.567 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 19584 5169 /usr/lib64/libdl-2.28.so 2024-05-08T23:18:01.567 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 543160 4872 /usr/lib64/libpcre2-8.so.0.7.1 2024-05-08T23:18:01.567 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-05-08T23:18:01.567 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 213592 7222 /usr/lib64/libtirpc.so.3.0.0 2024-05-08T23:18:01.567 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 168536 4876 /usr/lib64/libselinux.so.1 2024-05-08T23:18:01.567 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-05-08T23:18:01.567 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 337024 18370 /usr/lib/locale/en_US.utf8/LC_CTYPE 2024-05-08T23:18:01.567 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu mem REG 8,1 26998 5205 /usr/lib64/gconv/gconv-modules.cache 2024-05-08T23:18:01.567 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu 4r FIFO 0,13 0t0 432809 pipe 2024-05-08T23:18:01.567 INFO:tasks.workunit.client.0.smithi135.stdout:lsof 107614 ubuntu 7w FIFO 0,13 0t0 432810 pipe 2024-05-08T23:18:01.568 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T23:18:01.568 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T23:18:01.631 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-05-08T23:18:01.631 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-08T23:18:01.911 DEBUG:teuthology.parallel:result is None 2024-05-08T23:18:01.912 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T23:18:01.950 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T23:18:01.950 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-05-08T23:18:01.961 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T23:18:01.998 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-08T23:18:02.049 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T23:18:02.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.174+0000 7ff7d1b3d700 1 -- 172.21.15.135:0/2256119612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc1019b0 msgr2=0x7ff7cc103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:02.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.174+0000 7ff7d1b3d700 1 --2- 172.21.15.135:0/2256119612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc1019b0 0x7ff7cc103da0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009990 tx=0x7ff7bc009ca0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.174+0000 7ff7d1b3d700 1 -- 172.21.15.135:0/2256119612 shutdown_connections 2024-05-08T23:18:02.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.174+0000 7ff7d1b3d700 1 --2- 172.21.15.135:0/2256119612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7cc106c10 0x7ff7cc109000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.174+0000 7ff7d1b3d700 1 --2- 172.21.15.135:0/2256119612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc1019b0 0x7ff7cc103da0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.174+0000 7ff7d1b3d700 1 --2- 172.21.15.135:0/2256119612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7cc1042e0 0x7ff7cc1066d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.174+0000 7ff7d1b3d700 1 -- 172.21.15.135:0/2256119612 >> 172.21.15.135:0/2256119612 conn(0x7ff7cc0fb300 msgr2=0x7ff7cc0fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:02.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.174+0000 7ff7d1b3d700 1 -- 172.21.15.135:0/2256119612 shutdown_connections 2024-05-08T23:18:02.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.174+0000 7ff7d1b3d700 1 -- 172.21.15.135:0/2256119612 wait complete. 2024-05-08T23:18:02.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.174+0000 7ff7d1b3d700 1 Processor -- start 2024-05-08T23:18:02.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7d1b3d700 1 -- start start 2024-05-08T23:18:02.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7d1b3d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7cc1019b0 0x7ff7cc1012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:02.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7d1b3d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7cc1042e0 0x7ff7cc0ff960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:02.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7d1b3d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc106c10 0x7ff7cc0ffea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:02.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7d1b3d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc100640 con 0x7ff7cc106c10 2024-05-08T23:18:02.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7d1b3d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc1007b0 con 0x7ff7cc1042e0 2024-05-08T23:18:02.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7d1b3d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc1a0e40 con 0x7ff7cc1019b0 2024-05-08T23:18:02.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7cbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc106c10 0x7ff7cc0ffea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:02.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7cbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc106c10 0x7ff7cc0ffea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44706/0 (socket says 172.21.15.135:44706) 2024-05-08T23:18:02.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7cbfff700 1 -- 172.21.15.135:0/1770777889 learned_addr learned my addr 172.21.15.135:0/1770777889 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:02.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7caffd700 1 --2- 172.21.15.135:0/1770777889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7cc1042e0 0x7ff7cc0ff960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:02.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7cbfff700 1 -- 172.21.15.135:0/1770777889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7cc1019b0 msgr2=0x7ff7cc1012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:02.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7cb7fe700 1 --2- 172.21.15.135:0/1770777889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7cc1019b0 0x7ff7cc1012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:02.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7cbfff700 1 --2- 172.21.15.135:0/1770777889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7cc1019b0 0x7ff7cc1012d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7cbfff700 1 -- 172.21.15.135:0/1770777889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7cc1042e0 msgr2=0x7ff7cc0ff960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:02.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7cbfff700 1 --2- 172.21.15.135:0/1770777889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7cc1042e0 0x7ff7cc0ff960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7cbfff700 1 -- 172.21.15.135:0/1770777889 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc0095f0 con 0x7ff7cc106c10 2024-05-08T23:18:02.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.175+0000 7ff7cbfff700 1 --2- 172.21.15.135:0/1770777889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc106c10 0x7ff7cc0ffea0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400ada0 tx=0x7ff7c400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:02.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.176+0000 7ff7c8ff9700 1 -- 172.21.15.135:0/1770777889 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400f070 con 0x7ff7cc106c10 2024-05-08T23:18:02.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.176+0000 7ff7c8ff9700 1 -- 172.21.15.135:0/1770777889 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7c4007b30 con 0x7ff7cc106c10 2024-05-08T23:18:02.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.176+0000 7ff7c8ff9700 1 -- 172.21.15.135:0/1770777889 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4005440 con 0x7ff7cc106c10 2024-05-08T23:18:02.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.176+0000 7ff7d1b3d700 1 -- 172.21.15.135:0/1770777889 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc1a10d0 con 0x7ff7cc106c10 2024-05-08T23:18:02.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.176+0000 7ff7d1b3d700 1 -- 172.21.15.135:0/1770777889 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc1a1590 con 0x7ff7cc106c10 2024-05-08T23:18:02.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.177+0000 7ff7d1b3d700 1 -- 172.21.15.135:0/1770777889 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc0fce80 con 0x7ff7cc106c10 2024-05-08T23:18:02.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.178+0000 7ff7c8ff9700 1 -- 172.21.15.135:0/1770777889 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7ff7c400c920 con 0x7ff7cc106c10 2024-05-08T23:18:02.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.178+0000 7ff7c8ff9700 1 --2- 172.21.15.135:0/1770777889 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff7b40a1120 0x7ff7b40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:02.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.178+0000 7ff7cb7fe700 1 --2- 172.21.15.135:0/1770777889 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff7b40a1120 0x7ff7b40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:02.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.178+0000 7ff7c8ff9700 1 -- 172.21.15.135:0/1770777889 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff7c40cbfb0 con 0x7ff7cc106c10 2024-05-08T23:18:02.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.179+0000 7ff7cb7fe700 1 --2- 172.21.15.135:0/1770777889 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff7b40a1120 0x7ff7b40a35e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0095c0 tx=0x7ff7bc009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:02.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.183+0000 7ff7c8ff9700 1 -- 172.21.15.135:0/1770777889 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff7c4095750 con 0x7ff7cc106c10 2024-05-08T23:18:02.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:02 smithi135 ceph-mon[42440]: pgmap v335: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 861 KiB/s wr, 13 op/s 2024-05-08T23:18:02.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.382+0000 7ff7d1b3d700 1 -- 172.21.15.135:0/1770777889 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7cc067380 con 0x7ff7cc106c10 2024-05-08T23:18:02.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.384+0000 7ff7c8ff9700 1 -- 172.21.15.135:0/1770777889 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22702 (secure 0 0 0) 0x7ff7c4098d70 con 0x7ff7cc106c10 2024-05-08T23:18:02.385 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:18:02.385 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":85,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:15:22.121685+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T23:14:19.726838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T23:14:21.097732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:18:02.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.386+0000 7ff7d1b3d700 1 -- 172.21.15.135:0/1770777889 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff7b40a1120 msgr2=0x7ff7b40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:02.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.386+0000 7ff7d1b3d700 1 --2- 172.21.15.135:0/1770777889 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff7b40a1120 0x7ff7b40a35e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0095c0 tx=0x7ff7bc009510 comp rx=0 tx=0).stop 2024-05-08T23:18:02.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.386+0000 7ff7d1b3d700 1 -- 172.21.15.135:0/1770777889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc106c10 msgr2=0x7ff7cc0ffea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:02.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.386+0000 7ff7d1b3d700 1 --2- 172.21.15.135:0/1770777889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc106c10 0x7ff7cc0ffea0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400ada0 tx=0x7ff7c400c330 comp rx=0 tx=0).stop 2024-05-08T23:18:02.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.386+0000 7ff7d1b3d700 1 -- 172.21.15.135:0/1770777889 shutdown_connections 2024-05-08T23:18:02.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.386+0000 7ff7d1b3d700 1 --2- 172.21.15.135:0/1770777889 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff7b40a1120 0x7ff7b40a35e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.386+0000 7ff7d1b3d700 1 --2- 172.21.15.135:0/1770777889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7cc1019b0 0x7ff7cc1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.386+0000 7ff7d1b3d700 1 --2- 172.21.15.135:0/1770777889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc106c10 0x7ff7cc0ffea0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.386+0000 7ff7d1b3d700 1 --2- 172.21.15.135:0/1770777889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7cc1042e0 0x7ff7cc0ff960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.386+0000 7ff7d1b3d700 1 -- 172.21.15.135:0/1770777889 >> 172.21.15.135:0/1770777889 conn(0x7ff7cc0fb300 msgr2=0x7ff7cc102410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:02.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.386+0000 7ff7d1b3d700 1 -- 172.21.15.135:0/1770777889 shutdown_connections 2024-05-08T23:18:02.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.386+0000 7ff7d1b3d700 1 -- 172.21.15.135:0/1770777889 wait complete. 2024-05-08T23:18:02.399 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:11:11.282550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T23:14:19.726838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T23:14:21.097732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T23:18:02.400 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T23:18:02.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.525+0000 7fd74f733700 1 -- 172.21.15.135:0/3352932448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd748100f80 msgr2=0x7fd7481013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:02.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.525+0000 7fd74f733700 1 --2- 172.21.15.135:0/3352932448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd748100f80 0x7fd7481013a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd7380099c0 tx=0x7fd738009cd0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.525+0000 7fd74f733700 1 -- 172.21.15.135:0/3352932448 shutdown_connections 2024-05-08T23:18:02.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.525+0000 7fd74f733700 1 --2- 172.21.15.135:0/3352932448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd748102b10 0x7fd7481093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.525+0000 7fd74f733700 1 --2- 172.21.15.135:0/3352932448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd748100f80 0x7fd7481013a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.525+0000 7fd74f733700 1 --2- 172.21.15.135:0/3352932448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd748102170 0x7fd7481025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.525+0000 7fd74f733700 1 -- 172.21.15.135:0/3352932448 >> 172.21.15.135:0/3352932448 conn(0x7fd7480fc4f0 msgr2=0x7fd7480fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:02.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.525+0000 7fd74f733700 1 -- 172.21.15.135:0/3352932448 shutdown_connections 2024-05-08T23:18:02.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.525+0000 7fd74f733700 1 -- 172.21.15.135:0/3352932448 wait complete. 2024-05-08T23:18:02.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.526+0000 7fd74f733700 1 Processor -- start 2024-05-08T23:18:02.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.526+0000 7fd74f733700 1 -- start start 2024-05-08T23:18:02.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.526+0000 7fd74f733700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd748100f80 0x7fd748196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:02.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.526+0000 7fd74f733700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd748102170 0x7fd748197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:02.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.526+0000 7fd74f733700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd748102b10 0x7fd74819e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:02.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.526+0000 7fd74f733700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74819ea60 con 0x7fd748102170 2024-05-08T23:18:02.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.526+0000 7fd74f733700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74819eba0 con 0x7fd748102b10 2024-05-08T23:18:02.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.526+0000 7fd74f733700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74819ed30 con 0x7fd748100f80 2024-05-08T23:18:02.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.526+0000 7fd74ccce700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd748102170 0x7fd748197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:02.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.526+0000 7fd74ccce700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd748102170 0x7fd748197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44718/0 (socket says 172.21.15.135:44718) 2024-05-08T23:18:02.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.526+0000 7fd74ccce700 1 -- 172.21.15.135:0/1482068928 learned_addr learned my addr 172.21.15.135:0/1482068928 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:02.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.526+0000 7fd74d4cf700 1 --2- 172.21.15.135:0/1482068928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd748100f80 0x7fd748196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:02.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.526+0000 7fd74dcd0700 1 --2- 172.21.15.135:0/1482068928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd748102b10 0x7fd74819e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:02.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.527+0000 7fd74ccce700 1 -- 172.21.15.135:0/1482068928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd748100f80 msgr2=0x7fd748196f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:02.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.527+0000 7fd74ccce700 1 --2- 172.21.15.135:0/1482068928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd748100f80 0x7fd748196f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.527+0000 7fd74ccce700 1 -- 172.21.15.135:0/1482068928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd748102b10 msgr2=0x7fd74819e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:02.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.527+0000 7fd74ccce700 1 --2- 172.21.15.135:0/1482068928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd748102b10 0x7fd74819e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.527+0000 7fd74ccce700 1 -- 172.21.15.135:0/1482068928 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380095f0 con 0x7fd748102170 2024-05-08T23:18:02.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.527+0000 7fd74ccce700 1 --2- 172.21.15.135:0/1482068928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd748102170 0x7fd748197470 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd74400d980 tx=0x7fd74400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:02.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.527+0000 7fd73e7fc700 1 -- 172.21.15.135:0/1482068928 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744004220 con 0x7fd748102170 2024-05-08T23:18:02.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.527+0000 7fd73e7fc700 1 -- 172.21.15.135:0/1482068928 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd744007640 con 0x7fd748102170 2024-05-08T23:18:02.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.527+0000 7fd74f733700 1 -- 172.21.15.135:0/1482068928 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74819efb0 con 0x7fd748102170 2024-05-08T23:18:02.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.527+0000 7fd73e7fc700 1 -- 172.21.15.135:0/1482068928 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744005610 con 0x7fd748102170 2024-05-08T23:18:02.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.527+0000 7fd74f733700 1 -- 172.21.15.135:0/1482068928 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74819f490 con 0x7fd748102170 2024-05-08T23:18:02.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.528+0000 7fd74f733700 1 -- 172.21.15.135:0/1482068928 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7481083a0 con 0x7fd748102170 2024-05-08T23:18:02.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.529+0000 7fd73e7fc700 1 -- 172.21.15.135:0/1482068928 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fd744004750 con 0x7fd748102170 2024-05-08T23:18:02.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.529+0000 7fd73e7fc700 1 --2- 172.21.15.135:0/1482068928 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd7340a1120 0x7fd7340a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:02.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.530+0000 7fd74d4cf700 1 --2- 172.21.15.135:0/1482068928 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd7340a1120 0x7fd7340a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:02.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.530+0000 7fd73e7fc700 1 -- 172.21.15.135:0/1482068928 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd7440ccc70 con 0x7fd748102170 2024-05-08T23:18:02.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.530+0000 7fd74d4cf700 1 --2- 172.21.15.135:0/1482068928 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd7340a1120 0x7fd7340a35e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd738009f50 tx=0x7fd738005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:02.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.533+0000 7fd73e7fc700 1 -- 172.21.15.135:0/1482068928 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd7440963e0 con 0x7fd748102170 2024-05-08T23:18:02.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:02 smithi179 ceph-mon[46314]: pgmap v335: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 861 KiB/s wr, 13 op/s 2024-05-08T23:18:02.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:02 smithi195 ceph-mon[46516]: pgmap v335: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 861 KiB/s wr, 13 op/s 2024-05-08T23:18:02.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.728+0000 7fd74f733700 1 -- 172.21.15.135:0/1482068928 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd74810c7e0 con 0x7fd748102170 2024-05-08T23:18:02.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.729+0000 7fd73e7fc700 1 -- 172.21.15.135:0/1482068928 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7440160a0 con 0x7fd748102170 2024-05-08T23:18:02.730 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T23:18:02.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.731+0000 7fd74f733700 1 -- 172.21.15.135:0/1482068928 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd7340a1120 msgr2=0x7fd7340a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:02.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.731+0000 7fd74f733700 1 --2- 172.21.15.135:0/1482068928 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd7340a1120 0x7fd7340a35e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd738009f50 tx=0x7fd738005ea0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.731+0000 7fd74f733700 1 -- 172.21.15.135:0/1482068928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd748102170 msgr2=0x7fd748197470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:02.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.731+0000 7fd74f733700 1 --2- 172.21.15.135:0/1482068928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd748102170 0x7fd748197470 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd74400d980 tx=0x7fd74400dc90 comp rx=0 tx=0).stop 2024-05-08T23:18:02.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.731+0000 7fd74f733700 1 -- 172.21.15.135:0/1482068928 shutdown_connections 2024-05-08T23:18:02.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.731+0000 7fd74f733700 1 --2- 172.21.15.135:0/1482068928 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fd7340a1120 0x7fd7340a35e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.731+0000 7fd74f733700 1 --2- 172.21.15.135:0/1482068928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd748100f80 0x7fd748196f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.731+0000 7fd74f733700 1 --2- 172.21.15.135:0/1482068928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd748102b10 0x7fd74819e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.731+0000 7fd74f733700 1 --2- 172.21.15.135:0/1482068928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd748102170 0x7fd748197470 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:02.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.731+0000 7fd74f733700 1 -- 172.21.15.135:0/1482068928 >> 172.21.15.135:0/1482068928 conn(0x7fd7480fc4f0 msgr2=0x7fd7481054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:02.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.731+0000 7fd74f733700 1 -- 172.21.15.135:0/1482068928 shutdown_connections 2024-05-08T23:18:02.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:02.731+0000 7fd74f733700 1 -- 172.21.15.135:0/1482068928 wait complete. 2024-05-08T23:18:02.744 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T23:18:03.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.004+0000 7f3cb2c83700 1 -- 172.21.15.135:0/3635169486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac1020f0 msgr2=0x7f3cac102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:03.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.004+0000 7f3cb2c83700 1 --2- 172.21.15.135:0/3635169486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac1020f0 0x7f3cac102570 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009990 tx=0x7f3c98009ca0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.005+0000 7f3cb2c83700 1 -- 172.21.15.135:0/3635169486 shutdown_connections 2024-05-08T23:18:03.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.005+0000 7f3cb2c83700 1 --2- 172.21.15.135:0/3635169486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cac100f20 0x7f3cac101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.005+0000 7f3cb2c83700 1 --2- 172.21.15.135:0/3635169486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cac102ab0 0x7f3cac1093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.005+0000 7f3cb2c83700 1 --2- 172.21.15.135:0/3635169486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac1020f0 0x7f3cac102570 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.005+0000 7f3cb2c83700 1 -- 172.21.15.135:0/3635169486 >> 172.21.15.135:0/3635169486 conn(0x7f3cac0fc500 msgr2=0x7f3cac0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:03.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.005+0000 7f3cb2c83700 1 -- 172.21.15.135:0/3635169486 shutdown_connections 2024-05-08T23:18:03.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.005+0000 7f3cb2c83700 1 -- 172.21.15.135:0/3635169486 wait complete. 2024-05-08T23:18:03.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.005+0000 7f3cb2c83700 1 Processor -- start 2024-05-08T23:18:03.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb2c83700 1 -- start start 2024-05-08T23:18:03.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb2c83700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cac100f20 0x7f3cac196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:03.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb2c83700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cac1020f0 0x7f3cac1974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:03.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb2c83700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac102ab0 0x7f3cac19e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb2c83700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac19ead0 con 0x7f3cac102ab0 2024-05-08T23:18:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb2c83700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac19ec10 con 0x7f3cac100f20 2024-05-08T23:18:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb2c83700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac19eda0 con 0x7f3cac1020f0 2024-05-08T23:18:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb1220700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac102ab0 0x7f3cac19e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb1220700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac102ab0 0x7f3cac19e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44730/0 (socket says 172.21.15.135:44730) 2024-05-08T23:18:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb1220700 1 -- 172.21.15.135:0/887653945 learned_addr learned my addr 172.21.15.135:0/887653945 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb0a1f700 1 --2- 172.21.15.135:0/887653945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cac100f20 0x7f3cac196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cabfff700 1 --2- 172.21.15.135:0/887653945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cac1020f0 0x7f3cac1974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb1220700 1 -- 172.21.15.135:0/887653945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cac1020f0 msgr2=0x7f3cac1974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb1220700 1 --2- 172.21.15.135:0/887653945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cac1020f0 0x7f3cac1974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb1220700 1 -- 172.21.15.135:0/887653945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cac100f20 msgr2=0x7f3cac196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb1220700 1 --2- 172.21.15.135:0/887653945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cac100f20 0x7f3cac196fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.006+0000 7f3cb1220700 1 -- 172.21.15.135:0/887653945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c980095f0 con 0x7f3cac102ab0 2024-05-08T23:18:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.007+0000 7f3cb1220700 1 --2- 172.21.15.135:0/887653945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac102ab0 0x7f3cac19e500 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400b970 tx=0x7f3ca400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.007+0000 7f3ca9ffb700 1 -- 172.21.15.135:0/887653945 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400c9b0 con 0x7f3cac102ab0 2024-05-08T23:18:03.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.007+0000 7f3ca9ffb700 1 -- 172.21.15.135:0/887653945 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ca4014440 con 0x7f3cac102ab0 2024-05-08T23:18:03.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.007+0000 7f3cb2c83700 1 -- 172.21.15.135:0/887653945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac19f080 con 0x7f3cac102ab0 2024-05-08T23:18:03.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.007+0000 7f3ca9ffb700 1 -- 172.21.15.135:0/887653945 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40075d0 con 0x7f3cac102ab0 2024-05-08T23:18:03.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.007+0000 7f3cb2c83700 1 -- 172.21.15.135:0/887653945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac19f590 con 0x7f3cac102ab0 2024-05-08T23:18:03.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.009+0000 7f3cb2c83700 1 -- 172.21.15.135:0/887653945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac108410 con 0x7f3cac102ab0 2024-05-08T23:18:03.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.011+0000 7f3ca9ffb700 1 -- 172.21.15.135:0/887653945 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f3ca40145b0 con 0x7f3cac102ab0 2024-05-08T23:18:03.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.012+0000 7f3ca9ffb700 1 --2- 172.21.15.135:0/887653945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c9c0a12f0 0x7f3c9c0a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:03.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.012+0000 7f3cb0a1f700 1 --2- 172.21.15.135:0/887653945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c9c0a12f0 0x7f3c9c0a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:03.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.012+0000 7f3ca9ffb700 1 -- 172.21.15.135:0/887653945 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3ca4006e40 con 0x7f3cac102ab0 2024-05-08T23:18:03.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.013+0000 7f3cb0a1f700 1 --2- 172.21.15.135:0/887653945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c9c0a12f0 0x7f3c9c0a37b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3cac100c40 tx=0x7f3ca0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:03.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.016+0000 7f3ca9ffb700 1 -- 172.21.15.135:0/887653945 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3ca4095bd0 con 0x7f3cac102ab0 2024-05-08T23:18:03.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.245+0000 7f3cb2c83700 1 -- 172.21.15.135:0/887653945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3cac10c860 con 0x7f3cac102ab0 2024-05-08T23:18:03.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.245+0000 7f3ca9ffb700 1 -- 172.21.15.135:0/887653945 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ca4019020 con 0x7f3cac102ab0 2024-05-08T23:18:03.246 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T23:18:03.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.248+0000 7f3cb2c83700 1 -- 172.21.15.135:0/887653945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c9c0a12f0 msgr2=0x7f3c9c0a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:03.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.248+0000 7f3cb2c83700 1 --2- 172.21.15.135:0/887653945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c9c0a12f0 0x7f3c9c0a37b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3cac100c40 tx=0x7f3ca0009260 comp rx=0 tx=0).stop 2024-05-08T23:18:03.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.248+0000 7f3cb2c83700 1 -- 172.21.15.135:0/887653945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac102ab0 msgr2=0x7f3cac19e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:03.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.248+0000 7f3cb2c83700 1 --2- 172.21.15.135:0/887653945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac102ab0 0x7f3cac19e500 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400b970 tx=0x7f3ca400bd30 comp rx=0 tx=0).stop 2024-05-08T23:18:03.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.248+0000 7f3cb2c83700 1 -- 172.21.15.135:0/887653945 shutdown_connections 2024-05-08T23:18:03.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.248+0000 7f3cb2c83700 1 --2- 172.21.15.135:0/887653945 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f3c9c0a12f0 0x7f3c9c0a37b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.248+0000 7f3cb2c83700 1 --2- 172.21.15.135:0/887653945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac102ab0 0x7f3cac19e500 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.248+0000 7f3cb2c83700 1 --2- 172.21.15.135:0/887653945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cac100f20 0x7f3cac196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.248+0000 7f3cb2c83700 1 --2- 172.21.15.135:0/887653945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cac1020f0 0x7f3cac1974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.248+0000 7f3cb2c83700 1 -- 172.21.15.135:0/887653945 >> 172.21.15.135:0/887653945 conn(0x7f3cac0fc500 msgr2=0x7f3cac105550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:03.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.248+0000 7f3cb2c83700 1 -- 172.21.15.135:0/887653945 shutdown_connections 2024-05-08T23:18:03.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.248+0000 7f3cb2c83700 1 -- 172.21.15.135:0/887653945 wait complete. 2024-05-08T23:18:03.261 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T23:18:03.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.386+0000 7f526df10700 1 -- 172.21.15.135:0/997306363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5268101990 msgr2=0x7f52681082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:03.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.386+0000 7f526df10700 1 --2- 172.21.15.135:0/997306363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5268101990 0x7f52681082b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f526000b0a0 tx=0x7f526000b3b0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.386+0000 7f526df10700 1 -- 172.21.15.135:0/997306363 shutdown_connections 2024-05-08T23:18:03.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.386+0000 7f526df10700 1 --2- 172.21.15.135:0/997306363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52680ffe80 0x7f52681002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.386+0000 7f526df10700 1 --2- 172.21.15.135:0/997306363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5268101990 0x7f52681082b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.386+0000 7f526df10700 1 --2- 172.21.15.135:0/997306363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5268100fd0 0x7f5268101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.386+0000 7f526df10700 1 -- 172.21.15.135:0/997306363 >> 172.21.15.135:0/997306363 conn(0x7f52680fb3f0 msgr2=0x7f52680fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:03.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.386+0000 7f526df10700 1 -- 172.21.15.135:0/997306363 shutdown_connections 2024-05-08T23:18:03.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.386+0000 7f526df10700 1 -- 172.21.15.135:0/997306363 wait complete. 2024-05-08T23:18:03.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.387+0000 7f526df10700 1 Processor -- start 2024-05-08T23:18:03.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.387+0000 7f526df10700 1 -- start start 2024-05-08T23:18:03.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.387+0000 7f526df10700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52680ffe80 0x7f5268069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:03.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.387+0000 7f526df10700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5268100fd0 0x7f526819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:03.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.387+0000 7f526df10700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5268101990 0x7f526819e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:03.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.387+0000 7f526df10700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526819eb20 con 0x7f5268100fd0 2024-05-08T23:18:03.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.387+0000 7f526df10700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526819ec90 con 0x7f5268101990 2024-05-08T23:18:03.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.387+0000 7f526df10700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526819ee50 con 0x7f52680ffe80 2024-05-08T23:18:03.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.387+0000 7f5266ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5268100fd0 0x7f526819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:03.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.387+0000 7f5266ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5268100fd0 0x7f526819bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44750/0 (socket says 172.21.15.135:44750) 2024-05-08T23:18:03.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.387+0000 7f5266ffd700 1 -- 172.21.15.135:0/495126245 learned_addr learned my addr 172.21.15.135:0/495126245 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:03.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.387+0000 7f5267fff700 1 --2- 172.21.15.135:0/495126245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5268101990 0x7f526819e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:03.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.387+0000 7f52677fe700 1 --2- 172.21.15.135:0/495126245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52680ffe80 0x7f5268069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:03.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.388+0000 7f5266ffd700 1 -- 172.21.15.135:0/495126245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52680ffe80 msgr2=0x7f5268069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:03.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.388+0000 7f5266ffd700 1 --2- 172.21.15.135:0/495126245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52680ffe80 0x7f5268069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.388+0000 7f5266ffd700 1 -- 172.21.15.135:0/495126245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5268101990 msgr2=0x7f526819e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:03.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.388+0000 7f5266ffd700 1 --2- 172.21.15.135:0/495126245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5268101990 0x7f526819e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.388+0000 7f5266ffd700 1 -- 172.21.15.135:0/495126245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5260009d00 con 0x7f5268100fd0 2024-05-08T23:18:03.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.388+0000 7f5266ffd700 1 --2- 172.21.15.135:0/495126245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5268100fd0 0x7f526819bd90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f525c00b530 tx=0x7f525c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:03.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.388+0000 7f5264ff9700 1 -- 172.21.15.135:0/495126245 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c011830 con 0x7f5268100fd0 2024-05-08T23:18:03.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.388+0000 7f5264ff9700 1 -- 172.21.15.135:0/495126245 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f525c011e50 con 0x7f5268100fd0 2024-05-08T23:18:03.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.388+0000 7f526df10700 1 -- 172.21.15.135:0/495126245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526819f130 con 0x7f5268100fd0 2024-05-08T23:18:03.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.388+0000 7f5264ff9700 1 -- 172.21.15.135:0/495126245 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c00f2e0 con 0x7f5268100fd0 2024-05-08T23:18:03.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.388+0000 7f526df10700 1 -- 172.21.15.135:0/495126245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526819f690 con 0x7f5268100fd0 2024-05-08T23:18:03.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.389+0000 7f526df10700 1 -- 172.21.15.135:0/495126245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5268107220 con 0x7f5268100fd0 2024-05-08T23:18:03.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.390+0000 7f5264ff9700 1 -- 172.21.15.135:0/495126245 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f525c0105a0 con 0x7f5268100fd0 2024-05-08T23:18:03.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.391+0000 7f5264ff9700 1 --2- 172.21.15.135:0/495126245 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f52500a11a0 0x7f52500a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:03.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.391+0000 7f52677fe700 1 --2- 172.21.15.135:0/495126245 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f52500a11a0 0x7f52500a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:03.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.391+0000 7f5264ff9700 1 -- 172.21.15.135:0/495126245 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f525c0cc7f0 con 0x7f5268100fd0 2024-05-08T23:18:03.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.391+0000 7f52677fe700 1 --2- 172.21.15.135:0/495126245 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f52500a11a0 0x7f52500a3660 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5258005950 tx=0x7f525800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:03.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.395+0000 7f5264ff9700 1 -- 172.21.15.135:0/495126245 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f525c095f60 con 0x7f5268100fd0 2024-05-08T23:18:03.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:03 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1770777889' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:18:03.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:03 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1482068928' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:18:03.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.596+0000 7f526df10700 1 -- 172.21.15.135:0/495126245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f526810b930 con 0x7f5268100fd0 2024-05-08T23:18:03.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.597+0000 7f5264ff9700 1 -- 172.21.15.135:0/495126245 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f525c0150a0 con 0x7f5268100fd0 2024-05-08T23:18:03.598 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-08T23:18:03.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.599+0000 7f526df10700 1 -- 172.21.15.135:0/495126245 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f52500a11a0 msgr2=0x7f52500a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:03.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.599+0000 7f526df10700 1 --2- 172.21.15.135:0/495126245 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f52500a11a0 0x7f52500a3660 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5258005950 tx=0x7f525800b410 comp rx=0 tx=0).stop 2024-05-08T23:18:03.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.599+0000 7f526df10700 1 -- 172.21.15.135:0/495126245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5268100fd0 msgr2=0x7f526819bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:03.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.599+0000 7f526df10700 1 --2- 172.21.15.135:0/495126245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5268100fd0 0x7f526819bd90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f525c00b530 tx=0x7f525c00b840 comp rx=0 tx=0).stop 2024-05-08T23:18:03.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.599+0000 7f526df10700 1 -- 172.21.15.135:0/495126245 shutdown_connections 2024-05-08T23:18:03.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.599+0000 7f526df10700 1 --2- 172.21.15.135:0/495126245 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f52500a11a0 0x7f52500a3660 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.599+0000 7f526df10700 1 --2- 172.21.15.135:0/495126245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52680ffe80 0x7f5268069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.599+0000 7f526df10700 1 --2- 172.21.15.135:0/495126245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5268101990 0x7f526819e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.599+0000 7f526df10700 1 --2- 172.21.15.135:0/495126245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5268100fd0 0x7f526819bd90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.599+0000 7f526df10700 1 -- 172.21.15.135:0/495126245 >> 172.21.15.135:0/495126245 conn(0x7f52680fb3f0 msgr2=0x7f5268104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:03.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.599+0000 7f526df10700 1 -- 172.21.15.135:0/495126245 shutdown_connections 2024-05-08T23:18:03.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.599+0000 7f526df10700 1 -- 172.21.15.135:0/495126245 wait complete. 2024-05-08T23:18:03.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:03 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1770777889' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:18:03.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:03 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1482068928' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:18:03.612 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-08T23:18:03.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:03 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1770777889' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:18:03.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:03 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1482068928' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:18:03.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.734+0000 7fdbb7baa700 1 -- 172.21.15.135:0/2808464238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb0100f50 msgr2=0x7fdbb01013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:03.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.734+0000 7fdbb7baa700 1 --2- 172.21.15.135:0/2808464238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb0100f50 0x7fdbb01013b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdba00099c0 tx=0x7fdba0009cd0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.734+0000 7fdbb7baa700 1 -- 172.21.15.135:0/2808464238 shutdown_connections 2024-05-08T23:18:03.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.734+0000 7fdbb7baa700 1 --2- 172.21.15.135:0/2808464238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbb01018f0 0x7fdbb01081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.734+0000 7fdbb7baa700 1 --2- 172.21.15.135:0/2808464238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbb00ffd60 0x7fdbb0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.734+0000 7fdbb7baa700 1 --2- 172.21.15.135:0/2808464238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb0100f50 0x7fdbb01013b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.734+0000 7fdbb7baa700 1 -- 172.21.15.135:0/2808464238 >> 172.21.15.135:0/2808464238 conn(0x7fdbb00fb2f0 msgr2=0x7fdbb00fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:03.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.734+0000 7fdbb7baa700 1 -- 172.21.15.135:0/2808464238 shutdown_connections 2024-05-08T23:18:03.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.734+0000 7fdbb7baa700 1 -- 172.21.15.135:0/2808464238 wait complete. 2024-05-08T23:18:03.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb7baa700 1 Processor -- start 2024-05-08T23:18:03.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb7baa700 1 -- start start 2024-05-08T23:18:03.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb7baa700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbb00ffd60 0x7fdbb0196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:03.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb7baa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb0100f50 0x7fdbb0197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:03.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb7baa700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbb01018f0 0x7fdbb019e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:03.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb7baa700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb019e960 con 0x7fdbb0100f50 2024-05-08T23:18:03.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb7baa700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb019eaa0 con 0x7fdbb01018f0 2024-05-08T23:18:03.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb7baa700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb019ec30 con 0x7fdbb00ffd60 2024-05-08T23:18:03.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb5145700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb0100f50 0x7fdbb0197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:03.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb5145700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb0100f50 0x7fdbb0197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44762/0 (socket says 172.21.15.135:44762) 2024-05-08T23:18:03.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb5145700 1 -- 172.21.15.135:0/1547825176 learned_addr learned my addr 172.21.15.135:0/1547825176 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:03.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb6147700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbb01018f0 0x7fdbb019e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:03.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb5145700 1 -- 172.21.15.135:0/1547825176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbb00ffd60 msgr2=0x7fdbb0196e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:03.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb5946700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbb00ffd60 0x7fdbb0196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:03.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb5145700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbb00ffd60 0x7fdbb0196e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb5145700 1 -- 172.21.15.135:0/1547825176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbb01018f0 msgr2=0x7fdbb019e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:03.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb5145700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbb01018f0 0x7fdbb019e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:03.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb5145700 1 -- 172.21.15.135:0/1547825176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac009520 con 0x7fdbb0100f50 2024-05-08T23:18:03.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb6147700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbb01018f0 0x7fdbb019e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:18:03.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.735+0000 7fdbb5946700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbb00ffd60 0x7fdbb0196e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:18:03.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.736+0000 7fdbb5145700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb0100f50 0x7fdbb0197370 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdba0003730 tx=0x7fdba000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:03.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.736+0000 7fdba6ffd700 1 -- 172.21.15.135:0/1547825176 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba001d070 con 0x7fdbb0100f50 2024-05-08T23:18:03.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.736+0000 7fdbb7baa700 1 -- 172.21.15.135:0/1547825176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba00095f0 con 0x7fdbb0100f50 2024-05-08T23:18:03.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.736+0000 7fdba6ffd700 1 -- 172.21.15.135:0/1547825176 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdba000bda0 con 0x7fdbb0100f50 2024-05-08T23:18:03.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.736+0000 7fdba6ffd700 1 -- 172.21.15.135:0/1547825176 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0004ce0 con 0x7fdbb0100f50 2024-05-08T23:18:03.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.736+0000 7fdbb7baa700 1 -- 172.21.15.135:0/1547825176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb019f1a0 con 0x7fdbb0100f50 2024-05-08T23:18:03.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.737+0000 7fdbb7baa700 1 -- 172.21.15.135:0/1547825176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb0067c10 con 0x7fdbb0100f50 2024-05-08T23:18:03.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.738+0000 7fdba6ffd700 1 -- 172.21.15.135:0/1547825176 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fdba0005050 con 0x7fdbb0100f50 2024-05-08T23:18:03.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.738+0000 7fdba6ffd700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdb9c0a1120 0x7fdb9c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:03.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.738+0000 7fdbb5946700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdb9c0a1120 0x7fdb9c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:03.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.738+0000 7fdba6ffd700 1 -- 172.21.15.135:0/1547825176 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fdba00cdb70 con 0x7fdbb0100f50 2024-05-08T23:18:03.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.739+0000 7fdbb5946700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdb9c0a1120 0x7fdb9c0a35e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0100db0 tx=0x7fdbac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:03.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.742+0000 7fdba6ffd700 1 -- 172.21.15.135:0/1547825176 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fdba0097370 con 0x7fdbb0100f50 2024-05-08T23:18:04.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:03.999+0000 7fdbb7baa700 1 -- 172.21.15.135:0/1547825176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fdbb010b770 con 0x7fdbb0100f50 2024-05-08T23:18:04.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:04.007+0000 7fdba6ffd700 1 -- 172.21.15.135:0/1547825176 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+733416 (secure 0 0 0) 0x7fdba009a990 con 0x7fdbb0100f50 2024-05-08T23:18:04.023 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:18:04.023 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:18:04.024 INFO:teuthology.orchestra.run.smithi135.stdout: "epoch": 18, 2024-05-08T23:18:04.024 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.024 INFO:teuthology.orchestra.run.smithi135.stdout: "active_gid": 14152, 2024-05-08T23:18:04.024 INFO:teuthology.orchestra.run.smithi135.stdout: "active_name": "x", 2024-05-08T23:18:04.024 INFO:teuthology.orchestra.run.smithi135.stdout: "active_addrs": { 2024-05-08T23:18:04.024 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-05-08T23:18:04.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.024 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-05-08T23:18:04.024 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:6800", 2024-05-08T23:18:04.024 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 1743116941 2024-05-08T23:18:04.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.024 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.024 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2024-05-08T23:18:04.025 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:6801", 2024-05-08T23:18:04.025 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 1743116941 2024-05-08T23:18:04.025 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.025 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-08T23:18:04.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.025 INFO:teuthology.orchestra.run.smithi135.stdout: "active_addr": "172.21.15.135:6801/1743116941", 2024-05-08T23:18:04.025 INFO:teuthology.orchestra.run.smithi135.stdout: "active_change": "2024-05-08T23:09:20.971654+0000", 2024-05-08T23:18:04.025 INFO:teuthology.orchestra.run.smithi135.stdout: "active_mgr_features": 4540138322906710015, 2024-05-08T23:18:04.025 INFO:teuthology.orchestra.run.smithi135.stdout: "available": true, 2024-05-08T23:18:04.025 INFO:teuthology.orchestra.run.smithi135.stdout: "standbys": [ 2024-05-08T23:18:04.025 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.026 INFO:teuthology.orchestra.run.smithi135.stdout: "gid": 24109, 2024-05-08T23:18:04.026 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "z", 2024-05-08T23:18:04.026 INFO:teuthology.orchestra.run.smithi135.stdout: "mgr_features": 4540138322906710015, 2024-05-08T23:18:04.026 INFO:teuthology.orchestra.run.smithi135.stdout: "available_modules": [ 2024-05-08T23:18:04.026 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.026 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "alerts", 2024-05-08T23:18:04.026 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.026 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.026 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.026 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-08T23:18:04.026 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-08T23:18:04.026 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.027 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.027 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.027 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-08T23:18:04.027 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.027 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.027 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.027 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How frequently to reexamine health status", 2024-05-08T23:18:04.027 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.027 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.027 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.027 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.028 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.028 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.028 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.028 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.028 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.028 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.028 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.028 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.028 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.031 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.031 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.031 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.031 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.031 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.031 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.031 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.031 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.031 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.031 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.031 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.032 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.032 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.032 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.032 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.032 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.032 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.032 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.032 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.032 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.032 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.032 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.032 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.033 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.033 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.033 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.033 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.033 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.033 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.033 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.033 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.033 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.033 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.034 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_destination": { 2024-05-08T23:18:04.034 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_destination", 2024-05-08T23:18:04.034 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.034 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.034 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.034 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.034 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.034 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.034 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.035 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email address to send alerts to", 2024-05-08T23:18:04.035 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.035 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.035 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.035 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_from_name": { 2024-05-08T23:18:04.035 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_from_name", 2024-05-08T23:18:04.035 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.035 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.035 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.035 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "Ceph", 2024-05-08T23:18:04.036 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.036 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.036 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.036 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email From: name", 2024-05-08T23:18:04.036 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.036 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.036 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.037 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_host": { 2024-05-08T23:18:04.037 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_host", 2024-05-08T23:18:04.037 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.037 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.037 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.037 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.037 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.037 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.037 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.037 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP server", 2024-05-08T23:18:04.037 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.037 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.038 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.038 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_password": { 2024-05-08T23:18:04.038 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_password", 2024-05-08T23:18:04.038 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.038 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.038 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.038 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.039 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.039 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.039 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.039 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Password to authenticate with", 2024-05-08T23:18:04.039 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.039 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.039 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.039 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_port": { 2024-05-08T23:18:04.039 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_port", 2024-05-08T23:18:04.039 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.040 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.040 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.040 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "465", 2024-05-08T23:18:04.040 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.040 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.040 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.040 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP port", 2024-05-08T23:18:04.040 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.040 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.040 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.041 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_sender": { 2024-05-08T23:18:04.041 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_sender", 2024-05-08T23:18:04.041 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.041 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.041 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.041 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.041 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.041 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.041 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.041 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP envelope sender", 2024-05-08T23:18:04.042 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.042 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.042 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.042 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_ssl": { 2024-05-08T23:18:04.042 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_ssl", 2024-05-08T23:18:04.042 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.043 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.043 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.043 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.043 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.043 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.043 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.043 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-08T23:18:04.043 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.043 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.043 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.044 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_user": { 2024-05-08T23:18:04.044 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_user", 2024-05-08T23:18:04.044 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.044 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.044 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.044 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.044 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.045 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.045 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.045 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "User to authenticate as", 2024-05-08T23:18:04.045 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.045 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.046 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.046 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.046 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.046 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "balancer", 2024-05-08T23:18:04.046 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.046 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.046 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.047 INFO:teuthology.orchestra.run.smithi135.stdout: "active": { 2024-05-08T23:18:04.047 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "active", 2024-05-08T23:18:04.047 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.047 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.047 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.047 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.047 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.047 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.047 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.047 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically balance PGs across cluster", 2024-05-08T23:18:04.048 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.048 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.048 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.048 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_time": { 2024-05-08T23:18:04.048 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_time", 2024-05-08T23:18:04.048 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.048 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.048 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.049 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0000", 2024-05-08T23:18:04.049 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.049 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.049 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.049 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "beginning time of day to automatically balance", 2024-05-08T23:18:04.049 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T23:18:04.049 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.049 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.049 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_weekday": { 2024-05-08T23:18:04.049 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_weekday", 2024-05-08T23:18:04.050 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-08T23:18:04.050 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.050 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.050 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-08T23:18:04.050 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-05-08T23:18:04.050 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-05-08T23:18:04.050 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.051 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-08T23:18:04.051 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T23:18:04.051 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.051 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.051 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_max_iterations": { 2024-05-08T23:18:04.051 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_max_iterations", 2024-05-08T23:18:04.051 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-08T23:18:04.051 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.051 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.051 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "25", 2024-05-08T23:18:04.052 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-08T23:18:04.052 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "250", 2024-05-08T23:18:04.052 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.052 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-08T23:18:04.052 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.052 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.052 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.053 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_metrics": { 2024-05-08T23:18:04.053 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_metrics", 2024-05-08T23:18:04.053 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.053 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.053 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.053 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "pgs,objects,bytes", 2024-05-08T23:18:04.053 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.054 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.054 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.054 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-08T23:18:04.054 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-08T23:18:04.054 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.054 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.054 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_step": { 2024-05-08T23:18:04.055 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_step", 2024-05-08T23:18:04.055 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.055 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.055 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.055 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.5", 2024-05-08T23:18:04.055 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0.001", 2024-05-08T23:18:04.056 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "0.999", 2024-05-08T23:18:04.056 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.056 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "aggressiveness of optimization", 2024-05-08T23:18:04.056 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-08T23:18:04.056 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.056 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.057 INFO:teuthology.orchestra.run.smithi135.stdout: "end_time": { 2024-05-08T23:18:04.057 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_time", 2024-05-08T23:18:04.057 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.057 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.057 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.057 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2359", 2024-05-08T23:18:04.057 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.058 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.058 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.058 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ending time of day to automatically balance", 2024-05-08T23:18:04.058 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T23:18:04.058 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.058 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.058 INFO:teuthology.orchestra.run.smithi135.stdout: "end_weekday": { 2024-05-08T23:18:04.058 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_weekday", 2024-05-08T23:18:04.058 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-08T23:18:04.059 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.060 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.060 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-08T23:18:04.060 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-05-08T23:18:04.060 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-05-08T23:18:04.060 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.060 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-08T23:18:04.060 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T23:18:04.060 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.060 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.060 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.060 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.061 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.061 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.061 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.061 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.061 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.061 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.061 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.061 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.061 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.061 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.061 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.061 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.061 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.061 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.062 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.062 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.062 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.062 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.062 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.062 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.062 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.062 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.062 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.062 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.062 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.063 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.063 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.063 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.063 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.063 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.063 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.063 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.063 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.063 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.063 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.063 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.063 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.064 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.064 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.064 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.064 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.064 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.064 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.064 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.064 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.064 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.064 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.064 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.064 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.065 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.065 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.065 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.065 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.065 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.065 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.065 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.065 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.065 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.065 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.065 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.065 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.065 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.066 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.066 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.066 INFO:teuthology.orchestra.run.smithi135.stdout: "min_score": { 2024-05-08T23:18:04.066 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_score", 2024-05-08T23:18:04.066 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.066 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.066 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.066 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-08T23:18:04.066 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.066 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.067 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.067 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-08T23:18:04.067 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.067 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.067 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.067 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-05-08T23:18:04.067 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-05-08T23:18:04.067 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.067 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.067 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.067 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "upmap", 2024-05-08T23:18:04.068 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.068 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.068 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.068 INFO:teuthology.orchestra.run.smithi135.stdout: "crush-compat", 2024-05-08T23:18:04.068 INFO:teuthology.orchestra.run.smithi135.stdout: "none", 2024-05-08T23:18:04.068 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap" 2024-05-08T23:18:04.068 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.068 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Balancer mode", 2024-05-08T23:18:04.068 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.068 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.068 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.069 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_ids": { 2024-05-08T23:18:04.069 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_ids", 2024-05-08T23:18:04.069 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.069 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.069 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.070 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.070 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.070 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.070 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.070 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-08T23:18:04.070 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.070 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.070 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.070 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-08T23:18:04.070 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-08T23:18:04.070 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.071 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.071 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.071 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-08T23:18:04.071 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.071 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.071 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.071 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-08T23:18:04.071 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.071 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.071 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.071 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_deviation": { 2024-05-08T23:18:04.071 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_deviation", 2024-05-08T23:18:04.071 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.071 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.072 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.072 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-08T23:18:04.072 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-08T23:18:04.072 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.072 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.072 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-08T23:18:04.072 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-08T23:18:04.072 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.072 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.072 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_optimizations": { 2024-05-08T23:18:04.072 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_optimizations", 2024-05-08T23:18:04.072 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-08T23:18:04.072 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.072 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.073 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.073 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.073 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.073 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.073 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-08T23:18:04.073 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.073 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.073 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.073 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.073 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.073 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cephadm", 2024-05-08T23:18:04.073 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.073 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.074 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.074 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_down_multiplier": { 2024-05-08T23:18:04.074 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_down_multiplier", 2024-05-08T23:18:04.074 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.074 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.074 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.074 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-05-08T23:18:04.074 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.074 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.074 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.074 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-08T23:18:04.074 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.074 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.074 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_refresh_rate": { 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_refresh_rate", 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "20", 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_starting_port": { 2024-05-08T23:18:04.075 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_starting_port", 2024-05-08T23:18:04.076 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.076 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.076 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.076 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4721", 2024-05-08T23:18:04.076 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.076 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.076 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.076 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-08T23:18:04.076 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.076 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.076 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.076 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_ptrace": { 2024-05-08T23:18:04.077 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_ptrace", 2024-05-08T23:18:04.077 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.077 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.077 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.077 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.077 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.077 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.077 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.077 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-08T23:18:04.077 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-08T23:18:04.077 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.077 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.077 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_interval": { 2024-05-08T23:18:04.077 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_interval", 2024-05-08T23:18:04.078 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.078 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.078 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.078 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-08T23:18:04.078 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.078 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.078 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.078 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-08T23:18:04.078 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.078 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.078 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.078 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_memory_target_ratio": { 2024-05-08T23:18:04.078 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_memory_target_ratio", 2024-05-08T23:18:04.078 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.079 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.079 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.079 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.7", 2024-05-08T23:18:04.079 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.079 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.079 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.079 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-08T23:18:04.079 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.079 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.079 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.079 INFO:teuthology.orchestra.run.smithi135.stdout: "cgroups_split": { 2024-05-08T23:18:04.079 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cgroups_split", 2024-05-08T23:18:04.079 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.079 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-08T23:18:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: "config_checks_enabled": { 2024-05-08T23:18:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_checks_enabled", 2024-05-08T23:18:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.081 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.081 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.081 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.081 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.081 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-08T23:18:04.081 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.081 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.081 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.081 INFO:teuthology.orchestra.run.smithi135.stdout: "config_dashboard": { 2024-05-08T23:18:04.081 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_dashboard", 2024-05-08T23:18:04.081 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.081 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.081 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.081 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.082 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.082 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.082 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.082 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-08T23:18:04.082 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.082 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.082 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.082 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_alertmanager": { 2024-05-08T23:18:04.082 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_alertmanager", 2024-05-08T23:18:04.082 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.082 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.082 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.082 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-08T23:18:04.082 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.083 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.083 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.083 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-08T23:18:04.083 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.083 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.083 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.083 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_base": { 2024-05-08T23:18:04.083 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_base", 2024-05-08T23:18:04.083 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.083 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.083 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.083 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-08T23:18:04.083 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.083 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Container image name, without the tag", 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_elasticsearch": { 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_elasticsearch", 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.084 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "elasticsearch container image", 2024-05-08T23:18:04.085 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.085 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.085 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.085 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_grafana": { 2024-05-08T23:18:04.085 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_grafana", 2024-05-08T23:18:04.085 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.085 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.085 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.085 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-05-08T23:18:04.085 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.085 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.085 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.085 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-08T23:18:04.085 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.086 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.086 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.086 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_haproxy": { 2024-05-08T23:18:04.086 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_haproxy", 2024-05-08T23:18:04.086 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.086 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.086 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.086 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-08T23:18:04.086 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.086 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.086 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.086 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "HAproxy container image", 2024-05-08T23:18:04.086 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.086 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.087 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.087 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_agent": { 2024-05-08T23:18:04.087 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_agent", 2024-05-08T23:18:04.087 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.087 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.087 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.087 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-08T23:18:04.087 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.087 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.087 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.087 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger agent container image", 2024-05-08T23:18:04.087 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.088 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.088 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.088 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_collector": { 2024-05-08T23:18:04.088 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_collector", 2024-05-08T23:18:04.088 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.088 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.088 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.088 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-08T23:18:04.088 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.088 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.088 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.088 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger collector container image", 2024-05-08T23:18:04.088 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.088 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.089 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.089 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_query": { 2024-05-08T23:18:04.089 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_query", 2024-05-08T23:18:04.089 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.089 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.089 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.089 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-08T23:18:04.089 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.089 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.089 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.089 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger query container image", 2024-05-08T23:18:04.089 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.089 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.089 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.090 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_keepalived": { 2024-05-08T23:18:04.090 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_keepalived", 2024-05-08T23:18:04.090 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.090 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.090 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.090 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-08T23:18:04.090 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.090 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.090 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.090 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Keepalived container image", 2024-05-08T23:18:04.090 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.090 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.090 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.091 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_loki": { 2024-05-08T23:18:04.091 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_loki", 2024-05-08T23:18:04.091 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.091 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.091 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.091 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-08T23:18:04.091 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.091 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.091 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.091 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Loki container image", 2024-05-08T23:18:04.091 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.091 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.091 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.091 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.091 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_node_exporter": { 2024-05-08T23:18:04.092 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_node_exporter", 2024-05-08T23:18:04.092 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.092 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.092 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.092 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-08T23:18:04.092 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.092 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.092 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.092 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-08T23:18:04.092 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.092 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.092 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.092 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_nvmeof": { 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_nvmeof", 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Nvme-of container image", 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_prometheus": { 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_prometheus", 2024-05-08T23:18:04.093 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.094 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.094 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.094 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-08T23:18:04.094 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.094 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.094 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.094 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-08T23:18:04.094 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.094 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.094 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.094 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_promtail": { 2024-05-08T23:18:04.094 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_promtail", 2024-05-08T23:18:04.094 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.094 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.095 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.095 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-08T23:18:04.095 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.095 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.095 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.095 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Promtail container image", 2024-05-08T23:18:04.095 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.095 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.095 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.095 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_snmp_gateway": { 2024-05-08T23:18:04.095 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_snmp_gateway", 2024-05-08T23:18:04.095 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.095 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-08T23:18:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SNMP Gateway container image", 2024-05-08T23:18:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: "container_init": { 2024-05-08T23:18:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_init", 2024-05-08T23:18:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.097 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.097 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.097 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.097 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.097 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Run podman/docker with `--init`", 2024-05-08T23:18:04.097 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.097 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.097 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.097 INFO:teuthology.orchestra.run.smithi135.stdout: "daemon_cache_timeout": { 2024-05-08T23:18:04.097 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "daemon_cache_timeout", 2024-05-08T23:18:04.097 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.097 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.097 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.097 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-08T23:18:04.098 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.098 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.098 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.098 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-08T23:18:04.098 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.098 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.098 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.098 INFO:teuthology.orchestra.run.smithi135.stdout: "default_cephadm_command_timeout": { 2024-05-08T23:18:04.098 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_cephadm_command_timeout", 2024-05-08T23:18:04.098 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.098 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.098 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.098 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "900", 2024-05-08T23:18:04.098 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.099 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.099 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.099 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-08T23:18:04.099 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.099 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.099 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.099 INFO:teuthology.orchestra.run.smithi135.stdout: "default_registry": { 2024-05-08T23:18:04.099 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_registry", 2024-05-08T23:18:04.099 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.099 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.099 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.099 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io", 2024-05-08T23:18:04.099 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-08T23:18:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: "device_cache_timeout": { 2024-05-08T23:18:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_cache_timeout", 2024-05-08T23:18:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1800", 2024-05-08T23:18:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.101 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.101 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache device inventory", 2024-05-08T23:18:04.101 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.101 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.101 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.101 INFO:teuthology.orchestra.run.smithi135.stdout: "device_enhanced_scan": { 2024-05-08T23:18:04.101 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_enhanced_scan", 2024-05-08T23:18:04.101 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.101 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.101 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.101 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.101 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.101 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.101 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.102 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-08T23:18:04.102 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.102 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.102 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.102 INFO:teuthology.orchestra.run.smithi135.stdout: "facts_cache_timeout": { 2024-05-08T23:18:04.102 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "facts_cache_timeout", 2024-05-08T23:18:04.102 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.102 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.102 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.102 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-08T23:18:04.102 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.102 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.102 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.102 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache host facts data", 2024-05-08T23:18:04.103 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.103 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.103 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.103 INFO:teuthology.orchestra.run.smithi135.stdout: "host_check_interval": { 2024-05-08T23:18:04.103 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "host_check_interval", 2024-05-08T23:18:04.103 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.103 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.103 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.103 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-08T23:18:04.103 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.103 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.103 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.104 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to perform a host check", 2024-05-08T23:18:04.104 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.104 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.104 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.104 INFO:teuthology.orchestra.run.smithi135.stdout: "hw_monitoring": { 2024-05-08T23:18:04.104 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hw_monitoring", 2024-05-08T23:18:04.104 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.104 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.104 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.104 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.104 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.104 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: "inventory_list_all": { 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "inventory_list_all", 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.105 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-08T23:18:04.106 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.106 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.106 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.106 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.106 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.106 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.106 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.106 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.106 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.106 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.106 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.106 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.106 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: "log_refresh_metadata": { 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_refresh_metadata", 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.107 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.108 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.108 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.108 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.108 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.108 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-08T23:18:04.108 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.108 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.108 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.109 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.109 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.109 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.109 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.109 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.109 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.109 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.109 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.109 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.109 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-08T23:18:04.109 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.110 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.110 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.110 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.110 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.110 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.110 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.110 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.110 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.110 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.110 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.110 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.110 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.110 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.110 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.111 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.111 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.111 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.111 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.111 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.111 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.111 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.111 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.111 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.111 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.111 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.111 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.111 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.112 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.112 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.112 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.112 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.112 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.112 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.112 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.112 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.112 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-08T23:18:04.112 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-08T23:18:04.112 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.112 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.112 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.112 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.113 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.113 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.113 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.113 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-08T23:18:04.113 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.113 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.113 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.113 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-08T23:18:04.113 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-08T23:18:04.113 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.113 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.113 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.113 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "*", 2024-05-08T23:18:04.113 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.114 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.114 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.114 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-08T23:18:04.114 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.114 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.114 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.114 INFO:teuthology.orchestra.run.smithi135.stdout: "max_count_per_host": { 2024-05-08T23:18:04.114 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_count_per_host", 2024-05-08T23:18:04.114 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.114 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.114 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.114 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.114 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.114 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.115 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.115 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of daemons per service per host", 2024-05-08T23:18:04.115 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.115 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.115 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.115 INFO:teuthology.orchestra.run.smithi135.stdout: "max_osd_draining_count": { 2024-05-08T23:18:04.115 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_osd_draining_count", 2024-05-08T23:18:04.115 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.115 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.115 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.115 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.115 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.115 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.115 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.116 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-08T23:18:04.116 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.116 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.116 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.116 INFO:teuthology.orchestra.run.smithi135.stdout: "migration_current": { 2024-05-08T23:18:04.116 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "migration_current", 2024-05-08T23:18:04.116 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.116 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.116 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.116 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.116 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.116 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.116 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.116 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "internal - do not modify", 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "root", 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm-package", 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: "root" 2024-05-08T23:18:04.117 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.118 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "mode for remote execution of cephadm", 2024-05-08T23:18:04.118 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.118 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.118 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.118 INFO:teuthology.orchestra.run.smithi135.stdout: "oob_default_addr": { 2024-05-08T23:18:04.118 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "oob_default_addr", 2024-05-08T23:18:04.118 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.118 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.118 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.118 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "169.254.1.1", 2024-05-08T23:18:04.118 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.118 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.118 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-08T23:18:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: "prometheus_alerts_path": { 2024-05-08T23:18:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus_alerts_path", 2024-05-08T23:18:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-08T23:18:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.119 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_insecure": { 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_insecure", 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.120 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.121 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.121 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_password": { 2024-05-08T23:18:04.121 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_password", 2024-05-08T23:18:04.121 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.121 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.121 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.121 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.121 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.121 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.121 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.121 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-08T23:18:04.121 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.121 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.121 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.122 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_url": { 2024-05-08T23:18:04.122 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_url", 2024-05-08T23:18:04.122 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.122 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.122 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.122 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.122 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.122 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.122 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.122 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-08T23:18:04.122 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.122 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.122 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.123 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_username": { 2024-05-08T23:18:04.123 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_username", 2024-05-08T23:18:04.123 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.123 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.123 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.123 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.123 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.123 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.123 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.123 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-08T23:18:04.123 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.123 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.123 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: "secure_monitoring_stack": { 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "secure_monitoring_stack", 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: "service_discovery_port": { 2024-05-08T23:18:04.124 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "service_discovery_port", 2024-05-08T23:18:04.125 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.125 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.125 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.125 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8765", 2024-05-08T23:18:04.125 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.125 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.125 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.125 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "cephadm service discovery port", 2024-05-08T23:18:04.125 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.125 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.125 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.125 INFO:teuthology.orchestra.run.smithi135.stdout: "ssh_config_file": { 2024-05-08T23:18:04.125 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssh_config_file", 2024-05-08T23:18:04.125 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-08T23:18:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: "use_agent": { 2024-05-08T23:18:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_agent", 2024-05-08T23:18:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.126 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.127 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.127 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.127 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.127 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.127 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.127 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-08T23:18:04.127 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.127 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.127 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.127 INFO:teuthology.orchestra.run.smithi135.stdout: "use_repo_digest": { 2024-05-08T23:18:04.127 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_repo_digest", 2024-05-08T23:18:04.127 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.127 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.127 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_failed_host_check": { 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_failed_host_check", 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.128 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.129 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.129 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.129 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if the host check fails", 2024-05-08T23:18:04.129 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.129 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.129 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.129 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_daemons": { 2024-05-08T23:18:04.129 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_daemons", 2024-05-08T23:18:04.129 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.129 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.129 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.129 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.129 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.129 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_hosts": { 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_hosts", 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.130 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-08T23:18:04.131 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.131 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.131 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.131 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.131 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.131 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.131 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crash", 2024-05-08T23:18:04.131 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.131 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.131 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.131 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.131 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.131 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.131 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.132 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.133 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.135 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.135 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.135 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.135 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.135 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.135 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.135 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.135 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.135 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.135 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.135 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.135 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.135 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.136 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.136 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.136 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.136 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.136 INFO:teuthology.orchestra.run.smithi135.stdout: "retain_interval": { 2024-05-08T23:18:04.136 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retain_interval", 2024-05-08T23:18:04.136 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.136 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.136 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.136 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "31536000", 2024-05-08T23:18:04.136 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.136 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.136 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.136 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-08T23:18:04.137 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.137 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.137 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.137 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_recent_interval": { 2024-05-08T23:18:04.137 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_recent_interval", 2024-05-08T23:18:04.137 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.137 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.137 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.137 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1209600", 2024-05-08T23:18:04.137 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.137 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.137 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.137 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-08T23:18:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dashboard", 2024-05-08T23:18:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-08T23:18:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-08T23:18:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.139 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.139 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.139 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.139 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.139 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.139 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.139 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.139 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.139 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.139 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_HOST": { 2024-05-08T23:18:04.139 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-08T23:18:04.139 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.139 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.140 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.140 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.140 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.140 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.140 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.140 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.140 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.140 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.140 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.140 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-08T23:18:04.140 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-08T23:18:04.140 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.140 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.141 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.141 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.141 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.141 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.141 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.141 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.141 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.141 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.141 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.141 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_ENABLED": { 2024-05-08T23:18:04.141 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_ENABLED", 2024-05-08T23:18:04.141 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.141 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.141 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.142 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.142 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.142 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.142 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.142 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.142 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.142 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.142 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.142 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-08T23:18:04.142 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-08T23:18:04.142 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.142 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.142 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: "ENABLE_BROWSABLE_API": { 2024-05-08T23:18:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-08T23:18:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.143 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.144 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.144 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.144 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.144 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.144 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.144 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.144 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.144 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-08T23:18:04.144 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-08T23:18:04.144 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.144 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.144 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.144 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.144 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.145 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.146 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.146 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.146 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.146 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.146 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-08T23:18:04.146 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-08T23:18:04.146 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.146 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.146 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.146 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.146 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.146 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.146 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.146 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.147 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.147 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.147 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.147 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-08T23:18:04.147 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-08T23:18:04.147 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.147 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.147 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.147 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.147 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.147 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.147 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.147 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.147 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.148 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.148 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.148 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-08T23:18:04.148 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-08T23:18:04.148 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.148 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.148 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.148 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.148 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.148 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.148 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.148 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.148 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.148 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-08T23:18:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-08T23:18:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.150 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-08T23:18:04.150 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-08T23:18:04.150 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.150 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.150 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.150 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.150 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.150 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.150 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.150 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.150 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.150 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.150 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.151 INFO:teuthology.orchestra.run.smithi135.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-08T23:18:04.151 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-08T23:18:04.151 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.151 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.151 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.151 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.151 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.151 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.151 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.151 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.151 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.151 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.151 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.151 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_PASSWORD": { 2024-05-08T23:18:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-08T23:18:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-08T23:18:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-08T23:18:04.152 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_URL": { 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_URL", 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.153 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.154 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.154 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.154 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.154 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.154 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.154 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.154 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.154 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.154 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.154 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_USERNAME": { 2024-05-08T23:18:04.154 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-08T23:18:04.154 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.154 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.154 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.155 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-08T23:18:04.155 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.155 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.155 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.155 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.155 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.155 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.155 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.155 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.155 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-08T23:18:04.155 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-08T23:18:04.155 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.155 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.155 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.155 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.156 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.156 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.156 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.156 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.156 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.156 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.156 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.156 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-08T23:18:04.156 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-08T23:18:04.156 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.156 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.156 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.156 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.156 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.157 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.157 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.157 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.157 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.157 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.157 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.157 INFO:teuthology.orchestra.run.smithi135.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-08T23:18:04.157 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-08T23:18:04.157 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.157 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.157 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.157 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.157 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.157 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.158 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.158 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.158 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.158 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.158 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.158 INFO:teuthology.orchestra.run.smithi135.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-08T23:18:04.158 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-08T23:18:04.158 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.158 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.158 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.158 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.158 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.158 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.159 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.159 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.159 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.159 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.159 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.159 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.159 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_HOST": { 2024-05-08T23:18:04.159 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-08T23:18:04.159 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.159 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.159 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.159 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.159 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.159 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.159 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.160 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.160 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.160 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.160 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.160 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-08T23:18:04.160 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-08T23:18:04.160 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.160 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.160 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.160 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.160 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.160 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.160 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.161 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.161 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.161 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.161 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.161 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.161 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-08T23:18:04.161 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-08T23:18:04.161 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.161 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.161 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.161 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.161 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.161 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.161 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.162 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.162 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.162 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.162 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.162 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-08T23:18:04.162 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-08T23:18:04.162 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.162 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.162 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.162 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.162 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.162 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.162 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.163 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.163 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.163 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.163 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.163 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-08T23:18:04.163 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-08T23:18:04.163 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.163 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.163 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.163 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.163 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.163 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.163 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.163 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.164 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.164 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.164 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.164 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-08T23:18:04.164 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-08T23:18:04.164 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.164 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.164 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.164 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.164 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.164 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.164 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.165 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.165 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.165 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.165 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.165 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.165 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-08T23:18:04.165 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-08T23:18:04.165 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.165 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.165 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.165 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.165 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.165 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.165 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.166 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.166 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.166 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.166 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.166 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-08T23:18:04.166 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-08T23:18:04.166 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.166 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.166 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.166 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.166 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.166 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.166 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.166 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.167 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.167 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.167 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.167 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-08T23:18:04.167 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-08T23:18:04.167 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.167 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.167 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.167 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.167 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.167 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.167 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.167 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.167 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_ENABLED": { 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.168 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.169 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-08T23:18:04.169 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-08T23:18:04.169 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.169 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.169 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.169 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-08T23:18:04.169 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.169 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.169 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.169 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.169 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.169 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.169 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.170 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-08T23:18:04.170 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-08T23:18:04.170 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.170 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.170 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.170 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.170 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.170 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.170 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.170 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.170 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.170 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.170 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.170 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-08T23:18:04.171 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-08T23:18:04.171 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.171 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.171 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.171 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8", 2024-05-08T23:18:04.171 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.171 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.171 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.171 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.171 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.171 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.171 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.171 INFO:teuthology.orchestra.run.smithi135.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-08T23:18:04.171 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-08T23:18:04.172 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.172 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.172 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.172 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "45", 2024-05-08T23:18:04.172 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.172 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.172 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.172 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.172 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.172 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.172 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.172 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ACCESS_KEY": { 2024-05-08T23:18:04.172 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-08T23:18:04.173 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.173 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.173 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.173 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.173 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.173 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.173 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.173 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.173 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.173 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.173 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.173 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-08T23:18:04.173 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-08T23:18:04.173 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-08T23:18:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SECRET_KEY": { 2024-05-08T23:18:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-08T23:18:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.174 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SSL_VERIFY": { 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.175 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.176 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.176 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.176 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.176 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.176 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.176 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.176 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.176 INFO:teuthology.orchestra.run.smithi135.stdout: "UNSAFE_TLS_v1_2": { 2024-05-08T23:18:04.176 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-08T23:18:04.176 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.176 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.176 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.176 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.177 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.177 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.177 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.177 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.177 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.177 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.177 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.177 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-08T23:18:04.177 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-08T23:18:04.177 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.177 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.177 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.177 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-08T23:18:04.177 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.178 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.178 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.178 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.178 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.178 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.178 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.178 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-08T23:18:04.178 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-08T23:18:04.178 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.178 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.178 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.178 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.178 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.179 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.179 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.179 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.179 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.179 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.179 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.179 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-08T23:18:04.179 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-08T23:18:04.179 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.179 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.179 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.179 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-08T23:18:04.179 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.179 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.180 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.180 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.180 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.180 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.180 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.180 INFO:teuthology.orchestra.run.smithi135.stdout: "cross_origin_url": { 2024-05-08T23:18:04.180 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cross_origin_url", 2024-05-08T23:18:04.180 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.180 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.180 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.180 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.180 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.180 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.180 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: "crt_file": { 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crt_file", 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.182 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.182 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.182 INFO:teuthology.orchestra.run.smithi135.stdout: "debug": { 2024-05-08T23:18:04.182 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "debug", 2024-05-08T23:18:04.182 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.182 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.182 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.182 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.182 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.182 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.182 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.182 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable/disable debug options", 2024-05-08T23:18:04.182 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: "jwt_token_ttl": { 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "jwt_token_ttl", 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "28800", 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.183 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.184 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-05-08T23:18:04.184 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-05-08T23:18:04.184 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.184 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.184 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.184 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.184 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.184 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.184 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.184 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.184 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.184 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.184 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.185 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.185 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.185 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.185 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.185 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.185 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.185 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.185 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.185 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.185 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.185 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.185 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.185 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.185 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.186 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.186 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.186 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.186 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.186 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.186 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.186 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.186 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.186 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.186 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.186 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.186 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.186 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.186 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.187 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.188 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.188 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.188 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.188 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.188 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.188 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.188 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.188 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.188 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.188 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.188 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.188 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.188 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.188 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: "motd": { 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "motd", 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.189 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.190 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.190 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.190 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.190 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "The message of the day", 2024-05-08T23:18:04.190 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.190 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.190 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.190 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect_resolve_ip_addr": { 2024-05-08T23:18:04.190 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "redirect_resolve_ip_addr", 2024-05-08T23:18:04.190 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.190 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.190 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.190 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.191 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.191 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.191 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.191 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.191 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.191 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.191 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.191 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-08T23:18:04.191 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-08T23:18:04.191 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.191 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.191 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.191 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-05-08T23:18:04.191 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.192 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.192 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.192 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.192 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.192 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.192 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.192 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-08T23:18:04.192 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-08T23:18:04.192 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.192 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.192 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.192 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8080", 2024-05-08T23:18:04.192 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.192 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.193 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.194 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.194 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.194 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.194 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl_server_port": { 2024-05-08T23:18:04.194 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl_server_port", 2024-05-08T23:18:04.194 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.194 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.194 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.194 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8443", 2024-05-08T23:18:04.194 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.194 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.194 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.194 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "redirect", 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect" 2024-05-08T23:18:04.195 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.196 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.196 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.196 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.196 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.196 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-05-08T23:18:04.196 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-05-08T23:18:04.196 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.196 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.196 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.196 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-05-08T23:18:04.196 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-05-08T23:18:04.196 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-05-08T23:18:04.196 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.196 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.197 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.197 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.197 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.197 INFO:teuthology.orchestra.run.smithi135.stdout: "url_prefix": { 2024-05-08T23:18:04.197 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url_prefix", 2024-05-08T23:18:04.197 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.197 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.197 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.197 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.197 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.197 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.197 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.197 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.197 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.198 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.198 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.198 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.198 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.198 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "devicehealth", 2024-05-08T23:18:04.198 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.198 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.198 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.198 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_monitoring": { 2024-05-08T23:18:04.198 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_monitoring", 2024-05-08T23:18:04.198 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.198 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.199 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.199 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.199 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.199 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.199 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.199 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "monitor device health metrics", 2024-05-08T23:18:04.199 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.199 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.199 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.199 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.199 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.199 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.199 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.199 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.201 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.201 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.201 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.201 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.201 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.201 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.201 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.201 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.201 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.201 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.201 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.201 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.201 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.201 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.202 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.202 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.202 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.202 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.202 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.202 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.202 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.202 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.202 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.202 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.202 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.202 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.202 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.202 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.203 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.203 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.203 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.203 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.203 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.203 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.203 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.203 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.203 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.203 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.203 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.203 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.203 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.203 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.204 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.204 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.204 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.204 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.204 INFO:teuthology.orchestra.run.smithi135.stdout: "mark_out_threshold": { 2024-05-08T23:18:04.204 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mark_out_threshold", 2024-05-08T23:18:04.204 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.204 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.204 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.204 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2419200", 2024-05-08T23:18:04.204 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.204 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.204 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.205 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-08T23:18:04.205 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.205 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.205 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.205 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_name": { 2024-05-08T23:18:04.205 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_name", 2024-05-08T23:18:04.205 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.205 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.205 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.205 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "device_health_metrics", 2024-05-08T23:18:04.205 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.205 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.205 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.205 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-08T23:18:04.206 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.206 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.206 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.206 INFO:teuthology.orchestra.run.smithi135.stdout: "retention_period": { 2024-05-08T23:18:04.206 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retention_period", 2024-05-08T23:18:04.206 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.206 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.206 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.206 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15552000", 2024-05-08T23:18:04.206 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.206 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.206 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.206 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain device health metrics", 2024-05-08T23:18:04.206 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_frequency": { 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_frequency", 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.207 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.208 INFO:teuthology.orchestra.run.smithi135.stdout: "self_heal": { 2024-05-08T23:18:04.208 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "self_heal", 2024-05-08T23:18:04.208 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.208 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.208 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.208 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.208 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.208 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.208 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.208 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-08T23:18:04.209 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.209 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.209 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.209 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-08T23:18:04.209 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-08T23:18:04.209 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.209 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.209 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.209 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-08T23:18:04.209 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.209 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.209 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.209 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and check device health", 2024-05-08T23:18:04.209 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.210 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.210 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.210 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_threshold": { 2024-05-08T23:18:04.210 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_threshold", 2024-05-08T23:18:04.210 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.210 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.210 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.210 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7257600", 2024-05-08T23:18:04.210 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.210 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.210 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.210 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-08T23:18:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "diskprediction_local", 2024-05-08T23:18:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.211 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.212 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.214 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.215 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "predict_interval": { 2024-05-08T23:18:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predict_interval", 2024-05-08T23:18:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-05-08T23:18:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "predictor_model": { 2024-05-08T23:18:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predictor_model", 2024-05-08T23:18:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "prophetstor", 2024-05-08T23:18:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.217 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.218 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "influx", 2024-05-08T23:18:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": false, 2024-05-08T23:18:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "influxdb python module not found", 2024-05-08T23:18:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "batch_size": { 2024-05-08T23:18:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "batch_size", 2024-05-08T23:18:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.219 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5000", 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "database": { 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "database", 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "ceph", 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.220 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-08T23:18:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": { 2024-05-08T23:18:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hostname", 2024-05-08T23:18:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.221 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server hostname", 2024-05-08T23:18:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-08T23:18:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-08T23:18:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "30", 2024-05-08T23:18:04.222 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "5", 2024-05-08T23:18:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-08T23:18:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.225 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.226 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "password": { 2024-05-08T23:18:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "password", 2024-05-08T23:18:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "password of InfluxDB server user", 2024-05-08T23:18:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "port": { 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "port", 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8086", 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server port", 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-05-08T23:18:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-05-08T23:18:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "false", 2024-05-08T23:18:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T23:18:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "threads": { 2024-05-08T23:18:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threads", 2024-05-08T23:18:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-08T23:18:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-08T23:18:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "32", 2024-05-08T23:18:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-08T23:18:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.231 INFO:teuthology.orchestra.run.smithi135.stdout: "username": { 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "username", 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "username of InfluxDB server user", 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "verify_ssl": { 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "verify_ssl", 2024-05-08T23:18:04.232 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "true", 2024-05-08T23:18:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T23:18:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.233 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "insights", 2024-05-08T23:18:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.234 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.235 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.236 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.237 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.238 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "iostat", 2024-05-08T23:18:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.239 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.240 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.241 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.242 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.243 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "k8sevents", 2024-05-08T23:18:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_event_retention_days": { 2024-05-08T23:18:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ceph_event_retention_days", 2024-05-08T23:18:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.244 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7", 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "config_check_secs": { 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_check_secs", 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "10", 2024-05-08T23:18:04.245 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-08T23:18:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.246 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.247 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.248 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.249 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.250 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "localpool", 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "failure_domain": { 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "failure_domain", 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "host", 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.251 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "failure domain for any created local pool", 2024-05-08T23:18:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-08T23:18:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.252 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.253 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.254 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.255 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.256 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "min_size": { 2024-05-08T23:18:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_size", 2024-05-08T23:18:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default min_size for any created local pool", 2024-05-08T23:18:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-08T23:18:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.257 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: "num_rep": { 2024-05-08T23:18:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "num_rep", 2024-05-08T23:18:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3", 2024-05-08T23:18:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default replica count for any created local pool", 2024-05-08T23:18:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.259 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_num": { 2024-05-08T23:18:04.259 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_num", 2024-05-08T23:18:04.259 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.259 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.259 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.259 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "128", 2024-05-08T23:18:04.259 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.259 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.259 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.259 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default pg_num for any created local pool", 2024-05-08T23:18:04.259 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.259 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.259 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.259 INFO:teuthology.orchestra.run.smithi135.stdout: "prefix": { 2024-05-08T23:18:04.260 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prefix", 2024-05-08T23:18:04.260 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.260 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.260 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.260 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.260 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.260 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.260 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.260 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name prefix for any created local pool", 2024-05-08T23:18:04.260 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.260 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.260 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.260 INFO:teuthology.orchestra.run.smithi135.stdout: "subtree": { 2024-05-08T23:18:04.260 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "subtree", 2024-05-08T23:18:04.261 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.261 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.261 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.261 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "rack", 2024-05-08T23:18:04.261 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.261 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.261 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.261 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-08T23:18:04.261 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-08T23:18:04.261 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.261 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.261 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.261 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mds_autoscaler", 2024-05-08T23:18:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.262 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.263 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.264 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.265 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.266 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirroring", 2024-05-08T23:18:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.267 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.268 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.270 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "nfs", 2024-05-08T23:18:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.272 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.273 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.274 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.275 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.276 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-05-08T23:18:04.277 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "fail_fs": { 2024-05-08T23:18:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "fail_fs", 2024-05-08T23:18:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-08T23:18:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.278 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.279 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.280 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.281 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.282 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator": { 2024-05-08T23:18:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-05-08T23:18:04.283 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm", 2024-05-08T23:18:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "rook", 2024-05-08T23:18:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "test_orchestrator" 2024-05-08T23:18:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Orchestrator backend", 2024-05-08T23:18:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.284 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_perf_query", 2024-05-08T23:18:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.285 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.286 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.287 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.288 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.289 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_support", 2024-05-08T23:18:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.290 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.291 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.293 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.294 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_autoscaler", 2024-05-08T23:18:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.295 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.296 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.297 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.298 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.299 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-08T23:18:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-08T23:18:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-08T23:18:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.300 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "threshold": { 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threshold", 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1.0", 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "scaling threshold", 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-08T23:18:04.301 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "progress", 2024-05-08T23:18:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_pg_recovery_event": { 2024-05-08T23:18:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_pg_recovery_event", 2024-05-08T23:18:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.302 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-08T23:18:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-05-08T23:18:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-05-08T23:18:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.303 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.304 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.305 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.306 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.308 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "max_completed_events": { 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_completed_events", 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "50", 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "number of past completed events to remember", 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.309 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-08T23:18:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-08T23:18:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-08T23:18:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long the module is going to sleep", 2024-05-08T23:18:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.310 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus", 2024-05-08T23:18:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "cache": { 2024-05-08T23:18:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cache", 2024-05-08T23:18:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.311 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "exclude_perf_counters": { 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "exclude_perf_counters", 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.312 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-08T23:18:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-08T23:18:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.313 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.315 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.316 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools": { 2024-05-08T23:18:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools", 2024-05-08T23:18:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-08T23:18:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-08T23:18:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "300", 2024-05-08T23:18:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.319 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_interval": { 2024-05-08T23:18:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_interval", 2024-05-08T23:18:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15.0", 2024-05-08T23:18:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-08T23:18:04.320 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.321 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "9283", 2024-05-08T23:18:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-08T23:18:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "stale_cache_strategy": { 2024-05-08T23:18:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stale_cache_strategy", 2024-05-08T23:18:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.322 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "log", 2024-05-08T23:18:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-05-08T23:18:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-05-08T23:18:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "default", 2024-05-08T23:18:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "default", 2024-05-08T23:18:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "error" 2024-05-08T23:18:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-05-08T23:18:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-05-08T23:18:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.324 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-05-08T23:18:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-05-08T23:18:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-05-08T23:18:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_support", 2024-05-08T23:18:04.325 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.326 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.327 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.328 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.329 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_snap_create": { 2024-05-08T23:18:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_snap_create", 2024-05-08T23:18:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.330 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "mirror_snapshot_schedule": { 2024-05-08T23:18:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirror_snapshot_schedule", 2024-05-08T23:18:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.331 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "trash_purge_schedule": { 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "trash_purge_schedule", 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.332 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "restful", 2024-05-08T23:18:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.333 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_auth": { 2024-05-08T23:18:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_auth", 2024-05-08T23:18:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-05-08T23:18:04.334 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.335 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.336 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.338 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.338 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.338 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.338 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.338 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.338 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.338 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.338 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.338 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.338 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.339 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.339 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.339 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.339 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.339 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.339 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.339 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.339 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.339 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.339 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.339 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.339 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.339 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.339 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.340 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.340 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.340 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.340 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.340 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.340 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.340 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.340 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.340 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.340 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.340 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-08T23:18:04.340 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-08T23:18:04.340 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.340 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.340 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.341 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rgw", 2024-05-08T23:18:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.343 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.344 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.344 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.344 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.344 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.344 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.344 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.344 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.344 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.344 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.344 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.344 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.344 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.344 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.344 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.344 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.345 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.345 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.345 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.345 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.345 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.345 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.345 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.345 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.345 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.345 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.345 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.345 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.345 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.345 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.346 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rook", 2024-05-08T23:18:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.348 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.348 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.348 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.348 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.348 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.348 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.348 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.348 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.348 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.348 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.348 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.348 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.348 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.348 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.348 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.349 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.350 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.350 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.350 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.350 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.350 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.350 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.350 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.350 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.350 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.350 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.350 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.350 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.350 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.350 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.351 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.351 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.351 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.351 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.351 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.351 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.351 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.351 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.351 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.351 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.351 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.351 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.351 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.352 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.352 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.352 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.352 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.352 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.352 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.352 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.352 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.352 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.352 INFO:teuthology.orchestra.run.smithi135.stdout: "storage_class": { 2024-05-08T23:18:04.352 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "storage_class", 2024-05-08T23:18:04.352 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.352 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.352 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "local", 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "selftest", 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.353 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.354 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.354 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.354 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.354 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.354 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.354 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.354 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.354 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.354 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.354 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.354 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.354 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.354 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.354 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.354 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.356 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.356 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.356 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.356 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.356 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.356 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.356 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.356 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.356 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.356 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.356 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.356 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.356 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.357 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.357 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.357 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.357 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.357 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.357 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.357 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.357 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.357 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.357 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.357 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.357 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.357 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.357 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.358 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.358 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.358 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.358 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.358 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.358 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.358 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.358 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.358 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.358 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.358 INFO:teuthology.orchestra.run.smithi135.stdout: "roption1": { 2024-05-08T23:18:04.358 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption1", 2024-05-08T23:18:04.358 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.358 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.359 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.359 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.359 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.359 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.359 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.359 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.359 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.359 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.359 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.359 INFO:teuthology.orchestra.run.smithi135.stdout: "roption2": { 2024-05-08T23:18:04.359 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption2", 2024-05-08T23:18:04.359 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.359 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.359 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.360 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "xyz", 2024-05-08T23:18:04.360 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.360 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.360 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.360 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.360 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.360 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.360 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.360 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption1": { 2024-05-08T23:18:04.360 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption1", 2024-05-08T23:18:04.360 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.360 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.360 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.360 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.361 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.361 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.361 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.361 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.361 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.361 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.361 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.361 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption2": { 2024-05-08T23:18:04.361 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption2", 2024-05-08T23:18:04.361 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.361 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.361 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.361 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.362 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.362 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.362 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.362 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.362 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.362 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.362 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.362 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption3": { 2024-05-08T23:18:04.362 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption3", 2024-05-08T23:18:04.362 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.362 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.362 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.362 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.362 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.363 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.363 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.363 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.363 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.363 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.363 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.363 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.363 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption4": { 2024-05-08T23:18:04.363 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption4", 2024-05-08T23:18:04.363 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.363 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.363 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.363 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.363 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.363 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.364 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.364 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.364 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.364 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.364 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.364 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption5": { 2024-05-08T23:18:04.364 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption5", 2024-05-08T23:18:04.364 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.364 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.364 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.364 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.364 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.364 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.365 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.365 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.365 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.365 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.365 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.365 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption6": { 2024-05-08T23:18:04.365 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption6", 2024-05-08T23:18:04.365 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.365 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.365 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.365 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.365 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.365 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.365 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.366 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.366 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.366 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.366 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.366 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption7": { 2024-05-08T23:18:04.366 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption7", 2024-05-08T23:18:04.366 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.366 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.366 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.366 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.366 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-08T23:18:04.366 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "42", 2024-05-08T23:18:04.366 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: "testkey": { 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testkey", 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.367 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.368 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.368 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.368 INFO:teuthology.orchestra.run.smithi135.stdout: "testlkey": { 2024-05-08T23:18:04.368 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testlkey", 2024-05-08T23:18:04.368 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.368 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.368 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.368 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.368 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.368 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.368 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.368 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.368 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.368 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.369 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.369 INFO:teuthology.orchestra.run.smithi135.stdout: "testnewline": { 2024-05-08T23:18:04.369 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testnewline", 2024-05-08T23:18:04.369 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.369 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.369 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.369 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.369 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.369 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.369 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.369 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.369 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.369 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.369 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.370 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.370 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.370 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.370 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snap_schedule", 2024-05-08T23:18:04.370 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.370 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.370 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.370 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_m_granularity": { 2024-05-08T23:18:04.370 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_m_granularity", 2024-05-08T23:18:04.370 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.370 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.370 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.370 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.371 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.371 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.371 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.371 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow minute scheduled snapshots", 2024-05-08T23:18:04.371 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.371 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.371 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.371 INFO:teuthology.orchestra.run.smithi135.stdout: "dump_on_update": { 2024-05-08T23:18:04.371 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dump_on_update", 2024-05-08T23:18:04.371 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.371 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.371 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.371 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.371 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "dump database to debug log on update", 2024-05-08T23:18:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.373 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.373 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.373 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.373 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.373 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.373 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.373 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.373 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.373 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.373 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.373 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.373 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.373 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.373 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.374 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.374 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.374 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.374 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.374 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.374 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.374 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.374 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.374 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.374 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.374 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.374 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.374 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.374 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.375 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.377 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.377 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.377 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.377 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stats", 2024-05-08T23:18:04.377 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.377 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.377 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.377 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.377 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.377 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.377 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.377 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.377 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.378 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.378 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.378 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.378 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.378 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.378 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.378 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.378 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.378 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.378 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.378 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.378 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.378 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.378 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.379 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.379 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.379 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.379 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.379 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.379 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.379 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.379 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.379 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.379 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.379 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.379 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.379 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.380 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.380 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.380 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.380 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.380 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.380 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.380 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.380 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.380 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.380 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.380 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.380 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.380 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.381 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.381 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.381 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.381 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.381 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.381 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.381 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.381 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.381 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.381 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.381 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.381 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.381 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.381 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.382 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.382 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.382 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.382 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.382 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.382 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.382 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.382 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.382 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.382 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "status", 2024-05-08T23:18:04.382 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.382 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.382 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.382 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.383 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.383 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.383 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.383 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.383 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.383 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.383 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.383 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.383 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.383 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.383 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.383 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.383 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.383 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.383 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.384 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.385 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.385 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.385 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.385 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.385 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.385 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.385 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.385 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.385 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.385 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.385 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.385 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.385 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.385 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.386 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.386 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.386 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.386 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.386 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.386 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.386 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.386 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.386 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.386 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.386 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.386 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.386 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.386 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telegraf", 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.387 INFO:teuthology.orchestra.run.smithi135.stdout: "address": { 2024-05-08T23:18:04.388 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "address", 2024-05-08T23:18:04.388 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.388 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.388 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.388 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-08T23:18:04.388 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.388 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.388 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.388 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.388 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.388 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.388 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.388 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-08T23:18:04.388 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15", 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.389 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.390 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.390 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.390 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.390 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.390 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.390 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.390 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.390 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.390 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.390 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.390 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.390 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.390 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.390 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.391 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.391 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.391 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.391 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.391 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.391 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.391 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.391 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.391 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.391 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.391 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.391 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.391 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.391 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.392 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.393 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.393 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.393 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.393 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.393 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.393 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.393 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.393 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.393 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.393 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.393 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.393 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.393 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.393 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.394 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.394 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.394 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.394 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.394 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.394 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.394 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.394 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.394 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telemetry", 2024-05-08T23:18:04.394 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.394 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.394 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.394 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_basic": { 2024-05-08T23:18:04.394 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_basic", 2024-05-08T23:18:04.395 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.395 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.395 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.395 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.395 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.395 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.395 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.395 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-08T23:18:04.395 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.395 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.395 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.395 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_crash": { 2024-05-08T23:18:04.395 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_crash", 2024-05-08T23:18:04.395 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_device": { 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_device", 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.396 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.397 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.397 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.397 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.397 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.397 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-08T23:18:04.397 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.397 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.397 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.397 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_ident": { 2024-05-08T23:18:04.397 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_ident", 2024-05-08T23:18:04.397 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.397 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.397 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.397 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_perf": { 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_perf", 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.398 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.399 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.399 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-08T23:18:04.399 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.399 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.399 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.399 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.399 INFO:teuthology.orchestra.run.smithi135.stdout: "contact": { 2024-05-08T23:18:04.399 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "contact", 2024-05-08T23:18:04.399 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.399 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.399 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.399 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.399 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.399 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.399 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: "description": { 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "description", 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.400 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.401 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.401 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.401 INFO:teuthology.orchestra.run.smithi135.stdout: "device_url": { 2024-05-08T23:18:04.401 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_url", 2024-05-08T23:18:04.401 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.401 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.401 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.401 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-08T23:18:04.401 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.401 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.401 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.401 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.401 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.401 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.402 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.402 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-05-08T23:18:04.402 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-05-08T23:18:04.402 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.402 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.402 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.402 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.402 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.402 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.402 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.402 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.402 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.402 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.402 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.403 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.403 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-08T23:18:04.403 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-08T23:18:04.403 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.403 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.403 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.403 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "24", 2024-05-08T23:18:04.403 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "8", 2024-05-08T23:18:04.403 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.403 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.403 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.403 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.403 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.403 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.404 INFO:teuthology.orchestra.run.smithi135.stdout: "last_opt_revision": { 2024-05-08T23:18:04.404 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "last_opt_revision", 2024-05-08T23:18:04.404 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.404 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.404 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.404 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1", 2024-05-08T23:18:04.404 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.404 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.404 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.404 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.404 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.404 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.404 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard": { 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard", 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.405 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard_description": { 2024-05-08T23:18:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard_description", 2024-05-08T23:18:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.408 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.408 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.408 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.408 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.408 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.408 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.408 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.408 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.408 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.408 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.408 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.408 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.408 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.408 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.409 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.409 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.409 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.409 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.409 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.409 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.409 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.409 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.409 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.409 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.409 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.409 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.409 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.410 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.410 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.410 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.410 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.410 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.410 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.410 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.410 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.410 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.410 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.410 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.410 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.410 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.410 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.411 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.411 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.411 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.411 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.411 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.411 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.411 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.411 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.411 INFO:teuthology.orchestra.run.smithi135.stdout: "organization": { 2024-05-08T23:18:04.411 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "organization", 2024-05-08T23:18:04.411 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.411 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.411 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.411 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: "proxy": { 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "proxy", 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.412 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: "url": { 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url", 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.413 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.414 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.414 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.414 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.414 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.414 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.414 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.414 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "test_orchestrator", 2024-05-08T23:18:04.414 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.414 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.414 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.414 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.414 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.414 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.414 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.415 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.416 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.416 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.416 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.416 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.416 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.416 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.416 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.416 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.416 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.416 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.416 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.416 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.416 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.417 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.417 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.417 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.417 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.417 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.417 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.417 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.417 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.417 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.417 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.417 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.417 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.417 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.418 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.418 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.418 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.418 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.418 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.418 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.418 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.418 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.418 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.418 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.418 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.418 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.418 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.418 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.419 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.419 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.419 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.419 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.419 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.419 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.419 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.419 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.419 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.419 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "volumes", 2024-05-08T23:18:04.419 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.419 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.419 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.419 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.420 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.420 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.420 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.420 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.420 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.420 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.420 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.420 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.420 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.420 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.420 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.420 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.420 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.420 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.420 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.421 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.421 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.421 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.421 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.421 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.421 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.421 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.421 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.421 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.421 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.421 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.421 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.421 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.421 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.422 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.422 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.422 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.422 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.422 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.422 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.422 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.422 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.422 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.422 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.422 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.422 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.422 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.423 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.424 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.424 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.424 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.424 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.424 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.424 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.424 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.424 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.424 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_clones": { 2024-05-08T23:18:04.424 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_clones", 2024-05-08T23:18:04.424 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.424 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.425 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.425 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4", 2024-05-08T23:18:04.425 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.425 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.425 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.426 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-08T23:18:04.426 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.426 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.426 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.426 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_delay": { 2024-05-08T23:18:04.426 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_delay", 2024-05-08T23:18:04.426 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.426 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.426 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.426 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-08T23:18:04.426 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.426 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.426 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.426 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_no_wait": { 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_no_wait", 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.427 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix", 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: "discovery_interval": { 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "discovery_interval", 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "100", 2024-05-08T23:18:04.428 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.429 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.429 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.429 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.429 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.429 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.429 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.429 INFO:teuthology.orchestra.run.smithi135.stdout: "identifier": { 2024-05-08T23:18:04.429 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "identifier", 2024-05-08T23:18:04.429 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.429 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.429 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.429 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.430 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.430 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.430 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.430 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.430 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.430 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.430 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.430 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-08T23:18:04.430 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-08T23:18:04.430 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.430 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.430 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.430 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-08T23:18:04.430 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.431 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.431 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.431 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.431 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.431 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.431 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.431 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.431 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.431 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.431 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.431 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.431 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.431 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.431 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.432 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.433 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.434 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.434 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.434 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.434 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.434 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.434 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.434 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.434 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.434 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.434 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.434 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.434 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.434 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.434 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.436 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_host": { 2024-05-08T23:18:04.436 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_host", 2024-05-08T23:18:04.436 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.436 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.436 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.436 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.436 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.436 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.436 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.436 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.436 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.436 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.436 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.436 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_port": { 2024-05-08T23:18:04.437 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_port", 2024-05-08T23:18:04.437 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.437 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.437 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.437 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10051", 2024-05-08T23:18:04.437 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.437 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.437 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.437 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.437 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.437 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.437 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.437 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_sender": { 2024-05-08T23:18:04.437 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_sender", 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-08T23:18:04.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.439 INFO:teuthology.orchestra.run.smithi135.stdout: "gid": 24116, 2024-05-08T23:18:04.439 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "y", 2024-05-08T23:18:04.439 INFO:teuthology.orchestra.run.smithi135.stdout: "mgr_features": 4540138322906710015, 2024-05-08T23:18:04.439 INFO:teuthology.orchestra.run.smithi135.stdout: "available_modules": [ 2024-05-08T23:18:04.439 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.439 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "alerts", 2024-05-08T23:18:04.439 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.439 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.439 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.439 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-08T23:18:04.439 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-08T23:18:04.439 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.439 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.439 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How frequently to reexamine health status", 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.440 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.441 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.442 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.442 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.442 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.442 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.442 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.442 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.442 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.442 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.442 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.442 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.442 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.442 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.442 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.444 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_destination": { 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_destination", 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email address to send alerts to", 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.446 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_from_name": { 2024-05-08T23:18:04.446 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_from_name", 2024-05-08T23:18:04.446 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.446 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.446 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.446 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "Ceph", 2024-05-08T23:18:04.446 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.446 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.446 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.446 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email From: name", 2024-05-08T23:18:04.446 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.446 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.446 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.446 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_host": { 2024-05-08T23:18:04.447 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_host", 2024-05-08T23:18:04.447 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.447 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.447 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.447 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.447 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.447 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.447 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.447 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP server", 2024-05-08T23:18:04.447 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.447 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.447 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.447 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_password": { 2024-05-08T23:18:04.447 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_password", 2024-05-08T23:18:04.448 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.448 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.448 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.448 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.448 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.448 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.448 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.448 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Password to authenticate with", 2024-05-08T23:18:04.448 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.448 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.448 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.448 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_port": { 2024-05-08T23:18:04.448 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_port", 2024-05-08T23:18:04.449 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.449 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.449 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.449 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "465", 2024-05-08T23:18:04.449 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.449 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.449 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.449 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP port", 2024-05-08T23:18:04.449 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.449 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.449 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.449 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_sender": { 2024-05-08T23:18:04.449 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_sender", 2024-05-08T23:18:04.449 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.450 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.450 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.450 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.450 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.450 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.450 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.450 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP envelope sender", 2024-05-08T23:18:04.450 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.450 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.450 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.450 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_ssl": { 2024-05-08T23:18:04.450 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_ssl", 2024-05-08T23:18:04.450 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.450 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_user": { 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_user", 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.451 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.452 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.452 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.452 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.452 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "User to authenticate as", 2024-05-08T23:18:04.452 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.452 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.452 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.452 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.452 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.452 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.452 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "balancer", 2024-05-08T23:18:04.452 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.452 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.452 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.453 INFO:teuthology.orchestra.run.smithi135.stdout: "active": { 2024-05-08T23:18:04.453 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "active", 2024-05-08T23:18:04.453 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.453 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.453 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.453 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.453 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.453 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.453 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.453 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically balance PGs across cluster", 2024-05-08T23:18:04.453 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.453 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.453 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.453 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_time": { 2024-05-08T23:18:04.454 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_time", 2024-05-08T23:18:04.454 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.454 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.454 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.454 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0000", 2024-05-08T23:18:04.454 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.454 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.454 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.454 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "beginning time of day to automatically balance", 2024-05-08T23:18:04.454 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T23:18:04.454 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.454 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.454 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_weekday": { 2024-05-08T23:18:04.455 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_weekday", 2024-05-08T23:18:04.455 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-08T23:18:04.455 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.455 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.455 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-08T23:18:04.455 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-05-08T23:18:04.455 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-05-08T23:18:04.455 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.455 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-08T23:18:04.455 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T23:18:04.455 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.455 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.455 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_max_iterations": { 2024-05-08T23:18:04.456 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_max_iterations", 2024-05-08T23:18:04.456 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-08T23:18:04.456 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.456 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.456 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "25", 2024-05-08T23:18:04.456 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-08T23:18:04.456 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "250", 2024-05-08T23:18:04.456 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.456 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-08T23:18:04.456 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.456 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.456 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.456 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_metrics": { 2024-05-08T23:18:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_metrics", 2024-05-08T23:18:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "pgs,objects,bytes", 2024-05-08T23:18:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-08T23:18:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-08T23:18:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_step": { 2024-05-08T23:18:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_step", 2024-05-08T23:18:04.458 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.458 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.458 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.458 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.5", 2024-05-08T23:18:04.458 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0.001", 2024-05-08T23:18:04.458 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "0.999", 2024-05-08T23:18:04.458 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.458 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "aggressiveness of optimization", 2024-05-08T23:18:04.458 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-08T23:18:04.458 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.458 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.458 INFO:teuthology.orchestra.run.smithi135.stdout: "end_time": { 2024-05-08T23:18:04.458 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_time", 2024-05-08T23:18:04.458 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.459 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.459 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.459 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2359", 2024-05-08T23:18:04.459 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.459 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.459 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.459 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ending time of day to automatically balance", 2024-05-08T23:18:04.459 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T23:18:04.459 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.459 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.459 INFO:teuthology.orchestra.run.smithi135.stdout: "end_weekday": { 2024-05-08T23:18:04.459 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_weekday", 2024-05-08T23:18:04.459 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-08T23:18:04.459 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.460 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.460 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-08T23:18:04.460 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-05-08T23:18:04.460 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-05-08T23:18:04.460 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.460 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-08T23:18:04.460 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T23:18:04.460 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.460 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.460 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.460 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.460 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.460 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.461 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.462 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.462 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.462 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.462 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.462 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.462 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.462 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.462 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.462 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.462 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.462 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.462 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.462 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.463 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.464 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.464 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.464 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.464 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.464 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.464 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.464 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.464 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.464 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.464 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.464 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.464 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.464 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.464 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: "min_score": { 2024-05-08T23:18:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_score", 2024-05-08T23:18:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-08T23:18:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.465 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-08T23:18:04.466 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.466 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.466 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.466 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.466 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-05-08T23:18:04.466 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-05-08T23:18:04.466 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.466 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.466 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.466 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "upmap", 2024-05-08T23:18:04.466 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.466 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.466 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.466 INFO:teuthology.orchestra.run.smithi135.stdout: "crush-compat", 2024-05-08T23:18:04.467 INFO:teuthology.orchestra.run.smithi135.stdout: "none", 2024-05-08T23:18:04.467 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap" 2024-05-08T23:18:04.467 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.467 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Balancer mode", 2024-05-08T23:18:04.467 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.467 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.467 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.467 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_ids": { 2024-05-08T23:18:04.467 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_ids", 2024-05-08T23:18:04.467 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.467 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.467 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.467 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.467 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.468 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.468 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.468 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-08T23:18:04.468 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.468 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.468 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.468 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.468 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-08T23:18:04.468 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-08T23:18:04.468 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.468 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.468 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.468 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-08T23:18:04.468 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.468 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_deviation": { 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_deviation", 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.469 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-08T23:18:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-08T23:18:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_optimizations": { 2024-05-08T23:18:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_optimizations", 2024-05-08T23:18:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-08T23:18:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-08T23:18:04.470 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.471 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.471 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.471 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.471 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.471 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cephadm", 2024-05-08T23:18:04.471 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.471 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.471 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.471 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_down_multiplier": { 2024-05-08T23:18:04.471 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_down_multiplier", 2024-05-08T23:18:04.471 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.471 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.471 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.472 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-05-08T23:18:04.472 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.472 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.472 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.472 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-08T23:18:04.472 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.472 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.472 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.472 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.472 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_refresh_rate": { 2024-05-08T23:18:04.472 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_refresh_rate", 2024-05-08T23:18:04.472 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.472 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.472 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.472 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "20", 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_starting_port": { 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_starting_port", 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4721", 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.473 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.474 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.474 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-08T23:18:04.474 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.474 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.474 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.474 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.474 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_ptrace": { 2024-05-08T23:18:04.474 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_ptrace", 2024-05-08T23:18:04.474 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.474 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.474 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.474 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.474 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.474 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.474 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.475 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-08T23:18:04.475 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-08T23:18:04.475 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.475 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.475 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_interval": { 2024-05-08T23:18:04.475 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_interval", 2024-05-08T23:18:04.475 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.475 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.475 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.475 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-08T23:18:04.475 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.475 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.475 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.475 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_memory_target_ratio": { 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_memory_target_ratio", 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.7", 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.477 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.477 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.477 INFO:teuthology.orchestra.run.smithi135.stdout: "cgroups_split": { 2024-05-08T23:18:04.477 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cgroups_split", 2024-05-08T23:18:04.477 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.477 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.477 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.477 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.477 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.477 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.477 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.477 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-08T23:18:04.477 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.477 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.477 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.478 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.478 INFO:teuthology.orchestra.run.smithi135.stdout: "config_checks_enabled": { 2024-05-08T23:18:04.478 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_checks_enabled", 2024-05-08T23:18:04.478 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.478 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.478 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.478 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.478 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.478 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.478 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.478 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-08T23:18:04.478 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.478 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.478 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.479 INFO:teuthology.orchestra.run.smithi135.stdout: "config_dashboard": { 2024-05-08T23:18:04.479 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_dashboard", 2024-05-08T23:18:04.479 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.479 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.479 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.479 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.479 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.479 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.479 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.479 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-08T23:18:04.479 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.479 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.479 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.480 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_alertmanager": { 2024-05-08T23:18:04.480 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_alertmanager", 2024-05-08T23:18:04.480 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.480 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.480 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.480 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-08T23:18:04.480 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.480 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.480 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.480 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-08T23:18:04.480 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.480 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.480 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.480 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_base": { 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_base", 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Container image name, without the tag", 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_elasticsearch": { 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_elasticsearch", 2024-05-08T23:18:04.481 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.482 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.482 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.482 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-08T23:18:04.482 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.482 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.482 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.482 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "elasticsearch container image", 2024-05-08T23:18:04.482 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.482 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.482 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.482 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.482 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_grafana": { 2024-05-08T23:18:04.482 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_grafana", 2024-05-08T23:18:04.482 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.482 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_haproxy": { 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_haproxy", 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.483 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "HAproxy container image", 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_agent": { 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_agent", 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.484 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger agent container image", 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_collector": { 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_collector", 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.485 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger collector container image", 2024-05-08T23:18:04.486 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.486 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.486 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.486 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_query": { 2024-05-08T23:18:04.486 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_query", 2024-05-08T23:18:04.486 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.486 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.486 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.486 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-08T23:18:04.486 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.486 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.486 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.486 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger query container image", 2024-05-08T23:18:04.486 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_keepalived": { 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_keepalived", 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Keepalived container image", 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.487 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_loki": { 2024-05-08T23:18:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_loki", 2024-05-08T23:18:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-08T23:18:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Loki container image", 2024-05-08T23:18:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_node_exporter": { 2024-05-08T23:18:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_node_exporter", 2024-05-08T23:18:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-08T23:18:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-08T23:18:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.489 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_nvmeof": { 2024-05-08T23:18:04.490 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_nvmeof", 2024-05-08T23:18:04.490 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.490 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.490 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.490 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-05-08T23:18:04.490 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.490 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.490 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.490 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Nvme-of container image", 2024-05-08T23:18:04.490 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.490 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.490 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.490 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_prometheus": { 2024-05-08T23:18:04.490 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_prometheus", 2024-05-08T23:18:04.491 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.491 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.491 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.491 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-08T23:18:04.491 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.491 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.491 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.491 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-08T23:18:04.491 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.491 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.491 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.491 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_promtail": { 2024-05-08T23:18:04.491 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_promtail", 2024-05-08T23:18:04.491 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.492 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.492 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.492 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-08T23:18:04.492 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.492 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.492 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.492 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Promtail container image", 2024-05-08T23:18:04.492 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.492 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.492 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.492 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_snmp_gateway": { 2024-05-08T23:18:04.492 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_snmp_gateway", 2024-05-08T23:18:04.492 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.492 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.493 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.493 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-08T23:18:04.493 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.493 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.493 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.493 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SNMP Gateway container image", 2024-05-08T23:18:04.493 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.493 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.493 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.493 INFO:teuthology.orchestra.run.smithi135.stdout: "container_init": { 2024-05-08T23:18:04.493 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_init", 2024-05-08T23:18:04.493 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.493 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.493 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.494 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.494 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.494 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.494 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.494 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Run podman/docker with `--init`", 2024-05-08T23:18:04.494 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.494 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.494 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.494 INFO:teuthology.orchestra.run.smithi135.stdout: "daemon_cache_timeout": { 2024-05-08T23:18:04.494 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "daemon_cache_timeout", 2024-05-08T23:18:04.494 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.494 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.494 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: "default_cephadm_command_timeout": { 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_cephadm_command_timeout", 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "900", 2024-05-08T23:18:04.495 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.496 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.496 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.496 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-08T23:18:04.496 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.496 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.496 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.496 INFO:teuthology.orchestra.run.smithi135.stdout: "default_registry": { 2024-05-08T23:18:04.496 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_registry", 2024-05-08T23:18:04.496 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.496 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.496 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.496 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io", 2024-05-08T23:18:04.496 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.496 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.497 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.497 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-08T23:18:04.497 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.497 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.497 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.497 INFO:teuthology.orchestra.run.smithi135.stdout: "device_cache_timeout": { 2024-05-08T23:18:04.497 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_cache_timeout", 2024-05-08T23:18:04.497 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.497 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.497 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.497 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1800", 2024-05-08T23:18:04.497 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.497 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.497 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache device inventory", 2024-05-08T23:18:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: "device_enhanced_scan": { 2024-05-08T23:18:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_enhanced_scan", 2024-05-08T23:18:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: "facts_cache_timeout": { 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "facts_cache_timeout", 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache host facts data", 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.499 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.500 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.500 INFO:teuthology.orchestra.run.smithi135.stdout: "host_check_interval": { 2024-05-08T23:18:04.500 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "host_check_interval", 2024-05-08T23:18:04.500 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.500 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.500 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.500 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-08T23:18:04.500 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.500 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.500 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.500 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to perform a host check", 2024-05-08T23:18:04.500 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.500 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.500 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: "hw_monitoring": { 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hw_monitoring", 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.501 INFO:teuthology.orchestra.run.smithi135.stdout: "inventory_list_all": { 2024-05-08T23:18:04.502 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "inventory_list_all", 2024-05-08T23:18:04.502 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.502 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.502 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.502 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.502 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.502 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.502 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.502 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-08T23:18:04.502 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.502 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.502 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.502 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.503 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.504 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.504 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.504 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.504 INFO:teuthology.orchestra.run.smithi135.stdout: "log_refresh_metadata": { 2024-05-08T23:18:04.504 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_refresh_metadata", 2024-05-08T23:18:04.504 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.504 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.504 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.504 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.504 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.504 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.504 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.504 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-08T23:18:04.504 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-08T23:18:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.507 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.508 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "*", 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.509 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.510 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.510 INFO:teuthology.orchestra.run.smithi135.stdout: "max_count_per_host": { 2024-05-08T23:18:04.510 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_count_per_host", 2024-05-08T23:18:04.510 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.510 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.510 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.510 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.510 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.510 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.510 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.510 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of daemons per service per host", 2024-05-08T23:18:04.510 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.510 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.510 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.511 INFO:teuthology.orchestra.run.smithi135.stdout: "max_osd_draining_count": { 2024-05-08T23:18:04.511 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_osd_draining_count", 2024-05-08T23:18:04.511 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.511 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.511 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.511 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.511 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.511 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.511 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.511 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-08T23:18:04.511 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.511 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.511 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.512 INFO:teuthology.orchestra.run.smithi135.stdout: "migration_current": { 2024-05-08T23:18:04.512 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "migration_current", 2024-05-08T23:18:04.512 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.512 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.512 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.512 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.512 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.512 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.512 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.512 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "internal - do not modify", 2024-05-08T23:18:04.512 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.512 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.512 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.512 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-05-08T23:18:04.513 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-05-08T23:18:04.513 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.513 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.513 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.513 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "root", 2024-05-08T23:18:04.513 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.513 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.513 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.513 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm-package", 2024-05-08T23:18:04.513 INFO:teuthology.orchestra.run.smithi135.stdout: "root" 2024-05-08T23:18:04.513 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.513 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "mode for remote execution of cephadm", 2024-05-08T23:18:04.513 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.513 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.513 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.514 INFO:teuthology.orchestra.run.smithi135.stdout: "oob_default_addr": { 2024-05-08T23:18:04.514 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "oob_default_addr", 2024-05-08T23:18:04.514 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.514 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.514 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.514 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "169.254.1.1", 2024-05-08T23:18:04.514 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.514 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.514 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.514 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-08T23:18:04.514 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.514 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.514 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: "prometheus_alerts_path": { 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus_alerts_path", 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_insecure": { 2024-05-08T23:18:04.515 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_insecure", 2024-05-08T23:18:04.516 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.516 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.516 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.516 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.516 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.516 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.516 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.516 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-08T23:18:04.516 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.516 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.516 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.516 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_password": { 2024-05-08T23:18:04.516 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_password", 2024-05-08T23:18:04.516 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.517 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.517 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.517 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.517 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.517 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.517 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.517 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-08T23:18:04.517 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.517 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.517 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.517 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_url": { 2024-05-08T23:18:04.517 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_url", 2024-05-08T23:18:04.517 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.517 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.518 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.518 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.518 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.518 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.518 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.518 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-08T23:18:04.518 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.518 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.518 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.518 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.518 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_username": { 2024-05-08T23:18:04.518 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_username", 2024-05-08T23:18:04.518 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.518 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.518 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.519 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.519 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.519 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.519 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.519 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-08T23:18:04.519 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.519 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.519 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.519 INFO:teuthology.orchestra.run.smithi135.stdout: "secure_monitoring_stack": { 2024-05-08T23:18:04.519 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "secure_monitoring_stack", 2024-05-08T23:18:04.519 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.519 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.519 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.519 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: "service_discovery_port": { 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "service_discovery_port", 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8765", 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.520 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.521 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.521 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "cephadm service discovery port", 2024-05-08T23:18:04.521 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.521 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.521 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.521 INFO:teuthology.orchestra.run.smithi135.stdout: "ssh_config_file": { 2024-05-08T23:18:04.521 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssh_config_file", 2024-05-08T23:18:04.521 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.521 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.521 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.521 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.521 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.521 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.521 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: "use_agent": { 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_agent", 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-08T23:18:04.522 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.523 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.523 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.523 INFO:teuthology.orchestra.run.smithi135.stdout: "use_repo_digest": { 2024-05-08T23:18:04.523 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_repo_digest", 2024-05-08T23:18:04.523 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.523 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.523 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.523 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.523 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.523 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.523 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.523 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-08T23:18:04.523 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_failed_host_check": { 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_failed_host_check", 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if the host check fails", 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.524 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.525 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_daemons": { 2024-05-08T23:18:04.525 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_daemons", 2024-05-08T23:18:04.525 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.525 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.525 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.525 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.525 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.525 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.525 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.525 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-08T23:18:04.525 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.525 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.525 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.526 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_hosts": { 2024-05-08T23:18:04.526 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_hosts", 2024-05-08T23:18:04.526 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.526 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.526 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.526 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.526 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.526 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.526 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.526 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-08T23:18:04.526 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.526 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.526 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.526 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.526 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.527 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.527 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crash", 2024-05-08T23:18:04.527 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.527 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.527 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.527 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.527 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.527 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.527 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.527 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.527 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.527 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.527 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.527 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.528 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.529 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.530 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.530 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.530 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.530 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.530 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.530 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.530 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.530 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.530 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.530 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.530 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.530 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.530 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.530 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.531 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.531 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.531 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.531 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.531 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.531 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.531 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.531 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.531 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.531 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.531 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.531 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.531 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.531 INFO:teuthology.orchestra.run.smithi135.stdout: "retain_interval": { 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retain_interval", 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "31536000", 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_recent_interval": { 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_recent_interval", 2024-05-08T23:18:04.532 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.533 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.533 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.533 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1209600", 2024-05-08T23:18:04.533 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.533 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.533 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.533 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-08T23:18:04.533 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.533 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.533 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.533 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.533 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.533 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.533 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.533 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dashboard", 2024-05-08T23:18:04.534 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.534 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.534 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.534 INFO:teuthology.orchestra.run.smithi135.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-08T23:18:04.534 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-08T23:18:04.534 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.534 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.534 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.534 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.534 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.534 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.534 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.534 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.534 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.534 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.535 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.535 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_HOST": { 2024-05-08T23:18:04.535 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-08T23:18:04.535 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.535 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.535 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.535 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.535 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.535 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.535 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.535 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.535 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.535 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.535 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.536 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-08T23:18:04.536 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-08T23:18:04.536 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.536 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.536 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.536 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.536 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.536 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.536 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.536 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.536 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.536 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.536 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.537 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_ENABLED": { 2024-05-08T23:18:04.537 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_ENABLED", 2024-05-08T23:18:04.537 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.537 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.537 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.537 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.537 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.537 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.537 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.537 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.537 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.537 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.537 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.537 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.537 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: "ENABLE_BROWSABLE_API": { 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-08T23:18:04.538 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.539 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.539 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.539 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.539 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.539 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.539 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.539 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.539 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.539 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.539 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.539 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-08T23:18:04.539 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-08T23:18:04.539 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.539 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.540 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.540 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.540 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.540 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.540 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.540 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.540 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.540 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.540 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.540 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-08T23:18:04.540 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-08T23:18:04.540 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.540 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.540 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.542 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.542 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.542 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.542 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.542 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.542 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.542 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-08T23:18:04.542 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-08T23:18:04.542 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.542 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.542 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.542 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.542 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.542 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.543 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.544 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-08T23:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-08T23:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.546 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_PASSWORD": { 2024-05-08T23:18:04.547 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-08T23:18:04.547 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.547 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.547 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.547 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-08T23:18:04.547 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.547 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.547 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.547 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.547 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.547 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.547 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.547 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.547 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_URL": { 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_URL", 2024-05-08T23:18:04.548 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.549 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.549 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.549 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.549 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.549 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.549 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.549 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.549 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.549 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.549 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.549 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_USERNAME": { 2024-05-08T23:18:04.549 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-08T23:18:04.549 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.549 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.550 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.550 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-08T23:18:04.550 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.550 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.550 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.550 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.550 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.550 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.550 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.550 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.550 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-08T23:18:04.550 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-08T23:18:04.550 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.550 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.550 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.551 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.551 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.551 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.551 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.551 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.551 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.551 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.551 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.551 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-08T23:18:04.551 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-08T23:18:04.551 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.551 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.551 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.551 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-08T23:18:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-08T23:18:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_HOST": { 2024-05-08T23:18:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-08T23:18:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-08T23:18:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-08T23:18:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-08T23:18:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-08T23:18:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-08T23:18:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-08T23:18:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-08T23:18:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-08T23:18:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-08T23:18:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-08T23:18:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-08T23:18:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-08T23:18:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_ENABLED": { 2024-05-08T23:18:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-08T23:18:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-08T23:18:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-08T23:18:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-08T23:18:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-08T23:18:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8", 2024-05-08T23:18:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-08T23:18:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-08T23:18:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "45", 2024-05-08T23:18:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ACCESS_KEY": { 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-08T23:18:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-08T23:18:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-08T23:18:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SECRET_KEY": { 2024-05-08T23:18:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-08T23:18:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SSL_VERIFY": { 2024-05-08T23:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-08T23:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "UNSAFE_TLS_v1_2": { 2024-05-08T23:18:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-08T23:18:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-08T23:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-08T23:18:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-08T23:18:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-08T23:18:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "cross_origin_url": { 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cross_origin_url", 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "crt_file": { 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crt_file", 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "debug": { 2024-05-08T23:18:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "debug", 2024-05-08T23:18:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable/disable debug options", 2024-05-08T23:18:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "jwt_token_ttl": { 2024-05-08T23:18:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "jwt_token_ttl", 2024-05-08T23:18:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "28800", 2024-05-08T23:18:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-05-08T23:18:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-05-08T23:18:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "motd": { 2024-05-08T23:18:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "motd", 2024-05-08T23:18:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "The message of the day", 2024-05-08T23:18:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect_resolve_ip_addr": { 2024-05-08T23:18:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "redirect_resolve_ip_addr", 2024-05-08T23:18:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-08T23:18:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-08T23:18:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-05-08T23:18:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-08T23:18:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-08T23:18:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8080", 2024-05-08T23:18:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-05-08T23:18:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-05-08T23:18:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl_server_port": { 2024-05-08T23:18:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl_server_port", 2024-05-08T23:18:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8443", 2024-05-08T23:18:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-05-08T23:18:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-05-08T23:18:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "redirect", 2024-05-08T23:18:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect" 2024-05-08T23:18:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-05-08T23:18:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-05-08T23:18:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-05-08T23:18:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-05-08T23:18:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-05-08T23:18:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "url_prefix": { 2024-05-08T23:18:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url_prefix", 2024-05-08T23:18:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "devicehealth", 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_monitoring": { 2024-05-08T23:18:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_monitoring", 2024-05-08T23:18:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "monitor device health metrics", 2024-05-08T23:18:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "mark_out_threshold": { 2024-05-08T23:18:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mark_out_threshold", 2024-05-08T23:18:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2419200", 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_name": { 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_name", 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "device_health_metrics", 2024-05-08T23:18:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "retention_period": { 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retention_period", 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15552000", 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.601 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain device health metrics", 2024-05-08T23:18:04.601 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.601 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.601 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.601 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_frequency": { 2024-05-08T23:18:04.601 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_frequency", 2024-05-08T23:18:04.601 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.601 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.601 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.601 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-05-08T23:18:04.601 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.601 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.601 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.601 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-08T23:18:04.602 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.602 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.602 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.602 INFO:teuthology.orchestra.run.smithi135.stdout: "self_heal": { 2024-05-08T23:18:04.602 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "self_heal", 2024-05-08T23:18:04.602 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.602 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.602 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.602 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.602 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.602 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.602 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.602 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-08T23:18:04.602 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.603 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.603 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.603 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-08T23:18:04.603 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-08T23:18:04.603 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.603 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.603 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.603 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-08T23:18:04.603 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.603 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.603 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.603 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and check device health", 2024-05-08T23:18:04.603 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.603 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_threshold": { 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_threshold", 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7257600", 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.604 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.605 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.605 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.605 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "diskprediction_local", 2024-05-08T23:18:04.605 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.605 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.605 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.605 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.605 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.605 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.605 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.605 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.605 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.605 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.606 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.607 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.607 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.607 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.607 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.607 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.607 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.607 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.607 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.607 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.607 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.607 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.607 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.607 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.608 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.608 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.608 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.608 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.608 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.608 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.608 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.608 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.608 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.608 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.608 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.608 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.608 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.608 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.608 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.609 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.609 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.609 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.609 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.609 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.609 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.609 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.609 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.609 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.609 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.609 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.609 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.609 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.609 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.610 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.610 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.610 INFO:teuthology.orchestra.run.smithi135.stdout: "predict_interval": { 2024-05-08T23:18:04.610 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predict_interval", 2024-05-08T23:18:04.610 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.610 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.610 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.610 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-05-08T23:18:04.610 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.610 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.610 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.610 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.610 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: "predictor_model": { 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predictor_model", 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "prophetstor", 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.611 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.612 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-08T23:18:04.612 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-08T23:18:04.612 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.612 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.612 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.612 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-08T23:18:04.612 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.612 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.612 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.612 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.612 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.612 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.612 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.612 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.613 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.613 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.613 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "influx", 2024-05-08T23:18:04.613 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": false, 2024-05-08T23:18:04.613 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "influxdb python module not found", 2024-05-08T23:18:04.613 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.613 INFO:teuthology.orchestra.run.smithi135.stdout: "batch_size": { 2024-05-08T23:18:04.613 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "batch_size", 2024-05-08T23:18:04.613 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.613 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.613 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.613 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5000", 2024-05-08T23:18:04.613 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.613 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.614 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.614 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-08T23:18:04.614 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.614 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.614 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.614 INFO:teuthology.orchestra.run.smithi135.stdout: "database": { 2024-05-08T23:18:04.614 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "database", 2024-05-08T23:18:04.614 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.614 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.614 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.614 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "ceph", 2024-05-08T23:18:04.614 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.614 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.615 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.615 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-08T23:18:04.615 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.615 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.615 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.615 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": { 2024-05-08T23:18:04.615 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hostname", 2024-05-08T23:18:04.615 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.615 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.615 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.615 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.615 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.615 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.615 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server hostname", 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "30", 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "5", 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-08T23:18:04.616 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.617 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.617 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.617 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.617 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.617 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.617 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.617 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.617 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.617 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.617 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.617 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.617 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.617 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.617 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.618 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.618 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.618 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.618 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.618 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.618 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.618 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.618 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.618 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.618 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.618 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.618 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.618 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.618 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.618 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.619 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.620 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.620 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.620 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.620 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.620 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.620 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.620 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.620 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.620 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.620 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.620 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.620 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.620 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.620 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: "password": { 2024-05-08T23:18:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "password", 2024-05-08T23:18:04.621 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.622 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.622 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.622 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.622 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.622 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.622 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.622 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "password of InfluxDB server user", 2024-05-08T23:18:04.622 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.622 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.622 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.622 INFO:teuthology.orchestra.run.smithi135.stdout: "port": { 2024-05-08T23:18:04.622 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "port", 2024-05-08T23:18:04.622 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.622 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8086", 2024-05-08T23:18:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server port", 2024-05-08T23:18:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-05-08T23:18:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-05-08T23:18:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.623 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.624 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "false", 2024-05-08T23:18:04.624 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.624 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.624 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.624 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T23:18:04.624 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.624 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.624 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.624 INFO:teuthology.orchestra.run.smithi135.stdout: "threads": { 2024-05-08T23:18:04.624 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threads", 2024-05-08T23:18:04.624 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.624 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.624 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.624 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-08T23:18:04.625 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-08T23:18:04.625 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "32", 2024-05-08T23:18:04.625 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.625 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-08T23:18:04.625 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.625 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.625 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.625 INFO:teuthology.orchestra.run.smithi135.stdout: "username": { 2024-05-08T23:18:04.625 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "username", 2024-05-08T23:18:04.625 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.625 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.625 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.625 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.625 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.626 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.626 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.626 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "username of InfluxDB server user", 2024-05-08T23:18:04.626 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.626 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.626 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.626 INFO:teuthology.orchestra.run.smithi135.stdout: "verify_ssl": { 2024-05-08T23:18:04.626 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "verify_ssl", 2024-05-08T23:18:04.626 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.626 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.626 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.626 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "true", 2024-05-08T23:18:04.627 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.627 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.627 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.627 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T23:18:04.627 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.627 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.627 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.627 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.627 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.627 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.627 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "insights", 2024-05-08T23:18:04.627 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.627 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.627 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.628 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.629 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.630 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.631 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.631 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.631 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.631 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.631 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.631 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.631 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.631 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.631 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.631 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.631 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.631 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.631 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.631 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.632 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.632 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.632 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.632 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.632 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.632 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.632 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.632 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.632 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.632 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "iostat", 2024-05-08T23:18:04.632 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.633 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.633 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.633 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.633 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.633 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.633 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.634 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.634 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.634 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.634 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.634 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.634 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.634 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.634 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.634 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.634 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.634 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.634 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.634 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.634 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.635 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.635 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.635 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.635 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.635 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.635 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.635 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.635 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.635 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.635 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.635 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.635 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.635 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.635 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.636 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.638 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.638 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.638 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.638 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.638 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.638 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.638 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "k8sevents", 2024-05-08T23:18:04.638 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.638 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.638 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.638 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_event_retention_days": { 2024-05-08T23:18:04.638 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ceph_event_retention_days", 2024-05-08T23:18:04.638 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.638 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.639 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.639 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7", 2024-05-08T23:18:04.639 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.639 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.639 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.639 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-08T23:18:04.639 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.639 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.639 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.639 INFO:teuthology.orchestra.run.smithi135.stdout: "config_check_secs": { 2024-05-08T23:18:04.639 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_check_secs", 2024-05-08T23:18:04.639 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.639 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.639 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.640 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.640 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "10", 2024-05-08T23:18:04.640 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.640 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.640 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-08T23:18:04.640 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.640 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.640 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.640 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.640 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.640 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.640 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.640 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.640 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.641 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.642 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.642 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.642 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.642 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.642 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.642 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.642 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.642 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.642 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.642 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.642 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.642 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.642 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.643 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.644 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.644 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.644 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.644 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.644 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.644 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.644 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.644 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.644 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.644 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.644 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.644 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.644 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.644 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "localpool", 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: "failure_domain": { 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "failure_domain", 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.645 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "host", 2024-05-08T23:18:04.646 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.646 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.646 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.646 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "failure domain for any created local pool", 2024-05-08T23:18:04.646 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-08T23:18:04.646 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.646 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.646 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.646 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.646 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.646 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.646 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.646 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.646 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.647 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.647 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.647 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.647 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.647 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.647 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.647 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.647 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.647 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.647 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.647 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.647 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.647 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.648 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.648 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.648 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.648 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.648 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.648 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.648 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.648 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.648 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.648 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.648 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.648 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.648 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.648 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.649 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.650 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.650 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.650 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.650 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.650 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.650 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.650 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.650 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.650 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.650 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.650 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.650 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.650 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.651 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.651 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.651 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.651 INFO:teuthology.orchestra.run.smithi135.stdout: "min_size": { 2024-05-08T23:18:04.651 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_size", 2024-05-08T23:18:04.651 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.651 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.651 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.651 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.651 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.651 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.651 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.651 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default min_size for any created local pool", 2024-05-08T23:18:04.651 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-08T23:18:04.652 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.652 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.652 INFO:teuthology.orchestra.run.smithi135.stdout: "num_rep": { 2024-05-08T23:18:04.652 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "num_rep", 2024-05-08T23:18:04.652 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.652 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.652 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.652 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3", 2024-05-08T23:18:04.652 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.652 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.652 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.652 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default replica count for any created local pool", 2024-05-08T23:18:04.652 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.652 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.653 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.653 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_num": { 2024-05-08T23:18:04.653 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_num", 2024-05-08T23:18:04.653 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.653 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.653 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.653 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "128", 2024-05-08T23:18:04.653 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.653 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.653 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.653 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default pg_num for any created local pool", 2024-05-08T23:18:04.653 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.653 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.653 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.654 INFO:teuthology.orchestra.run.smithi135.stdout: "prefix": { 2024-05-08T23:18:04.654 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prefix", 2024-05-08T23:18:04.654 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.654 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.654 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.654 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.654 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.654 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.654 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.654 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name prefix for any created local pool", 2024-05-08T23:18:04.654 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.654 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.654 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: "subtree": { 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "subtree", 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "rack", 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.655 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mds_autoscaler", 2024-05-08T23:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.658 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.658 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.658 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.658 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.658 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.658 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.658 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.658 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.658 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.658 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.658 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.658 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.658 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.658 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.659 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.659 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.659 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.659 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.659 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.659 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.659 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.659 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.659 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.659 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.659 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.659 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.660 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.660 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.660 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.660 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.660 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.660 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.660 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.660 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.660 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.660 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.660 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.660 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.660 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirroring", 2024-05-08T23:18:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.662 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.663 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.664 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.665 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.665 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.665 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.665 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.665 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.665 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.665 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.665 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.665 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.665 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.665 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.665 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.665 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.666 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.666 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.666 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.666 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.666 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.666 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.666 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.666 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.666 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.666 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.666 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.666 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "nfs", 2024-05-08T23:18:04.666 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.667 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.667 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.667 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.667 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.667 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.667 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.667 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.667 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.667 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.667 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.667 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.667 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.667 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.667 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.667 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.668 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.669 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.669 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.669 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.669 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.669 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.669 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.669 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.669 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.669 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.669 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.669 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.669 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.669 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.669 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.670 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.670 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.670 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.670 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.670 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.670 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.670 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.670 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.670 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.670 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.670 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.670 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.670 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.670 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.671 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.671 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.671 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.671 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.671 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.671 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.671 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.671 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.671 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.671 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.671 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.671 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.671 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.671 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "fail_fs": { 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "fail_fs", 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.672 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.673 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.673 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.673 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.673 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.673 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.673 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.673 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.673 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.673 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.673 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.673 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.673 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.673 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.674 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.674 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.674 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.674 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.674 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.674 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.674 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.674 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.674 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.674 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.674 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.674 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.674 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.674 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.675 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.675 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.675 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.675 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.675 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.675 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.675 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.675 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.675 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.675 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.675 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.675 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.675 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.675 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.676 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.676 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.676 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.676 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.676 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.676 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.676 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.676 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.676 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.676 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.676 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.676 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.676 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.676 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.677 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.677 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.677 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.677 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.677 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.677 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.677 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.677 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.677 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.677 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.677 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.677 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator": { 2024-05-08T23:18:04.677 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-05-08T23:18:04.677 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.678 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.678 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.678 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.678 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.678 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.678 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.678 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm", 2024-05-08T23:18:04.678 INFO:teuthology.orchestra.run.smithi135.stdout: "rook", 2024-05-08T23:18:04.678 INFO:teuthology.orchestra.run.smithi135.stdout: "test_orchestrator" 2024-05-08T23:18:04.678 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.678 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Orchestrator backend", 2024-05-08T23:18:04.678 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.678 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.678 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_perf_query", 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.679 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.680 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.680 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.680 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.680 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.680 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.680 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.680 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.680 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.680 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.680 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.680 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.680 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.680 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.681 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.681 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.681 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.681 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.681 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.681 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.681 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.681 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.681 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.681 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.681 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.681 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.681 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.681 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.682 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.682 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.682 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.682 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.682 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.682 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.682 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.682 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.682 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.682 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.682 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.682 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.682 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.682 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.682 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.683 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_support", 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.684 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.685 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.686 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.686 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.686 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.686 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.686 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.686 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.686 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.686 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.686 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.686 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.686 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.686 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.687 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.687 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.687 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.687 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.687 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.687 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.687 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.687 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.687 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.687 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.687 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.687 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.687 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.687 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.687 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.688 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.688 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.688 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.688 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.688 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.688 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.688 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.688 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.688 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.688 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.688 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.688 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.688 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_autoscaler", 2024-05-08T23:18:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.689 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.690 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.691 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.691 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.691 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.691 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.691 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.691 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.691 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.691 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.691 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.691 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.691 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.691 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.691 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.692 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.692 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.692 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.692 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.692 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.692 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.692 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.692 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.692 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.692 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.692 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.692 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.692 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.692 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.693 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.693 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.693 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.693 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.693 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.693 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.693 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.693 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.693 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.693 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.693 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.693 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.693 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.693 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.694 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.694 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.694 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.694 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.694 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.694 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.694 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.694 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-08T23:18:04.694 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-08T23:18:04.694 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.694 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.694 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.694 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-08T23:18:04.694 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.695 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.695 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.695 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.695 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.695 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.695 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.695 INFO:teuthology.orchestra.run.smithi135.stdout: "threshold": { 2024-05-08T23:18:04.695 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threshold", 2024-05-08T23:18:04.695 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.695 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.695 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.695 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-05-08T23:18:04.695 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1.0", 2024-05-08T23:18:04.695 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.696 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.696 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "scaling threshold", 2024-05-08T23:18:04.696 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-08T23:18:04.696 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.696 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.696 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.696 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.696 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.696 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "progress", 2024-05-08T23:18:04.696 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.696 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.696 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.696 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_pg_recovery_event": { 2024-05-08T23:18:04.696 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_pg_recovery_event", 2024-05-08T23:18:04.697 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.697 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.697 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.697 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.697 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.697 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.697 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.697 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-08T23:18:04.697 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.697 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.697 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.697 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-05-08T23:18:04.697 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-05-08T23:18:04.697 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.698 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.698 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.698 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.698 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.698 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.698 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.698 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.698 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.698 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.698 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.698 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.698 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.698 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.698 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.699 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.699 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.699 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.699 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.699 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.699 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.699 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.699 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.699 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.699 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.699 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.699 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.699 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.699 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.699 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.700 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.700 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.700 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.700 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.700 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.700 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.700 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.700 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.700 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.700 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.700 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.700 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.700 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.700 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.701 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.702 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.702 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.702 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.702 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.702 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.702 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.702 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.702 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.702 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.702 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.702 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.702 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.702 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.702 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.703 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.703 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.703 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.703 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.703 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.703 INFO:teuthology.orchestra.run.smithi135.stdout: "max_completed_events": { 2024-05-08T23:18:04.703 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_completed_events", 2024-05-08T23:18:04.703 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.703 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.703 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.703 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "50", 2024-05-08T23:18:04.703 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.703 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.704 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.704 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "number of past completed events to remember", 2024-05-08T23:18:04.704 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.704 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.704 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.704 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-08T23:18:04.704 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-08T23:18:04.704 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.704 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.704 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.704 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-08T23:18:04.704 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.704 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.705 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.705 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long the module is going to sleep", 2024-05-08T23:18:04.705 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.705 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.705 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.705 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.705 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.705 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.705 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus", 2024-05-08T23:18:04.705 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.705 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.705 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.705 INFO:teuthology.orchestra.run.smithi135.stdout: "cache": { 2024-05-08T23:18:04.705 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cache", 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: "exclude_perf_counters": { 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "exclude_perf_counters", 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.706 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.707 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.707 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.707 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.707 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.707 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.707 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-08T23:18:04.707 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-08T23:18:04.707 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.707 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.707 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.707 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.707 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.707 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.707 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.709 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.710 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.710 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.710 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.710 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.710 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.710 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.710 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.710 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.710 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.710 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.710 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.710 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.710 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.710 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.710 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.711 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.711 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.711 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.711 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.711 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.711 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.711 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.711 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.711 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.711 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.711 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.711 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.711 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.712 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.712 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.712 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.712 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.712 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools": { 2024-05-08T23:18:04.712 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools", 2024-05-08T23:18:04.712 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.712 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.712 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.712 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.712 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.712 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.712 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.712 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.712 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.713 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.713 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.713 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-08T23:18:04.713 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-08T23:18:04.713 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.713 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.713 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.713 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "300", 2024-05-08T23:18:04.713 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.713 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.713 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.713 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.713 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.713 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_interval": { 2024-05-08T23:18:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_interval", 2024-05-08T23:18:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15.0", 2024-05-08T23:18:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.714 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-08T23:18:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-08T23:18:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-05-08T23:18:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-08T23:18:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.716 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-08T23:18:04.716 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-08T23:18:04.716 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.716 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.716 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.716 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "9283", 2024-05-08T23:18:04.716 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.716 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.716 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.716 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-08T23:18:04.716 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.716 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.716 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.716 INFO:teuthology.orchestra.run.smithi135.stdout: "stale_cache_strategy": { 2024-05-08T23:18:04.717 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stale_cache_strategy", 2024-05-08T23:18:04.717 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.717 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.717 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.717 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "log", 2024-05-08T23:18:04.717 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.717 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.717 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.717 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.717 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.717 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.717 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.717 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-05-08T23:18:04.717 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-05-08T23:18:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "default", 2024-05-08T23:18:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: "default", 2024-05-08T23:18:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: "error" 2024-05-08T23:18:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.719 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-05-08T23:18:04.719 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-05-08T23:18:04.719 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.719 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.719 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.719 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-05-08T23:18:04.719 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-05-08T23:18:04.719 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-05-08T23:18:04.719 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.719 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.719 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.719 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.719 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.719 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.719 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_support", 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.721 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.722 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.722 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.722 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.722 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.722 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.722 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.722 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.722 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.722 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.722 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.722 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.722 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.722 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.722 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.723 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.723 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.723 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.723 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.723 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.723 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.723 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.723 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.723 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.723 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.723 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.723 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.723 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.723 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.724 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.724 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.724 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.724 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.724 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.724 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.724 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.724 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.724 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.724 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.724 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.724 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.724 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_snap_create": { 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_snap_create", 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: "mirror_snapshot_schedule": { 2024-05-08T23:18:04.725 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirror_snapshot_schedule", 2024-05-08T23:18:04.726 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.726 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.726 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.726 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.726 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.726 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.726 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.726 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.726 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.726 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.726 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.726 INFO:teuthology.orchestra.run.smithi135.stdout: "trash_purge_schedule": { 2024-05-08T23:18:04.726 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "trash_purge_schedule", 2024-05-08T23:18:04.726 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.727 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.727 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.727 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.727 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.727 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.727 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.727 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.727 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.727 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.727 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.727 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.727 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.727 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.727 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.727 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "restful", 2024-05-08T23:18:04.728 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.728 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.728 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.728 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_auth": { 2024-05-08T23:18:04.728 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_auth", 2024-05-08T23:18:04.728 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.728 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.728 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.728 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.728 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.728 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.728 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.728 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.728 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.728 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.729 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.729 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-05-08T23:18:04.729 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-05-08T23:18:04.729 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.729 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.729 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.729 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.729 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.729 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.729 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.729 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.729 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.729 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.729 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.730 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.730 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.730 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.730 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.730 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.730 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.730 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.730 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.730 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.730 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.730 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.730 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.730 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.730 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.731 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.732 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.732 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.732 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.732 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.732 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.732 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.732 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.732 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.732 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.732 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.732 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.732 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.732 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.732 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.733 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.734 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.734 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.734 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.734 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.734 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.734 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.734 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.734 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.734 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-08T23:18:04.734 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-08T23:18:04.734 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.734 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.734 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.735 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.736 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.736 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.736 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.736 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.736 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.736 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.736 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.736 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rgw", 2024-05-08T23:18:04.736 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.736 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.736 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.736 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.736 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.737 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.737 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.737 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.737 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.737 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.737 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.737 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.737 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.737 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.737 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.737 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.737 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.737 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.737 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.738 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.738 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.738 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.738 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.738 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.738 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.738 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.738 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.738 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.738 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.738 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.738 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.738 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.739 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.739 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.739 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.739 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.739 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.739 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.739 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.739 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.739 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.739 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.739 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.739 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.739 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.739 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.740 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.740 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.740 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.740 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.740 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.740 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.740 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.740 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.740 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.740 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.740 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.740 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.740 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.740 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.741 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.741 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.741 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.741 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.741 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.741 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.741 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.741 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.741 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.741 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.741 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.741 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.741 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rook", 2024-05-08T23:18:04.741 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.742 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.743 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.743 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.743 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.743 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.743 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.743 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.743 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.743 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.743 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.743 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.743 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.743 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.743 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.744 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.744 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.744 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.744 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.744 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.744 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.744 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.744 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.744 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.744 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.744 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.744 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.744 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.744 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.746 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.746 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.746 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.746 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.746 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.746 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.746 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.746 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.746 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.746 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.746 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.746 INFO:teuthology.orchestra.run.smithi135.stdout: "storage_class": { 2024-05-08T23:18:04.746 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "storage_class", 2024-05-08T23:18:04.746 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.747 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.747 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.747 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "local", 2024-05-08T23:18:04.747 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.747 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.747 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.747 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-08T23:18:04.747 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.747 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.747 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.747 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.747 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.747 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.747 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "selftest", 2024-05-08T23:18:04.748 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.748 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.748 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.748 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.748 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.748 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.748 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.748 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.748 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.748 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.748 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.748 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.748 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.748 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.748 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.749 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.750 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.750 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.750 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.750 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.750 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.750 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.750 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.750 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.750 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.750 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.750 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.750 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.750 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.751 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.751 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.751 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.751 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.751 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.751 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.751 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.751 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.751 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.751 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.751 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.751 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.751 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.751 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.752 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.752 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.752 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.752 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.752 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.752 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.752 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.752 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.752 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.752 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.752 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.752 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.752 INFO:teuthology.orchestra.run.smithi135.stdout: "roption1": { 2024-05-08T23:18:04.753 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption1", 2024-05-08T23:18:04.753 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.753 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.753 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.753 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.753 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.753 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.753 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.753 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.753 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.753 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.753 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.753 INFO:teuthology.orchestra.run.smithi135.stdout: "roption2": { 2024-05-08T23:18:04.753 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption2", 2024-05-08T23:18:04.754 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.754 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.754 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.754 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "xyz", 2024-05-08T23:18:04.754 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.754 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.754 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.754 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.754 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.754 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.754 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.754 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption1": { 2024-05-08T23:18:04.754 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption1", 2024-05-08T23:18:04.754 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.755 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.755 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.755 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.755 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.755 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.755 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.755 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.755 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.755 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.755 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.755 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption2": { 2024-05-08T23:18:04.755 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption2", 2024-05-08T23:18:04.755 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.756 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.756 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.756 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.756 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.756 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.756 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.756 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.756 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.756 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.756 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.756 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.756 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption3": { 2024-05-08T23:18:04.756 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption3", 2024-05-08T23:18:04.756 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.756 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.757 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.757 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.757 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.757 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.757 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.757 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.757 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.757 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.757 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.757 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption4": { 2024-05-08T23:18:04.757 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption4", 2024-05-08T23:18:04.757 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.757 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.757 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.758 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.758 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.758 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.758 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.758 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.758 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.758 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.758 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.758 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption5": { 2024-05-08T23:18:04.758 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption5", 2024-05-08T23:18:04.758 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.758 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.758 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.758 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption6": { 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption6", 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.759 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.760 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.760 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.760 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.760 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.760 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.760 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption7": { 2024-05-08T23:18:04.760 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption7", 2024-05-08T23:18:04.760 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.760 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.760 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.760 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.760 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-08T23:18:04.760 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "42", 2024-05-08T23:18:04.760 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.761 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.761 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.761 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.761 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.761 INFO:teuthology.orchestra.run.smithi135.stdout: "testkey": { 2024-05-08T23:18:04.761 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testkey", 2024-05-08T23:18:04.761 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.761 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.761 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.761 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.761 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.761 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.761 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.761 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: "testlkey": { 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testlkey", 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.762 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.763 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.763 INFO:teuthology.orchestra.run.smithi135.stdout: "testnewline": { 2024-05-08T23:18:04.763 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testnewline", 2024-05-08T23:18:04.763 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.763 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.763 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.763 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.763 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.763 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.763 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.763 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.763 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.763 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snap_schedule", 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_m_granularity": { 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_m_granularity", 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.764 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow minute scheduled snapshots", 2024-05-08T23:18:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: "dump_on_update": { 2024-05-08T23:18:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dump_on_update", 2024-05-08T23:18:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.765 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.766 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.766 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "dump database to debug log on update", 2024-05-08T23:18:04.766 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.766 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.766 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.766 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.766 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.766 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.766 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.766 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.766 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.766 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.766 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.766 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.767 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.767 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.767 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.767 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.767 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.767 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.767 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.767 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.767 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.767 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.767 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.767 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.767 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.767 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.768 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.769 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.769 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.769 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.769 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.769 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.769 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.769 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.769 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.769 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.769 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.769 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.769 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.769 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.769 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.769 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.770 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.771 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.771 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stats", 2024-05-08T23:18:04.771 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.771 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.771 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.771 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.771 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.771 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.771 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.771 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.771 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.771 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.771 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.771 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.772 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.772 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.772 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.772 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.772 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.772 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.772 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.772 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.772 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.772 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.772 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.772 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.772 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.772 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.773 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.774 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.774 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.774 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.774 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.774 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.774 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.774 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.774 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.774 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.774 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.774 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.774 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.774 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.774 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.775 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.776 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.776 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.776 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "status", 2024-05-08T23:18:04.776 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.776 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.776 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.776 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.776 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.776 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.776 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.776 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.776 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.776 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.776 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.777 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.777 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.777 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.777 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.777 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.777 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.777 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.777 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.777 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.777 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.777 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.777 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.777 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.778 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.778 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.778 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.778 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.778 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.778 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.778 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.778 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.778 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.778 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.778 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.778 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.778 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.778 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.779 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.779 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.779 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.779 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.779 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.779 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.779 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.779 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.779 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.779 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.779 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.779 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.779 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.779 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.780 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.780 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.780 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.780 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.780 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.780 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.780 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.780 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.780 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.780 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.780 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.780 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.780 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.780 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.781 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.781 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.781 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.781 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.781 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.781 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.781 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.781 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telegraf", 2024-05-08T23:18:04.781 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.781 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.781 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.781 INFO:teuthology.orchestra.run.smithi135.stdout: "address": { 2024-05-08T23:18:04.781 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "address", 2024-05-08T23:18:04.781 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.782 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.782 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.782 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-08T23:18:04.782 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.782 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.782 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.782 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.782 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.782 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.782 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.782 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-08T23:18:04.782 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-08T23:18:04.782 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.783 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.783 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.783 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15", 2024-05-08T23:18:04.783 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.783 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.783 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.783 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.783 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.783 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.783 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.783 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.783 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.783 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.783 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.784 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.785 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.785 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.785 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.785 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.785 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.785 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.785 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.785 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.785 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.785 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.785 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.785 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.785 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.786 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.786 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.786 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.786 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.786 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.786 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.786 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.786 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.786 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.786 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.786 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.786 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.786 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.786 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.786 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.787 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.787 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.787 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.787 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.787 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.787 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.787 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.787 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.787 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.787 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.787 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.787 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.787 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.787 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.787 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telemetry", 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_basic": { 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_basic", 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.788 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.789 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.789 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.789 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.789 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.789 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.789 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-08T23:18:04.789 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.789 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.789 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.789 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_crash": { 2024-05-08T23:18:04.789 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_crash", 2024-05-08T23:18:04.789 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.789 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.790 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.790 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.790 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.790 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.790 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.790 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-08T23:18:04.790 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.790 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.790 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.790 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_device": { 2024-05-08T23:18:04.790 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_device", 2024-05-08T23:18:04.790 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.790 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.790 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.791 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.791 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.791 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.791 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.791 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-08T23:18:04.791 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.791 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.791 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.791 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_ident": { 2024-05-08T23:18:04.791 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_ident", 2024-05-08T23:18:04.791 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.791 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.791 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.791 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_perf": { 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_perf", 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.792 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.793 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.793 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-08T23:18:04.793 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.793 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.793 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.793 INFO:teuthology.orchestra.run.smithi135.stdout: "contact": { 2024-05-08T23:18:04.793 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "contact", 2024-05-08T23:18:04.793 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.793 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.793 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.793 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.793 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.793 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.793 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.794 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.794 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.794 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.794 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.794 INFO:teuthology.orchestra.run.smithi135.stdout: "description": { 2024-05-08T23:18:04.794 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "description", 2024-05-08T23:18:04.794 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.794 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.794 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.794 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.794 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.794 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.794 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.794 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.795 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.795 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.795 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.795 INFO:teuthology.orchestra.run.smithi135.stdout: "device_url": { 2024-05-08T23:18:04.795 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_url", 2024-05-08T23:18:04.795 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.795 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.795 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.795 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-08T23:18:04.795 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.795 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.795 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.795 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.795 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.796 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.796 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.796 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-05-08T23:18:04.796 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-05-08T23:18:04.796 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.796 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.796 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.796 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.796 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.796 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.796 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.796 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.796 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.796 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "24", 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "8", 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.798 INFO:teuthology.orchestra.run.smithi135.stdout: "last_opt_revision": { 2024-05-08T23:18:04.798 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "last_opt_revision", 2024-05-08T23:18:04.798 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.798 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.798 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.798 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1", 2024-05-08T23:18:04.798 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.798 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.798 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.798 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.798 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.798 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.798 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.799 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard": { 2024-05-08T23:18:04.799 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard", 2024-05-08T23:18:04.799 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.799 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.799 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.799 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.799 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.799 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.799 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.799 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.799 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.799 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.799 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.799 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.799 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard_description": { 2024-05-08T23:18:04.800 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard_description", 2024-05-08T23:18:04.800 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.800 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.800 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.800 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.800 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.800 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.800 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.800 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.800 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.800 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.800 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.800 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.800 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.801 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.801 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.801 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.801 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.801 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.801 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.801 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.801 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.801 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.801 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.801 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.801 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.801 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.802 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.802 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.802 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.802 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.802 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.802 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.802 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.802 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.802 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.802 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.802 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.802 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.802 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.802 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.803 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.804 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: "organization": { 2024-05-08T23:18:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "organization", 2024-05-08T23:18:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.805 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.806 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.806 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.806 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.806 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.806 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.806 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.806 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.806 INFO:teuthology.orchestra.run.smithi135.stdout: "proxy": { 2024-05-08T23:18:04.806 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "proxy", 2024-05-08T23:18:04.806 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.806 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.806 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.806 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.806 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.807 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.807 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.807 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.807 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.807 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.807 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.807 INFO:teuthology.orchestra.run.smithi135.stdout: "url": { 2024-05-08T23:18:04.807 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url", 2024-05-08T23:18:04.807 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.807 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.807 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.807 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-08T23:18:04.807 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.807 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.808 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.808 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.808 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.808 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.808 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.808 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.808 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.808 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.808 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "test_orchestrator", 2024-05-08T23:18:04.808 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.808 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.808 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.808 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.808 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.810 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.810 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.810 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.810 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.810 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.810 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.810 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.810 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.810 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.810 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.810 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.810 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.810 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.810 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.811 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.811 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.811 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.811 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.811 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.811 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.811 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.811 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.811 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.811 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.811 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.811 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.811 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.811 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.812 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "volumes", 2024-05-08T23:18:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.814 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.814 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.814 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.814 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.814 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.814 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.814 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.814 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.814 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.814 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.814 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.814 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.814 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.814 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.815 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.815 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.815 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.815 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.815 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.815 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.815 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.815 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.815 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.815 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.815 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.815 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.815 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.815 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.816 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.817 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.818 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.818 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.818 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.818 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.818 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.818 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_clones": { 2024-05-08T23:18:04.818 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_clones", 2024-05-08T23:18:04.818 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.818 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.818 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.818 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4", 2024-05-08T23:18:04.818 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.818 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_delay": { 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_delay", 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.819 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-08T23:18:04.820 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.820 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.820 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.820 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_no_wait": { 2024-05-08T23:18:04.820 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_no_wait", 2024-05-08T23:18:04.820 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.820 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.820 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.820 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.820 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.820 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.820 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.820 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-08T23:18:04.820 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix", 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: "discovery_interval": { 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "discovery_interval", 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "100", 2024-05-08T23:18:04.821 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.822 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.822 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.822 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.822 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.822 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.822 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.822 INFO:teuthology.orchestra.run.smithi135.stdout: "identifier": { 2024-05-08T23:18:04.822 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "identifier", 2024-05-08T23:18:04.822 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.822 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.822 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.822 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.822 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.823 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.824 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.825 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.825 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.825 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.825 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.825 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.825 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.825 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.825 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.825 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.825 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.825 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.825 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.825 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.825 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.826 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.826 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.826 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.826 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.826 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.826 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.826 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.826 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.826 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.826 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.826 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.826 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.826 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.826 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.826 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.827 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.827 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.827 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.827 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.827 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.827 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.827 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.827 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.827 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.827 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.827 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.827 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.827 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.827 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.828 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.828 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.828 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.828 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.828 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.828 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.828 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.828 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.828 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.828 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.828 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.828 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.828 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_host": { 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_host", 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_port": { 2024-05-08T23:18:04.829 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_port", 2024-05-08T23:18:04.830 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.830 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.830 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.830 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10051", 2024-05-08T23:18:04.830 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.830 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.830 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.830 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.830 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.830 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.830 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.830 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_sender": { 2024-05-08T23:18:04.830 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_sender", 2024-05-08T23:18:04.830 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.831 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.831 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.831 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-08T23:18:04.831 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.831 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.831 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.831 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.831 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.831 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.831 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.831 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.831 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.831 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.831 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: "modules": [ 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm", 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: "dashboard", 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: "iostat", 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: "nfs", 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: "restful" 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: "available_modules": [ 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "alerts", 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.832 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-08T23:18:04.833 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-08T23:18:04.833 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.833 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.833 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.833 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-08T23:18:04.833 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.833 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.833 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.833 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How frequently to reexamine health status", 2024-05-08T23:18:04.833 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.833 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.833 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.833 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.833 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.834 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.834 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.834 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.834 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.834 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.834 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.834 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.834 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.834 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.834 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.834 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.834 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.834 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.834 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.834 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.835 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.836 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.837 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.837 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.837 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.837 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.837 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.837 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.837 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.837 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.837 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.837 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.837 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.838 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.838 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.838 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.838 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.838 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.838 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.838 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.838 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.838 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.838 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_destination": { 2024-05-08T23:18:04.838 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_destination", 2024-05-08T23:18:04.838 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.838 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.838 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email address to send alerts to", 2024-05-08T23:18:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_from_name": { 2024-05-08T23:18:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_from_name", 2024-05-08T23:18:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "Ceph", 2024-05-08T23:18:04.840 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.840 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.840 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.840 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email From: name", 2024-05-08T23:18:04.840 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.840 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.840 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.840 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_host": { 2024-05-08T23:18:04.840 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_host", 2024-05-08T23:18:04.840 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.840 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.840 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.840 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.840 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP server", 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_password": { 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_password", 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.841 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.842 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Password to authenticate with", 2024-05-08T23:18:04.842 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.842 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.842 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.842 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_port": { 2024-05-08T23:18:04.842 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_port", 2024-05-08T23:18:04.842 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.842 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.842 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.842 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "465", 2024-05-08T23:18:04.842 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.842 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.842 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.843 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP port", 2024-05-08T23:18:04.843 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.843 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.843 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.843 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_sender": { 2024-05-08T23:18:04.843 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_sender", 2024-05-08T23:18:04.843 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.843 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.843 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.843 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.843 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.843 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.844 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.844 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP envelope sender", 2024-05-08T23:18:04.844 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.844 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.844 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.844 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_ssl": { 2024-05-08T23:18:04.844 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_ssl", 2024-05-08T23:18:04.844 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.844 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.844 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.844 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.844 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.844 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_user": { 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_user", 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "User to authenticate as", 2024-05-08T23:18:04.846 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.846 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.846 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.846 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.846 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.846 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.846 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "balancer", 2024-05-08T23:18:04.846 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.846 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.846 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.846 INFO:teuthology.orchestra.run.smithi135.stdout: "active": { 2024-05-08T23:18:04.846 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "active", 2024-05-08T23:18:04.846 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.846 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.847 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.847 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.847 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.847 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.847 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.847 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically balance PGs across cluster", 2024-05-08T23:18:04.847 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.847 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.847 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.847 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_time": { 2024-05-08T23:18:04.847 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_time", 2024-05-08T23:18:04.847 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.847 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.848 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.848 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0000", 2024-05-08T23:18:04.848 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.848 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.848 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.848 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "beginning time of day to automatically balance", 2024-05-08T23:18:04.848 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T23:18:04.848 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.848 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.848 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_weekday": { 2024-05-08T23:18:04.848 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_weekday", 2024-05-08T23:18:04.848 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-08T23:18:04.848 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.848 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.849 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-08T23:18:04.849 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-05-08T23:18:04.849 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-05-08T23:18:04.849 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.849 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-08T23:18:04.849 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T23:18:04.849 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.849 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.849 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_max_iterations": { 2024-05-08T23:18:04.849 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_max_iterations", 2024-05-08T23:18:04.849 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-08T23:18:04.849 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.849 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.849 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "25", 2024-05-08T23:18:04.850 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-08T23:18:04.850 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "250", 2024-05-08T23:18:04.850 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.850 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-08T23:18:04.850 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.850 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.850 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.850 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.850 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_metrics": { 2024-05-08T23:18:04.850 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_metrics", 2024-05-08T23:18:04.850 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.850 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.850 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.850 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "pgs,objects,bytes", 2024-05-08T23:18:04.850 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.851 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.851 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.851 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-08T23:18:04.851 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-08T23:18:04.851 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.851 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.851 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_step": { 2024-05-08T23:18:04.851 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_step", 2024-05-08T23:18:04.851 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.851 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.851 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.851 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.5", 2024-05-08T23:18:04.851 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0.001", 2024-05-08T23:18:04.851 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "0.999", 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "aggressiveness of optimization", 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: "end_time": { 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_time", 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2359", 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.852 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ending time of day to automatically balance", 2024-05-08T23:18:04.853 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T23:18:04.853 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.853 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.853 INFO:teuthology.orchestra.run.smithi135.stdout: "end_weekday": { 2024-05-08T23:18:04.853 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_weekday", 2024-05-08T23:18:04.853 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-08T23:18:04.853 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.853 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.853 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-08T23:18:04.853 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-05-08T23:18:04.853 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-05-08T23:18:04.853 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.853 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-08T23:18:04.853 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T23:18:04.854 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.854 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.854 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.854 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.854 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.854 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.854 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.854 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.854 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.854 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.854 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.854 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.854 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.854 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.855 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.855 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.855 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.855 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.855 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.855 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.855 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.855 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.855 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.855 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.855 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.855 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.855 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.855 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.856 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.856 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.856 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.856 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.856 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.856 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.856 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.856 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.856 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.856 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.856 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.856 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.856 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.857 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.858 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.858 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.858 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.858 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.858 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.858 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.858 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.858 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.858 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.858 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.858 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.858 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.858 INFO:teuthology.orchestra.run.smithi135.stdout: "min_score": { 2024-05-08T23:18:04.859 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_score", 2024-05-08T23:18:04.859 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.859 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.859 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.859 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-08T23:18:04.859 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.859 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.859 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.859 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-08T23:18:04.859 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.859 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.859 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.859 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-05-08T23:18:04.859 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-05-08T23:18:04.860 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.860 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.860 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.860 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "upmap", 2024-05-08T23:18:04.860 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.860 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.860 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.860 INFO:teuthology.orchestra.run.smithi135.stdout: "crush-compat", 2024-05-08T23:18:04.860 INFO:teuthology.orchestra.run.smithi135.stdout: "none", 2024-05-08T23:18:04.860 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap" 2024-05-08T23:18:04.860 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.860 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Balancer mode", 2024-05-08T23:18:04.860 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.860 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.860 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_ids": { 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_ids", 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.861 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-08T23:18:04.862 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-08T23:18:04.862 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.862 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.862 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.862 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-08T23:18:04.862 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.862 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.862 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.862 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-08T23:18:04.862 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.862 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.862 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.862 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_deviation": { 2024-05-08T23:18:04.863 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_deviation", 2024-05-08T23:18:04.863 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.863 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.863 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.863 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-08T23:18:04.863 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-08T23:18:04.863 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.863 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.863 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-08T23:18:04.863 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-08T23:18:04.863 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.863 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.863 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_optimizations": { 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_optimizations", 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.864 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cephadm", 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_down_multiplier": { 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_down_multiplier", 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.865 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_refresh_rate": { 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_refresh_rate", 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "20", 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_starting_port": { 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_starting_port", 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4721", 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_ptrace": { 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_ptrace", 2024-05-08T23:18:04.867 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_interval": { 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_interval", 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.868 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_memory_target_ratio": { 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_memory_target_ratio", 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.7", 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.869 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.870 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.870 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-08T23:18:04.870 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.870 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.870 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.870 INFO:teuthology.orchestra.run.smithi135.stdout: "cgroups_split": { 2024-05-08T23:18:04.870 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cgroups_split", 2024-05-08T23:18:04.870 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.870 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.870 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.870 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.870 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.870 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.870 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.871 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-08T23:18:04.871 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.871 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.871 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.871 INFO:teuthology.orchestra.run.smithi135.stdout: "config_checks_enabled": { 2024-05-08T23:18:04.871 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_checks_enabled", 2024-05-08T23:18:04.871 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.871 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.871 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.871 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.871 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.871 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.871 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.871 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-08T23:18:04.872 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.872 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.872 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.872 INFO:teuthology.orchestra.run.smithi135.stdout: "config_dashboard": { 2024-05-08T23:18:04.872 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_dashboard", 2024-05-08T23:18:04.872 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.872 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.872 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.872 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.872 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.872 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.872 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.872 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-08T23:18:04.872 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_alertmanager": { 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_alertmanager", 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.873 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_base": { 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_base", 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Container image name, without the tag", 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.874 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_elasticsearch": { 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_elasticsearch", 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "elasticsearch container image", 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_grafana": { 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_grafana", 2024-05-08T23:18:04.875 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_haproxy": { 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_haproxy", 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-08T23:18:04.876 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "HAproxy container image", 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_agent": { 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_agent", 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.877 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger agent container image", 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_collector": { 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_collector", 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger collector container image", 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.878 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_query": { 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_query", 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger query container image", 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.880 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_keepalived": { 2024-05-08T23:18:04.880 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_keepalived", 2024-05-08T23:18:04.880 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.880 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.880 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.880 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-08T23:18:04.880 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.880 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.880 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.880 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Keepalived container image", 2024-05-08T23:18:04.880 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.880 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.880 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.880 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_loki": { 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_loki", 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Loki container image", 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_node_exporter": { 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_node_exporter", 2024-05-08T23:18:04.881 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-08T23:18:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-08T23:18:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_nvmeof": { 2024-05-08T23:18:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_nvmeof", 2024-05-08T23:18:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.882 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.883 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.883 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-05-08T23:18:04.883 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.883 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.883 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.883 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Nvme-of container image", 2024-05-08T23:18:04.883 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.883 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.883 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.883 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.883 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_prometheus": { 2024-05-08T23:18:04.883 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_prometheus", 2024-05-08T23:18:04.883 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.883 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.883 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.884 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-08T23:18:04.884 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.884 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.884 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.884 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-05-08T23:18:04.884 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.884 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.884 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.884 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_promtail": { 2024-05-08T23:18:04.884 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_promtail", 2024-05-08T23:18:04.884 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.884 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.884 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.884 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Promtail container image", 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_snmp_gateway": { 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_snmp_gateway", 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.885 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SNMP Gateway container image", 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: "container_init": { 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_init", 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.886 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Run podman/docker with `--init`", 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: "daemon_cache_timeout": { 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "daemon_cache_timeout", 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.887 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: "default_cephadm_command_timeout": { 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_cephadm_command_timeout", 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "900", 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.888 INFO:teuthology.orchestra.run.smithi135.stdout: "default_registry": { 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_registry", 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io", 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "device_cache_timeout": { 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_cache_timeout", 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.889 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.890 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.890 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1800", 2024-05-08T23:18:04.890 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.890 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.890 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.890 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache device inventory", 2024-05-08T23:18:04.890 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.890 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.890 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.890 INFO:teuthology.orchestra.run.smithi135.stdout: "device_enhanced_scan": { 2024-05-08T23:18:04.890 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_enhanced_scan", 2024-05-08T23:18:04.890 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.890 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.891 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.891 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.891 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.891 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.891 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.891 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-08T23:18:04.891 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.891 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.891 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.891 INFO:teuthology.orchestra.run.smithi135.stdout: "facts_cache_timeout": { 2024-05-08T23:18:04.891 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "facts_cache_timeout", 2024-05-08T23:18:04.891 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.891 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.892 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.892 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-08T23:18:04.892 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.892 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.892 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.892 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache host facts data", 2024-05-08T23:18:04.892 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.892 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.892 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.892 INFO:teuthology.orchestra.run.smithi135.stdout: "host_check_interval": { 2024-05-08T23:18:04.892 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "host_check_interval", 2024-05-08T23:18:04.892 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.892 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.892 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.893 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-08T23:18:04.893 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.893 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.893 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.893 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to perform a host check", 2024-05-08T23:18:04.893 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.893 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.893 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.893 INFO:teuthology.orchestra.run.smithi135.stdout: "hw_monitoring": { 2024-05-08T23:18:04.893 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hw_monitoring", 2024-05-08T23:18:04.893 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.893 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.894 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.894 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.894 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.894 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.894 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.894 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-08T23:18:04.894 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.894 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.894 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.894 INFO:teuthology.orchestra.run.smithi135.stdout: "inventory_list_all": { 2024-05-08T23:18:04.894 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "inventory_list_all", 2024-05-08T23:18:04.894 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.894 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.894 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.895 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.895 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.895 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.895 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.895 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-08T23:18:04.895 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.895 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.895 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.895 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.895 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.895 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.895 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.895 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.896 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.897 INFO:teuthology.orchestra.run.smithi135.stdout: "log_refresh_metadata": { 2024-05-08T23:18:04.897 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_refresh_metadata", 2024-05-08T23:18:04.897 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.897 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.897 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.897 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.897 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.897 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.897 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.897 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-08T23:18:04.897 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.897 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.897 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.897 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.898 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.898 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.898 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.898 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.898 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.898 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.898 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.898 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.898 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-08T23:18:04.898 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.898 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.898 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.898 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.899 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.899 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.899 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.899 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.899 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.899 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.899 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.899 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.899 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.899 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.899 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.899 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.899 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.899 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.899 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.900 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.901 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "*", 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: "max_count_per_host": { 2024-05-08T23:18:04.903 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_count_per_host", 2024-05-08T23:18:04.903 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.903 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.903 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.903 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.903 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.903 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.903 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.903 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of daemons per service per host", 2024-05-08T23:18:04.903 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.903 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.903 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.903 INFO:teuthology.orchestra.run.smithi135.stdout: "max_osd_draining_count": { 2024-05-08T23:18:04.903 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_osd_draining_count", 2024-05-08T23:18:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-08T23:18:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: "migration_current": { 2024-05-08T23:18:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "migration_current", 2024-05-08T23:18:04.904 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "internal - do not modify", 2024-05-08T23:18:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-05-08T23:18:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-05-08T23:18:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.906 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.906 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "root", 2024-05-08T23:18:04.906 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.906 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.906 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.906 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm-package", 2024-05-08T23:18:04.906 INFO:teuthology.orchestra.run.smithi135.stdout: "root" 2024-05-08T23:18:04.906 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.906 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "mode for remote execution of cephadm", 2024-05-08T23:18:04.906 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.906 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.906 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.906 INFO:teuthology.orchestra.run.smithi135.stdout: "oob_default_addr": { 2024-05-08T23:18:04.906 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "oob_default_addr", 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "169.254.1.1", 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: "prometheus_alerts_path": { 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus_alerts_path", 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.907 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.908 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.908 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-08T23:18:04.908 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.908 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.908 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.908 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-08T23:18:04.908 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.908 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.908 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.908 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_insecure": { 2024-05-08T23:18:04.908 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_insecure", 2024-05-08T23:18:04.908 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.908 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.908 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_password": { 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_password", 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.909 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.910 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.910 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.910 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-08T23:18:04.910 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.910 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.910 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.910 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_url": { 2024-05-08T23:18:04.910 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_url", 2024-05-08T23:18:04.910 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.910 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.910 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.910 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.910 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.910 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.911 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.911 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-08T23:18:04.911 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.911 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.911 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.911 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_username": { 2024-05-08T23:18:04.911 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_username", 2024-05-08T23:18:04.911 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.911 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.911 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.911 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.911 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.911 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.911 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: "secure_monitoring_stack": { 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "secure_monitoring_stack", 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-08T23:18:04.912 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: "service_discovery_port": { 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "service_discovery_port", 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8765", 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "cephadm service discovery port", 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.913 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: "ssh_config_file": { 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssh_config_file", 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.914 INFO:teuthology.orchestra.run.smithi135.stdout: "use_agent": { 2024-05-08T23:18:04.915 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_agent", 2024-05-08T23:18:04.915 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.915 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.915 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.915 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.915 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.915 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.915 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.915 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-08T23:18:04.915 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.915 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.915 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.915 INFO:teuthology.orchestra.run.smithi135.stdout: "use_repo_digest": { 2024-05-08T23:18:04.915 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_repo_digest", 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_failed_host_check": { 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_failed_host_check", 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.916 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if the host check fails", 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_daemons": { 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_daemons", 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.917 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.918 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.918 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.918 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.918 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-08T23:18:04.918 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.918 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.918 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.918 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_hosts": { 2024-05-08T23:18:04.918 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_hosts", 2024-05-08T23:18:04.918 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.918 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.918 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.918 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.918 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-08T23:18:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crash", 2024-05-08T23:18:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.920 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.920 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.920 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.920 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.920 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.920 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.920 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.920 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.920 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.920 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.920 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.920 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.920 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.920 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.920 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.921 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.922 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.922 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.922 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.922 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.922 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.922 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.922 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.922 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.922 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.922 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.922 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.922 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.922 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.922 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.923 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.924 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.924 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.924 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.924 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.924 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.924 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.924 INFO:teuthology.orchestra.run.smithi135.stdout: "retain_interval": { 2024-05-08T23:18:04.924 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retain_interval", 2024-05-08T23:18:04.924 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.924 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.924 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.924 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "31536000", 2024-05-08T23:18:04.924 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.924 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-08T23:18:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_recent_interval": { 2024-05-08T23:18:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_recent_interval", 2024-05-08T23:18:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1209600", 2024-05-08T23:18:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-08T23:18:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dashboard", 2024-05-08T23:18:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-08T23:18:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-08T23:18:04.926 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_HOST": { 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.927 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.928 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.929 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.929 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.929 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.929 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.929 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.929 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.929 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_ENABLED": { 2024-05-08T23:18:04.929 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_ENABLED", 2024-05-08T23:18:04.929 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.929 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.929 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.929 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.929 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.929 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.930 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.930 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.930 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.930 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.930 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.930 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-08T23:18:04.930 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-08T23:18:04.930 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.930 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.930 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.930 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.930 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.930 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.930 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.931 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.931 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.931 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.931 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.931 INFO:teuthology.orchestra.run.smithi135.stdout: "ENABLE_BROWSABLE_API": { 2024-05-08T23:18:04.931 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-08T23:18:04.931 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.931 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.931 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.931 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.931 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.931 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.931 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.931 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-08T23:18:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-08T23:18:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.933 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-08T23:18:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-08T23:18:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-08T23:18:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-08T23:18:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.935 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-08T23:18:04.936 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-08T23:18:04.936 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.936 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.936 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.936 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.936 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.936 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.936 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.936 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.936 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.936 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.936 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.936 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-08T23:18:04.936 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-08T23:18:04.937 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.937 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.937 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.937 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.937 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.937 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.937 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.937 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.937 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.937 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.937 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.937 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.937 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-08T23:18:04.937 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-08T23:18:04.937 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-08T23:18:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-08T23:18:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.939 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.939 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.939 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.939 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.939 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.939 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.939 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.939 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.939 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.939 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_PASSWORD": { 2024-05-08T23:18:04.939 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-08T23:18:04.939 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.939 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.939 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.940 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-08T23:18:04.940 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.940 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.940 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.940 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.940 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.940 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.940 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.940 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-08T23:18:04.940 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-08T23:18:04.940 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.940 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.940 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.940 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.941 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.941 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.941 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.941 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.941 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.941 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.941 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.941 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_URL": { 2024-05-08T23:18:04.941 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_URL", 2024-05-08T23:18:04.941 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.941 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.941 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.941 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.941 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.942 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.942 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.942 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.942 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.942 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.942 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.942 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_USERNAME": { 2024-05-08T23:18:04.942 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-08T23:18:04.942 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.942 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.942 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.942 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-08T23:18:04.942 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.942 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.943 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.943 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.943 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.943 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.943 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.943 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-08T23:18:04.943 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-08T23:18:04.943 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.943 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.943 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.943 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.943 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.943 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.943 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.944 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.944 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.944 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.944 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.944 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.944 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-08T23:18:04.944 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-08T23:18:04.944 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.944 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.944 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.944 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.944 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.944 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.944 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.944 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.945 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.945 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.945 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.945 INFO:teuthology.orchestra.run.smithi135.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-08T23:18:04.945 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-08T23:18:04.945 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.945 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.945 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.945 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.945 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.945 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.945 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.945 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.946 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.946 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.946 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.946 INFO:teuthology.orchestra.run.smithi135.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-08T23:18:04.946 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-08T23:18:04.946 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.946 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.946 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.946 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.946 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.946 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.946 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.946 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.946 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_HOST": { 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.947 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.948 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-08T23:18:04.949 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.950 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.950 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.950 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.950 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.950 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.950 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.950 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.950 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.950 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.950 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.950 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-08T23:18:04.950 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-08T23:18:04.950 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.950 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.951 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.951 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.951 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.951 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.951 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.951 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.951 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.951 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.951 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.951 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.951 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-08T23:18:04.951 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-08T23:18:04.951 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.951 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.951 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.952 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.952 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.952 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.952 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.952 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.952 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.952 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.952 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.952 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-08T23:18:04.952 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-08T23:18:04.952 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.952 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.952 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.952 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.953 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.953 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.953 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.953 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.953 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.953 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.953 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.953 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-08T23:18:04.953 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-08T23:18:04.953 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.953 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.953 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.953 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.954 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_ENABLED": { 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.955 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.956 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.956 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.956 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.956 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.956 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-08T23:18:04.956 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-08T23:18:04.956 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.956 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.956 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.956 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-08T23:18:04.956 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.956 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.956 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.956 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.956 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.957 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.958 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-08T23:18:04.958 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-08T23:18:04.958 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.958 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.958 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.958 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8", 2024-05-08T23:18:04.958 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.958 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.958 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.958 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.958 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.958 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.958 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "45", 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ACCESS_KEY": { 2024-05-08T23:18:04.959 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.960 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SECRET_KEY": { 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.961 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.962 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.962 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.962 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.962 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.962 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.962 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.962 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SSL_VERIFY": { 2024-05-08T23:18:04.962 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-08T23:18:04.962 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.962 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.962 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.962 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.962 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: "UNSAFE_TLS_v1_2": { 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.963 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.964 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.965 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.966 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-08T23:18:04.966 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-08T23:18:04.966 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.966 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.966 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.966 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-08T23:18:04.966 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.966 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.966 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.966 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.966 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.966 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.966 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: "cross_origin_url": { 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cross_origin_url", 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: "crt_file": { 2024-05-08T23:18:04.967 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crt_file", 2024-05-08T23:18:04.968 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.968 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.968 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.968 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.968 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.968 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.968 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.968 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.968 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.968 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.968 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.968 INFO:teuthology.orchestra.run.smithi135.stdout: "debug": { 2024-05-08T23:18:04.968 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "debug", 2024-05-08T23:18:04.968 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable/disable debug options", 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "jwt_token_ttl": { 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "jwt_token_ttl", 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.969 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "28800", 2024-05-08T23:18:04.970 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.970 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.970 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.970 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.970 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.970 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.970 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.970 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-05-08T23:18:04.970 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-05-08T23:18:04.970 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.970 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.970 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.970 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.970 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.971 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.972 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.973 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.973 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.973 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.973 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.973 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.973 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.973 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.973 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.973 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.973 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.973 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.973 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.973 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.973 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.974 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.974 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.974 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.974 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.974 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.974 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.974 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.974 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.974 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.974 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.974 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.974 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.974 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.974 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.974 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "motd": { 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "motd", 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "The message of the day", 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect_resolve_ip_addr": { 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "redirect_resolve_ip_addr", 2024-05-08T23:18:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.977 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.977 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.977 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.977 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.977 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.977 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.977 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.977 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.977 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.977 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.977 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-08T23:18:04.977 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-08T23:18:04.977 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.977 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.978 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.978 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-05-08T23:18:04.978 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.978 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.978 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.978 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.978 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.978 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.978 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.978 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-08T23:18:04.978 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-08T23:18:04.978 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.978 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.978 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8080", 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.979 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.980 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.980 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.980 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.980 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.980 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.980 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.980 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl_server_port": { 2024-05-08T23:18:04.980 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl_server_port", 2024-05-08T23:18:04.980 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.980 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.980 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.980 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8443", 2024-05-08T23:18:04.980 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.980 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.981 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.981 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.981 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.981 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.981 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.981 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.981 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-05-08T23:18:04.981 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-05-08T23:18:04.981 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.981 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.981 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.981 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "redirect", 2024-05-08T23:18:04.981 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.981 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.981 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect" 2024-05-08T23:18:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-05-08T23:18:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-05-08T23:18:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-05-08T23:18:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-05-08T23:18:04.983 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-05-08T23:18:04.983 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.983 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.983 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.983 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.983 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.983 INFO:teuthology.orchestra.run.smithi135.stdout: "url_prefix": { 2024-05-08T23:18:04.983 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url_prefix", 2024-05-08T23:18:04.983 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.983 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.983 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:04.983 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.983 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.983 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.984 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.984 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.984 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.984 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.984 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.984 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.984 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.984 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.984 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "devicehealth", 2024-05-08T23:18:04.984 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.984 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.984 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.984 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_monitoring": { 2024-05-08T23:18:04.984 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_monitoring", 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "monitor device health metrics", 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.985 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.986 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.986 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.986 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.986 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.986 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.986 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.986 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.986 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.986 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.986 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.986 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.986 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.986 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.986 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.987 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.987 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.987 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.987 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.987 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.987 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.987 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.987 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.987 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.987 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.987 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.987 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.987 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.987 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.988 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.988 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.988 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.988 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.988 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.988 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.988 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.988 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.988 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.988 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.988 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.988 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.988 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.988 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout: "mark_out_threshold": { 2024-05-08T23:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mark_out_threshold", 2024-05-08T23:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2419200", 2024-05-08T23:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.991 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.991 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.991 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-08T23:18:04.991 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.991 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.991 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.991 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.991 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_name": { 2024-05-08T23:18:04.991 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_name", 2024-05-08T23:18:04.991 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.991 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.991 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.991 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "device_health_metrics", 2024-05-08T23:18:04.991 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.991 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: "retention_period": { 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retention_period", 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15552000", 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.992 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain device health metrics", 2024-05-08T23:18:04.993 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.993 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.993 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.993 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_frequency": { 2024-05-08T23:18:04.993 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_frequency", 2024-05-08T23:18:04.993 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.993 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.993 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.993 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-05-08T23:18:04.993 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.993 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.993 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.993 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-08T23:18:04.993 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.994 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.994 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.994 INFO:teuthology.orchestra.run.smithi135.stdout: "self_heal": { 2024-05-08T23:18:04.994 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "self_heal", 2024-05-08T23:18:04.994 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.994 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.994 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.994 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:04.994 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.994 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.994 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.994 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-08T23:18:04.994 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.995 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.995 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.995 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-08T23:18:04.995 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-08T23:18:04.995 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.995 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.995 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.995 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-08T23:18:04.995 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.995 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.995 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.995 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and check device health", 2024-05-08T23:18:04.995 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.995 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_threshold": { 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_threshold", 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7257600", 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:04.996 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "diskprediction_local", 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:04.997 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:04.998 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:04.998 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:04.998 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:04.998 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:04.998 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.998 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.998 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.998 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.998 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:04.998 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:04.998 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:04.998 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.998 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.998 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:04.999 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.000 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "predict_interval": { 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predict_interval", 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.001 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: "predictor_model": { 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predictor_model", 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "prophetstor", 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.002 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.003 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.004 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.004 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.004 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.004 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.004 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "influx", 2024-05-08T23:18:05.004 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": false, 2024-05-08T23:18:05.004 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "influxdb python module not found", 2024-05-08T23:18:05.004 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.004 INFO:teuthology.orchestra.run.smithi135.stdout: "batch_size": { 2024-05-08T23:18:05.004 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "batch_size", 2024-05-08T23:18:05.004 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.004 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.004 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.004 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5000", 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "database": { 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "database", 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "ceph", 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.005 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": { 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hostname", 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server hostname", 2024-05-08T23:18:05.006 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "30", 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "5", 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.008 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.009 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.010 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.010 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.010 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.010 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.010 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.010 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.010 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.010 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.010 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.010 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.010 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.010 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.010 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.010 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.011 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.012 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.012 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.012 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.012 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.012 INFO:teuthology.orchestra.run.smithi135.stdout: "password": { 2024-05-08T23:18:05.012 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "password", 2024-05-08T23:18:05.012 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.012 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.012 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.012 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.012 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "password of InfluxDB server user", 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: "port": { 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "port", 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8086", 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.013 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.014 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server port", 2024-05-08T23:18:05.014 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.014 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.014 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.014 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-05-08T23:18:05.014 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-05-08T23:18:05.014 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.014 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.014 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.014 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "false", 2024-05-08T23:18:05.014 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.014 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.014 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.014 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "threads": { 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threads", 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "32", 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.015 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: "username": { 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "username", 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "username of InfluxDB server user", 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.016 INFO:teuthology.orchestra.run.smithi135.stdout: "verify_ssl": { 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "verify_ssl", 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "true", 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.017 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "insights", 2024-05-08T23:18:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.019 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.020 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.021 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "iostat", 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.022 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.024 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.024 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.024 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.024 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.024 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.024 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.024 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.024 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.024 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.024 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.024 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.024 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.024 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.024 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.026 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.026 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.026 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.026 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.026 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.026 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.026 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.026 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.026 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.026 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.026 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.026 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.026 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.026 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.026 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.027 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.027 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.027 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.027 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.027 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.027 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.027 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.027 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.027 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.027 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "k8sevents", 2024-05-08T23:18:05.027 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.027 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.027 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.027 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_event_retention_days": { 2024-05-08T23:18:05.029 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ceph_event_retention_days", 2024-05-08T23:18:05.029 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.029 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.029 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.030 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7", 2024-05-08T23:18:05.030 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.030 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.030 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.030 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-08T23:18:05.030 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.030 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.030 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.030 INFO:teuthology.orchestra.run.smithi135.stdout: "config_check_secs": { 2024-05-08T23:18:05.030 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_check_secs", 2024-05-08T23:18:05.030 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.030 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.030 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.030 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "10", 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.031 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.032 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.033 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.034 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.034 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.034 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.034 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.034 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.034 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.034 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.034 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.034 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.034 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.034 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.034 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.034 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.034 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "localpool", 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: "failure_domain": { 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "failure_domain", 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "host", 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "failure domain for any created local pool", 2024-05-08T23:18:05.036 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.037 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.038 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.038 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.038 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.038 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.038 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.038 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.038 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.038 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.038 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.038 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.038 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.038 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.038 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.038 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.039 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.040 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: "min_size": { 2024-05-08T23:18:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_size", 2024-05-08T23:18:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.041 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default min_size for any created local pool", 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: "num_rep": { 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "num_rep", 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.042 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3", 2024-05-08T23:18:05.043 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.043 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.043 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.043 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default replica count for any created local pool", 2024-05-08T23:18:05.043 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.043 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.043 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.043 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_num": { 2024-05-08T23:18:05.043 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_num", 2024-05-08T23:18:05.043 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.043 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.043 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.043 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "128", 2024-05-08T23:18:05.043 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default pg_num for any created local pool", 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: "prefix": { 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prefix", 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.044 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.045 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name prefix for any created local pool", 2024-05-08T23:18:05.045 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.045 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.045 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.045 INFO:teuthology.orchestra.run.smithi135.stdout: "subtree": { 2024-05-08T23:18:05.045 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "subtree", 2024-05-08T23:18:05.045 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.045 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.045 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.045 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "rack", 2024-05-08T23:18:05.045 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.045 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.045 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.045 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mds_autoscaler", 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.046 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.047 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.048 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.048 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.048 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.048 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.048 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.048 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.048 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.048 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.048 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.048 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.048 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.048 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.048 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.048 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.048 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.049 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.050 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.050 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.050 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.050 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.050 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.050 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.050 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.050 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.050 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.050 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.050 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.050 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.050 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.050 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirroring", 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.051 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.052 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.053 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.054 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.055 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "nfs", 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.057 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.058 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.058 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.058 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.058 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.058 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.058 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.058 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.058 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.058 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.058 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.058 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.058 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.058 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.059 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.060 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.060 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.060 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.060 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.060 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.060 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.060 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.060 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.060 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.060 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.060 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.060 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.060 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-05-08T23:18:05.060 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.061 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.061 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.061 INFO:teuthology.orchestra.run.smithi135.stdout: "fail_fs": { 2024-05-08T23:18:05.061 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "fail_fs", 2024-05-08T23:18:05.061 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.061 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.061 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.061 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.061 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.061 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.061 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.061 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-08T23:18:05.061 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.061 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.061 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.062 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.062 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.062 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.062 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.062 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.062 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.062 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.062 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.062 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.062 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.062 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.062 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.062 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.063 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.063 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.063 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.063 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.063 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.063 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.063 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.063 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.063 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.063 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.063 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.063 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.063 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.063 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.063 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.064 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.065 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.065 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.065 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.065 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.065 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.065 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.065 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.065 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.065 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.065 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.065 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.065 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.065 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.065 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.066 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.066 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.066 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.066 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.066 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.066 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.066 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.066 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.066 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.066 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.066 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator": { 2024-05-08T23:18:05.066 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-05-08T23:18:05.066 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm", 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: "rook", 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: "test_orchestrator" 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Orchestrator backend", 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.067 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.068 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.068 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_perf_query", 2024-05-08T23:18:05.068 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.068 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.068 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.068 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.068 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.068 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.068 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.068 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.068 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.068 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.068 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.068 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.069 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.069 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.069 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.069 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.069 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.069 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.069 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.069 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.069 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.069 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.069 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.069 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.069 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.069 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.070 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.071 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.071 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.071 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.071 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.071 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.071 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.071 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.071 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.071 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.071 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.071 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.071 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.071 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.071 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.071 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.072 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.072 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.072 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.072 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.072 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.072 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.072 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.072 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.072 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.072 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.072 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.072 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.072 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.072 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.072 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.073 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.073 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.073 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_support", 2024-05-08T23:18:05.073 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.073 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.073 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.073 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.073 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.073 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.073 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.073 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.073 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.073 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.073 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.074 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.074 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.074 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.074 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.074 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.074 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.074 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.074 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.074 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.074 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.074 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.074 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.074 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.074 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.075 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.075 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.075 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.075 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.075 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.075 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.075 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.075 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.075 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.075 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.075 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.075 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.075 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.075 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.076 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.076 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.076 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.076 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.076 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.076 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.076 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.076 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.076 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.076 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.076 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.076 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.076 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.076 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.078 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.078 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.078 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.078 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_autoscaler", 2024-05-08T23:18:05.078 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.078 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.078 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.078 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.078 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.078 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.078 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.078 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.078 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.078 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.079 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.080 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.081 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.082 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.082 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.082 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.082 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.082 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.082 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.082 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.082 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.082 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.082 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.082 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.082 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.082 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-08T23:18:05.082 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-08T23:18:05.083 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:05.083 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.083 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.083 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-08T23:18:05.083 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.083 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.083 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.083 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.083 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.083 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.083 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.083 INFO:teuthology.orchestra.run.smithi135.stdout: "threshold": { 2024-05-08T23:18:05.083 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threshold", 2024-05-08T23:18:05.083 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:05.084 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.084 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.084 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-05-08T23:18:05.084 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1.0", 2024-05-08T23:18:05.084 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.084 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.084 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "scaling threshold", 2024-05-08T23:18:05.084 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-08T23:18:05.084 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.084 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.084 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.084 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.084 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.084 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "progress", 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_pg_recovery_event": { 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_pg_recovery_event", 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.085 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-05-08T23:18:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-05-08T23:18:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.087 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.088 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.089 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.090 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.090 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.090 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.090 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.090 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.090 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.090 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.090 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.090 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.090 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.090 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.090 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.090 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.091 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.091 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.091 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.091 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.091 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.091 INFO:teuthology.orchestra.run.smithi135.stdout: "max_completed_events": { 2024-05-08T23:18:05.091 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_completed_events", 2024-05-08T23:18:05.091 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.091 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.091 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.091 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "50", 2024-05-08T23:18:05.091 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.091 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.091 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "number of past completed events to remember", 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long the module is going to sleep", 2024-05-08T23:18:05.092 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus", 2024-05-08T23:18:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: "cache": { 2024-05-08T23:18:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cache", 2024-05-08T23:18:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.093 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.094 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:05.094 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.094 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.094 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.094 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.094 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.094 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.094 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.094 INFO:teuthology.orchestra.run.smithi135.stdout: "exclude_perf_counters": { 2024-05-08T23:18:05.094 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "exclude_perf_counters", 2024-05-08T23:18:05.094 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.094 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.094 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.095 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:05.095 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.095 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.095 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.095 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-08T23:18:05.095 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-08T23:18:05.095 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.095 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.095 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.095 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.095 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.095 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.095 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.095 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.096 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.096 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.096 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.096 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.096 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.096 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.096 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.096 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.096 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.096 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.096 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.096 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.096 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.096 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.097 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.097 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.097 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.097 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.097 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.097 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.097 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.097 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.097 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.097 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.097 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.097 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.097 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.097 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.098 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.098 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.098 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.098 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.098 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.098 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.098 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.098 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.098 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.098 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.098 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.098 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.098 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.098 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.098 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.099 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.099 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.099 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.099 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.099 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.099 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.099 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.099 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.099 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.099 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.099 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.099 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.099 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.099 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.100 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.100 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.100 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.100 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools": { 2024-05-08T23:18:05.100 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools", 2024-05-08T23:18:05.100 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.100 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.100 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.100 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.100 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.100 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.100 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.100 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.100 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.101 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.101 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.101 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-08T23:18:05.101 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-08T23:18:05.101 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.101 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.101 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.101 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "300", 2024-05-08T23:18:05.101 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.101 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.101 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.101 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.101 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.101 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.102 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.102 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_interval": { 2024-05-08T23:18:05.102 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_interval", 2024-05-08T23:18:05.102 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:05.102 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.102 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.102 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15.0", 2024-05-08T23:18:05.102 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.102 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.102 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.102 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.102 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.102 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.102 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.103 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-08T23:18:05.104 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-08T23:18:05.104 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.104 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.104 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.104 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "9283", 2024-05-08T23:18:05.104 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.104 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.104 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.104 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-08T23:18:05.104 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.104 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.104 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.104 INFO:teuthology.orchestra.run.smithi135.stdout: "stale_cache_strategy": { 2024-05-08T23:18:05.104 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stale_cache_strategy", 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "log", 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.105 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.106 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "default", 2024-05-08T23:18:05.106 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.106 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.106 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.106 INFO:teuthology.orchestra.run.smithi135.stdout: "default", 2024-05-08T23:18:05.106 INFO:teuthology.orchestra.run.smithi135.stdout: "error" 2024-05-08T23:18:05.106 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.106 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.106 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.106 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.106 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.106 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-05-08T23:18:05.106 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-05-08T23:18:05.107 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.107 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.107 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.107 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-05-08T23:18:05.107 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-05-08T23:18:05.107 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-05-08T23:18:05.107 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.107 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.107 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.107 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.107 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.107 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.107 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.107 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_support", 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.108 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.109 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.110 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.110 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.110 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.110 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.110 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.110 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.110 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.110 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.110 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.110 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.110 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.110 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.110 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.110 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.111 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_snap_create": { 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_snap_create", 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-05-08T23:18:05.112 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "mirror_snapshot_schedule": { 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirror_snapshot_schedule", 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.114 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.114 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.114 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.114 INFO:teuthology.orchestra.run.smithi135.stdout: "trash_purge_schedule": { 2024-05-08T23:18:05.114 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "trash_purge_schedule", 2024-05-08T23:18:05.114 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.114 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.114 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.114 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.114 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.114 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.114 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.114 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.114 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "restful", 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_auth": { 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_auth", 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.115 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.116 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.117 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.117 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.117 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.117 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.117 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.117 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.117 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.117 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.117 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.117 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.117 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.117 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.117 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.117 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.119 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.121 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.122 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.122 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.122 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.122 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.122 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.122 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.122 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.122 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.122 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-05-08T23:18:05.122 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-05-08T23:18:05.122 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.122 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.122 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rgw", 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.123 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.124 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.125 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.126 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.126 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.126 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.126 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.126 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.126 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.126 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.126 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.126 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.126 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.126 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.126 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.126 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.127 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.128 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.128 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.128 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.128 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.128 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.128 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.128 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.128 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.128 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rook", 2024-05-08T23:18:05.128 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.128 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.128 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.128 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.128 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.129 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.130 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.131 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.132 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.132 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.132 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.132 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.132 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.132 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.132 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.132 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.132 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.132 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.132 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.132 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.132 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.133 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.133 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.133 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.133 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.133 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.133 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.133 INFO:teuthology.orchestra.run.smithi135.stdout: "storage_class": { 2024-05-08T23:18:05.133 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "storage_class", 2024-05-08T23:18:05.133 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.133 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.133 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.133 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "local", 2024-05-08T23:18:05.133 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.133 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "selftest", 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.135 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.136 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.136 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.136 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.136 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.136 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.136 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.136 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.136 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.136 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.139 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.139 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.139 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.139 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.139 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.139 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.139 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.139 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.139 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.139 INFO:teuthology.orchestra.run.smithi135.stdout: "roption1": { 2024-05-08T23:18:05.139 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption1", 2024-05-08T23:18:05.139 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.139 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.139 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.140 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.140 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.140 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.140 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.140 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.140 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.140 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.140 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.140 INFO:teuthology.orchestra.run.smithi135.stdout: "roption2": { 2024-05-08T23:18:05.140 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption2", 2024-05-08T23:18:05.140 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.140 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.140 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.140 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "xyz", 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption1": { 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption1", 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.141 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.142 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.142 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.142 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.142 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.142 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.142 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption2": { 2024-05-08T23:18:05.142 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption2", 2024-05-08T23:18:05.142 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.142 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.142 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.142 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.142 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.142 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.142 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.143 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.143 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.143 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.143 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.143 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.143 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption3": { 2024-05-08T23:18:05.143 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption3", 2024-05-08T23:18:05.143 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-05-08T23:18:05.143 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.143 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.143 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.143 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.143 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.143 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.143 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption4": { 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption4", 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.144 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.145 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.145 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption5": { 2024-05-08T23:18:05.145 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption5", 2024-05-08T23:18:05.145 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.145 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.145 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.145 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.145 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.145 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.145 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.145 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.145 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.145 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.145 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.146 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption6": { 2024-05-08T23:18:05.146 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption6", 2024-05-08T23:18:05.146 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.146 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.146 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.146 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:05.146 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.146 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.146 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.146 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.146 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.146 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.146 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption7": { 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption7", 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "42", 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "testkey": { 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testkey", 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.147 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: "testlkey": { 2024-05-08T23:18:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testlkey", 2024-05-08T23:18:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "testnewline": { 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testnewline", 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.149 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.150 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.150 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.150 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.150 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.150 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.150 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.150 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.150 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.150 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snap_schedule", 2024-05-08T23:18:05.150 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.150 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.150 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.150 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_m_granularity": { 2024-05-08T23:18:05.150 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_m_granularity", 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow minute scheduled snapshots", 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: "dump_on_update": { 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dump_on_update", 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.151 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "dump database to debug log on update", 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.152 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.153 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.153 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.153 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.153 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.153 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.153 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.153 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.153 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.153 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.153 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.153 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.153 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.153 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.153 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.153 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.154 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.155 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.156 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stats", 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.158 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.158 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.158 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.158 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.158 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.158 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.158 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.158 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.158 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.158 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.158 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.158 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.158 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.158 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.159 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.160 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "status", 2024-05-08T23:18:05.161 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.162 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.162 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.162 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.162 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.162 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.162 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.162 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.162 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.162 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.162 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.162 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.162 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.162 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.162 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.162 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.163 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.164 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.165 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.166 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.166 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.166 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.166 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.166 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.166 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.166 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.166 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.166 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.166 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telegraf", 2024-05-08T23:18:05.166 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.166 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.166 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.166 INFO:teuthology.orchestra.run.smithi135.stdout: "address": { 2024-05-08T23:18:05.167 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "address", 2024-05-08T23:18:05.167 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.167 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.167 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.167 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-08T23:18:05.167 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.167 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.167 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.167 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.167 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.167 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.167 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.167 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-08T23:18:05.167 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-08T23:18:05.168 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:05.168 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.168 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.168 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15", 2024-05-08T23:18:05.168 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.168 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.168 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.168 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.168 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.168 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.168 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.168 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.168 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.168 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.169 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.169 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.169 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.169 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.169 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.169 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.169 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.169 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.169 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.169 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.169 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.169 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.169 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.169 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.170 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.171 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.171 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.171 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.171 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.171 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.171 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.171 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.171 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.171 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.171 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.171 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.171 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.171 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.171 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.172 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.173 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.173 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.173 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.173 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.173 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.173 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.173 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.173 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.173 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.173 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telemetry", 2024-05-08T23:18:05.173 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.173 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.173 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_basic": { 2024-05-08T23:18:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_basic", 2024-05-08T23:18:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-08T23:18:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.174 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_crash": { 2024-05-08T23:18:05.175 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_crash", 2024-05-08T23:18:05.175 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.175 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.175 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.175 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:05.175 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.175 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.175 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.175 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-08T23:18:05.175 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.175 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.175 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.175 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_device": { 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_device", 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_ident": { 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_ident", 2024-05-08T23:18:05.176 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_perf": { 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_perf", 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.177 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-08T23:18:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: "contact": { 2024-05-08T23:18:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "contact", 2024-05-08T23:18:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.178 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "description": { 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "description", 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: "device_url": { 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_url", 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.181 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.181 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.181 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-05-08T23:18:05.181 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-05-08T23:18:05.181 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.181 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.181 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.181 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.181 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.181 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.181 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.181 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.181 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.181 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-08T23:18:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-08T23:18:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "24", 2024-05-08T23:18:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "8", 2024-05-08T23:18:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: "last_opt_revision": { 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "last_opt_revision", 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1", 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard": { 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard", 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard_description": { 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard_description", 2024-05-08T23:18:05.184 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.185 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.185 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.185 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.185 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.185 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.185 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.185 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.185 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.185 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.185 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.185 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.185 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.185 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.185 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.186 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.186 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.186 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.186 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.186 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.186 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.186 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.186 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.186 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.186 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.186 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.186 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.186 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.186 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.186 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.188 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.188 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.188 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.188 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.188 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.188 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.188 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.188 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.188 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.188 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.188 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.188 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.188 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.188 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.188 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.189 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.190 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.190 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.190 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.190 INFO:teuthology.orchestra.run.smithi135.stdout: "organization": { 2024-05-08T23:18:05.190 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "organization", 2024-05-08T23:18:05.190 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.190 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.190 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.190 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.190 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.190 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.190 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.190 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.190 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.191 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.191 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.191 INFO:teuthology.orchestra.run.smithi135.stdout: "proxy": { 2024-05-08T23:18:05.191 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "proxy", 2024-05-08T23:18:05.191 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.191 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.191 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.191 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.191 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.191 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.191 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.191 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.191 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.191 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.192 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.192 INFO:teuthology.orchestra.run.smithi135.stdout: "url": { 2024-05-08T23:18:05.192 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url", 2024-05-08T23:18:05.192 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.192 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.192 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.192 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-08T23:18:05.192 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.192 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.192 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.192 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.192 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.192 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.192 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "test_orchestrator", 2024-05-08T23:18:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.193 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.194 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.195 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.195 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.195 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.195 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.195 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.195 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.195 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.195 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.195 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.195 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.195 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.195 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.195 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.196 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.197 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.197 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.197 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.197 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.197 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.197 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.197 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.197 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.197 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.197 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.197 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.197 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.197 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.198 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.198 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.198 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.198 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.198 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "volumes", 2024-05-08T23:18:05.198 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.198 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.198 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.198 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.198 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.198 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.198 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.198 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.200 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.201 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.201 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.201 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.201 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.201 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.201 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.201 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.201 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.201 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.201 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.201 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.201 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.201 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.201 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.201 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.202 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.202 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.202 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.202 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.202 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.202 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.202 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.202 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.202 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.202 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.202 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.202 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.202 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.203 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.203 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.203 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.203 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_clones": { 2024-05-08T23:18:05.203 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_clones", 2024-05-08T23:18:05.203 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.203 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.203 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.203 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4", 2024-05-08T23:18:05.203 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.203 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.203 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.203 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-08T23:18:05.203 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_delay": { 2024-05-08T23:18:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_delay", 2024-05-08T23:18:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-05-08T23:18:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-08T23:18:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.205 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.205 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_no_wait": { 2024-05-08T23:18:05.205 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_no_wait", 2024-05-08T23:18:05.205 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.205 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.205 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.205 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-05-08T23:18:05.205 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.205 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.205 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.205 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-08T23:18:05.205 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.205 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.206 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.206 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.206 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.206 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.206 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix", 2024-05-08T23:18:05.206 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-05-08T23:18:05.206 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-05-08T23:18:05.206 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-05-08T23:18:05.206 INFO:teuthology.orchestra.run.smithi135.stdout: "discovery_interval": { 2024-05-08T23:18:05.206 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "discovery_interval", 2024-05-08T23:18:05.206 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-05-08T23:18:05.206 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.206 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.206 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "100", 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: "identifier": { 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "identifier", 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.207 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.208 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.208 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.208 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.208 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.208 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.208 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-05-08T23:18:05.208 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-05-08T23:18:05.208 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-05-08T23:18:05.208 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.208 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.208 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-05-08T23:18:05.208 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.208 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.209 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.210 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-05-08T23:18:05.211 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.212 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.212 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-05-08T23:18:05.212 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-05-08T23:18:05.212 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-05-08T23:18:05.212 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-05-08T23:18:05.212 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-05-08T23:18:05.212 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-05-08T23:18:05.212 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-05-08T23:18:05.212 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.212 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.212 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.212 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.212 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.212 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-05-08T23:18:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-05-08T23:18:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-05-08T23:18:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-05-08T23:18:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-05-08T23:18:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_host": { 2024-05-08T23:18:05.213 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_host", 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_port": { 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_port", 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-05-08T23:18:05.214 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10051", 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_sender": { 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_sender", 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-05-08T23:18:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-08T23:18:05.216 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-05-08T23:18:05.216 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-05-08T23:18:05.216 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-05-08T23:18:05.216 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-05-08T23:18:05.216 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-05-08T23:18:05.216 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-05-08T23:18:05.216 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-05-08T23:18:05.216 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.216 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.216 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.216 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.216 INFO:teuthology.orchestra.run.smithi135.stdout: "services": { 2024-05-08T23:18:05.216 INFO:teuthology.orchestra.run.smithi135.stdout: "dashboard": "https://172.21.15.135:8443/" 2024-05-08T23:18:05.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: "always_on_modules": { 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: "octopus": [ 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: "balancer", 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: "crash", 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: "devicehealth", 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator", 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_autoscaler", 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: "progress", 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_support", 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: "status", 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: "telemetry", 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: "volumes" 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: "pacific": [ 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: "balancer", 2024-05-08T23:18:05.217 INFO:teuthology.orchestra.run.smithi135.stdout: "crash", 2024-05-08T23:18:05.218 INFO:teuthology.orchestra.run.smithi135.stdout: "devicehealth", 2024-05-08T23:18:05.218 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator", 2024-05-08T23:18:05.218 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_autoscaler", 2024-05-08T23:18:05.218 INFO:teuthology.orchestra.run.smithi135.stdout: "progress", 2024-05-08T23:18:05.218 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_support", 2024-05-08T23:18:05.218 INFO:teuthology.orchestra.run.smithi135.stdout: "status", 2024-05-08T23:18:05.218 INFO:teuthology.orchestra.run.smithi135.stdout: "telemetry", 2024-05-08T23:18:05.218 INFO:teuthology.orchestra.run.smithi135.stdout: "volumes" 2024-05-08T23:18:05.218 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.218 INFO:teuthology.orchestra.run.smithi135.stdout: "quincy": [ 2024-05-08T23:18:05.218 INFO:teuthology.orchestra.run.smithi135.stdout: "balancer", 2024-05-08T23:18:05.218 INFO:teuthology.orchestra.run.smithi135.stdout: "crash", 2024-05-08T23:18:05.218 INFO:teuthology.orchestra.run.smithi135.stdout: "devicehealth", 2024-05-08T23:18:05.218 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator", 2024-05-08T23:18:05.218 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_autoscaler", 2024-05-08T23:18:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: "progress", 2024-05-08T23:18:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_support", 2024-05-08T23:18:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: "status", 2024-05-08T23:18:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: "telemetry", 2024-05-08T23:18:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: "volumes" 2024-05-08T23:18:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-05-08T23:18:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: "reef": [ 2024-05-08T23:18:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: "balancer", 2024-05-08T23:18:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: "crash", 2024-05-08T23:18:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: "devicehealth", 2024-05-08T23:18:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator", 2024-05-08T23:18:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_autoscaler", 2024-05-08T23:18:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: "progress", 2024-05-08T23:18:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_support", 2024-05-08T23:18:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: "status", 2024-05-08T23:18:05.220 INFO:teuthology.orchestra.run.smithi135.stdout: "telemetry", 2024-05-08T23:18:05.220 INFO:teuthology.orchestra.run.smithi135.stdout: "volumes" 2024-05-08T23:18:05.220 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-08T23:18:05.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.220 INFO:teuthology.orchestra.run.smithi135.stdout: "last_failure_osd_epoch": 3, 2024-05-08T23:18:05.220 INFO:teuthology.orchestra.run.smithi135.stdout: "active_clients": [ 2024-05-08T23:18:05.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.220 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "devicehealth", 2024-05-08T23:18:05.220 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-05-08T23:18:05.220 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.220 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-05-08T23:18:05.220 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-05-08T23:18:05.220 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 2724343877 2024-05-08T23:18:05.220 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.220 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-08T23:18:05.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.221 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "libcephsqlite", 2024-05-08T23:18:05.221 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-05-08T23:18:05.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.221 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-05-08T23:18:05.221 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-05-08T23:18:05.221 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 1864621858 2024-05-08T23:18:05.221 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.221 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-08T23:18:05.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.221 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_support", 2024-05-08T23:18:05.221 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-05-08T23:18:05.221 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 653989776 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "volumes", 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 268551726 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-08T23:18:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:05.223 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-08T23:18:05.223 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:18:05.224 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:04 smithi195 ceph-mon[46516]: pgmap v336: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 MiB/s wr, 18 op/s 2024-05-08T23:18:05.224 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:04 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/887653945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:18:05.224 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:04 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/495126245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:18:05.224 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:04 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1547825176' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-08T23:18:05.225 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:04 smithi179 ceph-mon[46314]: pgmap v336: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 MiB/s wr, 18 op/s 2024-05-08T23:18:05.225 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:04 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/887653945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:18:05.225 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:04 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/495126245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:18:05.225 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:04 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1547825176' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-08T23:18:05.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:04.012+0000 7fdbb7baa700 1 -- 172.21.15.135:0/1547825176 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdb9c0a1120 msgr2=0x7fdb9c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:05.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:04.012+0000 7fdbb7baa700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdb9c0a1120 0x7fdb9c0a35e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0100db0 tx=0x7fdbac009260 comp rx=0 tx=0).stop 2024-05-08T23:18:05.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:04.012+0000 7fdbb7baa700 1 -- 172.21.15.135:0/1547825176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb0100f50 msgr2=0x7fdbb0197370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:05.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:04.012+0000 7fdbb7baa700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb0100f50 0x7fdbb0197370 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdba0003730 tx=0x7fdba000fab0 comp rx=0 tx=0).stop 2024-05-08T23:18:05.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:04.012+0000 7fdbb7baa700 1 -- 172.21.15.135:0/1547825176 shutdown_connections 2024-05-08T23:18:05.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:04.012+0000 7fdbb7baa700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fdb9c0a1120 0x7fdb9c0a35e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:05.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:04.012+0000 7fdbb7baa700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbb00ffd60 0x7fdbb0196e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:05.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:04.012+0000 7fdbb7baa700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbb01018f0 0x7fdbb019e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:05.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:04.012+0000 7fdbb7baa700 1 --2- 172.21.15.135:0/1547825176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbb0100f50 0x7fdbb0197370 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:05.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:04.012+0000 7fdbb7baa700 1 -- 172.21.15.135:0/1547825176 >> 172.21.15.135:0/1547825176 conn(0x7fdbb00fb2f0 msgr2=0x7fdbb00fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:05.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:04.012+0000 7fdbb7baa700 1 -- 172.21.15.135:0/1547825176 shutdown_connections 2024-05-08T23:18:05.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:04.012+0000 7fdbb7baa700 1 -- 172.21.15.135:0/1547825176 wait complete. 2024-05-08T23:18:05.231 DEBUG:tasks.check_counter:Getting stats from a 2024-05-08T23:18:05.232 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-08T23:18:05.232 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:04 smithi135 ceph-mon[42440]: pgmap v336: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 MiB/s wr, 18 op/s 2024-05-08T23:18:05.232 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:04 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/887653945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:18:05.232 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:04 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/495126245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:18:05.232 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:04 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1547825176' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-08T23:18:05.468 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:18:06.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:06 smithi135 ceph-mon[42440]: pgmap v337: 97 pgs: 97 active+clean; 222 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 15 op/s 2024-05-08T23:18:06.489 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:18:06.489 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T23:18:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 443, 2024-05-08T23:18:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 443, 2024-05-08T23:18:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 135251, 2024-05-08T23:18:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 136978, 2024-05-08T23:18:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 6, 2024-05-08T23:18:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 2, 2024-05-08T23:18:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.039269569, 2024-05-08T23:18:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.012707414, 2024-05-08T23:18:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.010592325, 2024-05-08T23:18:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.011674212, 2024-05-08T23:18:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 442, 2024-05-08T23:18:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.023529508, 2024-05-08T23:18:06.490 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000053234 2024-05-08T23:18:06.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.491 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:06.491 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.491 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.491 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.491 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-05-08T23:18:06.491 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 448 2024-05-08T23:18:06.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.491 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T23:18:06.491 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 79, 2024-05-08T23:18:06.491 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 128, 2024-05-08T23:18:06.491 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 20000, 2024-05-08T23:18:06.491 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 187238, 2024-05-08T23:18:06.492 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 5, 2024-05-08T23:18:06.492 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2024-05-08T23:18:06.492 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.011682119, 2024-05-08T23:18:06.492 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.004363164, 2024-05-08T23:18:06.492 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.003595168, 2024-05-08T23:18:06.492 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.002735384, 2024-05-08T23:18:06.492 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:06.492 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 126, 2024-05-08T23:18:06.492 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.006153674, 2024-05-08T23:18:06.492 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000048838 2024-05-08T23:18:06.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.492 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:06.492 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.492 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.492 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.493 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T23:18:06.493 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 162912 2024-05-08T23:18:06.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.493 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T23:18:06.493 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 78, 2024-05-08T23:18:06.493 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 74, 2024-05-08T23:18:06.493 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 451484, 2024-05-08T23:18:06.493 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 37927, 2024-05-08T23:18:06.493 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 3, 2024-05-08T23:18:06.493 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 2, 2024-05-08T23:18:06.493 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.012567746, 2024-05-08T23:18:06.493 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.004364114, 2024-05-08T23:18:06.493 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.009287422, 2024-05-08T23:18:06.493 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.001233720, 2024-05-08T23:18:06.494 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:06.494 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 73, 2024-05-08T23:18:06.494 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.004042809, 2024-05-08T23:18:06.494 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000055380 2024-05-08T23:18:06.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.494 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:06.494 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.494 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.494 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.494 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 451216, 2024-05-08T23:18:06.494 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 37616 2024-05-08T23:18:06.494 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.494 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-05-08T23:18:06.495 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-05-08T23:18:06.495 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-05-08T23:18:06.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.495 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-05-08T23:18:06.495 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-05-08T23:18:06.495 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-05-08T23:18:06.495 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 938, 2024-05-08T23:18:06.495 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.024006733, 2024-05-08T23:18:06.495 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000025593 2024-05-08T23:18:06.495 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:06.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.495 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-05-08T23:18:06.495 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-05-08T23:18:06.495 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-05-08T23:18:06.495 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.496 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.496 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.496 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:06.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.496 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-05-08T23:18:06.496 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2024-05-08T23:18:06.496 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2024-05-08T23:18:06.496 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-05-08T23:18:06.496 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.496 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.496 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.496 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-05-08T23:18:06.496 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2024-05-08T23:18:06.497 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2024-05-08T23:18:06.497 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-05-08T23:18:06.497 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2024-05-08T23:18:06.497 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-05-08T23:18:06.497 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-05-08T23:18:06.497 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 0, 2024-05-08T23:18:06.497 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 0, 2024-05-08T23:18:06.497 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 0, 2024-05-08T23:18:06.497 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 0, 2024-05-08T23:18:06.497 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 0, 2024-05-08T23:18:06.497 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 0, 2024-05-08T23:18:06.497 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2024-05-08T23:18:06.497 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2024-05-08T23:18:06.497 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 1, 2024-05-08T23:18:06.497 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2024-05-08T23:18:06.498 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2024-05-08T23:18:06.498 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2024-05-08T23:18:06.498 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2024-05-08T23:18:06.498 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-05-08T23:18:06.498 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-05-08T23:18:06.498 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2024-05-08T23:18:06.498 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2024-05-08T23:18:06.498 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-05-08T23:18:06.498 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2024-05-08T23:18:06.498 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2024-05-08T23:18:06.498 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2024-05-08T23:18:06.498 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2024-05-08T23:18:06.498 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T23:18:06.499 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2024-05-08T23:18:06.500 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T23:18:06.500 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T23:18:06.500 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T23:18:06.500 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2024-05-08T23:18:06.500 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2024-05-08T23:18:06.500 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2024-05-08T23:18:06.500 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2024-05-08T23:18:06.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.500 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-05-08T23:18:06.500 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2024-05-08T23:18:06.500 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2024-05-08T23:18:06.500 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2024-05-08T23:18:06.500 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2024-05-08T23:18:06.501 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2024-05-08T23:18:06.501 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-05-08T23:18:06.501 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-05-08T23:18:06.501 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-05-08T23:18:06.501 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2024-05-08T23:18:06.501 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2024-05-08T23:18:06.501 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-05-08T23:18:06.501 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-05-08T23:18:06.501 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-05-08T23:18:06.501 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-05-08T23:18:06.501 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-05-08T23:18:06.501 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-05-08T23:18:06.501 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-05-08T23:18:06.501 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T23:18:06.502 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2024-05-08T23:18:06.502 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-05-08T23:18:06.502 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-05-08T23:18:06.502 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-05-08T23:18:06.502 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2024-05-08T23:18:06.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.502 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-05-08T23:18:06.502 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2024-05-08T23:18:06.502 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-05-08T23:18:06.502 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-05-08T23:18:06.502 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 3, 2024-05-08T23:18:06.502 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-05-08T23:18:06.502 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-05-08T23:18:06.502 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2024-05-08T23:18:06.502 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-05-08T23:18:06.503 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-05-08T23:18:06.503 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 1, 2024-05-08T23:18:06.503 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-05-08T23:18:06.503 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-05-08T23:18:06.503 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2024-05-08T23:18:06.503 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 4195378, 2024-05-08T23:18:06.503 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 4195237, 2024-05-08T23:18:06.503 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-05-08T23:18:06.503 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.503 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.503 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.503 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 3 2024-05-08T23:18:06.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.503 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-05-08T23:18:06.504 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 3, 2024-05-08T23:18:06.504 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 3, 2024-05-08T23:18:06.504 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 0, 2024-05-08T23:18:06.504 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 1, 2024-05-08T23:18:06.504 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 1, 2024-05-08T23:18:06.504 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 0, 2024-05-08T23:18:06.504 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 0, 2024-05-08T23:18:06.504 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 0, 2024-05-08T23:18:06.504 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 0, 2024-05-08T23:18:06.504 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2024-05-08T23:18:06.504 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2024-05-08T23:18:06.504 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2024-05-08T23:18:06.504 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 45488, 2024-05-08T23:18:06.504 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 207156 2024-05-08T23:18:06.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.505 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-05-08T23:18:06.505 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2024-05-08T23:18:06.505 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2024-05-08T23:18:06.505 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2024-05-08T23:18:06.505 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2024-05-08T23:18:06.505 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2024-05-08T23:18:06.505 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-05-08T23:18:06.505 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.505 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.505 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.505 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-05-08T23:18:06.505 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.505 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.505 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.506 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-05-08T23:18:06.506 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.506 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.506 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.506 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-05-08T23:18:06.506 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.506 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.506 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.506 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.506 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-05-08T23:18:06.506 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.506 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.506 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.507 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-05-08T23:18:06.507 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.507 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.507 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.507 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-05-08T23:18:06.507 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.507 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.507 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.507 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-05-08T23:18:06.507 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.507 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.507 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.508 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-05-08T23:18:06.508 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.508 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.508 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.508 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-05-08T23:18:06.508 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.508 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.508 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.508 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-05-08T23:18:06.508 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.508 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.509 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.509 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-05-08T23:18:06.509 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.509 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.509 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.509 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-05-08T23:18:06.509 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.509 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.509 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.509 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-05-08T23:18:06.509 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.509 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.510 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.510 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-05-08T23:18:06.510 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.510 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.510 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.510 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-05-08T23:18:06.510 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.510 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.510 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.510 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-05-08T23:18:06.510 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.510 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.511 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.511 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-05-08T23:18:06.511 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.511 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.511 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.511 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-05-08T23:18:06.511 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.511 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.511 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.511 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.511 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-05-08T23:18:06.511 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.512 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.512 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.512 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-05-08T23:18:06.512 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.512 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.512 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.512 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-05-08T23:18:06.512 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.512 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.512 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.512 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-05-08T23:18:06.513 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.513 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.513 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.513 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-05-08T23:18:06.513 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.513 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.513 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.513 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-05-08T23:18:06.513 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.513 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.513 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.513 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-05-08T23:18:06.514 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.514 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.514 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.514 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-05-08T23:18:06.514 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.514 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.514 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.514 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-05-08T23:18:06.514 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.514 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.514 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-05-08T23:18:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-05-08T23:18:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-05-08T23:18:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-05-08T23:18:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-05-08T23:18:06.515 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 0, 2024-05-08T23:18:06.516 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 1, 2024-05-08T23:18:06.516 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 1, 2024-05-08T23:18:06.516 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 1, 2024-05-08T23:18:06.516 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-05-08T23:18:06.516 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2024-05-08T23:18:06.516 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2024-05-08T23:18:06.516 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 1454, 2024-05-08T23:18:06.516 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-05-08T23:18:06.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.516 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-05-08T23:18:06.516 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-05-08T23:18:06.516 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-05-08T23:18:06.516 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T23:18:06.517 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-05-08T23:18:06.517 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T23:18:06.517 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-05-08T23:18:06.517 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T23:18:06.517 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T23:18:06.517 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T23:18:06.517 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T23:18:06.517 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T23:18:06.517 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-05-08T23:18:06.517 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T23:18:06.517 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T23:18:06.517 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-05-08T23:18:06.517 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-05-08T23:18:06.517 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-05-08T23:18:06.518 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-05-08T23:18:06.518 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T23:18:06.518 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T23:18:06.518 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T23:18:06.518 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T23:18:06.518 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T23:18:06.518 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-05-08T23:18:06.518 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-05-08T23:18:06.518 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-05-08T23:18:06.518 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T23:18:06.518 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T23:18:06.518 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-05-08T23:18:06.518 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-05-08T23:18:06.518 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-05-08T23:18:06.519 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-05-08T23:18:06.519 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T23:18:06.519 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-05-08T23:18:06.519 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T23:18:06.519 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-05-08T23:18:06.519 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 189279, 2024-05-08T23:18:06.519 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 49, 2024-05-08T23:18:06.519 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-05-08T23:18:06.519 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-05-08T23:18:06.519 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-05-08T23:18:06.519 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-05-08T23:18:06.519 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-05-08T23:18:06.519 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-05-08T23:18:06.519 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-05-08T23:18:06.519 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-05-08T23:18:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 7720, 2024-05-08T23:18:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 162, 2024-05-08T23:18:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T23:18:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-05-08T23:18:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-05-08T23:18:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-05-08T23:18:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 8320, 2024-05-08T23:18:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 13, 2024-05-08T23:18:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-05-08T23:18:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-05-08T23:18:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-05-08T23:18:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-05-08T23:18:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-05-08T23:18:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-05-08T23:18:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-05-08T23:18:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 518, 2024-05-08T23:18:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 21, 2024-05-08T23:18:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 3, 2024-05-08T23:18:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 518, 2024-05-08T23:18:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-05-08T23:18:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 518, 2024-05-08T23:18:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.333993053, 2024-05-08T23:18:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000644774 2024-05-08T23:18:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-05-08T23:18:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-05-08T23:18:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 518, 2024-05-08T23:18:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 519 2024-05-08T23:18:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.522 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 518, 2024-05-08T23:18:06.522 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 518, 2024-05-08T23:18:06.522 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-05-08T23:18:06.522 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-05-08T23:18:06.522 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-05-08T23:18:06.522 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 293, 2024-05-08T23:18:06.522 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-05-08T23:18:06.522 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 223, 2024-05-08T23:18:06.522 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-05-08T23:18:06.522 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-05-08T23:18:06.522 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-05-08T23:18:06.522 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-05-08T23:18:06.522 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-05-08T23:18:06.522 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-05-08T23:18:06.522 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-05-08T23:18:06.523 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-05-08T23:18:06.523 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-05-08T23:18:06.523 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-05-08T23:18:06.523 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1, 2024-05-08T23:18:06.523 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-05-08T23:18:06.523 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-05-08T23:18:06.523 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-05-08T23:18:06.523 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-05-08T23:18:06.523 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-05-08T23:18:06.523 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-05-08T23:18:06.523 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-05-08T23:18:06.523 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T23:18:06.523 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-05-08T23:18:06.523 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-05-08T23:18:06.523 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-05-08T23:18:06.524 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-05-08T23:18:06.524 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-05-08T23:18:06.524 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-05-08T23:18:06.524 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-05-08T23:18:06.524 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-05-08T23:18:06.524 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-05-08T23:18:06.524 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-05-08T23:18:06.524 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-05-08T23:18:06.524 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-05-08T23:18:06.524 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-05-08T23:18:06.524 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-05-08T23:18:06.524 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-05-08T23:18:06.524 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-05-08T23:18:06.524 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-05-08T23:18:06.524 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-05-08T23:18:06.525 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-05-08T23:18:06.525 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 85, 2024-05-08T23:18:06.525 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-05-08T23:18:06.525 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 2, 2024-05-08T23:18:06.525 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 5, 2024-05-08T23:18:06.525 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 5, 2024-05-08T23:18:06.525 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-05-08T23:18:06.525 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-05-08T23:18:06.525 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-05-08T23:18:06.525 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2024-05-08T23:18:06.525 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-05-08T23:18:06.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.525 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-05-08T23:18:06.525 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2024-05-08T23:18:06.525 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-05-08T23:18:06.526 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-05-08T23:18:06.526 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-05-08T23:18:06.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.526 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2024-05-08T23:18:06.526 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-05-08T23:18:06.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.526 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-05-08T23:18:06.526 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-05-08T23:18:06.526 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T23:18:06.526 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-05-08T23:18:06.526 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 596, 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 546118, 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 596, 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 596, 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 546118, 2024-05-08T23:18:06.527 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-08T23:18:06.528 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.528 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.528 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.528 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:06.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.528 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-05-08T23:18:06.528 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-08T23:18:06.528 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-05-08T23:18:06.528 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-08T23:18:06.528 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-05-08T23:18:06.528 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-05-08T23:18:06.528 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:06.528 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:06.528 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 518, 2024-05-08T23:18:06.528 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 1079, 2024-05-08T23:18:06.529 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 518, 2024-05-08T23:18:06.529 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1079, 2024-05-08T23:18:06.529 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-08T23:18:06.529 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.529 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.529 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.529 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:06.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.529 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-05-08T23:18:06.529 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-08T23:18:06.529 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-05-08T23:18:06.529 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-08T23:18:06.529 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-05-08T23:18:06.529 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-05-08T23:18:06.530 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:06.530 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:06.530 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 518, 2024-05-08T23:18:06.530 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 518, 2024-05-08T23:18:06.530 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 518, 2024-05-08T23:18:06.530 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 518, 2024-05-08T23:18:06.530 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-08T23:18:06.530 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.530 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.530 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.530 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:06.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.530 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-05-08T23:18:06.530 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-08T23:18:06.530 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-05-08T23:18:06.531 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-08T23:18:06.531 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-05-08T23:18:06.531 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-05-08T23:18:06.531 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:06.531 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:06.531 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-05-08T23:18:06.531 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-05-08T23:18:06.531 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-05-08T23:18:06.531 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-05-08T23:18:06.531 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-08T23:18:06.531 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.531 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.531 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.531 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:06.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:06.532 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55c9f92a4500": { 2024-05-08T23:18:06.532 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-08T23:18:06.532 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-05-08T23:18:06.532 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-08T23:18:06.532 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-05-08T23:18:06.532 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-05-08T23:18:06.532 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:06.532 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:06.532 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-05-08T23:18:06.532 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-05-08T23:18:06.532 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-05-08T23:18:06.532 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-05-08T23:18:06.532 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-08T23:18:06.532 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:06.533 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:06.533 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:06.533 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:06.533 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:06.533 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:18:06.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:06 smithi179 ceph-mon[46314]: pgmap v337: 97 pgs: 97 active+clean; 222 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 15 op/s 2024-05-08T23:18:06.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:06 smithi195 ceph-mon[46516]: pgmap v337: 97 pgs: 97 active+clean; 222 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 15 op/s 2024-05-08T23:18:06.867 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-05-08T23:18:06.867 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-05-08T23:18:06.867 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-05-08T23:18:06.868 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-05-08T23:18:06.868 DEBUG:tasks.check_counter:Getting stats from d 2024-05-08T23:18:06.868 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-08T23:18:07.093 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:18:08.119 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:18:08.120 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T23:18:08.120 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 0, 2024-05-08T23:18:08.120 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 2, 2024-05-08T23:18:08.120 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 0, 2024-05-08T23:18:08.120 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 0, 2024-05-08T23:18:08.120 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 4, 2024-05-08T23:18:08.120 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 0, 2024-05-08T23:18:08.120 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.001355080, 2024-05-08T23:18:08.120 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T23:18:08.120 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.000294481, 2024-05-08T23:18:08.120 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T23:18:08.120 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:08.120 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:08.121 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:08.121 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:08.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:08.121 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:08.121 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:08.121 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:08.121 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:08.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:08.121 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T23:18:08.121 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T23:18:08.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:08.121 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T23:18:08.121 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 5, 2024-05-08T23:18:08.121 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 55, 2024-05-08T23:18:08.122 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 3200, 2024-05-08T23:18:08.122 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 85952, 2024-05-08T23:18:08.122 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 3, 2024-05-08T23:18:08.122 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 2, 2024-05-08T23:18:08.122 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.004800849, 2024-05-08T23:18:08.122 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.002724040, 2024-05-08T23:18:08.122 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.001552936, 2024-05-08T23:18:08.122 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T23:18:08.122 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:08.122 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 54, 2024-05-08T23:18:08.122 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.002988463, 2024-05-08T23:18:08.122 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000055341 2024-05-08T23:18:08.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:08.122 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:08.123 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:08.123 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:08.123 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:08.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:08.123 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-05-08T23:18:08.123 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 85952 2024-05-08T23:18:08.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:08.123 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T23:18:08.123 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 73, 2024-05-08T23:18:08.123 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 70, 2024-05-08T23:18:08.123 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 430480, 2024-05-08T23:18:08.123 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 38800, 2024-05-08T23:18:08.123 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 2, 2024-05-08T23:18:08.123 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 1, 2024-05-08T23:18:08.123 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.011869197, 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.004142387, 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.008372887, 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.001246478, 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 69, 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.003679225, 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000053322 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 430480, 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 38800 2024-05-08T23:18:08.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:08.125 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-05-08T23:18:08.125 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 0, 2024-05-08T23:18:08.125 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-05-08T23:18:08.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:08.125 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-05-08T23:18:08.125 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-05-08T23:18:08.125 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-05-08T23:18:08.125 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T23:18:08.125 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-05-08T23:18:08.125 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T23:18:08.125 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-05-08T23:18:08.125 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T23:18:08.125 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T23:18:08.125 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T23:18:08.125 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-05-08T23:18:08.126 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-05-08T23:18:08.127 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T23:18:08.127 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T23:18:08.127 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-05-08T23:18:08.127 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-05-08T23:18:08.127 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-05-08T23:18:08.127 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-05-08T23:18:08.127 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T23:18:08.127 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-05-08T23:18:08.127 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T23:18:08.127 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-05-08T23:18:08.127 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 148903, 2024-05-08T23:18:08.127 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 29, 2024-05-08T23:18:08.127 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-05-08T23:18:08.127 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 0, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 0, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 928, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 2, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-05-08T23:18:08.128 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-05-08T23:18:08.129 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-05-08T23:18:08.129 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-05-08T23:18:08.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:08.129 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T23:18:08.129 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-08T23:18:08.129 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-05-08T23:18:08.129 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-08T23:18:08.129 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 74, 2024-05-08T23:18:08.129 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 420196, 2024-05-08T23:18:08.129 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:08.129 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 74, 2024-05-08T23:18:08.129 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-05-08T23:18:08.129 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-05-08T23:18:08.129 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 74, 2024-05-08T23:18:08.130 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 420196, 2024-05-08T23:18:08.130 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-08T23:18:08.130 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:08.130 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:08.130 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:08.130 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:08.130 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:08.130 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:18:08.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:08 smithi135 ceph-mon[42440]: pgmap v338: 97 pgs: 97 active+clean; 97 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 22 op/s 2024-05-08T23:18:08.499 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-08T23:18:08.500 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-08T23:18:08.500 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-05-08T23:18:08.500 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-05-08T23:18:08.500 DEBUG:tasks.check_counter:Getting stats from g 2024-05-08T23:18:08.500 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-08T23:18:08.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:08 smithi179 ceph-mon[46314]: pgmap v338: 97 pgs: 97 active+clean; 97 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 22 op/s 2024-05-08T23:18:08.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:08 smithi195 ceph-mon[46516]: pgmap v338: 97 pgs: 97 active+clean; 97 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 22 op/s 2024-05-08T23:18:08.725 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:18:09.801 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:18:10.348 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T23:18:10.348 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 301, 2024-05-08T23:18:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 296, 2024-05-08T23:18:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 526450, 2024-05-08T23:18:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 107515, 2024-05-08T23:18:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 5, 2024-05-08T23:18:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 1, 2024-05-08T23:18:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.036364242, 2024-05-08T23:18:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.014361842, 2024-05-08T23:18:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.014547653, 2024-05-08T23:18:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.007248290, 2024-05-08T23:18:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 295, 2024-05-08T23:18:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.015744123, 2024-05-08T23:18:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000053369 2024-05-08T23:18:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:10.350 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.350 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.350 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.350 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 451760, 2024-05-08T23:18:10.350 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 38784 2024-05-08T23:18:10.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.350 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T23:18:10.350 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 384, 2024-05-08T23:18:10.350 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 432, 2024-05-08T23:18:10.350 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 101422, 2024-05-08T23:18:10.350 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 281462, 2024-05-08T23:18:10.350 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 5, 2024-05-08T23:18:10.350 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2024-05-08T23:18:10.351 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.027572700, 2024-05-08T23:18:10.351 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.008931783, 2024-05-08T23:18:10.351 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.007390872, 2024-05-08T23:18:10.351 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.009094496, 2024-05-08T23:18:10.351 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:10.351 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 431, 2024-05-08T23:18:10.351 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.014613397, 2024-05-08T23:18:10.351 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000033905 2024-05-08T23:18:10.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.351 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:10.351 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.351 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.351 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.352 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-05-08T23:18:10.352 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 163536 2024-05-08T23:18:10.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.352 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T23:18:10.352 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 4, 2024-05-08T23:18:10.352 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 6, 2024-05-08T23:18:10.352 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 1629, 2024-05-08T23:18:10.352 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 1256, 2024-05-08T23:18:10.352 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 5, 2024-05-08T23:18:10.352 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2024-05-08T23:18:10.352 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.001433904, 2024-05-08T23:18:10.352 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.000080863, 2024-05-08T23:18:10.352 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.001166994, 2024-05-08T23:18:10.353 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000096297, 2024-05-08T23:18:10.353 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:10.353 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4, 2024-05-08T23:18:10.353 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.002244644, 2024-05-08T23:18:10.353 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000561161 2024-05-08T23:18:10.353 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.353 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:10.353 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.353 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.353 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.353 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.353 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T23:18:10.354 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T23:18:10.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.354 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-05-08T23:18:10.354 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-05-08T23:18:10.354 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-05-08T23:18:10.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.354 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-05-08T23:18:10.354 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-05-08T23:18:10.354 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-05-08T23:18:10.354 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1039, 2024-05-08T23:18:10.354 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.023042922, 2024-05-08T23:18:10.354 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000022177 2024-05-08T23:18:10.355 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:10.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.355 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-05-08T23:18:10.355 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-05-08T23:18:10.355 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-05-08T23:18:10.355 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.355 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.355 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.355 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:10.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.355 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-05-08T23:18:10.355 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2024-05-08T23:18:10.355 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2024-05-08T23:18:10.355 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-05-08T23:18:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-05-08T23:18:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2024-05-08T23:18:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2024-05-08T23:18:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-05-08T23:18:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2024-05-08T23:18:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-05-08T23:18:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-05-08T23:18:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 0, 2024-05-08T23:18:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 0, 2024-05-08T23:18:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 0, 2024-05-08T23:18:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 0, 2024-05-08T23:18:10.357 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 0, 2024-05-08T23:18:10.357 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 0, 2024-05-08T23:18:10.357 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2024-05-08T23:18:10.357 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2024-05-08T23:18:10.357 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 1, 2024-05-08T23:18:10.357 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2024-05-08T23:18:10.357 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2024-05-08T23:18:10.357 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2024-05-08T23:18:10.357 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2024-05-08T23:18:10.357 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-05-08T23:18:10.358 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-05-08T23:18:10.358 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2024-05-08T23:18:10.358 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2024-05-08T23:18:10.358 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-05-08T23:18:10.358 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2024-05-08T23:18:10.358 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2024-05-08T23:18:10.358 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2024-05-08T23:18:10.358 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2024-05-08T23:18:10.358 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-05-08T23:18:10.362 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2024-05-08T23:18:10.362 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-05-08T23:18:10.362 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 0, 2024-05-08T23:18:10.362 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 0, 2024-05-08T23:18:10.362 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2024-05-08T23:18:10.362 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T23:18:10.363 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-05-08T23:18:10.363 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T23:18:10.363 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-05-08T23:18:10.363 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2024-05-08T23:18:10.363 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T23:18:10.363 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T23:18:10.363 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2024-05-08T23:18:10.363 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2024-05-08T23:18:10.363 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T23:18:10.363 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2024-05-08T23:18:10.363 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T23:18:10.363 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T23:18:10.363 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T23:18:10.363 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2024-05-08T23:18:10.363 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2024-05-08T23:18:10.364 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2024-05-08T23:18:10.364 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2024-05-08T23:18:10.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.364 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-05-08T23:18:10.364 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2024-05-08T23:18:10.364 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2024-05-08T23:18:10.364 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2024-05-08T23:18:10.364 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2024-05-08T23:18:10.364 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2024-05-08T23:18:10.364 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-05-08T23:18:10.364 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-05-08T23:18:10.364 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-05-08T23:18:10.364 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2024-05-08T23:18:10.364 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2024-05-08T23:18:10.364 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-05-08T23:18:10.365 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-05-08T23:18:10.365 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-05-08T23:18:10.365 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-05-08T23:18:10.365 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-05-08T23:18:10.365 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-05-08T23:18:10.365 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-05-08T23:18:10.365 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T23:18:10.365 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2024-05-08T23:18:10.365 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-05-08T23:18:10.365 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-05-08T23:18:10.365 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-05-08T23:18:10.365 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2024-05-08T23:18:10.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.366 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-05-08T23:18:10.366 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2024-05-08T23:18:10.366 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-05-08T23:18:10.366 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-05-08T23:18:10.366 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 4, 2024-05-08T23:18:10.366 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-05-08T23:18:10.366 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-05-08T23:18:10.366 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2024-05-08T23:18:10.366 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-05-08T23:18:10.366 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-05-08T23:18:10.367 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 1, 2024-05-08T23:18:10.367 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-05-08T23:18:10.367 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-05-08T23:18:10.367 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2024-05-08T23:18:10.367 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 4195692, 2024-05-08T23:18:10.367 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 4195551, 2024-05-08T23:18:10.367 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-05-08T23:18:10.367 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.367 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.367 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.367 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 4 2024-05-08T23:18:10.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.368 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-05-08T23:18:10.368 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 3, 2024-05-08T23:18:10.368 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 3, 2024-05-08T23:18:10.368 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 0, 2024-05-08T23:18:10.368 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 1, 2024-05-08T23:18:10.368 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 1, 2024-05-08T23:18:10.368 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 0, 2024-05-08T23:18:10.368 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 0, 2024-05-08T23:18:10.368 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 0, 2024-05-08T23:18:10.368 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 0, 2024-05-08T23:18:10.368 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2024-05-08T23:18:10.369 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2024-05-08T23:18:10.369 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2024-05-08T23:18:10.369 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 45512, 2024-05-08T23:18:10.369 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 207156 2024-05-08T23:18:10.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.369 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-05-08T23:18:10.369 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2024-05-08T23:18:10.369 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2024-05-08T23:18:10.369 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2024-05-08T23:18:10.369 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2024-05-08T23:18:10.369 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2024-05-08T23:18:10.369 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-05-08T23:18:10.369 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.370 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.370 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.370 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-05-08T23:18:10.370 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.370 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.370 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.370 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-05-08T23:18:10.370 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.370 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.370 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.371 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-05-08T23:18:10.371 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.371 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.371 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.371 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-05-08T23:18:10.371 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.371 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.371 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.372 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-05-08T23:18:10.372 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.372 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.372 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.372 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-05-08T23:18:10.372 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.372 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.372 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.373 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-05-08T23:18:10.373 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.373 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.373 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.373 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-05-08T23:18:10.373 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.373 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.373 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.373 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-05-08T23:18:10.373 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.373 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.373 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.374 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-05-08T23:18:10.374 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.374 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.374 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.374 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-05-08T23:18:10.374 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.375 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.375 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.375 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-05-08T23:18:10.375 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.375 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.375 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.376 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-05-08T23:18:10.376 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.376 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.376 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.376 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-05-08T23:18:10.376 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.376 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.376 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.377 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-05-08T23:18:10.377 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.377 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.377 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.377 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-05-08T23:18:10.377 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.377 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.377 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.378 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-05-08T23:18:10.378 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.378 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.378 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.379 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-05-08T23:18:10.379 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.379 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.379 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.379 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-05-08T23:18:10.379 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.379 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.379 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.379 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-05-08T23:18:10.379 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.380 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.380 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.380 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-05-08T23:18:10.380 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.380 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.380 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.380 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-05-08T23:18:10.380 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.380 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.380 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.380 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-05-08T23:18:10.381 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.381 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.381 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.381 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-05-08T23:18:10.381 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.381 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.381 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.381 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-05-08T23:18:10.381 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.381 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.381 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.382 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-05-08T23:18:10.382 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.382 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.382 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.382 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-05-08T23:18:10.382 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.382 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.382 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.383 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-05-08T23:18:10.383 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.383 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.383 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.383 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-05-08T23:18:10.383 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-05-08T23:18:10.383 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-05-08T23:18:10.383 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.383 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.383 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.383 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:10.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.384 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-05-08T23:18:10.384 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 1, 2024-05-08T23:18:10.384 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 2, 2024-05-08T23:18:10.384 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 1, 2024-05-08T23:18:10.384 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 2, 2024-05-08T23:18:10.384 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-05-08T23:18:10.384 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2024-05-08T23:18:10.384 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2024-05-08T23:18:10.384 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 2913, 2024-05-08T23:18:10.384 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-05-08T23:18:10.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.385 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-05-08T23:18:10.385 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-05-08T23:18:10.385 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-05-08T23:18:10.385 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T23:18:10.385 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-05-08T23:18:10.385 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T23:18:10.385 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-05-08T23:18:10.385 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T23:18:10.385 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T23:18:10.385 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T23:18:10.385 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T23:18:10.385 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T23:18:10.386 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-05-08T23:18:10.386 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T23:18:10.386 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T23:18:10.386 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-05-08T23:18:10.386 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-05-08T23:18:10.386 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-05-08T23:18:10.386 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-05-08T23:18:10.386 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T23:18:10.386 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T23:18:10.386 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T23:18:10.386 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T23:18:10.387 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T23:18:10.387 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-05-08T23:18:10.387 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-05-08T23:18:10.387 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-05-08T23:18:10.387 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T23:18:10.387 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T23:18:10.387 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-05-08T23:18:10.387 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-05-08T23:18:10.387 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-05-08T23:18:10.387 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-05-08T23:18:10.387 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T23:18:10.388 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-05-08T23:18:10.388 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T23:18:10.388 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-05-08T23:18:10.388 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 197336, 2024-05-08T23:18:10.388 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 53, 2024-05-08T23:18:10.388 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-05-08T23:18:10.388 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-05-08T23:18:10.388 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-05-08T23:18:10.388 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-05-08T23:18:10.388 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-05-08T23:18:10.388 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-05-08T23:18:10.389 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-05-08T23:18:10.389 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-05-08T23:18:10.389 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 7720, 2024-05-08T23:18:10.389 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 162, 2024-05-08T23:18:10.389 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T23:18:10.389 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-05-08T23:18:10.389 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-05-08T23:18:10.389 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-05-08T23:18:10.389 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 8320, 2024-05-08T23:18:10.389 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 13, 2024-05-08T23:18:10.389 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-05-08T23:18:10.389 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-05-08T23:18:10.389 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-05-08T23:18:10.390 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-05-08T23:18:10.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.390 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-05-08T23:18:10.390 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-05-08T23:18:10.390 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-05-08T23:18:10.390 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 604, 2024-05-08T23:18:10.390 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 21, 2024-05-08T23:18:10.390 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 3, 2024-05-08T23:18:10.390 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 604, 2024-05-08T23:18:10.390 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-05-08T23:18:10.390 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 604, 2024-05-08T23:18:10.390 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.047978251, 2024-05-08T23:18:10.390 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001735063 2024-05-08T23:18:10.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 604, 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 605 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 604, 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 604, 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 375, 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 227, 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-05-08T23:18:10.391 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-05-08T23:18:10.392 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-05-08T23:18:10.392 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-05-08T23:18:10.392 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-05-08T23:18:10.392 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-05-08T23:18:10.392 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-05-08T23:18:10.392 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-05-08T23:18:10.392 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-05-08T23:18:10.392 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1, 2024-05-08T23:18:10.392 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-05-08T23:18:10.392 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-05-08T23:18:10.392 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-05-08T23:18:10.392 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-05-08T23:18:10.392 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-05-08T23:18:10.392 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-05-08T23:18:10.392 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-05-08T23:18:10.393 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T23:18:10.393 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-05-08T23:18:10.393 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-05-08T23:18:10.393 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-05-08T23:18:10.393 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-05-08T23:18:10.393 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-05-08T23:18:10.393 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-05-08T23:18:10.393 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-05-08T23:18:10.393 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-05-08T23:18:10.393 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-05-08T23:18:10.393 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-05-08T23:18:10.393 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-05-08T23:18:10.393 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-05-08T23:18:10.393 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-05-08T23:18:10.393 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-05-08T23:18:10.394 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-05-08T23:18:10.394 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-05-08T23:18:10.394 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-05-08T23:18:10.394 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-05-08T23:18:10.394 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-05-08T23:18:10.394 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 85, 2024-05-08T23:18:10.394 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-05-08T23:18:10.394 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 2, 2024-05-08T23:18:10.394 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 6, 2024-05-08T23:18:10.394 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 6, 2024-05-08T23:18:10.394 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-05-08T23:18:10.394 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-05-08T23:18:10.394 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-05-08T23:18:10.394 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2024-05-08T23:18:10.395 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-05-08T23:18:10.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.395 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-05-08T23:18:10.395 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2024-05-08T23:18:10.395 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-05-08T23:18:10.395 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-05-08T23:18:10.395 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-05-08T23:18:10.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.395 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2024-05-08T23:18:10.395 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-05-08T23:18:10.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.395 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-05-08T23:18:10.395 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-05-08T23:18:10.395 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T23:18:10.396 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-05-08T23:18:10.396 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2024-05-08T23:18:10.396 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2024-05-08T23:18:10.396 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-05-08T23:18:10.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.396 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T23:18:10.396 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-08T23:18:10.396 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-05-08T23:18:10.396 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-08T23:18:10.396 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 685, 2024-05-08T23:18:10.396 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 560770, 2024-05-08T23:18:10.396 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:10.396 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 685, 2024-05-08T23:18:10.396 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-05-08T23:18:10.397 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-05-08T23:18:10.397 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 685, 2024-05-08T23:18:10.397 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 560770, 2024-05-08T23:18:10.397 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-08T23:18:10.397 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.397 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.397 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.397 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:10.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.397 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-05-08T23:18:10.397 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-08T23:18:10.397 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-05-08T23:18:10.397 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-08T23:18:10.397 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-05-08T23:18:10.397 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-05-08T23:18:10.398 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:10.398 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:10.398 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 604, 2024-05-08T23:18:10.398 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 1393, 2024-05-08T23:18:10.398 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 604, 2024-05-08T23:18:10.398 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1393, 2024-05-08T23:18:10.398 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-08T23:18:10.398 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.398 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.398 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.398 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:10.398 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.398 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-05-08T23:18:10.399 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-08T23:18:10.399 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-05-08T23:18:10.399 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-08T23:18:10.399 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-05-08T23:18:10.399 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-05-08T23:18:10.399 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:10.399 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:10.399 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 604, 2024-05-08T23:18:10.399 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 604, 2024-05-08T23:18:10.399 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 604, 2024-05-08T23:18:10.399 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 604, 2024-05-08T23:18:10.399 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-08T23:18:10.399 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.399 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.399 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.400 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:10.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.400 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-05-08T23:18:10.400 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-08T23:18:10.400 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-05-08T23:18:10.400 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-08T23:18:10.400 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-05-08T23:18:10.400 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-05-08T23:18:10.400 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:10.401 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:10.401 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-05-08T23:18:10.401 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-05-08T23:18:10.401 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-05-08T23:18:10.401 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-05-08T23:18:10.401 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-08T23:18:10.401 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.401 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.401 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.401 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:10.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:10.402 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x558805092500": { 2024-05-08T23:18:10.402 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-08T23:18:10.402 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-05-08T23:18:10.402 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-08T23:18:10.402 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-05-08T23:18:10.402 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-05-08T23:18:10.402 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:10.402 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:10.402 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-05-08T23:18:10.402 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-05-08T23:18:10.403 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-05-08T23:18:10.403 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-05-08T23:18:10.403 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-08T23:18:10.403 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:10.403 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:10.403 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:10.403 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:10.403 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:10.403 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:18:10.406 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-05-08T23:18:10.406 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-05-08T23:18:10.406 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-05-08T23:18:10.406 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-05-08T23:18:10.406 DEBUG:tasks.check_counter:Getting stats from j 2024-05-08T23:18:10.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-08T23:18:10.433 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:10 smithi135 ceph-mon[42440]: pgmap v339: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 MiB/s wr, 27 op/s 2024-05-08T23:18:10.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:10 smithi179 ceph-mon[46314]: pgmap v339: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 MiB/s wr, 27 op/s 2024-05-08T23:18:10.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:10 smithi195 ceph-mon[46516]: pgmap v339: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 MiB/s wr, 27 op/s 2024-05-08T23:18:10.631 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:18:11.696 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:18:11.696 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T23:18:11.696 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 0, 2024-05-08T23:18:11.696 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 2, 2024-05-08T23:18:11.696 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 0, 2024-05-08T23:18:11.696 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 0, 2024-05-08T23:18:11.696 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 4, 2024-05-08T23:18:11.696 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 0, 2024-05-08T23:18:11.697 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.001058505, 2024-05-08T23:18:11.697 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T23:18:11.697 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.000145673, 2024-05-08T23:18:11.697 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T23:18:11.697 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:11.697 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:11.697 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:11.697 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:11.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:11.697 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:11.697 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:11.697 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:11.697 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:11.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:11.697 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T23:18:11.698 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T23:18:11.698 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:11.698 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T23:18:11.698 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 74, 2024-05-08T23:18:11.698 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 71, 2024-05-08T23:18:11.698 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 430752, 2024-05-08T23:18:11.698 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 39392, 2024-05-08T23:18:11.698 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 2, 2024-05-08T23:18:11.698 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 1, 2024-05-08T23:18:11.698 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.013281340, 2024-05-08T23:18:11.698 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.004511911, 2024-05-08T23:18:11.698 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.010386573, 2024-05-08T23:18:11.698 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.001309953, 2024-05-08T23:18:11.699 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:11.699 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 70, 2024-05-08T23:18:11.699 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.003376294, 2024-05-08T23:18:11.699 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000048232 2024-05-08T23:18:11.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:11.699 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:11.699 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:11.699 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:11.699 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:11.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:11.699 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 430752, 2024-05-08T23:18:11.699 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 39392 2024-05-08T23:18:11.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:11.699 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T23:18:11.699 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 5, 2024-05-08T23:18:11.700 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 56, 2024-05-08T23:18:11.700 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 3200, 2024-05-08T23:18:11.700 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 86128, 2024-05-08T23:18:11.700 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 3, 2024-05-08T23:18:11.700 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 2, 2024-05-08T23:18:11.700 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.005432105, 2024-05-08T23:18:11.700 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.003304976, 2024-05-08T23:18:11.700 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.001576066, 2024-05-08T23:18:11.700 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T23:18:11.700 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:11.700 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 55, 2024-05-08T23:18:11.700 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.003951283, 2024-05-08T23:18:11.700 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000071841 2024-05-08T23:18:11.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:11.701 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:11.701 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:11.701 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:11.701 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:11.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:11.701 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-05-08T23:18:11.701 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 86128 2024-05-08T23:18:11.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:11.701 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-05-08T23:18:11.701 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 0, 2024-05-08T23:18:11.701 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-05-08T23:18:11.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:11.701 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-05-08T23:18:11.701 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-05-08T23:18:11.701 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-05-08T23:18:11.702 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T23:18:11.702 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-05-08T23:18:11.702 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T23:18:11.702 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-05-08T23:18:11.702 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T23:18:11.702 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T23:18:11.702 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T23:18:11.702 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T23:18:11.702 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T23:18:11.702 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-05-08T23:18:11.702 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T23:18:11.702 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T23:18:11.702 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-05-08T23:18:11.702 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-05-08T23:18:11.703 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-05-08T23:18:11.703 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-05-08T23:18:11.703 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T23:18:11.703 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T23:18:11.703 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T23:18:11.703 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T23:18:11.703 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T23:18:11.704 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-05-08T23:18:11.704 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-05-08T23:18:11.704 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-05-08T23:18:11.704 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T23:18:11.704 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T23:18:11.704 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-05-08T23:18:11.705 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-05-08T23:18:11.705 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-05-08T23:18:11.705 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-05-08T23:18:11.705 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T23:18:11.706 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-05-08T23:18:11.706 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T23:18:11.706 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-05-08T23:18:11.706 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 148841, 2024-05-08T23:18:11.706 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 28, 2024-05-08T23:18:11.706 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-05-08T23:18:11.706 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-05-08T23:18:11.706 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-05-08T23:18:11.706 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-05-08T23:18:11.706 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-05-08T23:18:11.706 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-05-08T23:18:11.707 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-05-08T23:18:11.707 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-05-08T23:18:11.707 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 0, 2024-05-08T23:18:11.707 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 0, 2024-05-08T23:18:11.707 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T23:18:11.707 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 928, 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 2, 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 75, 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 420326, 2024-05-08T23:18:11.708 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:11.709 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 75, 2024-05-08T23:18:11.709 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-05-08T23:18:11.709 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-05-08T23:18:11.709 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 75, 2024-05-08T23:18:11.709 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 420326, 2024-05-08T23:18:11.709 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-05-08T23:18:11.709 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-05-08T23:18:11.709 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-05-08T23:18:11.709 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-05-08T23:18:11.709 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:11.709 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T23:18:11.709 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:18:12.093 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-08T23:18:12.093 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-08T23:18:12.093 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-05-08T23:18:12.093 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-05-08T23:18:12.093 DEBUG:tasks.check_counter:Getting stats from b 2024-05-08T23:18:12.093 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-08T23:18:12.343 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:18:12.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:12 smithi135 ceph-mon[42440]: pgmap v340: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 22 MiB/s wr, 24 op/s 2024-05-08T23:18:12.479 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:12 smithi179 ceph-mon[46314]: pgmap v340: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 22 MiB/s wr, 24 op/s 2024-05-08T23:18:12.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:12 smithi195 ceph-mon[46516]: pgmap v340: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 22 MiB/s wr, 24 op/s 2024-05-08T23:18:13.418 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-05-08T23:18:13.418 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T23:18:13.418 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 138, 2024-05-08T23:18:13.418 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 126, 2024-05-08T23:18:13.418 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 493203, 2024-05-08T23:18:13.418 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 52473, 2024-05-08T23:18:13.418 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 8, 2024-05-08T23:18:13.419 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 4, 2024-05-08T23:18:13.419 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.020719994, 2024-05-08T23:18:13.419 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.005691991, 2024-05-08T23:18:13.419 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.016229547, 2024-05-08T23:18:13.419 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.002044050, 2024-05-08T23:18:13.419 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:13.419 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 124, 2024-05-08T23:18:13.419 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.016677459, 2024-05-08T23:18:13.419 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000134495 2024-05-08T23:18:13.419 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.419 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:13.419 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 15, 2024-05-08T23:18:13.419 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000002656, 2024-05-08T23:18:13.419 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000177 2024-05-08T23:18:13.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.420 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 489584, 2024-05-08T23:18:13.420 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 45424 2024-05-08T23:18:13.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.420 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T23:18:13.420 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 215, 2024-05-08T23:18:13.420 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 237, 2024-05-08T23:18:13.420 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 72926, 2024-05-08T23:18:13.420 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 239824, 2024-05-08T23:18:13.420 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 7, 2024-05-08T23:18:13.420 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 4, 2024-05-08T23:18:13.420 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.024063631, 2024-05-08T23:18:13.420 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.009248027, 2024-05-08T23:18:13.420 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.012908461, 2024-05-08T23:18:13.421 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.001723933, 2024-05-08T23:18:13.421 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:13.421 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 237, 2024-05-08T23:18:13.421 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.037452907, 2024-05-08T23:18:13.421 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000158029 2024-05-08T23:18:13.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.421 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:13.421 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 371, 2024-05-08T23:18:13.421 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000092250, 2024-05-08T23:18:13.421 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000248 2024-05-08T23:18:13.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.421 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T23:18:13.421 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 166224 2024-05-08T23:18:13.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.421 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T23:18:13.422 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 18, 2024-05-08T23:18:13.422 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 20, 2024-05-08T23:18:13.422 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 4443, 2024-05-08T23:18:13.422 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 51153, 2024-05-08T23:18:13.422 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 10, 2024-05-08T23:18:13.422 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 6, 2024-05-08T23:18:13.422 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.004505026, 2024-05-08T23:18:13.422 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.000363662, 2024-05-08T23:18:13.422 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.003456933, 2024-05-08T23:18:13.422 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.000417751, 2024-05-08T23:18:13.422 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:13.422 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 18, 2024-05-08T23:18:13.422 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.017001341, 2024-05-08T23:18:13.423 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000944518 2024-05-08T23:18:13.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.423 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:13.423 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 4, 2024-05-08T23:18:13.423 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000378, 2024-05-08T23:18:13.423 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000094 2024-05-08T23:18:13.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.423 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T23:18:13.423 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T23:18:13.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.423 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-05-08T23:18:13.423 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 1, 2024-05-08T23:18:13.423 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-05-08T23:18:13.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.424 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-MDSRank": { 2024-05-08T23:18:13.424 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-05-08T23:18:13.424 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-05-08T23:18:13.424 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 51, 2024-05-08T23:18:13.424 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.001465065, 2024-05-08T23:18:13.424 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000028726 2024-05-08T23:18:13.424 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:13.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.424 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-PurgeQueue": { 2024-05-08T23:18:13.424 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-05-08T23:18:13.424 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-05-08T23:18:13.424 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 2, 2024-05-08T23:18:13.424 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000022762, 2024-05-08T23:18:13.424 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000011381 2024-05-08T23:18:13.424 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:13.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.425 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": { 2024-05-08T23:18:13.425 INFO:teuthology.orchestra.run.smithi179.stdout: "request": 3, 2024-05-08T23:18:13.425 INFO:teuthology.orchestra.run.smithi179.stdout: "reply": 1, 2024-05-08T23:18:13.425 INFO:teuthology.orchestra.run.smithi179.stdout: "reply_latency": { 2024-05-08T23:18:13.425 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1, 2024-05-08T23:18:13.425 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000189253, 2024-05-08T23:18:13.425 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000189253 2024-05-08T23:18:13.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.425 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_reply": 0, 2024-05-08T23:18:13.425 INFO:teuthology.orchestra.run.smithi179.stdout: "forward": 2, 2024-05-08T23:18:13.425 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_complete": 0, 2024-05-08T23:18:13.425 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_keys": 0, 2024-05-08T23:18:13.425 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_commit": 11, 2024-05-08T23:18:13.426 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_split": 0, 2024-05-08T23:18:13.426 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_merge": 0, 2024-05-08T23:18:13.426 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes": 16, 2024-05-08T23:18:13.426 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_top": 0, 2024-05-08T23:18:13.426 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_bottom": 16, 2024-05-08T23:18:13.426 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pin_tail": 0, 2024-05-08T23:18:13.426 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pinned": 13, 2024-05-08T23:18:13.426 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_expired": 4, 2024-05-08T23:18:13.426 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_with_caps": 0, 2024-05-08T23:18:13.426 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": 0, 2024-05-08T23:18:13.426 INFO:teuthology.orchestra.run.smithi179.stdout: "subtrees": 3, 2024-05-08T23:18:13.426 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse": 11, 2024-05-08T23:18:13.426 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_hit": 5, 2024-05-08T23:18:13.426 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_forward": 0, 2024-05-08T23:18:13.427 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_discover": 4, 2024-05-08T23:18:13.427 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_dir_fetch": 0, 2024-05-08T23:18:13.427 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_remote_ino": 0, 2024-05-08T23:18:13.427 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_lock": 0, 2024-05-08T23:18:13.427 INFO:teuthology.orchestra.run.smithi179.stdout: "load_cent": 0, 2024-05-08T23:18:13.427 INFO:teuthology.orchestra.run.smithi179.stdout: "q": 0, 2024-05-08T23:18:13.427 INFO:teuthology.orchestra.run.smithi179.stdout: "exported": 0, 2024-05-08T23:18:13.427 INFO:teuthology.orchestra.run.smithi179.stdout: "exported_inodes": 0, 2024-05-08T23:18:13.427 INFO:teuthology.orchestra.run.smithi179.stdout: "imported": 0, 2024-05-08T23:18:13.427 INFO:teuthology.orchestra.run.smithi179.stdout: "imported_inodes": 0, 2024-05-08T23:18:13.427 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_dir_fetch": 0, 2024-05-08T23:18:13.427 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_backtrace_fetch": 0, 2024-05-08T23:18:13.427 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_peer_discover": 0, 2024-05-08T23:18:13.427 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rfiles": 8, 2024-05-08T23:18:13.428 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rbytes": 269513722, 2024-05-08T23:18:13.428 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rsnaps": 0, 2024-05-08T23:18:13.428 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T23:18:13.428 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_set_tag": 0, 2024-05-08T23:18:13.428 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T23:18:13.428 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_inotable_repaired": 0, 2024-05-08T23:18:13.428 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_inodes": 0, 2024-05-08T23:18:13.428 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T23:18:13.428 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T23:18:13.428 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_file_inodes": 0, 2024-05-08T23:18:13.428 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_inode_file_caps": 0, 2024-05-08T23:18:13.428 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T23:18:13.428 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_grant": 0, 2024-05-08T23:18:13.428 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T23:18:13.429 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T23:18:13.429 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T23:18:13.429 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps": 0, 2024-05-08T23:18:13.429 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps_dirty": 0, 2024-05-08T23:18:13.429 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_cap_release": 0, 2024-05-08T23:18:13.429 INFO:teuthology.orchestra.run.smithi179.stdout: "process_request_cap_release": 2 2024-05-08T23:18:13.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.429 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_cache": { 2024-05-08T23:18:13.429 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update": 0, 2024-05-08T23:18:13.429 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update_receipt": 9, 2024-05-08T23:18:13.429 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_try_discover": 6, 2024-05-08T23:18:13.429 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_send_discover": 8, 2024-05-08T23:18:13.429 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_handle_discover": 0, 2024-05-08T23:18:13.429 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays": 0, 2024-05-08T23:18:13.429 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_delayed": 0, 2024-05-08T23:18:13.430 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_enqueuing": 0, 2024-05-08T23:18:13.430 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_created": 0, 2024-05-08T23:18:13.430 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_enqueued": 0, 2024-05-08T23:18:13.430 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_reintegrated": 0, 2024-05-08T23:18:13.430 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_migrated": 0, 2024-05-08T23:18:13.430 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_processing": 0, 2024-05-08T23:18:13.430 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_enqueued": 0, 2024-05-08T23:18:13.430 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_prioritized": 0, 2024-05-08T23:18:13.430 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_started": 0, 2024-05-08T23:18:13.430 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_completed": 0, 2024-05-08T23:18:13.430 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T23:18:13.430 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_exportdir": 0, 2024-05-08T23:18:13.430 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_flush": 0, 2024-05-08T23:18:13.430 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragmentdir": 0, 2024-05-08T23:18:13.431 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragstats": 0, 2024-05-08T23:18:13.431 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_inodestats": 0 2024-05-08T23:18:13.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.431 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_log": { 2024-05-08T23:18:13.431 INFO:teuthology.orchestra.run.smithi179.stdout: "evadd": 3, 2024-05-08T23:18:13.431 INFO:teuthology.orchestra.run.smithi179.stdout: "evex": 0, 2024-05-08T23:18:13.431 INFO:teuthology.orchestra.run.smithi179.stdout: "evtrm": 0, 2024-05-08T23:18:13.431 INFO:teuthology.orchestra.run.smithi179.stdout: "ev": 3, 2024-05-08T23:18:13.431 INFO:teuthology.orchestra.run.smithi179.stdout: "evexg": 0, 2024-05-08T23:18:13.431 INFO:teuthology.orchestra.run.smithi179.stdout: "evexd": 0, 2024-05-08T23:18:13.431 INFO:teuthology.orchestra.run.smithi179.stdout: "segadd": 1, 2024-05-08T23:18:13.431 INFO:teuthology.orchestra.run.smithi179.stdout: "segex": 0, 2024-05-08T23:18:13.431 INFO:teuthology.orchestra.run.smithi179.stdout: "segtrm": 0, 2024-05-08T23:18:13.431 INFO:teuthology.orchestra.run.smithi179.stdout: "seg": 1, 2024-05-08T23:18:13.431 INFO:teuthology.orchestra.run.smithi179.stdout: "segexg": 0, 2024-05-08T23:18:13.432 INFO:teuthology.orchestra.run.smithi179.stdout: "segexd": 0, 2024-05-08T23:18:13.432 INFO:teuthology.orchestra.run.smithi179.stdout: "expos": 4194304, 2024-05-08T23:18:13.432 INFO:teuthology.orchestra.run.smithi179.stdout: "wrpos": 4195378, 2024-05-08T23:18:13.432 INFO:teuthology.orchestra.run.smithi179.stdout: "rdpos": 0, 2024-05-08T23:18:13.432 INFO:teuthology.orchestra.run.smithi179.stdout: "jlat": { 2024-05-08T23:18:13.432 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 3, 2024-05-08T23:18:13.432 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.005627007, 2024-05-08T23:18:13.432 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.001875669 2024-05-08T23:18:13.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.432 INFO:teuthology.orchestra.run.smithi179.stdout: "replayed": 0 2024-05-08T23:18:13.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.432 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_mem": { 2024-05-08T23:18:13.432 INFO:teuthology.orchestra.run.smithi179.stdout: "ino": 20, 2024-05-08T23:18:13.432 INFO:teuthology.orchestra.run.smithi179.stdout: "ino+": 22, 2024-05-08T23:18:13.433 INFO:teuthology.orchestra.run.smithi179.stdout: "ino-": 2, 2024-05-08T23:18:13.433 INFO:teuthology.orchestra.run.smithi179.stdout: "dir": 19, 2024-05-08T23:18:13.433 INFO:teuthology.orchestra.run.smithi179.stdout: "dir+": 22, 2024-05-08T23:18:13.433 INFO:teuthology.orchestra.run.smithi179.stdout: "dir-": 3, 2024-05-08T23:18:13.433 INFO:teuthology.orchestra.run.smithi179.stdout: "dn": 16, 2024-05-08T23:18:13.433 INFO:teuthology.orchestra.run.smithi179.stdout: "dn+": 20, 2024-05-08T23:18:13.433 INFO:teuthology.orchestra.run.smithi179.stdout: "dn-": 4, 2024-05-08T23:18:13.433 INFO:teuthology.orchestra.run.smithi179.stdout: "cap": 0, 2024-05-08T23:18:13.433 INFO:teuthology.orchestra.run.smithi179.stdout: "cap+": 1, 2024-05-08T23:18:13.433 INFO:teuthology.orchestra.run.smithi179.stdout: "cap-": 1, 2024-05-08T23:18:13.433 INFO:teuthology.orchestra.run.smithi179.stdout: "rss": 44552, 2024-05-08T23:18:13.433 INFO:teuthology.orchestra.run.smithi179.stdout: "heap": 198964 2024-05-08T23:18:13.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.433 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_server": { 2024-05-08T23:18:13.433 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_client_request": 4, 2024-05-08T23:18:13.434 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_server_request": 0, 2024-05-08T23:18:13.434 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_request": 3, 2024-05-08T23:18:13.434 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_session": 5, 2024-05-08T23:18:13.434 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_peer_request": 0, 2024-05-08T23:18:13.434 INFO:teuthology.orchestra.run.smithi179.stdout: "req_create_latency": { 2024-05-08T23:18:13.434 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.434 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.434 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.434 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getattr_latency": { 2024-05-08T23:18:13.434 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1, 2024-05-08T23:18:13.434 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000189253, 2024-05-08T23:18:13.434 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000189253 2024-05-08T23:18:13.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.435 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getfilelock_latency": { 2024-05-08T23:18:13.435 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.435 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.435 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.435 INFO:teuthology.orchestra.run.smithi179.stdout: "req_link_latency": { 2024-05-08T23:18:13.435 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.435 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.435 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.435 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookup_latency": { 2024-05-08T23:18:13.435 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.435 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.435 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.436 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookuphash_latency": { 2024-05-08T23:18:13.436 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.436 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.436 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.436 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupino_latency": { 2024-05-08T23:18:13.436 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.436 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.436 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.436 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupname_latency": { 2024-05-08T23:18:13.436 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.436 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.436 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupparent_latency": { 2024-05-08T23:18:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupsnap_latency": { 2024-05-08T23:18:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lssnap_latency": { 2024-05-08T23:18:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.438 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mkdir_latency": { 2024-05-08T23:18:13.438 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.438 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.438 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.438 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mknod_latency": { 2024-05-08T23:18:13.438 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.438 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.438 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.438 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mksnap_latency": { 2024-05-08T23:18:13.438 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.439 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.439 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.439 INFO:teuthology.orchestra.run.smithi179.stdout: "req_open_latency": { 2024-05-08T23:18:13.439 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.439 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.439 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.439 INFO:teuthology.orchestra.run.smithi179.stdout: "req_readdir_latency": { 2024-05-08T23:18:13.439 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.439 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.439 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.439 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rename_latency": { 2024-05-08T23:18:13.439 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.440 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.440 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.440 INFO:teuthology.orchestra.run.smithi179.stdout: "req_renamesnap_latency": { 2024-05-08T23:18:13.440 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.440 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.440 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.440 INFO:teuthology.orchestra.run.smithi179.stdout: "req_snapdiff_latency": { 2024-05-08T23:18:13.440 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.440 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.440 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.440 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmdir_latency": { 2024-05-08T23:18:13.440 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.441 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.441 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.441 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmsnap_latency": { 2024-05-08T23:18:13.441 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.441 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.441 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.441 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmxattr_latency": { 2024-05-08T23:18:13.441 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.441 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.441 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.441 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setattr_latency": { 2024-05-08T23:18:13.442 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.442 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.442 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.442 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setdirlayout_latency": { 2024-05-08T23:18:13.442 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.442 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.442 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.442 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setfilelock_latency": { 2024-05-08T23:18:13.442 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.442 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.442 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.443 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setlayout_latency": { 2024-05-08T23:18:13.443 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.443 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.443 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.443 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setxattr_latency": { 2024-05-08T23:18:13.443 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.443 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.443 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.444 INFO:teuthology.orchestra.run.smithi179.stdout: "req_symlink_latency": { 2024-05-08T23:18:13.444 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.444 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.444 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.444 INFO:teuthology.orchestra.run.smithi179.stdout: "req_unlink_latency": { 2024-05-08T23:18:13.444 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.444 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.444 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.444 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_revoke_eviction": 0, 2024-05-08T23:18:13.444 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_acquisition_throttle": 0, 2024-05-08T23:18:13.444 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getvxattr_latency": { 2024-05-08T23:18:13.445 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.445 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.445 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.445 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:13.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.445 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_sessions": { 2024-05-08T23:18:13.445 INFO:teuthology.orchestra.run.smithi179.stdout: "session_count": 0, 2024-05-08T23:18:13.445 INFO:teuthology.orchestra.run.smithi179.stdout: "session_add": 1, 2024-05-08T23:18:13.445 INFO:teuthology.orchestra.run.smithi179.stdout: "session_remove": 1, 2024-05-08T23:18:13.445 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_open": 0, 2024-05-08T23:18:13.445 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_stale": 0, 2024-05-08T23:18:13.445 INFO:teuthology.orchestra.run.smithi179.stdout: "total_load": 1, 2024-05-08T23:18:13.445 INFO:teuthology.orchestra.run.smithi179.stdout: "average_load": 1, 2024-05-08T23:18:13.445 INFO:teuthology.orchestra.run.smithi179.stdout: "avg_session_uptime": 138, 2024-05-08T23:18:13.445 INFO:teuthology.orchestra.run.smithi179.stdout: "mdthresh_evicted": 0 2024-05-08T23:18:13.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.446 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-05-08T23:18:13.446 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 0, 2024-05-08T23:18:13.446 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 0, 2024-05-08T23:18:13.446 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T23:18:13.446 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-05-08T23:18:13.446 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T23:18:13.446 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-05-08T23:18:13.446 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T23:18:13.446 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T23:18:13.446 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T23:18:13.446 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T23:18:13.446 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T23:18:13.447 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-05-08T23:18:13.447 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T23:18:13.447 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T23:18:13.447 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-05-08T23:18:13.447 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-05-08T23:18:13.447 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-05-08T23:18:13.447 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-05-08T23:18:13.447 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T23:18:13.447 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T23:18:13.447 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T23:18:13.447 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T23:18:13.447 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T23:18:13.447 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-05-08T23:18:13.447 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-05-08T23:18:13.447 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-05-08T23:18:13.448 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T23:18:13.448 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T23:18:13.448 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-05-08T23:18:13.448 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-05-08T23:18:13.448 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-05-08T23:18:13.448 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-05-08T23:18:13.448 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T23:18:13.448 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-05-08T23:18:13.448 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T23:18:13.448 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-05-08T23:18:13.448 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 238679, 2024-05-08T23:18:13.448 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 76, 2024-05-08T23:18:13.448 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 0, 2024-05-08T23:18:13.448 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 0, 2024-05-08T23:18:13.448 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-05-08T23:18:13.449 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-05-08T23:18:13.449 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-05-08T23:18:13.449 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-05-08T23:18:13.449 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-05-08T23:18:13.449 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-05-08T23:18:13.449 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 7720, 2024-05-08T23:18:13.449 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 162, 2024-05-08T23:18:13.449 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T23:18:13.449 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-05-08T23:18:13.449 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-05-08T23:18:13.449 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-05-08T23:18:13.449 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 79661, 2024-05-08T23:18:13.449 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 324, 2024-05-08T23:18:13.449 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-05-08T23:18:13.449 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-05-08T23:18:13.450 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-05-08T23:18:13.450 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-05-08T23:18:13.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.450 INFO:teuthology.orchestra.run.smithi179.stdout: "objecter": { 2024-05-08T23:18:13.450 INFO:teuthology.orchestra.run.smithi179.stdout: "op_active": 0, 2024-05-08T23:18:13.450 INFO:teuthology.orchestra.run.smithi179.stdout: "op_laggy": 0, 2024-05-08T23:18:13.450 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send": 38, 2024-05-08T23:18:13.450 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send_bytes": 11286, 2024-05-08T23:18:13.450 INFO:teuthology.orchestra.run.smithi179.stdout: "op_resend": 27, 2024-05-08T23:18:13.450 INFO:teuthology.orchestra.run.smithi179.stdout: "op_reply": 38, 2024-05-08T23:18:13.450 INFO:teuthology.orchestra.run.smithi179.stdout: "op_latency": { 2024-05-08T23:18:13.450 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 38, 2024-05-08T23:18:13.450 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.261994291, 2024-05-08T23:18:13.450 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.006894586 2024-05-08T23:18:13.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.451 INFO:teuthology.orchestra.run.smithi179.stdout: "op_inflight": 0, 2024-05-08T23:18:13.451 INFO:teuthology.orchestra.run.smithi179.stdout: "oplen_avg": { 2024-05-08T23:18:13.451 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 38, 2024-05-08T23:18:13.451 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 60 2024-05-08T23:18:13.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.451 INFO:teuthology.orchestra.run.smithi179.stdout: "op": 38, 2024-05-08T23:18:13.451 INFO:teuthology.orchestra.run.smithi179.stdout: "op_r": 0, 2024-05-08T23:18:13.451 INFO:teuthology.orchestra.run.smithi179.stdout: "op_w": 38, 2024-05-08T23:18:13.451 INFO:teuthology.orchestra.run.smithi179.stdout: "op_rmw": 0, 2024-05-08T23:18:13.451 INFO:teuthology.orchestra.run.smithi179.stdout: "op_pg": 0, 2024-05-08T23:18:13.451 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_stat": 0, 2024-05-08T23:18:13.451 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_create": 10, 2024-05-08T23:18:13.451 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_read": 0, 2024-05-08T23:18:13.451 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_write": 3, 2024-05-08T23:18:13.452 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writefull": 6, 2024-05-08T23:18:13.452 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writesame": 0, 2024-05-08T23:18:13.452 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_append": 0, 2024-05-08T23:18:13.452 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_zero": 0, 2024-05-08T23:18:13.452 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_truncate": 0, 2024-05-08T23:18:13.452 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_delete": 6, 2024-05-08T23:18:13.452 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_mapext": 0, 2024-05-08T23:18:13.452 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_sparse_read": 0, 2024-05-08T23:18:13.452 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_clonerange": 0, 2024-05-08T23:18:13.452 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_getxattr": 0, 2024-05-08T23:18:13.452 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_setxattr": 20, 2024-05-08T23:18:13.452 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_cmpxattr": 0, 2024-05-08T23:18:13.452 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_rmxattr": 0, 2024-05-08T23:18:13.452 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_resetxattrs": 0, 2024-05-08T23:18:13.452 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_call": 0, 2024-05-08T23:18:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_watch": 0, 2024-05-08T23:18:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_notify": 0, 2024-05-08T23:18:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T23:18:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls": 0, 2024-05-08T23:18:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls_filter": 0, 2024-05-08T23:18:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_other": 0, 2024-05-08T23:18:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_active": 0, 2024-05-08T23:18:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_send": 0, 2024-05-08T23:18:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_resend": 0, 2024-05-08T23:18:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_ping": 0, 2024-05-08T23:18:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_active": 0, 2024-05-08T23:18:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_send": 0, 2024-05-08T23:18:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_resend": 0, 2024-05-08T23:18:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_active": 0, 2024-05-08T23:18:13.453 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_send": 0, 2024-05-08T23:18:13.454 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_resend": 0, 2024-05-08T23:18:13.454 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_active": 0, 2024-05-08T23:18:13.454 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_send": 0, 2024-05-08T23:18:13.454 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_resend": 0, 2024-05-08T23:18:13.454 INFO:teuthology.orchestra.run.smithi179.stdout: "command_active": 0, 2024-05-08T23:18:13.454 INFO:teuthology.orchestra.run.smithi179.stdout: "command_send": 0, 2024-05-08T23:18:13.454 INFO:teuthology.orchestra.run.smithi179.stdout: "command_resend": 0, 2024-05-08T23:18:13.454 INFO:teuthology.orchestra.run.smithi179.stdout: "map_epoch": 85, 2024-05-08T23:18:13.454 INFO:teuthology.orchestra.run.smithi179.stdout: "map_full": 0, 2024-05-08T23:18:13.454 INFO:teuthology.orchestra.run.smithi179.stdout: "map_inc": 2, 2024-05-08T23:18:13.454 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_sessions": 9, 2024-05-08T23:18:13.454 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_open": 9, 2024-05-08T23:18:13.454 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_close": 0, 2024-05-08T23:18:13.454 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_laggy": 0, 2024-05-08T23:18:13.454 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_wr": 14, 2024-05-08T23:18:13.455 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_rd": 0, 2024-05-08T23:18:13.455 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_del": 1 2024-05-08T23:18:13.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.455 INFO:teuthology.orchestra.run.smithi179.stdout: "oft": { 2024-05-08T23:18:13.455 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_objs": 1, 2024-05-08T23:18:13.455 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_kv_pairs": 0, 2024-05-08T23:18:13.455 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_updates": 0, 2024-05-08T23:18:13.455 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_removes": 0 2024-05-08T23:18:13.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.455 INFO:teuthology.orchestra.run.smithi179.stdout: "osd-slow-ops": { 2024-05-08T23:18:13.455 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_ops_count": 0 2024-05-08T23:18:13.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.455 INFO:teuthology.orchestra.run.smithi179.stdout: "purge_queue": { 2024-05-08T23:18:13.455 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops": 0, 2024-05-08T23:18:13.455 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T23:18:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing": 0, 2024-05-08T23:18:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_high_water": 0, 2024-05-08T23:18:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed": 0, 2024-05-08T23:18:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_item_in_journal": 0 2024-05-08T23:18:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T23:18:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-05-08T23:18:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 367, 2024-05-08T23:18:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 528620, 2024-05-08T23:18:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 367, 2024-05-08T23:18:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-05-08T23:18:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-05-08T23:18:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 367, 2024-05-08T23:18:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 528620, 2024-05-08T23:18:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_bytes": { 2024-05-08T23:18:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-05-08T23:18:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-05-08T23:18:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-05-08T23:18:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 38, 2024-05-08T23:18:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 11286, 2024-05-08T23:18:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 38, 2024-05-08T23:18:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 11286, 2024-05-08T23:18:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_ops": { 2024-05-08T23:18:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 1024, 2024-05-08T23:18:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-05-08T23:18:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-05-08T23:18:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 38, 2024-05-08T23:18:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 38, 2024-05-08T23:18:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 38, 2024-05-08T23:18:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 38, 2024-05-08T23:18:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle": { 2024-05-08T23:18:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-05-08T23:18:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-05-08T23:18:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-05-08T23:18:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-05-08T23:18:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-05-08T23:18:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-05-08T23:18:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-05-08T23:18:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle-0x55d7a262a0a0": { 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 3, 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 1074, 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 3, 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 3, 2024-05-08T23:18:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 1074, 2024-05-08T23:18:13.462 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:13.462 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:13.462 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:13.462 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:13.462 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:13.462 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:13.462 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-05-08T23:18:13.790 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-05-08T23:18:13.790 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-05-08T23:18:13.790 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=0 2024-05-08T23:18:13.790 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=9 2024-05-08T23:18:13.791 DEBUG:tasks.check_counter:Getting stats from e 2024-05-08T23:18:13.791 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-08T23:18:14.016 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:18:14.447 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:14 smithi179 ceph-mon[46314]: pgmap v341: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 MiB/s wr, 28 op/s 2024-05-08T23:18:14.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:14 smithi135 ceph-mon[42440]: pgmap v341: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 MiB/s wr, 28 op/s 2024-05-08T23:18:14.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:14 smithi195 ceph-mon[46516]: pgmap v341: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 MiB/s wr, 28 op/s 2024-05-08T23:18:15.007 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-05-08T23:18:15.007 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T23:18:15.007 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 88, 2024-05-08T23:18:15.007 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 79, 2024-05-08T23:18:15.007 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 476114, 2024-05-08T23:18:15.007 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 40877, 2024-05-08T23:18:15.008 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 5, 2024-05-08T23:18:15.008 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 1, 2024-05-08T23:18:15.008 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.016050470, 2024-05-08T23:18:15.008 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.004425895, 2024-05-08T23:18:15.008 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.011680393, 2024-05-08T23:18:15.008 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.001753286, 2024-05-08T23:18:15.008 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:15.008 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 78, 2024-05-08T23:18:15.008 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.005712171, 2024-05-08T23:18:15.008 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000073232 2024-05-08T23:18:15.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.008 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:15.008 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.008 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.009 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.009 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.009 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 475280, 2024-05-08T23:18:15.009 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 40560 2024-05-08T23:18:15.009 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.009 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T23:18:15.009 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 168, 2024-05-08T23:18:15.009 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 219, 2024-05-08T23:18:15.009 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 43320, 2024-05-08T23:18:15.009 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 217898, 2024-05-08T23:18:15.010 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 5, 2024-05-08T23:18:15.010 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 4, 2024-05-08T23:18:15.010 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.020340990, 2024-05-08T23:18:15.010 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.006887661, 2024-05-08T23:18:15.010 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.005490559, 2024-05-08T23:18:15.010 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.005720291, 2024-05-08T23:18:15.010 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:15.010 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 218, 2024-05-08T23:18:15.010 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.012914334, 2024-05-08T23:18:15.010 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000059240 2024-05-08T23:18:15.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.010 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:15.010 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.011 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.011 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.011 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-05-08T23:18:15.011 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 167200 2024-05-08T23:18:15.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.011 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T23:18:15.011 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 464, 2024-05-08T23:18:15.011 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 466, 2024-05-08T23:18:15.011 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 139905, 2024-05-08T23:18:15.011 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 144362, 2024-05-08T23:18:15.011 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 4, 2024-05-08T23:18:15.011 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 3, 2024-05-08T23:18:15.011 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.046907441, 2024-05-08T23:18:15.011 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.016400911, 2024-05-08T23:18:15.012 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.011982123, 2024-05-08T23:18:15.012 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.013803925, 2024-05-08T23:18:15.012 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:15.012 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 464, 2024-05-08T23:18:15.012 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.021577627, 2024-05-08T23:18:15.012 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000046503 2024-05-08T23:18:15.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.012 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:15.012 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.012 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.012 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.012 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T23:18:15.012 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T23:18:15.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.013 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-05-08T23:18:15.013 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 1, 2024-05-08T23:18:15.013 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-05-08T23:18:15.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.013 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-MDSRank": { 2024-05-08T23:18:15.013 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-05-08T23:18:15.013 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-05-08T23:18:15.013 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1073, 2024-05-08T23:18:15.013 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.028191841, 2024-05-08T23:18:15.013 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000026273 2024-05-08T23:18:15.013 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:15.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.013 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-PurgeQueue": { 2024-05-08T23:18:15.013 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-05-08T23:18:15.014 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-05-08T23:18:15.014 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.014 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.014 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.014 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:15.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.014 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": { 2024-05-08T23:18:15.014 INFO:teuthology.orchestra.run.smithi179.stdout: "request": 0, 2024-05-08T23:18:15.014 INFO:teuthology.orchestra.run.smithi179.stdout: "reply": 0, 2024-05-08T23:18:15.014 INFO:teuthology.orchestra.run.smithi179.stdout: "reply_latency": { 2024-05-08T23:18:15.014 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.014 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.014 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.015 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_reply": 0, 2024-05-08T23:18:15.015 INFO:teuthology.orchestra.run.smithi179.stdout: "forward": 0, 2024-05-08T23:18:15.015 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_complete": 0, 2024-05-08T23:18:15.015 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_keys": 0, 2024-05-08T23:18:15.015 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_commit": 0, 2024-05-08T23:18:15.015 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_split": 0, 2024-05-08T23:18:15.015 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_merge": 0, 2024-05-08T23:18:15.015 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes": 0, 2024-05-08T23:18:15.015 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_top": 0, 2024-05-08T23:18:15.015 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_bottom": 0, 2024-05-08T23:18:15.015 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pin_tail": 0, 2024-05-08T23:18:15.015 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pinned": 0, 2024-05-08T23:18:15.015 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_expired": 0, 2024-05-08T23:18:15.015 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_with_caps": 0, 2024-05-08T23:18:15.015 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": 0, 2024-05-08T23:18:15.016 INFO:teuthology.orchestra.run.smithi179.stdout: "subtrees": 1, 2024-05-08T23:18:15.016 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse": 0, 2024-05-08T23:18:15.016 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_hit": 0, 2024-05-08T23:18:15.016 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_forward": 0, 2024-05-08T23:18:15.016 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_discover": 0, 2024-05-08T23:18:15.016 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_dir_fetch": 0, 2024-05-08T23:18:15.016 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_remote_ino": 0, 2024-05-08T23:18:15.016 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_lock": 0, 2024-05-08T23:18:15.016 INFO:teuthology.orchestra.run.smithi179.stdout: "load_cent": 0, 2024-05-08T23:18:15.016 INFO:teuthology.orchestra.run.smithi179.stdout: "q": 0, 2024-05-08T23:18:15.016 INFO:teuthology.orchestra.run.smithi179.stdout: "exported": 0, 2024-05-08T23:18:15.016 INFO:teuthology.orchestra.run.smithi179.stdout: "exported_inodes": 0, 2024-05-08T23:18:15.016 INFO:teuthology.orchestra.run.smithi179.stdout: "imported": 0, 2024-05-08T23:18:15.016 INFO:teuthology.orchestra.run.smithi179.stdout: "imported_inodes": 0, 2024-05-08T23:18:15.017 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_dir_fetch": 0, 2024-05-08T23:18:15.017 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_backtrace_fetch": 0, 2024-05-08T23:18:15.017 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_peer_discover": 0, 2024-05-08T23:18:15.017 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rfiles": 0, 2024-05-08T23:18:15.017 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rbytes": 0, 2024-05-08T23:18:15.017 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rsnaps": 0, 2024-05-08T23:18:15.017 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T23:18:15.017 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_set_tag": 0, 2024-05-08T23:18:15.017 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T23:18:15.017 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_inotable_repaired": 0, 2024-05-08T23:18:15.017 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_inodes": 0, 2024-05-08T23:18:15.017 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T23:18:15.017 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T23:18:15.017 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_file_inodes": 0, 2024-05-08T23:18:15.017 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_inode_file_caps": 0, 2024-05-08T23:18:15.018 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T23:18:15.018 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_grant": 0, 2024-05-08T23:18:15.018 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T23:18:15.018 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T23:18:15.018 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T23:18:15.018 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps": 0, 2024-05-08T23:18:15.018 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps_dirty": 0, 2024-05-08T23:18:15.018 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_cap_release": 0, 2024-05-08T23:18:15.018 INFO:teuthology.orchestra.run.smithi179.stdout: "process_request_cap_release": 0 2024-05-08T23:18:15.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.018 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_cache": { 2024-05-08T23:18:15.018 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update": 0, 2024-05-08T23:18:15.018 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update_receipt": 0, 2024-05-08T23:18:15.018 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_try_discover": 0, 2024-05-08T23:18:15.018 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_send_discover": 0, 2024-05-08T23:18:15.019 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_handle_discover": 0, 2024-05-08T23:18:15.019 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays": 0, 2024-05-08T23:18:15.019 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_delayed": 0, 2024-05-08T23:18:15.019 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_enqueuing": 0, 2024-05-08T23:18:15.019 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_created": 0, 2024-05-08T23:18:15.019 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_enqueued": 0, 2024-05-08T23:18:15.019 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_reintegrated": 0, 2024-05-08T23:18:15.019 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_migrated": 0, 2024-05-08T23:18:15.019 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_processing": 0, 2024-05-08T23:18:15.019 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_enqueued": 0, 2024-05-08T23:18:15.020 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_prioritized": 0, 2024-05-08T23:18:15.020 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_started": 0, 2024-05-08T23:18:15.020 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_completed": 0, 2024-05-08T23:18:15.020 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T23:18:15.020 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_exportdir": 0, 2024-05-08T23:18:15.020 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_flush": 0, 2024-05-08T23:18:15.020 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragmentdir": 0, 2024-05-08T23:18:15.020 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragstats": 0, 2024-05-08T23:18:15.020 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_inodestats": 0 2024-05-08T23:18:15.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.020 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_log": { 2024-05-08T23:18:15.020 INFO:teuthology.orchestra.run.smithi179.stdout: "evadd": 0, 2024-05-08T23:18:15.020 INFO:teuthology.orchestra.run.smithi179.stdout: "evex": 0, 2024-05-08T23:18:15.020 INFO:teuthology.orchestra.run.smithi179.stdout: "evtrm": 0, 2024-05-08T23:18:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: "ev": 4, 2024-05-08T23:18:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: "evexg": 0, 2024-05-08T23:18:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: "evexd": 0, 2024-05-08T23:18:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: "segadd": 0, 2024-05-08T23:18:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: "segex": 0, 2024-05-08T23:18:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: "segtrm": 0, 2024-05-08T23:18:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: "seg": 1, 2024-05-08T23:18:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: "segexg": 0, 2024-05-08T23:18:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: "segexd": 0, 2024-05-08T23:18:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: "expos": 4194304, 2024-05-08T23:18:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: "wrpos": 4195692, 2024-05-08T23:18:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: "rdpos": 4195551, 2024-05-08T23:18:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: "jlat": { 2024-05-08T23:18:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.021 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: "replayed": 4 2024-05-08T23:18:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_mem": { 2024-05-08T23:18:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: "ino": 3, 2024-05-08T23:18:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: "ino+": 3, 2024-05-08T23:18:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: "ino-": 0, 2024-05-08T23:18:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: "dir": 1, 2024-05-08T23:18:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: "dir+": 1, 2024-05-08T23:18:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: "dir-": 0, 2024-05-08T23:18:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: "dn": 0, 2024-05-08T23:18:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: "dn+": 0, 2024-05-08T23:18:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: "dn-": 0, 2024-05-08T23:18:15.022 INFO:teuthology.orchestra.run.smithi179.stdout: "cap": 0, 2024-05-08T23:18:15.023 INFO:teuthology.orchestra.run.smithi179.stdout: "cap+": 0, 2024-05-08T23:18:15.023 INFO:teuthology.orchestra.run.smithi179.stdout: "cap-": 0, 2024-05-08T23:18:15.023 INFO:teuthology.orchestra.run.smithi179.stdout: "rss": 47768, 2024-05-08T23:18:15.023 INFO:teuthology.orchestra.run.smithi179.stdout: "heap": 207156 2024-05-08T23:18:15.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.023 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_server": { 2024-05-08T23:18:15.023 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_client_request": 0, 2024-05-08T23:18:15.023 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_server_request": 0, 2024-05-08T23:18:15.023 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_request": 0, 2024-05-08T23:18:15.023 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_session": 0, 2024-05-08T23:18:15.023 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_peer_request": 0, 2024-05-08T23:18:15.023 INFO:teuthology.orchestra.run.smithi179.stdout: "req_create_latency": { 2024-05-08T23:18:15.023 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.023 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.023 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.024 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getattr_latency": { 2024-05-08T23:18:15.024 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.024 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.024 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.024 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getfilelock_latency": { 2024-05-08T23:18:15.024 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.024 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.024 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.025 INFO:teuthology.orchestra.run.smithi179.stdout: "req_link_latency": { 2024-05-08T23:18:15.025 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.025 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.025 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.025 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookup_latency": { 2024-05-08T23:18:15.025 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.025 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.025 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.025 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookuphash_latency": { 2024-05-08T23:18:15.025 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.025 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.025 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.026 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupino_latency": { 2024-05-08T23:18:15.026 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.026 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.026 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.026 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupname_latency": { 2024-05-08T23:18:15.026 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.026 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.026 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.026 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupparent_latency": { 2024-05-08T23:18:15.026 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.026 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.026 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupsnap_latency": { 2024-05-08T23:18:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lssnap_latency": { 2024-05-08T23:18:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mkdir_latency": { 2024-05-08T23:18:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.028 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mknod_latency": { 2024-05-08T23:18:15.028 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.028 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.028 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.028 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mksnap_latency": { 2024-05-08T23:18:15.028 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.029 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.029 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.029 INFO:teuthology.orchestra.run.smithi179.stdout: "req_open_latency": { 2024-05-08T23:18:15.029 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.029 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.029 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.029 INFO:teuthology.orchestra.run.smithi179.stdout: "req_readdir_latency": { 2024-05-08T23:18:15.029 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.029 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.029 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.029 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rename_latency": { 2024-05-08T23:18:15.030 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.030 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.030 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.030 INFO:teuthology.orchestra.run.smithi179.stdout: "req_renamesnap_latency": { 2024-05-08T23:18:15.030 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.030 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.030 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.030 INFO:teuthology.orchestra.run.smithi179.stdout: "req_snapdiff_latency": { 2024-05-08T23:18:15.030 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.030 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.030 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.031 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmdir_latency": { 2024-05-08T23:18:15.031 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.031 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.031 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.031 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmsnap_latency": { 2024-05-08T23:18:15.031 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.031 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.031 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.031 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmxattr_latency": { 2024-05-08T23:18:15.031 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.031 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.031 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.032 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setattr_latency": { 2024-05-08T23:18:15.032 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.032 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.032 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.032 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setdirlayout_latency": { 2024-05-08T23:18:15.032 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.032 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.032 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.032 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setfilelock_latency": { 2024-05-08T23:18:15.032 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.032 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.032 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.033 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setlayout_latency": { 2024-05-08T23:18:15.033 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.033 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.033 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.033 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setxattr_latency": { 2024-05-08T23:18:15.033 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.033 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.033 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.034 INFO:teuthology.orchestra.run.smithi179.stdout: "req_symlink_latency": { 2024-05-08T23:18:15.034 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.034 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.034 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.034 INFO:teuthology.orchestra.run.smithi179.stdout: "req_unlink_latency": { 2024-05-08T23:18:15.034 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.034 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.034 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.034 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_revoke_eviction": 0, 2024-05-08T23:18:15.034 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_acquisition_throttle": 0, 2024-05-08T23:18:15.034 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getvxattr_latency": { 2024-05-08T23:18:15.034 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.034 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.035 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.035 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:15.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.035 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_sessions": { 2024-05-08T23:18:15.035 INFO:teuthology.orchestra.run.smithi179.stdout: "session_count": 1, 2024-05-08T23:18:15.035 INFO:teuthology.orchestra.run.smithi179.stdout: "session_add": 2, 2024-05-08T23:18:15.035 INFO:teuthology.orchestra.run.smithi179.stdout: "session_remove": 1, 2024-05-08T23:18:15.035 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_open": 2, 2024-05-08T23:18:15.035 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_stale": 0, 2024-05-08T23:18:15.035 INFO:teuthology.orchestra.run.smithi179.stdout: "total_load": 0, 2024-05-08T23:18:15.035 INFO:teuthology.orchestra.run.smithi179.stdout: "average_load": 0, 2024-05-08T23:18:15.035 INFO:teuthology.orchestra.run.smithi179.stdout: "avg_session_uptime": 2865, 2024-05-08T23:18:15.036 INFO:teuthology.orchestra.run.smithi179.stdout: "mdthresh_evicted": 0 2024-05-08T23:18:15.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.036 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-05-08T23:18:15.036 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 0, 2024-05-08T23:18:15.036 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 0, 2024-05-08T23:18:15.036 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T23:18:15.036 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-05-08T23:18:15.036 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T23:18:15.036 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-05-08T23:18:15.036 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T23:18:15.036 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T23:18:15.036 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T23:18:15.036 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T23:18:15.036 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T23:18:15.036 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-05-08T23:18:15.037 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T23:18:15.037 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T23:18:15.037 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-05-08T23:18:15.037 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-05-08T23:18:15.037 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-05-08T23:18:15.037 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-05-08T23:18:15.037 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T23:18:15.037 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T23:18:15.037 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T23:18:15.037 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T23:18:15.037 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T23:18:15.037 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-05-08T23:18:15.037 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-05-08T23:18:15.037 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-05-08T23:18:15.038 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T23:18:15.038 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T23:18:15.038 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-05-08T23:18:15.038 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-05-08T23:18:15.038 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-05-08T23:18:15.038 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-05-08T23:18:15.038 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T23:18:15.038 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-05-08T23:18:15.038 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T23:18:15.038 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-05-08T23:18:15.038 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 189296, 2024-05-08T23:18:15.038 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 50, 2024-05-08T23:18:15.038 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 0, 2024-05-08T23:18:15.038 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 0, 2024-05-08T23:18:15.039 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-05-08T23:18:15.039 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-05-08T23:18:15.039 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-05-08T23:18:15.039 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-05-08T23:18:15.039 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-05-08T23:18:15.039 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-05-08T23:18:15.039 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 7720, 2024-05-08T23:18:15.039 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 162, 2024-05-08T23:18:15.039 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T23:18:15.039 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-05-08T23:18:15.039 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-05-08T23:18:15.039 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-05-08T23:18:15.039 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 8320, 2024-05-08T23:18:15.039 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 13, 2024-05-08T23:18:15.039 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-05-08T23:18:15.040 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-05-08T23:18:15.040 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-05-08T23:18:15.040 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-05-08T23:18:15.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.040 INFO:teuthology.orchestra.run.smithi179.stdout: "objecter": { 2024-05-08T23:18:15.040 INFO:teuthology.orchestra.run.smithi179.stdout: "op_active": 0, 2024-05-08T23:18:15.040 INFO:teuthology.orchestra.run.smithi179.stdout: "op_laggy": 0, 2024-05-08T23:18:15.040 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send": 628, 2024-05-08T23:18:15.040 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send_bytes": 21, 2024-05-08T23:18:15.040 INFO:teuthology.orchestra.run.smithi179.stdout: "op_resend": 3, 2024-05-08T23:18:15.040 INFO:teuthology.orchestra.run.smithi179.stdout: "op_reply": 628, 2024-05-08T23:18:15.040 INFO:teuthology.orchestra.run.smithi179.stdout: "op_latency": { 2024-05-08T23:18:15.040 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 628, 2024-05-08T23:18:15.040 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.344992478, 2024-05-08T23:18:15.040 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000549351 2024-05-08T23:18:15.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.041 INFO:teuthology.orchestra.run.smithi179.stdout: "op_inflight": 0, 2024-05-08T23:18:15.041 INFO:teuthology.orchestra.run.smithi179.stdout: "oplen_avg": { 2024-05-08T23:18:15.041 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 628, 2024-05-08T23:18:15.041 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 629 2024-05-08T23:18:15.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.041 INFO:teuthology.orchestra.run.smithi179.stdout: "op": 628, 2024-05-08T23:18:15.041 INFO:teuthology.orchestra.run.smithi179.stdout: "op_r": 628, 2024-05-08T23:18:15.041 INFO:teuthology.orchestra.run.smithi179.stdout: "op_w": 0, 2024-05-08T23:18:15.041 INFO:teuthology.orchestra.run.smithi179.stdout: "op_rmw": 0, 2024-05-08T23:18:15.041 INFO:teuthology.orchestra.run.smithi179.stdout: "op_pg": 0, 2024-05-08T23:18:15.041 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_stat": 390, 2024-05-08T23:18:15.041 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_create": 0, 2024-05-08T23:18:15.041 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_read": 236, 2024-05-08T23:18:15.042 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_write": 0, 2024-05-08T23:18:15.042 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writefull": 0, 2024-05-08T23:18:15.042 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writesame": 0, 2024-05-08T23:18:15.042 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_append": 0, 2024-05-08T23:18:15.042 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_zero": 0, 2024-05-08T23:18:15.042 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_truncate": 0, 2024-05-08T23:18:15.042 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_delete": 0, 2024-05-08T23:18:15.042 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_mapext": 0, 2024-05-08T23:18:15.042 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_sparse_read": 0, 2024-05-08T23:18:15.042 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_clonerange": 0, 2024-05-08T23:18:15.042 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_getxattr": 1, 2024-05-08T23:18:15.042 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_setxattr": 0, 2024-05-08T23:18:15.042 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_cmpxattr": 0, 2024-05-08T23:18:15.042 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_rmxattr": 0, 2024-05-08T23:18:15.042 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_resetxattrs": 0, 2024-05-08T23:18:15.043 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_call": 0, 2024-05-08T23:18:15.043 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_watch": 0, 2024-05-08T23:18:15.043 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_notify": 0, 2024-05-08T23:18:15.043 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T23:18:15.043 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls": 0, 2024-05-08T23:18:15.043 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls_filter": 0, 2024-05-08T23:18:15.043 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_other": 0, 2024-05-08T23:18:15.043 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_active": 0, 2024-05-08T23:18:15.044 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_send": 0, 2024-05-08T23:18:15.044 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_resend": 0, 2024-05-08T23:18:15.044 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_ping": 0, 2024-05-08T23:18:15.044 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_active": 0, 2024-05-08T23:18:15.044 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_send": 0, 2024-05-08T23:18:15.044 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_resend": 0, 2024-05-08T23:18:15.044 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_active": 0, 2024-05-08T23:18:15.044 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_send": 0, 2024-05-08T23:18:15.044 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_resend": 0, 2024-05-08T23:18:15.044 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_active": 0, 2024-05-08T23:18:15.044 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_send": 0, 2024-05-08T23:18:15.045 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_resend": 0, 2024-05-08T23:18:15.045 INFO:teuthology.orchestra.run.smithi179.stdout: "command_active": 0, 2024-05-08T23:18:15.045 INFO:teuthology.orchestra.run.smithi179.stdout: "command_send": 0, 2024-05-08T23:18:15.045 INFO:teuthology.orchestra.run.smithi179.stdout: "command_resend": 0, 2024-05-08T23:18:15.045 INFO:teuthology.orchestra.run.smithi179.stdout: "map_epoch": 85, 2024-05-08T23:18:15.045 INFO:teuthology.orchestra.run.smithi179.stdout: "map_full": 0, 2024-05-08T23:18:15.045 INFO:teuthology.orchestra.run.smithi179.stdout: "map_inc": 2, 2024-05-08T23:18:15.045 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_sessions": 5, 2024-05-08T23:18:15.045 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_open": 5, 2024-05-08T23:18:15.045 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_close": 0, 2024-05-08T23:18:15.045 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_laggy": 0, 2024-05-08T23:18:15.045 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_wr": 0, 2024-05-08T23:18:15.045 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_rd": 2, 2024-05-08T23:18:15.045 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_del": 0 2024-05-08T23:18:15.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.046 INFO:teuthology.orchestra.run.smithi179.stdout: "oft": { 2024-05-08T23:18:15.046 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_objs": 0, 2024-05-08T23:18:15.046 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_kv_pairs": 0, 2024-05-08T23:18:15.046 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_updates": 0, 2024-05-08T23:18:15.046 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_removes": 0 2024-05-08T23:18:15.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.046 INFO:teuthology.orchestra.run.smithi179.stdout: "osd-slow-ops": { 2024-05-08T23:18:15.046 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_ops_count": 0 2024-05-08T23:18:15.047 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.047 INFO:teuthology.orchestra.run.smithi179.stdout: "purge_queue": { 2024-05-08T23:18:15.047 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops": 0, 2024-05-08T23:18:15.047 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T23:18:15.047 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing": 0, 2024-05-08T23:18:15.047 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_high_water": 0, 2024-05-08T23:18:15.047 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed": 0, 2024-05-08T23:18:15.047 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_item_in_journal": 0 2024-05-08T23:18:15.047 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.047 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T23:18:15.047 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:15.047 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-05-08T23:18:15.047 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:15.047 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 716, 2024-05-08T23:18:15.047 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 587443, 2024-05-08T23:18:15.048 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:15.048 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 716, 2024-05-08T23:18:15.048 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-05-08T23:18:15.048 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-05-08T23:18:15.048 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 716, 2024-05-08T23:18:15.048 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 587443, 2024-05-08T23:18:15.048 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:15.048 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.048 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.048 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.048 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:15.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.048 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_bytes": { 2024-05-08T23:18:15.048 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:15.048 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-05-08T23:18:15.049 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:15.049 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-05-08T23:18:15.049 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-05-08T23:18:15.049 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:15.049 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:15.049 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 628, 2024-05-08T23:18:15.049 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 1393, 2024-05-08T23:18:15.049 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 628, 2024-05-08T23:18:15.049 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 1393, 2024-05-08T23:18:15.049 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:15.049 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.049 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.049 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.049 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:15.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.050 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_ops": { 2024-05-08T23:18:15.050 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:15.050 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 1024, 2024-05-08T23:18:15.050 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:15.050 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-05-08T23:18:15.050 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-05-08T23:18:15.050 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:15.050 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:15.050 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 628, 2024-05-08T23:18:15.050 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 628, 2024-05-08T23:18:15.050 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 628, 2024-05-08T23:18:15.050 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 628, 2024-05-08T23:18:15.050 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:15.050 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.051 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.051 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.051 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:15.051 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.051 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle": { 2024-05-08T23:18:15.051 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:15.051 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-05-08T23:18:15.051 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:15.051 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-05-08T23:18:15.051 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-05-08T23:18:15.051 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:15.051 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:15.051 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-05-08T23:18:15.051 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-05-08T23:18:15.051 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-05-08T23:18:15.052 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-05-08T23:18:15.052 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:15.052 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.052 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.052 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.052 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:15.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:15.052 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle-0x55d47ad125a0": { 2024-05-08T23:18:15.052 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:15.052 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-05-08T23:18:15.052 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:15.052 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-05-08T23:18:15.052 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-05-08T23:18:15.052 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:15.052 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:15.053 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-05-08T23:18:15.053 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-05-08T23:18:15.053 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-05-08T23:18:15.053 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-05-08T23:18:15.053 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:15.053 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:15.053 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:15.053 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:15.053 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:15.053 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:15.053 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-05-08T23:18:15.423 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-05-08T23:18:15.424 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-05-08T23:18:15.424 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-05-08T23:18:15.424 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-05-08T23:18:15.424 DEBUG:tasks.check_counter:Getting stats from h 2024-05-08T23:18:15.424 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-08T23:18:15.647 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:18:16.349 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:16 smithi179 ceph-mon[46314]: pgmap v342: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 21 MiB/s wr, 22 op/s 2024-05-08T23:18:16.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:16 smithi135 ceph-mon[42440]: pgmap v342: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 21 MiB/s wr, 22 op/s 2024-05-08T23:18:16.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:16 smithi195 ceph-mon[46516]: pgmap v342: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 21 MiB/s wr, 22 op/s 2024-05-08T23:18:16.696 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-05-08T23:18:16.696 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T23:18:16.696 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 321, 2024-05-08T23:18:16.696 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 310, 2024-05-08T23:18:16.696 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 555664, 2024-05-08T23:18:16.696 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 112273, 2024-05-08T23:18:16.696 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 5, 2024-05-08T23:18:16.696 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 1, 2024-05-08T23:18:16.696 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.041611731, 2024-05-08T23:18:16.696 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.015280565, 2024-05-08T23:18:16.697 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.016229579, 2024-05-08T23:18:16.697 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.008471924, 2024-05-08T23:18:16.697 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:16.697 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 310, 2024-05-08T23:18:16.697 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.018781507, 2024-05-08T23:18:16.697 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000060585 2024-05-08T23:18:16.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.697 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:16.697 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.697 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.697 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.697 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 478048, 2024-05-08T23:18:16.697 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 40432 2024-05-08T23:18:16.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.698 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T23:18:16.698 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 3, 2024-05-08T23:18:16.698 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 55, 2024-05-08T23:18:16.698 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 716, 2024-05-08T23:18:16.698 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 167260, 2024-05-08T23:18:16.698 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 4, 2024-05-08T23:18:16.698 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 3, 2024-05-08T23:18:16.698 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.004285794, 2024-05-08T23:18:16.698 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.002153029, 2024-05-08T23:18:16.698 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.001339976, 2024-05-08T23:18:16.698 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.000070229, 2024-05-08T23:18:16.698 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:16.698 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 53, 2024-05-08T23:18:16.698 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.003834703, 2024-05-08T23:18:16.699 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000072352 2024-05-08T23:18:16.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.699 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:16.699 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.699 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.699 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.699 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T23:18:16.699 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 166576 2024-05-08T23:18:16.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.699 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T23:18:16.699 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 323, 2024-05-08T23:18:16.699 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 325, 2024-05-08T23:18:16.699 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 84873, 2024-05-08T23:18:16.699 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 100460, 2024-05-08T23:18:16.700 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 4, 2024-05-08T23:18:16.700 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 3, 2024-05-08T23:18:16.700 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.023803217, 2024-05-08T23:18:16.700 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.005342365, 2024-05-08T23:18:16.700 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.007180767, 2024-05-08T23:18:16.700 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.009404129, 2024-05-08T23:18:16.700 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:16.700 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 323, 2024-05-08T23:18:16.700 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.010920502, 2024-05-08T23:18:16.700 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000033809 2024-05-08T23:18:16.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.700 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:16.700 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.700 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.701 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.701 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T23:18:16.701 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T23:18:16.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.702 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-05-08T23:18:16.702 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 1, 2024-05-08T23:18:16.702 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-05-08T23:18:16.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.702 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-MDSRank": { 2024-05-08T23:18:16.702 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-05-08T23:18:16.702 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-05-08T23:18:16.702 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1018, 2024-05-08T23:18:16.702 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.025991395, 2024-05-08T23:18:16.702 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000025531 2024-05-08T23:18:16.702 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:16.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.702 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-PurgeQueue": { 2024-05-08T23:18:16.702 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-05-08T23:18:16.703 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-05-08T23:18:16.703 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.703 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.703 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.703 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:16.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.703 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": { 2024-05-08T23:18:16.703 INFO:teuthology.orchestra.run.smithi179.stdout: "request": 0, 2024-05-08T23:18:16.703 INFO:teuthology.orchestra.run.smithi179.stdout: "reply": 0, 2024-05-08T23:18:16.703 INFO:teuthology.orchestra.run.smithi179.stdout: "reply_latency": { 2024-05-08T23:18:16.703 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.703 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.703 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.703 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_reply": 0, 2024-05-08T23:18:16.704 INFO:teuthology.orchestra.run.smithi179.stdout: "forward": 0, 2024-05-08T23:18:16.704 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_complete": 0, 2024-05-08T23:18:16.704 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_keys": 0, 2024-05-08T23:18:16.704 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_commit": 0, 2024-05-08T23:18:16.704 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_split": 0, 2024-05-08T23:18:16.704 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_merge": 0, 2024-05-08T23:18:16.704 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes": 0, 2024-05-08T23:18:16.704 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_top": 0, 2024-05-08T23:18:16.704 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_bottom": 0, 2024-05-08T23:18:16.704 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pin_tail": 0, 2024-05-08T23:18:16.704 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pinned": 0, 2024-05-08T23:18:16.704 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_expired": 0, 2024-05-08T23:18:16.704 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_with_caps": 0, 2024-05-08T23:18:16.704 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": 0, 2024-05-08T23:18:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: "subtrees": 1, 2024-05-08T23:18:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse": 0, 2024-05-08T23:18:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_hit": 0, 2024-05-08T23:18:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_forward": 0, 2024-05-08T23:18:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_discover": 0, 2024-05-08T23:18:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_dir_fetch": 0, 2024-05-08T23:18:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_remote_ino": 0, 2024-05-08T23:18:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_lock": 0, 2024-05-08T23:18:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: "load_cent": 0, 2024-05-08T23:18:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: "q": 0, 2024-05-08T23:18:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: "exported": 0, 2024-05-08T23:18:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: "exported_inodes": 0, 2024-05-08T23:18:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: "imported": 0, 2024-05-08T23:18:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: "imported_inodes": 0, 2024-05-08T23:18:16.705 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_dir_fetch": 0, 2024-05-08T23:18:16.706 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_backtrace_fetch": 0, 2024-05-08T23:18:16.706 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_peer_discover": 0, 2024-05-08T23:18:16.706 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rfiles": 0, 2024-05-08T23:18:16.706 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rbytes": 0, 2024-05-08T23:18:16.706 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rsnaps": 0, 2024-05-08T23:18:16.706 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T23:18:16.706 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_set_tag": 0, 2024-05-08T23:18:16.706 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T23:18:16.706 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_inotable_repaired": 0, 2024-05-08T23:18:16.706 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_inodes": 0, 2024-05-08T23:18:16.706 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T23:18:16.706 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T23:18:16.706 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_file_inodes": 0, 2024-05-08T23:18:16.706 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_inode_file_caps": 0, 2024-05-08T23:18:16.706 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_grant": 0, 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps": 0, 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps_dirty": 0, 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_cap_release": 0, 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: "process_request_cap_release": 0 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_cache": { 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update": 0, 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update_receipt": 0, 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_try_discover": 0, 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_send_discover": 0, 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_handle_discover": 0, 2024-05-08T23:18:16.707 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays": 0, 2024-05-08T23:18:16.708 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_delayed": 0, 2024-05-08T23:18:16.708 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_enqueuing": 0, 2024-05-08T23:18:16.708 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_created": 0, 2024-05-08T23:18:16.708 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_enqueued": 0, 2024-05-08T23:18:16.708 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_reintegrated": 0, 2024-05-08T23:18:16.708 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_migrated": 0, 2024-05-08T23:18:16.708 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_processing": 0, 2024-05-08T23:18:16.708 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_enqueued": 0, 2024-05-08T23:18:16.708 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_prioritized": 0, 2024-05-08T23:18:16.708 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_started": 0, 2024-05-08T23:18:16.708 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_completed": 0, 2024-05-08T23:18:16.708 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T23:18:16.708 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_exportdir": 0, 2024-05-08T23:18:16.708 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_flush": 0, 2024-05-08T23:18:16.708 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragmentdir": 0, 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragstats": 0, 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_inodestats": 0 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_log": { 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: "evadd": 0, 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: "evex": 0, 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: "evtrm": 0, 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: "ev": 3, 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: "evexg": 0, 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: "evexd": 0, 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: "segadd": 0, 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: "segex": 0, 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: "segtrm": 0, 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: "seg": 1, 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: "segexg": 0, 2024-05-08T23:18:16.709 INFO:teuthology.orchestra.run.smithi179.stdout: "segexd": 0, 2024-05-08T23:18:16.710 INFO:teuthology.orchestra.run.smithi179.stdout: "expos": 4194304, 2024-05-08T23:18:16.710 INFO:teuthology.orchestra.run.smithi179.stdout: "wrpos": 4195378, 2024-05-08T23:18:16.710 INFO:teuthology.orchestra.run.smithi179.stdout: "rdpos": 4195237, 2024-05-08T23:18:16.710 INFO:teuthology.orchestra.run.smithi179.stdout: "jlat": { 2024-05-08T23:18:16.710 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.710 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.710 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.710 INFO:teuthology.orchestra.run.smithi179.stdout: "replayed": 3 2024-05-08T23:18:16.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.710 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_mem": { 2024-05-08T23:18:16.710 INFO:teuthology.orchestra.run.smithi179.stdout: "ino": 3, 2024-05-08T23:18:16.710 INFO:teuthology.orchestra.run.smithi179.stdout: "ino+": 3, 2024-05-08T23:18:16.710 INFO:teuthology.orchestra.run.smithi179.stdout: "ino-": 0, 2024-05-08T23:18:16.710 INFO:teuthology.orchestra.run.smithi179.stdout: "dir": 1, 2024-05-08T23:18:16.711 INFO:teuthology.orchestra.run.smithi179.stdout: "dir+": 1, 2024-05-08T23:18:16.711 INFO:teuthology.orchestra.run.smithi179.stdout: "dir-": 0, 2024-05-08T23:18:16.711 INFO:teuthology.orchestra.run.smithi179.stdout: "dn": 0, 2024-05-08T23:18:16.711 INFO:teuthology.orchestra.run.smithi179.stdout: "dn+": 0, 2024-05-08T23:18:16.711 INFO:teuthology.orchestra.run.smithi179.stdout: "dn-": 0, 2024-05-08T23:18:16.711 INFO:teuthology.orchestra.run.smithi179.stdout: "cap": 0, 2024-05-08T23:18:16.711 INFO:teuthology.orchestra.run.smithi179.stdout: "cap+": 0, 2024-05-08T23:18:16.711 INFO:teuthology.orchestra.run.smithi179.stdout: "cap-": 0, 2024-05-08T23:18:16.711 INFO:teuthology.orchestra.run.smithi179.stdout: "rss": 44804, 2024-05-08T23:18:16.711 INFO:teuthology.orchestra.run.smithi179.stdout: "heap": 207156 2024-05-08T23:18:16.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.712 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_server": { 2024-05-08T23:18:16.712 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_client_request": 0, 2024-05-08T23:18:16.712 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_server_request": 0, 2024-05-08T23:18:16.712 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_request": 0, 2024-05-08T23:18:16.712 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_session": 0, 2024-05-08T23:18:16.712 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_peer_request": 0, 2024-05-08T23:18:16.712 INFO:teuthology.orchestra.run.smithi179.stdout: "req_create_latency": { 2024-05-08T23:18:16.712 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.712 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.712 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.712 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getattr_latency": { 2024-05-08T23:18:16.713 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.713 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.713 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.713 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getfilelock_latency": { 2024-05-08T23:18:16.713 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.713 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.713 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.713 INFO:teuthology.orchestra.run.smithi179.stdout: "req_link_latency": { 2024-05-08T23:18:16.713 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.713 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.713 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.713 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookup_latency": { 2024-05-08T23:18:16.714 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.714 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.714 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.714 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookuphash_latency": { 2024-05-08T23:18:16.714 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.714 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.714 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.714 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupino_latency": { 2024-05-08T23:18:16.714 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.714 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.714 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupname_latency": { 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupparent_latency": { 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupsnap_latency": { 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.715 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lssnap_latency": { 2024-05-08T23:18:16.716 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.716 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.716 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.716 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mkdir_latency": { 2024-05-08T23:18:16.716 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.716 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.716 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.716 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mknod_latency": { 2024-05-08T23:18:16.716 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.716 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.716 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.716 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mksnap_latency": { 2024-05-08T23:18:16.717 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.717 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.717 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.717 INFO:teuthology.orchestra.run.smithi179.stdout: "req_open_latency": { 2024-05-08T23:18:16.717 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.717 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.717 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.717 INFO:teuthology.orchestra.run.smithi179.stdout: "req_readdir_latency": { 2024-05-08T23:18:16.717 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.717 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.717 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.717 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rename_latency": { 2024-05-08T23:18:16.718 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.718 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.718 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.718 INFO:teuthology.orchestra.run.smithi179.stdout: "req_renamesnap_latency": { 2024-05-08T23:18:16.718 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.718 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.718 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.718 INFO:teuthology.orchestra.run.smithi179.stdout: "req_snapdiff_latency": { 2024-05-08T23:18:16.718 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.718 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.718 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.718 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmdir_latency": { 2024-05-08T23:18:16.719 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.719 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.719 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.719 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmsnap_latency": { 2024-05-08T23:18:16.719 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.719 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.719 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.719 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmxattr_latency": { 2024-05-08T23:18:16.719 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.719 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.719 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.719 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setattr_latency": { 2024-05-08T23:18:16.720 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.720 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.720 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.720 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setdirlayout_latency": { 2024-05-08T23:18:16.720 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.720 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.720 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.720 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setfilelock_latency": { 2024-05-08T23:18:16.720 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.720 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.720 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.720 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setlayout_latency": { 2024-05-08T23:18:16.721 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.721 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.721 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.721 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setxattr_latency": { 2024-05-08T23:18:16.721 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.721 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.721 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.721 INFO:teuthology.orchestra.run.smithi179.stdout: "req_symlink_latency": { 2024-05-08T23:18:16.721 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.721 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.721 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.721 INFO:teuthology.orchestra.run.smithi179.stdout: "req_unlink_latency": { 2024-05-08T23:18:16.722 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.722 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.722 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.722 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_revoke_eviction": 0, 2024-05-08T23:18:16.722 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_acquisition_throttle": 0, 2024-05-08T23:18:16.722 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getvxattr_latency": { 2024-05-08T23:18:16.722 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.722 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.722 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.722 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:16.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.722 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_sessions": { 2024-05-08T23:18:16.722 INFO:teuthology.orchestra.run.smithi179.stdout: "session_count": 0, 2024-05-08T23:18:16.723 INFO:teuthology.orchestra.run.smithi179.stdout: "session_add": 1, 2024-05-08T23:18:16.723 INFO:teuthology.orchestra.run.smithi179.stdout: "session_remove": 1, 2024-05-08T23:18:16.723 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_open": 1, 2024-05-08T23:18:16.723 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_stale": 0, 2024-05-08T23:18:16.723 INFO:teuthology.orchestra.run.smithi179.stdout: "total_load": 0, 2024-05-08T23:18:16.723 INFO:teuthology.orchestra.run.smithi179.stdout: "average_load": 0, 2024-05-08T23:18:16.723 INFO:teuthology.orchestra.run.smithi179.stdout: "avg_session_uptime": 1460, 2024-05-08T23:18:16.723 INFO:teuthology.orchestra.run.smithi179.stdout: "mdthresh_evicted": 0 2024-05-08T23:18:16.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.723 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-05-08T23:18:16.723 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 0, 2024-05-08T23:18:16.723 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 0, 2024-05-08T23:18:16.723 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T23:18:16.723 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-05-08T23:18:16.723 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T23:18:16.724 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-05-08T23:18:16.724 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T23:18:16.724 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T23:18:16.724 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T23:18:16.724 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T23:18:16.724 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T23:18:16.724 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-05-08T23:18:16.724 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T23:18:16.724 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T23:18:16.724 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-05-08T23:18:16.724 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-05-08T23:18:16.724 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-05-08T23:18:16.724 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-05-08T23:18:16.724 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T23:18:16.724 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T23:18:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-05-08T23:18:16.726 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 181159, 2024-05-08T23:18:16.726 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 44, 2024-05-08T23:18:16.726 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 0, 2024-05-08T23:18:16.726 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 0, 2024-05-08T23:18:16.726 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-05-08T23:18:16.726 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-05-08T23:18:16.726 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-05-08T23:18:16.726 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-05-08T23:18:16.726 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-05-08T23:18:16.726 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-05-08T23:18:16.726 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 7720, 2024-05-08T23:18:16.726 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 162, 2024-05-08T23:18:16.726 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T23:18:16.726 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-05-08T23:18:16.726 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-05-08T23:18:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-05-08T23:18:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 8320, 2024-05-08T23:18:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 13, 2024-05-08T23:18:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-05-08T23:18:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-05-08T23:18:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-05-08T23:18:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-05-08T23:18:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: "objecter": { 2024-05-08T23:18:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: "op_active": 0, 2024-05-08T23:18:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: "op_laggy": 0, 2024-05-08T23:18:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send": 556, 2024-05-08T23:18:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send_bytes": 21, 2024-05-08T23:18:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: "op_resend": 3, 2024-05-08T23:18:16.727 INFO:teuthology.orchestra.run.smithi179.stdout: "op_reply": 556, 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: "op_latency": { 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 556, 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.295993544, 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000532362 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: "op_inflight": 0, 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: "oplen_avg": { 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 556, 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 557 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: "op": 556, 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: "op_r": 556, 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: "op_w": 0, 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: "op_rmw": 0, 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: "op_pg": 0, 2024-05-08T23:18:16.728 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_stat": 317, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_create": 0, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_read": 237, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_write": 0, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writefull": 0, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writesame": 0, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_append": 0, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_zero": 0, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_truncate": 0, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_delete": 0, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_mapext": 0, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_sparse_read": 0, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_clonerange": 0, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_getxattr": 1, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_setxattr": 0, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_cmpxattr": 0, 2024-05-08T23:18:16.729 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_rmxattr": 0, 2024-05-08T23:18:16.730 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_resetxattrs": 0, 2024-05-08T23:18:16.730 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_call": 0, 2024-05-08T23:18:16.730 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_watch": 0, 2024-05-08T23:18:16.730 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_notify": 0, 2024-05-08T23:18:16.730 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T23:18:16.730 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls": 0, 2024-05-08T23:18:16.730 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls_filter": 0, 2024-05-08T23:18:16.730 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_other": 0, 2024-05-08T23:18:16.730 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_active": 0, 2024-05-08T23:18:16.730 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_send": 0, 2024-05-08T23:18:16.731 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_resend": 0, 2024-05-08T23:18:16.731 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_ping": 0, 2024-05-08T23:18:16.731 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_active": 0, 2024-05-08T23:18:16.731 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_send": 0, 2024-05-08T23:18:16.731 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_resend": 0, 2024-05-08T23:18:16.731 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_active": 0, 2024-05-08T23:18:16.731 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_send": 0, 2024-05-08T23:18:16.731 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_resend": 0, 2024-05-08T23:18:16.731 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_active": 0, 2024-05-08T23:18:16.731 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_send": 0, 2024-05-08T23:18:16.731 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_resend": 0, 2024-05-08T23:18:16.731 INFO:teuthology.orchestra.run.smithi179.stdout: "command_active": 0, 2024-05-08T23:18:16.731 INFO:teuthology.orchestra.run.smithi179.stdout: "command_send": 0, 2024-05-08T23:18:16.731 INFO:teuthology.orchestra.run.smithi179.stdout: "command_resend": 0, 2024-05-08T23:18:16.731 INFO:teuthology.orchestra.run.smithi179.stdout: "map_epoch": 85, 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: "map_full": 0, 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: "map_inc": 2, 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_sessions": 4, 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_open": 4, 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_close": 0, 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_laggy": 0, 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_wr": 0, 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_rd": 2, 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_del": 0 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: "oft": { 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_objs": 0, 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_kv_pairs": 0, 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_updates": 0, 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_removes": 0 2024-05-08T23:18:16.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.733 INFO:teuthology.orchestra.run.smithi179.stdout: "osd-slow-ops": { 2024-05-08T23:18:16.733 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_ops_count": 0 2024-05-08T23:18:16.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.733 INFO:teuthology.orchestra.run.smithi179.stdout: "purge_queue": { 2024-05-08T23:18:16.733 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops": 0, 2024-05-08T23:18:16.733 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T23:18:16.733 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing": 0, 2024-05-08T23:18:16.733 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_high_water": 0, 2024-05-08T23:18:16.733 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed": 0, 2024-05-08T23:18:16.733 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_item_in_journal": 0 2024-05-08T23:18:16.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.733 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T23:18:16.733 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:16.733 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-05-08T23:18:16.733 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:16.734 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 643, 2024-05-08T23:18:16.734 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 575979, 2024-05-08T23:18:16.734 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:16.734 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 643, 2024-05-08T23:18:16.734 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-05-08T23:18:16.734 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-05-08T23:18:16.734 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 643, 2024-05-08T23:18:16.734 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 575979, 2024-05-08T23:18:16.734 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:16.734 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.734 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.734 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.734 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:16.734 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.734 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_bytes": { 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 556, 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 1079, 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 556, 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 1079, 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.735 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:16.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.736 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_ops": { 2024-05-08T23:18:16.736 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:16.736 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 1024, 2024-05-08T23:18:16.736 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:16.736 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-05-08T23:18:16.736 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-05-08T23:18:16.736 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:16.736 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:16.736 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 556, 2024-05-08T23:18:16.736 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 556, 2024-05-08T23:18:16.736 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 556, 2024-05-08T23:18:16.736 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 556, 2024-05-08T23:18:16.736 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:16.736 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.737 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.737 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.737 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:16.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.737 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle": { 2024-05-08T23:18:16.737 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:16.737 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-05-08T23:18:16.737 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:16.737 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-05-08T23:18:16.737 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-05-08T23:18:16.737 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:16.737 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:16.737 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-05-08T23:18:16.737 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-05-08T23:18:16.738 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-05-08T23:18:16.738 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-05-08T23:18:16.738 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:16.738 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.738 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.738 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.738 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:16.738 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:16.739 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle-0x55c0187d0500": { 2024-05-08T23:18:16.739 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:16.739 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-05-08T23:18:16.739 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:16.739 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-05-08T23:18:16.739 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-05-08T23:18:16.739 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:16.739 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:16.739 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-05-08T23:18:16.739 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-05-08T23:18:16.739 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-05-08T23:18:16.739 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-05-08T23:18:16.740 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:16.740 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:16.740 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:16.740 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:16.740 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:16.740 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:16.740 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-05-08T23:18:17.065 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-05-08T23:18:17.065 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-05-08T23:18:17.065 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-05-08T23:18:17.065 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-05-08T23:18:17.065 DEBUG:tasks.check_counter:Getting stats from k 2024-05-08T23:18:17.065 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-08T23:18:17.290 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:18:17.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:17 smithi135 ceph-mon[42440]: pgmap v343: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 16 MiB/s wr, 21 op/s 2024-05-08T23:18:17.728 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:17 smithi179 ceph-mon[46314]: pgmap v343: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 16 MiB/s wr, 21 op/s 2024-05-08T23:18:17.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:17 smithi195 ceph-mon[46516]: pgmap v343: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 16 MiB/s wr, 21 op/s 2024-05-08T23:18:18.437 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-05-08T23:18:18.437 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T23:18:18.437 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 137, 2024-05-08T23:18:18.437 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 133, 2024-05-08T23:18:18.437 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 472848, 2024-05-08T23:18:18.437 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 93572, 2024-05-08T23:18:18.437 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 12, 2024-05-08T23:18:18.437 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 6, 2024-05-08T23:18:18.438 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.021194215, 2024-05-08T23:18:18.438 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.005421389, 2024-05-08T23:18:18.438 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.015073773, 2024-05-08T23:18:18.438 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.002094026, 2024-05-08T23:18:18.438 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:18.438 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 130, 2024-05-08T23:18:18.438 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.015535619, 2024-05-08T23:18:18.438 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000119504 2024-05-08T23:18:18.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.438 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:18.438 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 11, 2024-05-08T23:18:18.439 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000001198, 2024-05-08T23:18:18.439 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000108 2024-05-08T23:18:18.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.439 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 469072, 2024-05-08T23:18:18.439 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 47888 2024-05-08T23:18:18.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.439 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T23:18:18.439 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 209, 2024-05-08T23:18:18.439 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 238, 2024-05-08T23:18:18.439 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 74737, 2024-05-08T23:18:18.439 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 258197, 2024-05-08T23:18:18.440 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 7, 2024-05-08T23:18:18.440 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 4, 2024-05-08T23:18:18.440 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.024766647, 2024-05-08T23:18:18.440 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.009888812, 2024-05-08T23:18:18.440 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.012831857, 2024-05-08T23:18:18.440 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.001689859, 2024-05-08T23:18:18.440 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:18.440 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 239, 2024-05-08T23:18:18.440 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.023013242, 2024-05-08T23:18:18.440 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000096289 2024-05-08T23:18:18.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.441 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:18.441 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 360, 2024-05-08T23:18:18.441 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000085050, 2024-05-08T23:18:18.441 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000236 2024-05-08T23:18:18.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.441 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-05-08T23:18:18.441 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 167376 2024-05-08T23:18:18.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.441 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T23:18:18.442 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 25, 2024-05-08T23:18:18.442 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 27, 2024-05-08T23:18:18.442 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 6573, 2024-05-08T23:18:18.442 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 11050, 2024-05-08T23:18:18.442 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 7, 2024-05-08T23:18:18.442 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 5, 2024-05-08T23:18:18.442 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.005084124, 2024-05-08T23:18:18.442 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.000888881, 2024-05-08T23:18:18.443 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.003446512, 2024-05-08T23:18:18.443 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.000566740, 2024-05-08T23:18:18.443 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:18.443 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 25, 2024-05-08T23:18:18.443 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.016240113, 2024-05-08T23:18:18.443 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000649604 2024-05-08T23:18:18.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.443 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:18.443 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 9, 2024-05-08T23:18:18.443 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000001862, 2024-05-08T23:18:18.444 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000206 2024-05-08T23:18:18.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.444 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 1216, 2024-05-08T23:18:18.444 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 1712 2024-05-08T23:18:18.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.444 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-05-08T23:18:18.444 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 1, 2024-05-08T23:18:18.444 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-05-08T23:18:18.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.444 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-MDSRank": { 2024-05-08T23:18:18.444 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-05-08T23:18:18.444 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-05-08T23:18:18.445 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 48, 2024-05-08T23:18:18.445 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.001560686, 2024-05-08T23:18:18.445 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000032514 2024-05-08T23:18:18.445 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:18.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.445 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-PurgeQueue": { 2024-05-08T23:18:18.445 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-05-08T23:18:18.446 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-05-08T23:18:18.446 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 2, 2024-05-08T23:18:18.446 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000019196, 2024-05-08T23:18:18.446 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000009598 2024-05-08T23:18:18.446 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:18.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.446 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": { 2024-05-08T23:18:18.446 INFO:teuthology.orchestra.run.smithi179.stdout: "request": 2, 2024-05-08T23:18:18.446 INFO:teuthology.orchestra.run.smithi179.stdout: "reply": 2, 2024-05-08T23:18:18.446 INFO:teuthology.orchestra.run.smithi179.stdout: "reply_latency": { 2024-05-08T23:18:18.446 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 2, 2024-05-08T23:18:18.447 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000225678, 2024-05-08T23:18:18.447 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000112839 2024-05-08T23:18:18.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.447 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_reply": 0, 2024-05-08T23:18:18.447 INFO:teuthology.orchestra.run.smithi179.stdout: "forward": 0, 2024-05-08T23:18:18.447 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_complete": 0, 2024-05-08T23:18:18.447 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_keys": 0, 2024-05-08T23:18:18.447 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_commit": 11, 2024-05-08T23:18:18.447 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_split": 0, 2024-05-08T23:18:18.447 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_merge": 0, 2024-05-08T23:18:18.447 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes": 16, 2024-05-08T23:18:18.447 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_top": 0, 2024-05-08T23:18:18.447 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_bottom": 16, 2024-05-08T23:18:18.447 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pin_tail": 0, 2024-05-08T23:18:18.447 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pinned": 13, 2024-05-08T23:18:18.448 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_expired": 4, 2024-05-08T23:18:18.448 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_with_caps": 2, 2024-05-08T23:18:18.448 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": 2, 2024-05-08T23:18:18.448 INFO:teuthology.orchestra.run.smithi179.stdout: "subtrees": 3, 2024-05-08T23:18:18.448 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse": 6, 2024-05-08T23:18:18.448 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_hit": 3, 2024-05-08T23:18:18.448 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_forward": 0, 2024-05-08T23:18:18.448 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_discover": 3, 2024-05-08T23:18:18.448 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_dir_fetch": 0, 2024-05-08T23:18:18.448 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_remote_ino": 0, 2024-05-08T23:18:18.448 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_lock": 0, 2024-05-08T23:18:18.448 INFO:teuthology.orchestra.run.smithi179.stdout: "load_cent": 0, 2024-05-08T23:18:18.448 INFO:teuthology.orchestra.run.smithi179.stdout: "q": 0, 2024-05-08T23:18:18.448 INFO:teuthology.orchestra.run.smithi179.stdout: "exported": 0, 2024-05-08T23:18:18.449 INFO:teuthology.orchestra.run.smithi179.stdout: "exported_inodes": 0, 2024-05-08T23:18:18.449 INFO:teuthology.orchestra.run.smithi179.stdout: "imported": 0, 2024-05-08T23:18:18.449 INFO:teuthology.orchestra.run.smithi179.stdout: "imported_inodes": 0, 2024-05-08T23:18:18.449 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_dir_fetch": 0, 2024-05-08T23:18:18.449 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_backtrace_fetch": 0, 2024-05-08T23:18:18.449 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_peer_discover": 0, 2024-05-08T23:18:18.449 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rfiles": 8, 2024-05-08T23:18:18.449 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rbytes": 269513722, 2024-05-08T23:18:18.449 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rsnaps": 0, 2024-05-08T23:18:18.449 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T23:18:18.449 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_set_tag": 0, 2024-05-08T23:18:18.450 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T23:18:18.450 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_inotable_repaired": 0, 2024-05-08T23:18:18.450 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_inodes": 0, 2024-05-08T23:18:18.450 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T23:18:18.450 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T23:18:18.450 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_file_inodes": 0, 2024-05-08T23:18:18.450 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_inode_file_caps": 0, 2024-05-08T23:18:18.450 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T23:18:18.450 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_grant": 0, 2024-05-08T23:18:18.450 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T23:18:18.450 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T23:18:18.450 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T23:18:18.450 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps": 0, 2024-05-08T23:18:18.450 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps_dirty": 0, 2024-05-08T23:18:18.451 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_cap_release": 0, 2024-05-08T23:18:18.451 INFO:teuthology.orchestra.run.smithi179.stdout: "process_request_cap_release": 0 2024-05-08T23:18:18.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.451 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_cache": { 2024-05-08T23:18:18.451 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update": 0, 2024-05-08T23:18:18.451 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update_receipt": 9, 2024-05-08T23:18:18.451 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_try_discover": 6, 2024-05-08T23:18:18.451 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_send_discover": 7, 2024-05-08T23:18:18.451 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_handle_discover": 0, 2024-05-08T23:18:18.451 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays": 0, 2024-05-08T23:18:18.451 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_delayed": 0, 2024-05-08T23:18:18.451 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_enqueuing": 0, 2024-05-08T23:18:18.451 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_created": 0, 2024-05-08T23:18:18.451 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_enqueued": 0, 2024-05-08T23:18:18.451 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_reintegrated": 0, 2024-05-08T23:18:18.452 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_migrated": 0, 2024-05-08T23:18:18.452 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_processing": 0, 2024-05-08T23:18:18.452 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_enqueued": 0, 2024-05-08T23:18:18.452 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_prioritized": 0, 2024-05-08T23:18:18.452 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_started": 0, 2024-05-08T23:18:18.452 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_completed": 0, 2024-05-08T23:18:18.452 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T23:18:18.452 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_exportdir": 0, 2024-05-08T23:18:18.452 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_flush": 0, 2024-05-08T23:18:18.452 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragmentdir": 0, 2024-05-08T23:18:18.452 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragstats": 0, 2024-05-08T23:18:18.452 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_inodestats": 0 2024-05-08T23:18:18.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.452 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_log": { 2024-05-08T23:18:18.452 INFO:teuthology.orchestra.run.smithi179.stdout: "evadd": 4, 2024-05-08T23:18:18.453 INFO:teuthology.orchestra.run.smithi179.stdout: "evex": 0, 2024-05-08T23:18:18.453 INFO:teuthology.orchestra.run.smithi179.stdout: "evtrm": 0, 2024-05-08T23:18:18.453 INFO:teuthology.orchestra.run.smithi179.stdout: "ev": 4, 2024-05-08T23:18:18.453 INFO:teuthology.orchestra.run.smithi179.stdout: "evexg": 0, 2024-05-08T23:18:18.453 INFO:teuthology.orchestra.run.smithi179.stdout: "evexd": 0, 2024-05-08T23:18:18.453 INFO:teuthology.orchestra.run.smithi179.stdout: "segadd": 1, 2024-05-08T23:18:18.453 INFO:teuthology.orchestra.run.smithi179.stdout: "segex": 0, 2024-05-08T23:18:18.453 INFO:teuthology.orchestra.run.smithi179.stdout: "segtrm": 0, 2024-05-08T23:18:18.453 INFO:teuthology.orchestra.run.smithi179.stdout: "seg": 1, 2024-05-08T23:18:18.453 INFO:teuthology.orchestra.run.smithi179.stdout: "segexg": 0, 2024-05-08T23:18:18.453 INFO:teuthology.orchestra.run.smithi179.stdout: "segexd": 0, 2024-05-08T23:18:18.453 INFO:teuthology.orchestra.run.smithi179.stdout: "expos": 4194304, 2024-05-08T23:18:18.453 INFO:teuthology.orchestra.run.smithi179.stdout: "wrpos": 4195692, 2024-05-08T23:18:18.453 INFO:teuthology.orchestra.run.smithi179.stdout: "rdpos": 0, 2024-05-08T23:18:18.454 INFO:teuthology.orchestra.run.smithi179.stdout: "jlat": { 2024-05-08T23:18:18.454 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 4, 2024-05-08T23:18:18.454 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.007363861, 2024-05-08T23:18:18.454 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.001840965 2024-05-08T23:18:18.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.454 INFO:teuthology.orchestra.run.smithi179.stdout: "replayed": 0 2024-05-08T23:18:18.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.454 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_mem": { 2024-05-08T23:18:18.454 INFO:teuthology.orchestra.run.smithi179.stdout: "ino": 20, 2024-05-08T23:18:18.454 INFO:teuthology.orchestra.run.smithi179.stdout: "ino+": 22, 2024-05-08T23:18:18.454 INFO:teuthology.orchestra.run.smithi179.stdout: "ino-": 2, 2024-05-08T23:18:18.454 INFO:teuthology.orchestra.run.smithi179.stdout: "dir": 19, 2024-05-08T23:18:18.454 INFO:teuthology.orchestra.run.smithi179.stdout: "dir+": 21, 2024-05-08T23:18:18.454 INFO:teuthology.orchestra.run.smithi179.stdout: "dir-": 2, 2024-05-08T23:18:18.455 INFO:teuthology.orchestra.run.smithi179.stdout: "dn": 16, 2024-05-08T23:18:18.455 INFO:teuthology.orchestra.run.smithi179.stdout: "dn+": 20, 2024-05-08T23:18:18.455 INFO:teuthology.orchestra.run.smithi179.stdout: "dn-": 4, 2024-05-08T23:18:18.455 INFO:teuthology.orchestra.run.smithi179.stdout: "cap": 2, 2024-05-08T23:18:18.455 INFO:teuthology.orchestra.run.smithi179.stdout: "cap+": 2, 2024-05-08T23:18:18.455 INFO:teuthology.orchestra.run.smithi179.stdout: "cap-": 0, 2024-05-08T23:18:18.455 INFO:teuthology.orchestra.run.smithi179.stdout: "rss": 45732, 2024-05-08T23:18:18.455 INFO:teuthology.orchestra.run.smithi179.stdout: "heap": 198964 2024-05-08T23:18:18.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.455 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_server": { 2024-05-08T23:18:18.455 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_client_request": 2, 2024-05-08T23:18:18.455 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_server_request": 0, 2024-05-08T23:18:18.455 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_request": 2, 2024-05-08T23:18:18.455 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_session": 7, 2024-05-08T23:18:18.455 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_peer_request": 0, 2024-05-08T23:18:18.456 INFO:teuthology.orchestra.run.smithi179.stdout: "req_create_latency": { 2024-05-08T23:18:18.456 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.456 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.456 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.456 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getattr_latency": { 2024-05-08T23:18:18.456 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.456 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.456 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.457 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getfilelock_latency": { 2024-05-08T23:18:18.457 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.457 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.457 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.457 INFO:teuthology.orchestra.run.smithi179.stdout: "req_link_latency": { 2024-05-08T23:18:18.457 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.457 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.457 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.457 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookup_latency": { 2024-05-08T23:18:18.457 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.457 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.457 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.458 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookuphash_latency": { 2024-05-08T23:18:18.458 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.458 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.458 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.458 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupino_latency": { 2024-05-08T23:18:18.458 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 2, 2024-05-08T23:18:18.458 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000225678, 2024-05-08T23:18:18.458 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000112839 2024-05-08T23:18:18.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.458 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupname_latency": { 2024-05-08T23:18:18.458 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.458 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.459 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.459 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupparent_latency": { 2024-05-08T23:18:18.459 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.459 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.459 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.459 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupsnap_latency": { 2024-05-08T23:18:18.459 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.459 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.459 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.459 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lssnap_latency": { 2024-05-08T23:18:18.459 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.459 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.460 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.460 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mkdir_latency": { 2024-05-08T23:18:18.460 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.460 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.460 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.460 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mknod_latency": { 2024-05-08T23:18:18.460 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.460 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.460 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.460 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mksnap_latency": { 2024-05-08T23:18:18.460 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.461 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.461 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.461 INFO:teuthology.orchestra.run.smithi179.stdout: "req_open_latency": { 2024-05-08T23:18:18.461 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.461 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.461 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.461 INFO:teuthology.orchestra.run.smithi179.stdout: "req_readdir_latency": { 2024-05-08T23:18:18.461 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.461 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.461 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.461 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rename_latency": { 2024-05-08T23:18:18.461 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.462 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.462 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.462 INFO:teuthology.orchestra.run.smithi179.stdout: "req_renamesnap_latency": { 2024-05-08T23:18:18.462 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.462 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.462 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.462 INFO:teuthology.orchestra.run.smithi179.stdout: "req_snapdiff_latency": { 2024-05-08T23:18:18.462 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.462 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.462 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.462 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmdir_latency": { 2024-05-08T23:18:18.463 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.463 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.463 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.463 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmsnap_latency": { 2024-05-08T23:18:18.463 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.463 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.463 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.463 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmxattr_latency": { 2024-05-08T23:18:18.463 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.463 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.463 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setattr_latency": { 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setdirlayout_latency": { 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setfilelock_latency": { 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.464 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setlayout_latency": { 2024-05-08T23:18:18.465 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.465 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.465 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.465 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setxattr_latency": { 2024-05-08T23:18:18.465 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.465 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.465 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.465 INFO:teuthology.orchestra.run.smithi179.stdout: "req_symlink_latency": { 2024-05-08T23:18:18.465 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.465 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.465 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.465 INFO:teuthology.orchestra.run.smithi179.stdout: "req_unlink_latency": { 2024-05-08T23:18:18.466 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.466 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.466 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.466 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_revoke_eviction": 0, 2024-05-08T23:18:18.466 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_acquisition_throttle": 0, 2024-05-08T23:18:18.466 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getvxattr_latency": { 2024-05-08T23:18:18.467 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.467 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.467 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.467 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:18.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.467 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_sessions": { 2024-05-08T23:18:18.468 INFO:teuthology.orchestra.run.smithi179.stdout: "session_count": 1, 2024-05-08T23:18:18.468 INFO:teuthology.orchestra.run.smithi179.stdout: "session_add": 2, 2024-05-08T23:18:18.468 INFO:teuthology.orchestra.run.smithi179.stdout: "session_remove": 1, 2024-05-08T23:18:18.468 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_open": 1, 2024-05-08T23:18:18.468 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_stale": 0, 2024-05-08T23:18:18.468 INFO:teuthology.orchestra.run.smithi179.stdout: "total_load": 2, 2024-05-08T23:18:18.468 INFO:teuthology.orchestra.run.smithi179.stdout: "average_load": 1, 2024-05-08T23:18:18.468 INFO:teuthology.orchestra.run.smithi179.stdout: "avg_session_uptime": 162, 2024-05-08T23:18:18.468 INFO:teuthology.orchestra.run.smithi179.stdout: "mdthresh_evicted": 0 2024-05-08T23:18:18.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.468 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-05-08T23:18:18.468 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 0, 2024-05-08T23:18:18.468 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 0, 2024-05-08T23:18:18.469 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T23:18:18.469 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-05-08T23:18:18.469 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T23:18:18.469 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-05-08T23:18:18.469 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T23:18:18.469 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T23:18:18.469 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T23:18:18.469 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T23:18:18.470 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T23:18:18.470 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-05-08T23:18:18.470 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T23:18:18.470 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T23:18:18.470 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-05-08T23:18:18.470 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-05-08T23:18:18.470 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-05-08T23:18:18.470 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-05-08T23:18:18.470 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T23:18:18.470 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T23:18:18.471 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T23:18:18.471 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T23:18:18.471 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T23:18:18.471 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-05-08T23:18:18.471 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-05-08T23:18:18.471 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-05-08T23:18:18.472 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T23:18:18.472 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T23:18:18.472 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-05-08T23:18:18.472 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-05-08T23:18:18.472 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-05-08T23:18:18.472 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-05-08T23:18:18.472 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T23:18:18.472 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-05-08T23:18:18.472 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T23:18:18.472 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-05-08T23:18:18.472 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 246583, 2024-05-08T23:18:18.472 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 80, 2024-05-08T23:18:18.472 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 0, 2024-05-08T23:18:18.473 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 0, 2024-05-08T23:18:18.473 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-05-08T23:18:18.473 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-05-08T23:18:18.473 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-05-08T23:18:18.473 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-05-08T23:18:18.473 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-05-08T23:18:18.473 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-05-08T23:18:18.473 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 7720, 2024-05-08T23:18:18.473 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 162, 2024-05-08T23:18:18.473 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T23:18:18.474 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-05-08T23:18:18.474 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-05-08T23:18:18.474 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-05-08T23:18:18.474 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 80373, 2024-05-08T23:18:18.474 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 325, 2024-05-08T23:18:18.474 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-05-08T23:18:18.474 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-05-08T23:18:18.474 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-05-08T23:18:18.474 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-05-08T23:18:18.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.475 INFO:teuthology.orchestra.run.smithi179.stdout: "objecter": { 2024-05-08T23:18:18.475 INFO:teuthology.orchestra.run.smithi179.stdout: "op_active": 0, 2024-05-08T23:18:18.475 INFO:teuthology.orchestra.run.smithi179.stdout: "op_laggy": 0, 2024-05-08T23:18:18.475 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send": 41, 2024-05-08T23:18:18.475 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send_bytes": 11901, 2024-05-08T23:18:18.475 INFO:teuthology.orchestra.run.smithi179.stdout: "op_resend": 33, 2024-05-08T23:18:18.475 INFO:teuthology.orchestra.run.smithi179.stdout: "op_reply": 41, 2024-05-08T23:18:18.475 INFO:teuthology.orchestra.run.smithi179.stdout: "op_latency": { 2024-05-08T23:18:18.475 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 41, 2024-05-08T23:18:18.476 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.226995045, 2024-05-08T23:18:18.476 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.005536464 2024-05-08T23:18:18.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.476 INFO:teuthology.orchestra.run.smithi179.stdout: "op_inflight": 0, 2024-05-08T23:18:18.476 INFO:teuthology.orchestra.run.smithi179.stdout: "oplen_avg": { 2024-05-08T23:18:18.476 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 41, 2024-05-08T23:18:18.476 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 64 2024-05-08T23:18:18.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.476 INFO:teuthology.orchestra.run.smithi179.stdout: "op": 41, 2024-05-08T23:18:18.477 INFO:teuthology.orchestra.run.smithi179.stdout: "op_r": 0, 2024-05-08T23:18:18.477 INFO:teuthology.orchestra.run.smithi179.stdout: "op_w": 41, 2024-05-08T23:18:18.477 INFO:teuthology.orchestra.run.smithi179.stdout: "op_rmw": 0, 2024-05-08T23:18:18.477 INFO:teuthology.orchestra.run.smithi179.stdout: "op_pg": 0, 2024-05-08T23:18:18.477 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_stat": 0, 2024-05-08T23:18:18.477 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_create": 10, 2024-05-08T23:18:18.477 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_read": 0, 2024-05-08T23:18:18.477 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_write": 4, 2024-05-08T23:18:18.478 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writefull": 7, 2024-05-08T23:18:18.478 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writesame": 0, 2024-05-08T23:18:18.478 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_append": 0, 2024-05-08T23:18:18.478 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_zero": 0, 2024-05-08T23:18:18.478 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_truncate": 0, 2024-05-08T23:18:18.478 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_delete": 6, 2024-05-08T23:18:18.478 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_mapext": 0, 2024-05-08T23:18:18.478 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_sparse_read": 0, 2024-05-08T23:18:18.478 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_clonerange": 0, 2024-05-08T23:18:18.478 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_getxattr": 0, 2024-05-08T23:18:18.479 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_setxattr": 20, 2024-05-08T23:18:18.479 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_cmpxattr": 0, 2024-05-08T23:18:18.479 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_rmxattr": 0, 2024-05-08T23:18:18.479 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_resetxattrs": 0, 2024-05-08T23:18:18.479 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_call": 0, 2024-05-08T23:18:18.479 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_watch": 0, 2024-05-08T23:18:18.479 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_notify": 0, 2024-05-08T23:18:18.480 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T23:18:18.480 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls": 0, 2024-05-08T23:18:18.480 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls_filter": 0, 2024-05-08T23:18:18.480 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_other": 0, 2024-05-08T23:18:18.480 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_active": 0, 2024-05-08T23:18:18.480 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_send": 0, 2024-05-08T23:18:18.480 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_resend": 0, 2024-05-08T23:18:18.480 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_ping": 0, 2024-05-08T23:18:18.480 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_active": 0, 2024-05-08T23:18:18.480 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_send": 0, 2024-05-08T23:18:18.480 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_resend": 0, 2024-05-08T23:18:18.480 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_active": 0, 2024-05-08T23:18:18.481 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_send": 0, 2024-05-08T23:18:18.481 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_resend": 0, 2024-05-08T23:18:18.481 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_active": 0, 2024-05-08T23:18:18.481 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_send": 0, 2024-05-08T23:18:18.481 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_resend": 0, 2024-05-08T23:18:18.481 INFO:teuthology.orchestra.run.smithi179.stdout: "command_active": 0, 2024-05-08T23:18:18.481 INFO:teuthology.orchestra.run.smithi179.stdout: "command_send": 0, 2024-05-08T23:18:18.481 INFO:teuthology.orchestra.run.smithi179.stdout: "command_resend": 0, 2024-05-08T23:18:18.481 INFO:teuthology.orchestra.run.smithi179.stdout: "map_epoch": 85, 2024-05-08T23:18:18.481 INFO:teuthology.orchestra.run.smithi179.stdout: "map_full": 0, 2024-05-08T23:18:18.481 INFO:teuthology.orchestra.run.smithi179.stdout: "map_inc": 2, 2024-05-08T23:18:18.481 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_sessions": 9, 2024-05-08T23:18:18.481 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_open": 9, 2024-05-08T23:18:18.481 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_close": 0, 2024-05-08T23:18:18.481 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_laggy": 0, 2024-05-08T23:18:18.482 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_wr": 16, 2024-05-08T23:18:18.482 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_rd": 0, 2024-05-08T23:18:18.482 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_del": 1 2024-05-08T23:18:18.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.482 INFO:teuthology.orchestra.run.smithi179.stdout: "oft": { 2024-05-08T23:18:18.482 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_objs": 1, 2024-05-08T23:18:18.482 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_kv_pairs": 0, 2024-05-08T23:18:18.482 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_updates": 0, 2024-05-08T23:18:18.482 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_removes": 0 2024-05-08T23:18:18.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.483 INFO:teuthology.orchestra.run.smithi179.stdout: "osd-slow-ops": { 2024-05-08T23:18:18.483 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_ops_count": 0 2024-05-08T23:18:18.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.483 INFO:teuthology.orchestra.run.smithi179.stdout: "purge_queue": { 2024-05-08T23:18:18.483 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops": 0, 2024-05-08T23:18:18.483 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T23:18:18.483 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing": 0, 2024-05-08T23:18:18.483 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_high_water": 0, 2024-05-08T23:18:18.483 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed": 0, 2024-05-08T23:18:18.483 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_item_in_journal": 0 2024-05-08T23:18:18.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.483 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T23:18:18.483 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:18.484 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-05-08T23:18:18.484 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:18.484 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 367, 2024-05-08T23:18:18.484 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 511896, 2024-05-08T23:18:18.484 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:18.484 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 367, 2024-05-08T23:18:18.484 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-05-08T23:18:18.484 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-05-08T23:18:18.484 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 367, 2024-05-08T23:18:18.484 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 511896, 2024-05-08T23:18:18.484 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:18.484 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.484 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.485 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.485 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:18.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.485 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_bytes": { 2024-05-08T23:18:18.485 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:18.485 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-05-08T23:18:18.485 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:18.485 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-05-08T23:18:18.485 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-05-08T23:18:18.485 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:18.485 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:18.485 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 41, 2024-05-08T23:18:18.485 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 11901, 2024-05-08T23:18:18.485 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 41, 2024-05-08T23:18:18.485 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 11901, 2024-05-08T23:18:18.486 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:18.486 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.486 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.486 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.486 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:18.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.486 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_ops": { 2024-05-08T23:18:18.486 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:18.486 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 1024, 2024-05-08T23:18:18.486 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:18.486 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-05-08T23:18:18.486 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-05-08T23:18:18.486 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 41, 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 41, 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 41, 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 41, 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle": { 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:18.487 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-05-08T23:18:18.488 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-05-08T23:18:18.488 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:18.488 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:18.488 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-05-08T23:18:18.488 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-05-08T23:18:18.488 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-05-08T23:18:18.488 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-05-08T23:18:18.488 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:18.488 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.488 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.488 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.488 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:18.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-05-08T23:18:18.488 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle-0x55f6bd3ae0a0": { 2024-05-08T23:18:18.488 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 4, 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 1388, 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 4, 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 4, 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 1388, 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:18.489 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-05-08T23:18:18.490 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-05-08T23:18:18.808 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-05-08T23:18:18.808 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-05-08T23:18:18.808 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-05-08T23:18:18.808 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=9 2024-05-08T23:18:18.808 DEBUG:tasks.check_counter:Getting stats from c 2024-05-08T23:18:18.808 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-08T23:18:19.055 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:18:20.163 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-05-08T23:18:20.163 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T23:18:20.163 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 326, 2024-05-08T23:18:20.163 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 294, 2024-05-08T23:18:20.163 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 554125, 2024-05-08T23:18:20.164 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 148288, 2024-05-08T23:18:20.164 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 7, 2024-05-08T23:18:20.164 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 2, 2024-05-08T23:18:20.164 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.039991870, 2024-05-08T23:18:20.164 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.015434432, 2024-05-08T23:18:20.164 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.022841473, 2024-05-08T23:18:20.164 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.003334438, 2024-05-08T23:18:20.164 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:20.164 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 295, 2024-05-08T23:18:20.164 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.024170057, 2024-05-08T23:18:20.164 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000081932 2024-05-08T23:18:20.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.164 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:20.164 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 365, 2024-05-08T23:18:20.164 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000095007, 2024-05-08T23:18:20.165 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000260 2024-05-08T23:18:20.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.165 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 481712, 2024-05-08T23:18:20.165 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 45008 2024-05-08T23:18:20.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.165 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T23:18:20.165 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 27, 2024-05-08T23:18:20.165 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 78, 2024-05-08T23:18:20.165 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 8570, 2024-05-08T23:18:20.165 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 220696, 2024-05-08T23:18:20.165 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 11, 2024-05-08T23:18:20.165 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 7, 2024-05-08T23:18:20.165 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.010225002, 2024-05-08T23:18:20.165 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.003225285, 2024-05-08T23:18:20.166 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.005696117, 2024-05-08T23:18:20.166 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.000381527, 2024-05-08T23:18:20.166 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:20.166 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 77, 2024-05-08T23:18:20.166 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.018457856, 2024-05-08T23:18:20.166 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000239712 2024-05-08T23:18:20.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.166 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:20.166 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 11, 2024-05-08T23:18:20.166 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000002033, 2024-05-08T23:18:20.166 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000184 2024-05-08T23:18:20.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.166 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 4208, 2024-05-08T23:18:20.166 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 169488 2024-05-08T23:18:20.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.167 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T23:18:20.167 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 17, 2024-05-08T23:18:20.167 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 21, 2024-05-08T23:18:20.167 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 4376, 2024-05-08T23:18:20.167 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 6714, 2024-05-08T23:18:20.167 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 7, 2024-05-08T23:18:20.167 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 5, 2024-05-08T23:18:20.167 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.003554063, 2024-05-08T23:18:20.167 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.000338157, 2024-05-08T23:18:20.167 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.002705636, 2024-05-08T23:18:20.167 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.000367950, 2024-05-08T23:18:20.167 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:20.167 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 17, 2024-05-08T23:18:20.168 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.008106844, 2024-05-08T23:18:20.168 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000476873 2024-05-08T23:18:20.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.168 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:20.168 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 9, 2024-05-08T23:18:20.168 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000001758, 2024-05-08T23:18:20.168 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000195 2024-05-08T23:18:20.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.168 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-05-08T23:18:20.168 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 896 2024-05-08T23:18:20.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.168 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2024-05-08T23:18:20.168 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2024-05-08T23:18:20.168 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2024-05-08T23:18:20.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.169 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2024-05-08T23:18:20.169 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-05-08T23:18:20.169 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-05-08T23:18:20.169 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 52, 2024-05-08T23:18:20.169 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.001558815, 2024-05-08T23:18:20.169 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000029977 2024-05-08T23:18:20.169 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:20.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.169 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2024-05-08T23:18:20.169 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-05-08T23:18:20.169 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-05-08T23:18:20.169 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2, 2024-05-08T23:18:20.169 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000005971, 2024-05-08T23:18:20.169 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000002985 2024-05-08T23:18:20.170 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:20.170 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.170 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2024-05-08T23:18:20.170 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 1, 2024-05-08T23:18:20.170 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 0, 2024-05-08T23:18:20.170 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2024-05-08T23:18:20.170 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.170 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.170 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.170 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.170 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2024-05-08T23:18:20.170 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 1, 2024-05-08T23:18:20.170 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 0, 2024-05-08T23:18:20.170 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2024-05-08T23:18:20.171 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 11, 2024-05-08T23:18:20.171 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 0, 2024-05-08T23:18:20.171 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2024-05-08T23:18:20.171 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 16, 2024-05-08T23:18:20.171 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 0, 2024-05-08T23:18:20.171 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 16, 2024-05-08T23:18:20.171 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 0, 2024-05-08T23:18:20.171 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 13, 2024-05-08T23:18:20.171 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 4, 2024-05-08T23:18:20.171 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 0, 2024-05-08T23:18:20.171 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 0, 2024-05-08T23:18:20.172 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 3, 2024-05-08T23:18:20.172 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 8, 2024-05-08T23:18:20.172 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 4, 2024-05-08T23:18:20.172 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 1, 2024-05-08T23:18:20.172 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 3, 2024-05-08T23:18:20.172 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2024-05-08T23:18:20.172 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2024-05-08T23:18:20.172 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 0, 2024-05-08T23:18:20.172 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 0, 2024-05-08T23:18:20.172 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 0, 2024-05-08T23:18:20.172 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 0, 2024-05-08T23:18:20.172 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 0, 2024-05-08T23:18:20.172 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 0, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 0, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 0, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 8, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 269513722, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 0, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 0, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 0, 2024-05-08T23:18:20.173 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 0, 2024-05-08T23:18:20.174 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T23:18:20.174 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 0, 2024-05-08T23:18:20.174 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T23:18:20.174 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T23:18:20.174 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T23:18:20.174 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 0, 2024-05-08T23:18:20.174 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 0, 2024-05-08T23:18:20.174 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 0, 2024-05-08T23:18:20.174 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 0 2024-05-08T23:18:20.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.174 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2024-05-08T23:18:20.174 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 0, 2024-05-08T23:18:20.174 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 11, 2024-05-08T23:18:20.174 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 7, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 8, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 0, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 0, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 0, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 0, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 0, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 0, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T23:18:20.175 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 0, 2024-05-08T23:18:20.176 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2024-05-08T23:18:20.176 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 0, 2024-05-08T23:18:20.176 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2024-05-08T23:18:20.176 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2024-05-08T23:18:20.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.176 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2024-05-08T23:18:20.176 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 4, 2024-05-08T23:18:20.176 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2024-05-08T23:18:20.176 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2024-05-08T23:18:20.176 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 4, 2024-05-08T23:18:20.176 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2024-05-08T23:18:20.176 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2024-05-08T23:18:20.176 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 1, 2024-05-08T23:18:20.176 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2024-05-08T23:18:20.176 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2024-05-08T23:18:20.177 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 1, 2024-05-08T23:18:20.177 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2024-05-08T23:18:20.177 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2024-05-08T23:18:20.177 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2024-05-08T23:18:20.177 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 4195692, 2024-05-08T23:18:20.177 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 0, 2024-05-08T23:18:20.177 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2024-05-08T23:18:20.177 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 4, 2024-05-08T23:18:20.177 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.008251061, 2024-05-08T23:18:20.177 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.002062765 2024-05-08T23:18:20.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.177 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 0 2024-05-08T23:18:20.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.177 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2024-05-08T23:18:20.177 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 20, 2024-05-08T23:18:20.178 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 22, 2024-05-08T23:18:20.178 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 2, 2024-05-08T23:18:20.178 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 19, 2024-05-08T23:18:20.178 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 22, 2024-05-08T23:18:20.178 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 3, 2024-05-08T23:18:20.178 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 16, 2024-05-08T23:18:20.178 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 20, 2024-05-08T23:18:20.178 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 4, 2024-05-08T23:18:20.178 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 0, 2024-05-08T23:18:20.178 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 0, 2024-05-08T23:18:20.178 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 0, 2024-05-08T23:18:20.178 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 47700, 2024-05-08T23:18:20.178 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 198964 2024-05-08T23:18:20.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.178 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2024-05-08T23:18:20.179 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 1, 2024-05-08T23:18:20.179 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 0, 2024-05-08T23:18:20.179 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 1, 2024-05-08T23:18:20.179 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 8, 2024-05-08T23:18:20.179 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 0, 2024-05-08T23:18:20.179 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2024-05-08T23:18:20.179 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.179 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.179 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.179 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2024-05-08T23:18:20.179 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.179 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.179 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.180 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2024-05-08T23:18:20.181 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.181 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.181 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.181 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2024-05-08T23:18:20.181 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.181 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.181 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.181 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2024-05-08T23:18:20.181 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.181 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.181 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.181 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2024-05-08T23:18:20.182 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.182 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.182 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.182 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.182 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2024-05-08T23:18:20.182 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.182 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.182 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.182 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.182 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2024-05-08T23:18:20.182 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.182 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.182 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.182 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.182 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2024-05-08T23:18:20.183 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.183 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.183 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.183 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2024-05-08T23:18:20.183 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.183 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.183 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.183 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2024-05-08T23:18:20.183 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.183 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.183 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.184 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2024-05-08T23:18:20.184 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.184 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.184 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.184 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2024-05-08T23:18:20.184 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.184 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.184 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.184 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2024-05-08T23:18:20.184 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.184 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.184 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.185 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2024-05-08T23:18:20.185 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.185 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.185 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.185 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2024-05-08T23:18:20.185 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.185 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.185 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.185 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2024-05-08T23:18:20.185 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.185 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.185 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.186 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2024-05-08T23:18:20.186 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.186 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.186 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.186 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.186 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2024-05-08T23:18:20.186 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.186 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.186 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.186 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.186 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2024-05-08T23:18:20.186 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.186 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.186 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.187 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2024-05-08T23:18:20.187 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.187 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.187 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.187 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2024-05-08T23:18:20.187 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.187 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.187 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.187 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2024-05-08T23:18:20.187 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.187 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.188 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.188 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2024-05-08T23:18:20.188 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.188 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.188 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.188 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2024-05-08T23:18:20.188 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.188 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.188 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.188 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2024-05-08T23:18:20.188 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.189 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.189 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.189 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2024-05-08T23:18:20.189 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2024-05-08T23:18:20.189 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2024-05-08T23:18:20.189 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.189 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.189 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.189 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:20.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.189 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2024-05-08T23:18:20.189 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 1, 2024-05-08T23:18:20.189 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 2, 2024-05-08T23:18:20.189 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 1, 2024-05-08T23:18:20.190 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 1, 2024-05-08T23:18:20.190 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2024-05-08T23:18:20.190 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 0, 2024-05-08T23:18:20.190 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 0, 2024-05-08T23:18:20.190 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 163, 2024-05-08T23:18:20.190 INFO:teuthology.orchestra.run.smithi195.stdout: "mdthresh_evicted": 0 2024-05-08T23:18:20.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.190 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2024-05-08T23:18:20.190 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2024-05-08T23:18:20.190 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2024-05-08T23:18:20.190 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T23:18:20.190 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2024-05-08T23:18:20.190 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T23:18:20.190 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2024-05-08T23:18:20.191 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T23:18:20.191 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T23:18:20.191 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T23:18:20.191 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T23:18:20.191 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T23:18:20.191 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2024-05-08T23:18:20.191 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T23:18:20.191 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T23:18:20.191 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2024-05-08T23:18:20.191 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2024-05-08T23:18:20.191 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2024-05-08T23:18:20.191 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2024-05-08T23:18:20.191 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T23:18:20.191 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T23:18:20.192 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T23:18:20.192 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T23:18:20.192 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T23:18:20.192 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2024-05-08T23:18:20.192 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2024-05-08T23:18:20.192 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2024-05-08T23:18:20.192 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T23:18:20.192 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T23:18:20.192 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2024-05-08T23:18:20.192 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2024-05-08T23:18:20.192 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2024-05-08T23:18:20.192 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2024-05-08T23:18:20.192 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T23:18:20.192 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2024-05-08T23:18:20.192 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T23:18:20.193 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2024-05-08T23:18:20.193 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 222391, 2024-05-08T23:18:20.193 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 71, 2024-05-08T23:18:20.193 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2024-05-08T23:18:20.193 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2024-05-08T23:18:20.193 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2024-05-08T23:18:20.193 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2024-05-08T23:18:20.193 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2024-05-08T23:18:20.193 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2024-05-08T23:18:20.193 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2024-05-08T23:18:20.193 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2024-05-08T23:18:20.193 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 7720, 2024-05-08T23:18:20.193 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 162, 2024-05-08T23:18:20.193 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T23:18:20.193 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2024-05-08T23:18:20.194 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2024-05-08T23:18:20.194 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2024-05-08T23:18:20.194 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 79661, 2024-05-08T23:18:20.194 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 324, 2024-05-08T23:18:20.194 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2024-05-08T23:18:20.194 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2024-05-08T23:18:20.194 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2024-05-08T23:18:20.194 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2024-05-08T23:18:20.194 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.194 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2024-05-08T23:18:20.194 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2024-05-08T23:18:20.194 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2024-05-08T23:18:20.194 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 40, 2024-05-08T23:18:20.194 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 11690, 2024-05-08T23:18:20.195 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 27, 2024-05-08T23:18:20.195 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 40, 2024-05-08T23:18:20.195 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2024-05-08T23:18:20.195 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 40, 2024-05-08T23:18:20.195 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.212996122, 2024-05-08T23:18:20.195 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.005324903 2024-05-08T23:18:20.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.195 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2024-05-08T23:18:20.195 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2024-05-08T23:18:20.195 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 40, 2024-05-08T23:18:20.195 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 62 2024-05-08T23:18:20.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.195 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 40, 2024-05-08T23:18:20.195 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 0, 2024-05-08T23:18:20.195 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 40, 2024-05-08T23:18:20.196 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2024-05-08T23:18:20.196 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2024-05-08T23:18:20.196 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 0, 2024-05-08T23:18:20.196 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 10, 2024-05-08T23:18:20.196 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 0, 2024-05-08T23:18:20.196 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 4, 2024-05-08T23:18:20.196 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 7, 2024-05-08T23:18:20.196 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2024-05-08T23:18:20.196 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2024-05-08T23:18:20.196 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2024-05-08T23:18:20.196 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 0, 2024-05-08T23:18:20.196 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 6, 2024-05-08T23:18:20.196 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2024-05-08T23:18:20.196 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2024-05-08T23:18:20.197 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2024-05-08T23:18:20.197 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 0, 2024-05-08T23:18:20.197 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 20, 2024-05-08T23:18:20.197 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2024-05-08T23:18:20.197 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2024-05-08T23:18:20.197 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2024-05-08T23:18:20.197 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2024-05-08T23:18:20.197 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2024-05-08T23:18:20.197 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2024-05-08T23:18:20.197 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T23:18:20.197 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2024-05-08T23:18:20.197 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2024-05-08T23:18:20.197 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2024-05-08T23:18:20.197 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2024-05-08T23:18:20.197 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2024-05-08T23:18:20.198 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2024-05-08T23:18:20.198 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2024-05-08T23:18:20.198 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2024-05-08T23:18:20.198 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2024-05-08T23:18:20.198 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2024-05-08T23:18:20.198 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2024-05-08T23:18:20.198 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2024-05-08T23:18:20.198 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2024-05-08T23:18:20.198 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2024-05-08T23:18:20.198 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2024-05-08T23:18:20.198 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2024-05-08T23:18:20.198 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2024-05-08T23:18:20.198 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2024-05-08T23:18:20.198 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2024-05-08T23:18:20.198 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 85, 2024-05-08T23:18:20.199 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2024-05-08T23:18:20.199 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 2, 2024-05-08T23:18:20.199 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 8, 2024-05-08T23:18:20.199 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 8, 2024-05-08T23:18:20.199 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 0, 2024-05-08T23:18:20.199 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2024-05-08T23:18:20.199 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 14, 2024-05-08T23:18:20.199 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 0, 2024-05-08T23:18:20.199 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 1 2024-05-08T23:18:20.199 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.199 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2024-05-08T23:18:20.199 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 1, 2024-05-08T23:18:20.199 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2024-05-08T23:18:20.199 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 0 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 0, 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 0, 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:20.200 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-05-08T23:18:20.201 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:20.201 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 366, 2024-05-08T23:18:20.201 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 525090, 2024-05-08T23:18:20.201 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:20.201 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 366, 2024-05-08T23:18:20.201 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-05-08T23:18:20.201 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-05-08T23:18:20.201 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 366, 2024-05-08T23:18:20.201 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 525090, 2024-05-08T23:18:20.201 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:20.201 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.201 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.201 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.201 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:20.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.202 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2024-05-08T23:18:20.202 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:20.202 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-05-08T23:18:20.202 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:20.202 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-05-08T23:18:20.202 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-05-08T23:18:20.202 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:20.202 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:20.202 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 40, 2024-05-08T23:18:20.202 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 11690, 2024-05-08T23:18:20.202 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 40, 2024-05-08T23:18:20.202 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 11690, 2024-05-08T23:18:20.202 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:20.202 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.203 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.203 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.203 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:20.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.203 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2024-05-08T23:18:20.203 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:20.203 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2024-05-08T23:18:20.203 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:20.203 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-05-08T23:18:20.203 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-05-08T23:18:20.203 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:20.203 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:20.203 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 40, 2024-05-08T23:18:20.203 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 40, 2024-05-08T23:18:20.203 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 40, 2024-05-08T23:18:20.204 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 40, 2024-05-08T23:18:20.204 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:20.204 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.204 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.204 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.204 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:20.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.204 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2024-05-08T23:18:20.204 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:20.204 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-05-08T23:18:20.204 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:20.204 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-05-08T23:18:20.204 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-05-08T23:18:20.204 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:20.204 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 0, 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 0, 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x561d6d94e0a0": { 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 4, 2024-05-08T23:18:20.205 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 1388, 2024-05-08T23:18:20.206 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:20.206 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 4, 2024-05-08T23:18:20.206 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-05-08T23:18:20.206 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-05-08T23:18:20.206 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 4, 2024-05-08T23:18:20.206 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 1388, 2024-05-08T23:18:20.206 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:20.206 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:20.206 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:20.206 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:20.206 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:20.206 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:20.206 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-05-08T23:18:20.360 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:20 smithi195 ceph-mon[46516]: pgmap v344: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 MiB/s wr, 15 op/s 2024-05-08T23:18:20.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:20 smithi135 ceph-mon[42440]: pgmap v344: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 MiB/s wr, 15 op/s 2024-05-08T23:18:20.548 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-05-08T23:18:20.548 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-05-08T23:18:20.548 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-05-08T23:18:20.548 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=11 2024-05-08T23:18:20.548 DEBUG:tasks.check_counter:Getting stats from f 2024-05-08T23:18:20.548 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-08T23:18:20.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:20 smithi179 ceph-mon[46314]: pgmap v344: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 MiB/s wr, 15 op/s 2024-05-08T23:18:20.770 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:18:21.734 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-05-08T23:18:21.735 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T23:18:21.735 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 556, 2024-05-08T23:18:21.735 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 558, 2024-05-08T23:18:21.735 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 792675, 2024-05-08T23:18:21.735 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 172926, 2024-05-08T23:18:21.735 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 6, 2024-05-08T23:18:21.735 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 2, 2024-05-08T23:18:21.735 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.055728050, 2024-05-08T23:18:21.735 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.016188493, 2024-05-08T23:18:21.735 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.015456509, 2024-05-08T23:18:21.735 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.017697584, 2024-05-08T23:18:21.735 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:21.735 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 556, 2024-05-08T23:18:21.735 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.026761576, 2024-05-08T23:18:21.736 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000048132 2024-05-08T23:18:21.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.736 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:21.736 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.736 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.736 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.736 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T23:18:21.736 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T23:18:21.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.736 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T23:18:21.736 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 5, 2024-05-08T23:18:21.736 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 59, 2024-05-08T23:18:21.737 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 1816, 2024-05-08T23:18:21.737 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 169806, 2024-05-08T23:18:21.737 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 5, 2024-05-08T23:18:21.737 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 4, 2024-05-08T23:18:21.737 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.004907471, 2024-05-08T23:18:21.737 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.002251371, 2024-05-08T23:18:21.737 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.001793935, 2024-05-08T23:18:21.737 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.000269034, 2024-05-08T23:18:21.737 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:21.737 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 57, 2024-05-08T23:18:21.737 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.012956800, 2024-05-08T23:18:21.737 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000227312 2024-05-08T23:18:21.738 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.738 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:21.738 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.738 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.738 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.738 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.738 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T23:18:21.738 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 168496 2024-05-08T23:18:21.738 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.738 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T23:18:21.738 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 310, 2024-05-08T23:18:21.738 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 299, 2024-05-08T23:18:21.738 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 532231, 2024-05-08T23:18:21.739 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 109545, 2024-05-08T23:18:21.739 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 3, 2024-05-08T23:18:21.739 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 2, 2024-05-08T23:18:21.739 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.036380414, 2024-05-08T23:18:21.739 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.011949828, 2024-05-08T23:18:21.739 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.015527217, 2024-05-08T23:18:21.739 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.009012909, 2024-05-08T23:18:21.739 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:21.739 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 299, 2024-05-08T23:18:21.739 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.014241447, 2024-05-08T23:18:21.739 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000047630 2024-05-08T23:18:21.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.739 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:21.739 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.739 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.740 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.740 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 479024, 2024-05-08T23:18:21.740 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 42368 2024-05-08T23:18:21.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.740 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2024-05-08T23:18:21.740 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2024-05-08T23:18:21.740 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2024-05-08T23:18:21.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.740 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2024-05-08T23:18:21.740 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-05-08T23:18:21.740 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-05-08T23:18:21.740 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1311, 2024-05-08T23:18:21.740 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.037816351, 2024-05-08T23:18:21.741 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000028845 2024-05-08T23:18:21.741 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:21.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.741 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2024-05-08T23:18:21.741 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-05-08T23:18:21.741 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-05-08T23:18:21.741 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.741 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.741 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.741 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:21.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.741 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2024-05-08T23:18:21.741 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 0, 2024-05-08T23:18:21.741 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 0, 2024-05-08T23:18:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2024-05-08T23:18:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2024-05-08T23:18:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 0, 2024-05-08T23:18:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 0, 2024-05-08T23:18:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2024-05-08T23:18:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 0, 2024-05-08T23:18:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 0, 2024-05-08T23:18:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2024-05-08T23:18:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 20, 2024-05-08T23:18:21.742 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 4, 2024-05-08T23:18:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 16, 2024-05-08T23:18:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 0, 2024-05-08T23:18:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 13, 2024-05-08T23:18:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 0, 2024-05-08T23:18:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 0, 2024-05-08T23:18:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 0, 2024-05-08T23:18:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 2, 2024-05-08T23:18:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 0, 2024-05-08T23:18:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 0, 2024-05-08T23:18:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 0, 2024-05-08T23:18:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 0, 2024-05-08T23:18:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2024-05-08T23:18:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2024-05-08T23:18:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 0, 2024-05-08T23:18:21.743 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 0, 2024-05-08T23:18:21.744 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 0, 2024-05-08T23:18:21.744 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 0, 2024-05-08T23:18:21.744 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 0, 2024-05-08T23:18:21.744 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 0, 2024-05-08T23:18:21.744 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 0, 2024-05-08T23:18:21.744 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2024-05-08T23:18:21.744 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 0, 2024-05-08T23:18:21.744 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2024-05-08T23:18:21.744 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 4, 2024-05-08T23:18:21.744 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 234, 2024-05-08T23:18:21.744 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 0, 2024-05-08T23:18:21.744 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T23:18:21.744 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2024-05-08T23:18:21.744 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T23:18:21.744 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2024-05-08T23:18:21.745 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 0, 2024-05-08T23:18:21.745 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T23:18:21.745 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T23:18:21.745 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 0, 2024-05-08T23:18:21.745 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 0, 2024-05-08T23:18:21.745 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T23:18:21.745 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 0, 2024-05-08T23:18:21.745 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T23:18:21.745 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T23:18:21.745 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T23:18:21.745 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 0, 2024-05-08T23:18:21.745 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 0, 2024-05-08T23:18:21.745 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 0, 2024-05-08T23:18:21.746 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 0 2024-05-08T23:18:21.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.746 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2024-05-08T23:18:21.746 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 0, 2024-05-08T23:18:21.746 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 0, 2024-05-08T23:18:21.746 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 0, 2024-05-08T23:18:21.746 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 0, 2024-05-08T23:18:21.746 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 0, 2024-05-08T23:18:21.746 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 0, 2024-05-08T23:18:21.746 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2024-05-08T23:18:21.746 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2024-05-08T23:18:21.746 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 0, 2024-05-08T23:18:21.747 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 0, 2024-05-08T23:18:21.747 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 0, 2024-05-08T23:18:21.747 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 0, 2024-05-08T23:18:21.747 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2024-05-08T23:18:21.747 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2024-05-08T23:18:21.747 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2024-05-08T23:18:21.747 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2024-05-08T23:18:21.747 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2024-05-08T23:18:21.747 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T23:18:21.747 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 0, 2024-05-08T23:18:21.747 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2024-05-08T23:18:21.747 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 0, 2024-05-08T23:18:21.747 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2024-05-08T23:18:21.747 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2024-05-08T23:18:21.748 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.748 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2024-05-08T23:18:21.748 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 0, 2024-05-08T23:18:21.748 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2024-05-08T23:18:21.748 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2024-05-08T23:18:21.748 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 168, 2024-05-08T23:18:21.748 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2024-05-08T23:18:21.748 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2024-05-08T23:18:21.748 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 0, 2024-05-08T23:18:21.748 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2024-05-08T23:18:21.748 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2024-05-08T23:18:21.748 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 2, 2024-05-08T23:18:21.748 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2024-05-08T23:18:21.748 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2024-05-08T23:18:21.748 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4780455, 2024-05-08T23:18:21.749 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 4824672, 2024-05-08T23:18:21.749 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 4820371, 2024-05-08T23:18:21.749 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2024-05-08T23:18:21.749 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.749 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.749 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.749 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.749 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 168 2024-05-08T23:18:21.749 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.749 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2024-05-08T23:18:21.749 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 14, 2024-05-08T23:18:21.749 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 20, 2024-05-08T23:18:21.749 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 6, 2024-05-08T23:18:21.749 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 9, 2024-05-08T23:18:21.750 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 11, 2024-05-08T23:18:21.750 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 2, 2024-05-08T23:18:21.750 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 20, 2024-05-08T23:18:21.750 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 25, 2024-05-08T23:18:21.750 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 5, 2024-05-08T23:18:21.750 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 0, 2024-05-08T23:18:21.750 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 0, 2024-05-08T23:18:21.750 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 0, 2024-05-08T23:18:21.750 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 47372, 2024-05-08T23:18:21.750 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 207156 2024-05-08T23:18:21.750 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.750 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2024-05-08T23:18:21.750 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 0, 2024-05-08T23:18:21.750 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 0, 2024-05-08T23:18:21.750 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 0, 2024-05-08T23:18:21.751 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 0, 2024-05-08T23:18:21.751 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 0, 2024-05-08T23:18:21.751 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2024-05-08T23:18:21.751 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.751 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.751 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.751 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.751 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2024-05-08T23:18:21.751 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.751 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.751 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.751 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.751 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2024-05-08T23:18:21.751 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.751 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2024-05-08T23:18:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2024-05-08T23:18:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2024-05-08T23:18:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.753 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.753 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2024-05-08T23:18:21.753 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.753 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.753 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.753 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2024-05-08T23:18:21.753 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.753 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.753 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.754 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2024-05-08T23:18:21.754 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.754 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.754 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.754 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.754 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2024-05-08T23:18:21.754 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.754 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.754 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.754 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.754 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2024-05-08T23:18:21.754 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.754 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.754 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.755 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.755 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2024-05-08T23:18:21.755 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.755 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.755 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.755 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.755 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2024-05-08T23:18:21.755 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.755 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.755 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.755 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.755 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2024-05-08T23:18:21.755 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.756 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.756 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.756 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.756 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2024-05-08T23:18:21.756 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.756 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.756 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.756 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.756 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2024-05-08T23:18:21.756 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.756 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.756 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.756 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.756 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2024-05-08T23:18:21.756 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.757 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.757 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.757 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.757 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2024-05-08T23:18:21.757 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.757 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.757 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.757 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.757 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2024-05-08T23:18:21.757 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.757 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.758 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.758 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.758 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2024-05-08T23:18:21.758 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.758 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.758 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.758 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.758 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2024-05-08T23:18:21.758 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.758 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.758 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.758 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.758 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2024-05-08T23:18:21.758 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.759 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.759 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.759 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2024-05-08T23:18:21.759 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.759 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.759 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.759 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2024-05-08T23:18:21.759 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.759 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.759 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.759 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2024-05-08T23:18:21.760 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.760 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.760 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.760 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.760 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2024-05-08T23:18:21.760 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.760 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.760 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.760 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.760 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2024-05-08T23:18:21.760 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.760 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.760 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.761 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.761 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2024-05-08T23:18:21.761 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.761 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.761 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.761 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.761 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2024-05-08T23:18:21.761 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.761 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.761 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.761 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.761 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2024-05-08T23:18:21.761 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2024-05-08T23:18:21.761 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2024-05-08T23:18:21.761 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.762 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.762 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.762 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:21.762 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.762 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2024-05-08T23:18:21.762 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 1, 2024-05-08T23:18:21.762 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 2, 2024-05-08T23:18:21.762 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 1, 2024-05-08T23:18:21.762 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 2, 2024-05-08T23:18:21.762 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2024-05-08T23:18:21.762 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 0, 2024-05-08T23:18:21.762 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 0, 2024-05-08T23:18:21.762 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 2860, 2024-05-08T23:18:21.762 INFO:teuthology.orchestra.run.smithi195.stdout: "mdthresh_evicted": 0 2024-05-08T23:18:21.763 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.763 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2024-05-08T23:18:21.763 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2024-05-08T23:18:21.763 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2024-05-08T23:18:21.763 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T23:18:21.763 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2024-05-08T23:18:21.763 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T23:18:21.763 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2024-05-08T23:18:21.763 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T23:18:21.763 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T23:18:21.763 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T23:18:21.763 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T23:18:21.763 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T23:18:21.763 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2024-05-08T23:18:21.764 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T23:18:21.764 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T23:18:21.764 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2024-05-08T23:18:21.764 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2024-05-08T23:18:21.764 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2024-05-08T23:18:21.764 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2024-05-08T23:18:21.764 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T23:18:21.764 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T23:18:21.764 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T23:18:21.764 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T23:18:21.764 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T23:18:21.764 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2024-05-08T23:18:21.764 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2024-05-08T23:18:21.764 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2024-05-08T23:18:21.764 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T23:18:21.765 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T23:18:21.765 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2024-05-08T23:18:21.765 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2024-05-08T23:18:21.765 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2024-05-08T23:18:21.765 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2024-05-08T23:18:21.765 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T23:18:21.765 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2024-05-08T23:18:21.765 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T23:18:21.765 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2024-05-08T23:18:21.765 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 189279, 2024-05-08T23:18:21.765 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 49, 2024-05-08T23:18:21.765 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2024-05-08T23:18:21.766 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2024-05-08T23:18:21.766 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2024-05-08T23:18:21.766 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2024-05-08T23:18:21.766 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2024-05-08T23:18:21.766 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2024-05-08T23:18:21.766 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2024-05-08T23:18:21.766 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2024-05-08T23:18:21.766 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 7720, 2024-05-08T23:18:21.766 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 162, 2024-05-08T23:18:21.766 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T23:18:21.766 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2024-05-08T23:18:21.766 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2024-05-08T23:18:21.766 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2024-05-08T23:18:21.766 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 56034, 2024-05-08T23:18:21.767 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 269, 2024-05-08T23:18:21.767 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2024-05-08T23:18:21.767 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2024-05-08T23:18:21.767 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2024-05-08T23:18:21.767 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2024-05-08T23:18:21.767 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.767 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2024-05-08T23:18:21.767 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2024-05-08T23:18:21.767 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2024-05-08T23:18:21.767 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 776, 2024-05-08T23:18:21.767 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 26, 2024-05-08T23:18:21.767 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 4, 2024-05-08T23:18:21.767 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 776, 2024-05-08T23:18:21.767 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2024-05-08T23:18:21.768 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 776, 2024-05-08T23:18:21.768 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.348993665, 2024-05-08T23:18:21.768 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000449734 2024-05-08T23:18:21.768 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.768 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2024-05-08T23:18:21.768 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2024-05-08T23:18:21.768 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 776, 2024-05-08T23:18:21.768 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 777 2024-05-08T23:18:21.768 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.768 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 776, 2024-05-08T23:18:21.768 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 776, 2024-05-08T23:18:21.769 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 0, 2024-05-08T23:18:21.769 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2024-05-08T23:18:21.769 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2024-05-08T23:18:21.769 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 450, 2024-05-08T23:18:21.769 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 0, 2024-05-08T23:18:21.769 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 323, 2024-05-08T23:18:21.769 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 0, 2024-05-08T23:18:21.769 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 0, 2024-05-08T23:18:21.769 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2024-05-08T23:18:21.769 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2024-05-08T23:18:21.769 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2024-05-08T23:18:21.769 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 0, 2024-05-08T23:18:21.769 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 0, 2024-05-08T23:18:21.769 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2024-05-08T23:18:21.769 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2024-05-08T23:18:21.770 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2024-05-08T23:18:21.770 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 2, 2024-05-08T23:18:21.770 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 0, 2024-05-08T23:18:21.770 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2024-05-08T23:18:21.770 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2024-05-08T23:18:21.770 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2024-05-08T23:18:21.770 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2024-05-08T23:18:21.770 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2024-05-08T23:18:21.770 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2024-05-08T23:18:21.770 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T23:18:21.770 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2024-05-08T23:18:21.770 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2024-05-08T23:18:21.771 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2024-05-08T23:18:21.771 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2024-05-08T23:18:21.771 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2024-05-08T23:18:21.771 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2024-05-08T23:18:21.771 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2024-05-08T23:18:21.771 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2024-05-08T23:18:21.771 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2024-05-08T23:18:21.771 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2024-05-08T23:18:21.771 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2024-05-08T23:18:21.771 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2024-05-08T23:18:21.771 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2024-05-08T23:18:21.771 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2024-05-08T23:18:21.771 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2024-05-08T23:18:21.771 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2024-05-08T23:18:21.772 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2024-05-08T23:18:21.772 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2024-05-08T23:18:21.772 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2024-05-08T23:18:21.772 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 85, 2024-05-08T23:18:21.772 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2024-05-08T23:18:21.772 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 2, 2024-05-08T23:18:21.772 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 5, 2024-05-08T23:18:21.772 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 5, 2024-05-08T23:18:21.772 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 0, 2024-05-08T23:18:21.772 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2024-05-08T23:18:21.772 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 0, 2024-05-08T23:18:21.772 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 2, 2024-05-08T23:18:21.772 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 0 2024-05-08T23:18:21.772 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.772 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2024-05-08T23:18:21.773 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 0, 2024-05-08T23:18:21.773 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2024-05-08T23:18:21.773 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2024-05-08T23:18:21.773 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2024-05-08T23:18:21.773 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.773 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2024-05-08T23:18:21.773 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 0 2024-05-08T23:18:21.773 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.773 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2024-05-08T23:18:21.773 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2024-05-08T23:18:21.773 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T23:18:21.773 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2024-05-08T23:18:21.773 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 0, 2024-05-08T23:18:21.773 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 0, 2024-05-08T23:18:21.773 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2024-05-08T23:18:21.774 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.774 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T23:18:21.774 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:21.774 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-05-08T23:18:21.774 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:21.774 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 867, 2024-05-08T23:18:21.774 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 1241086, 2024-05-08T23:18:21.774 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:21.774 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 867, 2024-05-08T23:18:21.774 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-05-08T23:18:21.774 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-05-08T23:18:21.774 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 867, 2024-05-08T23:18:21.774 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 1241086, 2024-05-08T23:18:21.774 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:21.775 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.775 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.775 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.775 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:21.775 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.775 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2024-05-08T23:18:21.775 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:21.775 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-05-08T23:18:21.775 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:21.775 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-05-08T23:18:21.775 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-05-08T23:18:21.775 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:21.775 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:21.775 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 776, 2024-05-08T23:18:21.775 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 630378, 2024-05-08T23:18:21.776 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 776, 2024-05-08T23:18:21.776 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 630378, 2024-05-08T23:18:21.776 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:21.776 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.776 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.776 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.776 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:21.776 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.776 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2024-05-08T23:18:21.776 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:21.776 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2024-05-08T23:18:21.776 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:21.776 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-05-08T23:18:21.776 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-05-08T23:18:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 776, 2024-05-08T23:18:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 776, 2024-05-08T23:18:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 776, 2024-05-08T23:18:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 776, 2024-05-08T23:18:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2024-05-08T23:18:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-05-08T23:18:21.778 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:21.778 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-05-08T23:18:21.778 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-05-08T23:18:21.778 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:21.778 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:21.778 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-05-08T23:18:21.778 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-05-08T23:18:21.778 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 0, 2024-05-08T23:18:21.778 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 0, 2024-05-08T23:18:21.778 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:21.778 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.778 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.778 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.778 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:21.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:21.779 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x55ddfd964640": { 2024-05-08T23:18:21.779 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:21.779 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-05-08T23:18:21.779 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:21.779 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-05-08T23:18:21.779 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-05-08T23:18:21.779 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:21.779 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:21.779 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-05-08T23:18:21.779 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-05-08T23:18:21.779 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 0, 2024-05-08T23:18:21.779 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 0, 2024-05-08T23:18:21.779 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:21.779 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:21.780 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:21.780 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:21.780 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:21.780 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:21.780 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-05-08T23:18:22.123 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-05-08T23:18:22.124 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-05-08T23:18:22.124 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-05-08T23:18:22.124 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-05-08T23:18:22.124 DEBUG:tasks.check_counter:Getting stats from i 2024-05-08T23:18:22.124 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-08T23:18:22.347 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:18:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:22 smithi195 ceph-mon[46516]: pgmap v345: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-08T23:18:22.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:22 smithi135 ceph-mon[42440]: pgmap v345: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-08T23:18:22.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:22 smithi179 ceph-mon[46314]: pgmap v345: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-08T23:18:23.485 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-05-08T23:18:23.485 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T23:18:23.485 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 795, 2024-05-08T23:18:23.485 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 835, 2024-05-08T23:18:23.485 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 277628, 2024-05-08T23:18:23.485 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 934998, 2024-05-08T23:18:23.485 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 11, 2024-05-08T23:18:23.485 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 4, 2024-05-08T23:18:23.485 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.077158240, 2024-05-08T23:18:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.025405610, 2024-05-08T23:18:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.026244384, 2024-05-08T23:18:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.020207469, 2024-05-08T23:18:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 833, 2024-05-08T23:18:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.483247364, 2024-05-08T23:18:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000580128 2024-05-08T23:18:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 737, 2024-05-08T23:18:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000196813, 2024-05-08T23:18:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000267 2024-05-08T23:18:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T23:18:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T23:18:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T23:18:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 1017, 2024-05-08T23:18:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 891, 2024-05-08T23:18:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 798303, 2024-05-08T23:18:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 423557, 2024-05-08T23:18:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 14, 2024-05-08T23:18:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 5, 2024-05-08T23:18:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.094976093, 2024-05-08T23:18:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.027990314, 2024-05-08T23:18:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.054031678, 2024-05-08T23:18:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.021270516, 2024-05-08T23:18:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 890, 2024-05-08T23:18:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.952168416, 2024-05-08T23:18:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001069852 2024-05-08T23:18:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1073, 2024-05-08T23:18:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000218076, 2024-05-08T23:18:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000203 2024-05-08T23:18:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 644736, 2024-05-08T23:18:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 205200 2024-05-08T23:18:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T23:18:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 656, 2024-05-08T23:18:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 601, 2024-05-08T23:18:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 226407, 2024-05-08T23:18:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 594963, 2024-05-08T23:18:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 32, 2024-05-08T23:18:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 8, 2024-05-08T23:18:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.076313573, 2024-05-08T23:18:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.018825275, 2024-05-08T23:18:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.032196636, 2024-05-08T23:18:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.020063522, 2024-05-08T23:18:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 600, 2024-05-08T23:18:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.449032438, 2024-05-08T23:18:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000748387 2024-05-08T23:18:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 665, 2024-05-08T23:18:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000146475, 2024-05-08T23:18:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000220 2024-05-08T23:18:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 89056, 2024-05-08T23:18:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 208496 2024-05-08T23:18:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2024-05-08T23:18:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2024-05-08T23:18:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2024-05-08T23:18:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2024-05-08T23:18:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-05-08T23:18:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-05-08T23:18:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 438, 2024-05-08T23:18:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.103903767, 2024-05-08T23:18:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000237223 2024-05-08T23:18:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2024-05-08T23:18:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-05-08T23:18:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-05-08T23:18:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 137, 2024-05-08T23:18:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.003758332, 2024-05-08T23:18:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000027433 2024-05-08T23:18:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2024-05-08T23:18:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 210, 2024-05-08T23:18:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 210, 2024-05-08T23:18:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2024-05-08T23:18:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 210, 2024-05-08T23:18:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.114938713, 2024-05-08T23:18:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000547327 2024-05-08T23:18:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2024-05-08T23:18:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 0, 2024-05-08T23:18:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 0, 2024-05-08T23:18:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2024-05-08T23:18:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 60, 2024-05-08T23:18:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 0, 2024-05-08T23:18:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2024-05-08T23:18:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 23, 2024-05-08T23:18:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 4, 2024-05-08T23:18:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 19, 2024-05-08T23:18:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 0, 2024-05-08T23:18:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 16, 2024-05-08T23:18:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 0, 2024-05-08T23:18:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 1, 2024-05-08T23:18:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 1, 2024-05-08T23:18:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 2, 2024-05-08T23:18:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 388, 2024-05-08T23:18:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 376, 2024-05-08T23:18:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 0, 2024-05-08T23:18:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 0, 2024-05-08T23:18:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2024-05-08T23:18:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2024-05-08T23:18:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 0, 2024-05-08T23:18:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 0, 2024-05-08T23:18:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 0, 2024-05-08T23:18:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 0, 2024-05-08T23:18:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 0, 2024-05-08T23:18:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 0, 2024-05-08T23:18:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 0, 2024-05-08T23:18:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2024-05-08T23:18:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 0, 2024-05-08T23:18:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2024-05-08T23:18:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 4, 2024-05-08T23:18:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 234, 2024-05-08T23:18:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 0, 2024-05-08T23:18:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T23:18:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2024-05-08T23:18:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T23:18:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2024-05-08T23:18:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 0, 2024-05-08T23:18:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T23:18:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T23:18:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 0, 2024-05-08T23:18:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 0, 2024-05-08T23:18:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 20, 2024-05-08T23:18:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 35, 2024-05-08T23:18:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T23:18:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T23:18:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T23:18:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 103, 2024-05-08T23:18:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 79, 2024-05-08T23:18:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 1, 2024-05-08T23:18:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 26 2024-05-08T23:18:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2024-05-08T23:18:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 14, 2024-05-08T23:18:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 0, 2024-05-08T23:18:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 0, 2024-05-08T23:18:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 0, 2024-05-08T23:18:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 31, 2024-05-08T23:18:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 0, 2024-05-08T23:18:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2024-05-08T23:18:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2024-05-08T23:18:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 6, 2024-05-08T23:18:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 6, 2024-05-08T23:18:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 0, 2024-05-08T23:18:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 0, 2024-05-08T23:18:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2024-05-08T23:18:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2024-05-08T23:18:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2024-05-08T23:18:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2024-05-08T23:18:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2024-05-08T23:18:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T23:18:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 0, 2024-05-08T23:18:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2024-05-08T23:18:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 0, 2024-05-08T23:18:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2024-05-08T23:18:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2024-05-08T23:18:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2024-05-08T23:18:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 168, 2024-05-08T23:18:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 148, 2024-05-08T23:18:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 148, 2024-05-08T23:18:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 20, 2024-05-08T23:18:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2024-05-08T23:18:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 19, 2024-05-08T23:18:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 12, 2024-05-08T23:18:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 11, 2024-05-08T23:18:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 11, 2024-05-08T23:18:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 2, 2024-05-08T23:18:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2024-05-08T23:18:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 1, 2024-05-08T23:18:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4780455, 2024-05-08T23:18:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 4824672, 2024-05-08T23:18:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 0, 2024-05-08T23:18:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2024-05-08T23:18:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 140, 2024-05-08T23:18:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.270687254, 2024-05-08T23:18:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001933480 2024-05-08T23:18:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 0 2024-05-08T23:18:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2024-05-08T23:18:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 23, 2024-05-08T23:18:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 29, 2024-05-08T23:18:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 6, 2024-05-08T23:18:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 18, 2024-05-08T23:18:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 20, 2024-05-08T23:18:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 2, 2024-05-08T23:18:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 23, 2024-05-08T23:18:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 35, 2024-05-08T23:18:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 12, 2024-05-08T23:18:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 1, 2024-05-08T23:18:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 18, 2024-05-08T23:18:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 17, 2024-05-08T23:18:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 50152, 2024-05-08T23:18:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 207156 2024-05-08T23:18:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2024-05-08T23:18:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 241, 2024-05-08T23:18:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 0, 2024-05-08T23:18:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 210, 2024-05-08T23:18:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 11, 2024-05-08T23:18:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 0, 2024-05-08T23:18:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2024-05-08T23:18:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 8, 2024-05-08T23:18:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.007503745, 2024-05-08T23:18:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000937968 2024-05-08T23:18:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2024-05-08T23:18:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 172, 2024-05-08T23:18:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.043863288, 2024-05-08T23:18:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000255019 2024-05-08T23:18:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2024-05-08T23:18:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2024-05-08T23:18:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2024-05-08T23:18:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2, 2024-05-08T23:18:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000853431, 2024-05-08T23:18:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000426715 2024-05-08T23:18:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2024-05-08T23:18:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2024-05-08T23:18:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2024-05-08T23:18:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2024-05-08T23:18:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2024-05-08T23:18:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2024-05-08T23:18:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2024-05-08T23:18:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 8, 2024-05-08T23:18:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.013330783, 2024-05-08T23:18:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001666347 2024-05-08T23:18:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2024-05-08T23:18:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2024-05-08T23:18:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2024-05-08T23:18:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1, 2024-05-08T23:18:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000396334, 2024-05-08T23:18:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000396334 2024-05-08T23:18:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2024-05-08T23:18:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2, 2024-05-08T23:18:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.004884182, 2024-05-08T23:18:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.002442091 2024-05-08T23:18:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2024-05-08T23:18:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2, 2024-05-08T23:18:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.002220588, 2024-05-08T23:18:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001110294 2024-05-08T23:18:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2024-05-08T23:18:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2024-05-08T23:18:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.509 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.509 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2024-05-08T23:18:23.509 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2, 2024-05-08T23:18:23.509 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.015614813, 2024-05-08T23:18:23.509 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.007807406 2024-05-08T23:18:23.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.509 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2024-05-08T23:18:23.509 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.509 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.509 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.509 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2024-05-08T23:18:23.509 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.509 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.510 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.510 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.510 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2024-05-08T23:18:23.510 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1, 2024-05-08T23:18:23.510 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.001217986, 2024-05-08T23:18:23.510 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001217986 2024-05-08T23:18:23.510 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.510 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2024-05-08T23:18:23.510 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.510 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.511 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.511 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.511 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2024-05-08T23:18:23.511 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.511 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.511 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.511 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.511 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2024-05-08T23:18:23.511 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.512 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.512 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.512 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2024-05-08T23:18:23.512 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 8, 2024-05-08T23:18:23.512 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.019939358, 2024-05-08T23:18:23.512 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.002492419 2024-05-08T23:18:23.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.512 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2024-05-08T23:18:23.513 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.513 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.513 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.513 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2024-05-08T23:18:23.513 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 4, 2024-05-08T23:18:23.513 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.005114205, 2024-05-08T23:18:23.513 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001278551 2024-05-08T23:18:23.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.514 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2024-05-08T23:18:23.514 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2024-05-08T23:18:23.514 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2024-05-08T23:18:23.514 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.514 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.514 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.514 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:23.514 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.515 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2024-05-08T23:18:23.515 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 1, 2024-05-08T23:18:23.515 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 2, 2024-05-08T23:18:23.515 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 1, 2024-05-08T23:18:23.515 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 1, 2024-05-08T23:18:23.515 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2024-05-08T23:18:23.515 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 43, 2024-05-08T23:18:23.515 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 43, 2024-05-08T23:18:23.516 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 167, 2024-05-08T23:18:23.516 INFO:teuthology.orchestra.run.smithi195.stdout: "mdthresh_evicted": 0 2024-05-08T23:18:23.516 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.516 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2024-05-08T23:18:23.516 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2024-05-08T23:18:23.516 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2024-05-08T23:18:23.516 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T23:18:23.516 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2024-05-08T23:18:23.516 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T23:18:23.517 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2024-05-08T23:18:23.517 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T23:18:23.517 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T23:18:23.517 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T23:18:23.518 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T23:18:23.518 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T23:18:23.518 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2024-05-08T23:18:23.518 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T23:18:23.518 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T23:18:23.518 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2024-05-08T23:18:23.518 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2024-05-08T23:18:23.518 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2024-05-08T23:18:23.519 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2024-05-08T23:18:23.519 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T23:18:23.519 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T23:18:23.519 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T23:18:23.519 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T23:18:23.519 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T23:18:23.519 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2024-05-08T23:18:23.519 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2024-05-08T23:18:23.519 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2024-05-08T23:18:23.520 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T23:18:23.520 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T23:18:23.520 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2024-05-08T23:18:23.520 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2024-05-08T23:18:23.520 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2024-05-08T23:18:23.520 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2024-05-08T23:18:23.520 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T23:18:23.520 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2024-05-08T23:18:23.520 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T23:18:23.521 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2024-05-08T23:18:23.522 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 323767, 2024-05-08T23:18:23.522 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 139, 2024-05-08T23:18:23.522 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 616, 2024-05-08T23:18:23.522 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 7, 2024-05-08T23:18:23.522 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2024-05-08T23:18:23.522 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2024-05-08T23:18:23.522 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2024-05-08T23:18:23.523 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2024-05-08T23:18:23.523 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2024-05-08T23:18:23.523 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2024-05-08T23:18:23.523 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 7720, 2024-05-08T23:18:23.523 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 162, 2024-05-08T23:18:23.523 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T23:18:23.523 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2024-05-08T23:18:23.523 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2024-05-08T23:18:23.524 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2024-05-08T23:18:23.524 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 94658, 2024-05-08T23:18:23.524 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 678, 2024-05-08T23:18:23.524 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2024-05-08T23:18:23.524 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2024-05-08T23:18:23.524 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2024-05-08T23:18:23.524 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2024-05-08T23:18:23.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.524 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2024-05-08T23:18:23.524 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2024-05-08T23:18:23.524 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2024-05-08T23:18:23.524 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 950, 2024-05-08T23:18:23.525 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 703633, 2024-05-08T23:18:23.525 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 37, 2024-05-08T23:18:23.525 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 950, 2024-05-08T23:18:23.525 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2024-05-08T23:18:23.525 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 950, 2024-05-08T23:18:23.525 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 21.534608662, 2024-05-08T23:18:23.525 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.022668009 2024-05-08T23:18:23.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.525 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2024-05-08T23:18:23.525 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2024-05-08T23:18:23.525 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 950, 2024-05-08T23:18:23.525 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1110 2024-05-08T23:18:23.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.525 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 950, 2024-05-08T23:18:23.525 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 2, 2024-05-08T23:18:23.526 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 948, 2024-05-08T23:18:23.526 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2024-05-08T23:18:23.526 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2024-05-08T23:18:23.526 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 40, 2024-05-08T23:18:23.526 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 28, 2024-05-08T23:18:23.526 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 2, 2024-05-08T23:18:23.526 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 142, 2024-05-08T23:18:23.526 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 44, 2024-05-08T23:18:23.526 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2024-05-08T23:18:23.526 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2024-05-08T23:18:23.526 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2024-05-08T23:18:23.526 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 0, 2024-05-08T23:18:23.527 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 646, 2024-05-08T23:18:23.527 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2024-05-08T23:18:23.527 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2024-05-08T23:18:23.527 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2024-05-08T23:18:23.527 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 0, 2024-05-08T23:18:23.527 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 56, 2024-05-08T23:18:23.527 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2024-05-08T23:18:23.527 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2024-05-08T23:18:23.527 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2024-05-08T23:18:23.527 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2024-05-08T23:18:23.527 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2024-05-08T23:18:23.527 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2024-05-08T23:18:23.527 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T23:18:23.527 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2024-05-08T23:18:23.528 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2024-05-08T23:18:23.528 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2024-05-08T23:18:23.528 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2024-05-08T23:18:23.528 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2024-05-08T23:18:23.528 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2024-05-08T23:18:23.528 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2024-05-08T23:18:23.528 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2024-05-08T23:18:23.528 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2024-05-08T23:18:23.528 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2024-05-08T23:18:23.528 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2024-05-08T23:18:23.528 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2024-05-08T23:18:23.528 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2024-05-08T23:18:23.528 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2024-05-08T23:18:23.528 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2024-05-08T23:18:23.529 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2024-05-08T23:18:23.529 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2024-05-08T23:18:23.529 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2024-05-08T23:18:23.529 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2024-05-08T23:18:23.529 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 85, 2024-05-08T23:18:23.529 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2024-05-08T23:18:23.529 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 3, 2024-05-08T23:18:23.529 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 12, 2024-05-08T23:18:23.529 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 12, 2024-05-08T23:18:23.529 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 0, 2024-05-08T23:18:23.529 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2024-05-08T23:18:23.529 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 143, 2024-05-08T23:18:23.529 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 0, 2024-05-08T23:18:23.529 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 9 2024-05-08T23:18:23.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.530 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2024-05-08T23:18:23.530 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 1, 2024-05-08T23:18:23.530 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2024-05-08T23:18:23.530 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2024-05-08T23:18:23.530 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2024-05-08T23:18:23.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.530 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2024-05-08T23:18:23.530 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 0 2024-05-08T23:18:23.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.530 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2024-05-08T23:18:23.530 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2024-05-08T23:18:23.530 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 133, 2024-05-08T23:18:23.530 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2024-05-08T23:18:23.531 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 5, 2024-05-08T23:18:23.531 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 6, 2024-05-08T23:18:23.531 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2024-05-08T23:18:23.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.531 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T23:18:23.531 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:23.531 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-05-08T23:18:23.531 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:23.531 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 2464, 2024-05-08T23:18:23.531 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 1043471, 2024-05-08T23:18:23.531 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:23.531 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 2464, 2024-05-08T23:18:23.531 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-05-08T23:18:23.531 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-05-08T23:18:23.531 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 2464, 2024-05-08T23:18:23.532 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 1043471, 2024-05-08T23:18:23.532 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:23.532 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.532 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.532 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.532 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:23.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.532 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2024-05-08T23:18:23.532 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:23.532 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-05-08T23:18:23.532 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:23.532 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-05-08T23:18:23.533 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-05-08T23:18:23.533 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:23.533 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:23.533 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 950, 2024-05-08T23:18:23.533 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 704239, 2024-05-08T23:18:23.533 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 950, 2024-05-08T23:18:23.533 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 704239, 2024-05-08T23:18:23.533 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:23.533 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.533 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.533 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.533 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:23.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.533 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2024-05-08T23:18:23.534 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:23.534 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2024-05-08T23:18:23.534 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:23.534 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-05-08T23:18:23.534 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-05-08T23:18:23.534 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:23.534 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:23.534 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 950, 2024-05-08T23:18:23.534 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 950, 2024-05-08T23:18:23.534 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 950, 2024-05-08T23:18:23.534 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 950, 2024-05-08T23:18:23.534 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:23.534 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.534 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.535 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.535 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:23.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.535 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2024-05-08T23:18:23.535 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:23.535 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-05-08T23:18:23.535 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:23.535 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 6, 2024-05-08T23:18:23.535 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 606, 2024-05-08T23:18:23.535 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:23.535 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 6, 2024-05-08T23:18:23.535 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-05-08T23:18:23.535 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-05-08T23:18:23.535 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 2, 2024-05-08T23:18:23.535 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 606, 2024-05-08T23:18:23.536 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:23.536 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.536 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.536 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.536 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:23.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:23.536 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x55fd3360a0a0": { 2024-05-08T23:18:23.536 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:23.536 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-05-08T23:18:23.536 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:23.536 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 168, 2024-05-08T23:18:23.536 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 630368, 2024-05-08T23:18:23.536 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:23.536 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 168, 2024-05-08T23:18:23.536 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-05-08T23:18:23.537 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-05-08T23:18:23.537 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 140, 2024-05-08T23:18:23.537 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 630368, 2024-05-08T23:18:23.537 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:23.537 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:23.537 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:23.537 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:23.537 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:23.537 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:23.537 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-05-08T23:18:23.881 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-05-08T23:18:23.881 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-05-08T23:18:23.881 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=14 2024-05-08T23:18:23.881 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=0 2024-05-08T23:18:23.881 DEBUG:tasks.check_counter:Getting stats from l 2024-05-08T23:18:23.881 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-08T23:18:24.103 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:18:24.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:24 smithi195 ceph-mon[46516]: pgmap v346: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-08T23:18:24.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:24 smithi135 ceph-mon[42440]: pgmap v346: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-08T23:18:24.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:24 smithi179 ceph-mon[46314]: pgmap v346: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-08T23:18:25.221 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-05-08T23:18:25.221 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T23:18:25.221 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 219, 2024-05-08T23:18:25.221 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 200, 2024-05-08T23:18:25.221 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 74643, 2024-05-08T23:18:25.221 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 79728, 2024-05-08T23:18:25.221 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 8, 2024-05-08T23:18:25.222 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 2, 2024-05-08T23:18:25.222 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.026512266, 2024-05-08T23:18:25.222 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.011061745, 2024-05-08T23:18:25.222 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.012503101, 2024-05-08T23:18:25.222 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.001872233, 2024-05-08T23:18:25.222 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:25.222 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 200, 2024-05-08T23:18:25.222 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.027242608, 2024-05-08T23:18:25.222 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000136213 2024-05-08T23:18:25.222 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.222 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:25.222 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 373, 2024-05-08T23:18:25.222 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000088329, 2024-05-08T23:18:25.223 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000236 2024-05-08T23:18:25.223 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.223 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T23:18:25.223 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T23:18:25.223 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.223 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T23:18:25.223 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 21, 2024-05-08T23:18:25.223 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 75, 2024-05-08T23:18:25.223 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 7063, 2024-05-08T23:18:25.223 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 215647, 2024-05-08T23:18:25.223 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 10, 2024-05-08T23:18:25.223 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 6, 2024-05-08T23:18:25.223 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.006976331, 2024-05-08T23:18:25.224 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.002530905, 2024-05-08T23:18:25.224 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.003465060, 2024-05-08T23:18:25.224 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.000197581, 2024-05-08T23:18:25.224 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:25.224 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 74, 2024-05-08T23:18:25.224 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.036447178, 2024-05-08T23:18:25.224 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000492529 2024-05-08T23:18:25.224 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.224 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:25.224 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 4, 2024-05-08T23:18:25.224 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000316, 2024-05-08T23:18:25.224 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000079 2024-05-08T23:18:25.224 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.224 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-05-08T23:18:25.225 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 170864 2024-05-08T23:18:25.225 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.225 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T23:18:25.225 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 132, 2024-05-08T23:18:25.225 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 126, 2024-05-08T23:18:25.225 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 480248, 2024-05-08T23:18:25.225 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 57736, 2024-05-08T23:18:25.225 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 6, 2024-05-08T23:18:25.225 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 5, 2024-05-08T23:18:25.225 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.018225187, 2024-05-08T23:18:25.225 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.005394879, 2024-05-08T23:18:25.225 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.015118470, 2024-05-08T23:18:25.225 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.002009248, 2024-05-08T23:18:25.225 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T23:18:25.226 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 123, 2024-05-08T23:18:25.226 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.014606890, 2024-05-08T23:18:25.226 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000118755 2024-05-08T23:18:25.226 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.226 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-05-08T23:18:25.226 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 9, 2024-05-08T23:18:25.226 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000002111, 2024-05-08T23:18:25.226 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000234 2024-05-08T23:18:25.226 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.226 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 478640, 2024-05-08T23:18:25.226 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 49232 2024-05-08T23:18:25.226 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.227 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2024-05-08T23:18:25.227 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2024-05-08T23:18:25.227 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2024-05-08T23:18:25.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.227 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2024-05-08T23:18:25.227 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-05-08T23:18:25.227 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-05-08T23:18:25.227 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 39, 2024-05-08T23:18:25.227 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.001596683, 2024-05-08T23:18:25.227 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000040940 2024-05-08T23:18:25.227 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:25.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.227 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2, 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000009756, 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000004878 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 0, 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 0, 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.228 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2024-05-08T23:18:25.229 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 0, 2024-05-08T23:18:25.229 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 0, 2024-05-08T23:18:25.229 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2024-05-08T23:18:25.229 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 11, 2024-05-08T23:18:25.229 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 0, 2024-05-08T23:18:25.229 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2024-05-08T23:18:25.229 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 16, 2024-05-08T23:18:25.229 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 0, 2024-05-08T23:18:25.229 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 16, 2024-05-08T23:18:25.229 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 0, 2024-05-08T23:18:25.229 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 13, 2024-05-08T23:18:25.229 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 4, 2024-05-08T23:18:25.229 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 0, 2024-05-08T23:18:25.230 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 0, 2024-05-08T23:18:25.230 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 3, 2024-05-08T23:18:25.230 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 7, 2024-05-08T23:18:25.230 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 4, 2024-05-08T23:18:25.230 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 0, 2024-05-08T23:18:25.230 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 3, 2024-05-08T23:18:25.230 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2024-05-08T23:18:25.230 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2024-05-08T23:18:25.230 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 0, 2024-05-08T23:18:25.230 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 0, 2024-05-08T23:18:25.231 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 0, 2024-05-08T23:18:25.231 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 0, 2024-05-08T23:18:25.231 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 0, 2024-05-08T23:18:25.231 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 0, 2024-05-08T23:18:25.231 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 0, 2024-05-08T23:18:25.231 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2024-05-08T23:18:25.231 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 0, 2024-05-08T23:18:25.231 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2024-05-08T23:18:25.231 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 8, 2024-05-08T23:18:25.231 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 269513722, 2024-05-08T23:18:25.231 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 0, 2024-05-08T23:18:25.231 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T23:18:25.231 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2024-05-08T23:18:25.231 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T23:18:25.231 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 0, 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 0, 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 0, 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 0, 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 0, 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 0, 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 0, 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 0 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.232 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2024-05-08T23:18:25.233 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 0, 2024-05-08T23:18:25.233 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 11, 2024-05-08T23:18:25.233 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 7, 2024-05-08T23:18:25.233 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 8, 2024-05-08T23:18:25.233 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 0, 2024-05-08T23:18:25.233 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 0, 2024-05-08T23:18:25.233 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2024-05-08T23:18:25.233 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2024-05-08T23:18:25.233 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 0, 2024-05-08T23:18:25.233 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 0, 2024-05-08T23:18:25.233 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 0, 2024-05-08T23:18:25.233 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 0, 2024-05-08T23:18:25.233 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2024-05-08T23:18:25.233 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2024-05-08T23:18:25.233 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2024-05-08T23:18:25.234 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2024-05-08T23:18:25.234 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2024-05-08T23:18:25.234 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T23:18:25.234 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 0, 2024-05-08T23:18:25.234 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2024-05-08T23:18:25.234 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 0, 2024-05-08T23:18:25.234 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2024-05-08T23:18:25.234 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2024-05-08T23:18:25.234 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.234 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2024-05-08T23:18:25.234 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 3, 2024-05-08T23:18:25.234 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2024-05-08T23:18:25.234 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2024-05-08T23:18:25.234 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 3, 2024-05-08T23:18:25.235 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2024-05-08T23:18:25.235 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2024-05-08T23:18:25.235 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 1, 2024-05-08T23:18:25.235 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2024-05-08T23:18:25.235 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2024-05-08T23:18:25.235 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 1, 2024-05-08T23:18:25.235 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2024-05-08T23:18:25.235 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2024-05-08T23:18:25.235 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2024-05-08T23:18:25.235 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 4195378, 2024-05-08T23:18:25.235 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 0, 2024-05-08T23:18:25.235 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2024-05-08T23:18:25.235 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3, 2024-05-08T23:18:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.014006832, 2024-05-08T23:18:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.004668944 2024-05-08T23:18:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 0 2024-05-08T23:18:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2024-05-08T23:18:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 20, 2024-05-08T23:18:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 22, 2024-05-08T23:18:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 2, 2024-05-08T23:18:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 19, 2024-05-08T23:18:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 22, 2024-05-08T23:18:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 3, 2024-05-08T23:18:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 16, 2024-05-08T23:18:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 20, 2024-05-08T23:18:25.236 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 4, 2024-05-08T23:18:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 0, 2024-05-08T23:18:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 0, 2024-05-08T23:18:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 0, 2024-05-08T23:18:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 48072, 2024-05-08T23:18:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 198964 2024-05-08T23:18:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2024-05-08T23:18:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 0, 2024-05-08T23:18:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 0, 2024-05-08T23:18:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 0, 2024-05-08T23:18:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 5, 2024-05-08T23:18:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 0, 2024-05-08T23:18:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2024-05-08T23:18:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.237 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2024-05-08T23:18:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2024-05-08T23:18:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.238 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2024-05-08T23:18:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2024-05-08T23:18:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2024-05-08T23:18:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.239 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2024-05-08T23:18:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2024-05-08T23:18:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.240 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2024-05-08T23:18:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.241 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2024-05-08T23:18:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2024-05-08T23:18:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2024-05-08T23:18:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.242 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2024-05-08T23:18:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2024-05-08T23:18:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.243 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2024-05-08T23:18:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2024-05-08T23:18:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2024-05-08T23:18:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.244 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2024-05-08T23:18:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2024-05-08T23:18:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.245 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2024-05-08T23:18:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2024-05-08T23:18:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.246 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2024-05-08T23:18:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2024-05-08T23:18:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2024-05-08T23:18:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.247 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.248 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.248 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.248 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2024-05-08T23:18:25.248 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.248 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.248 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.248 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.248 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2024-05-08T23:18:25.248 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.248 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.249 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.249 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.249 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2024-05-08T23:18:25.249 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.249 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.249 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.249 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.249 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2024-05-08T23:18:25.249 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.250 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.250 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.250 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.250 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2024-05-08T23:18:25.250 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.250 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.250 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.251 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.251 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2024-05-08T23:18:25.251 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2024-05-08T23:18:25.251 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2024-05-08T23:18:25.251 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.251 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.251 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.251 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:25.251 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.252 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2024-05-08T23:18:25.252 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 0, 2024-05-08T23:18:25.252 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 1, 2024-05-08T23:18:25.252 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 1, 2024-05-08T23:18:25.252 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 0, 2024-05-08T23:18:25.252 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2024-05-08T23:18:25.252 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 0, 2024-05-08T23:18:25.252 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 0, 2024-05-08T23:18:25.253 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 138, 2024-05-08T23:18:25.253 INFO:teuthology.orchestra.run.smithi195.stdout: "mdthresh_evicted": 0 2024-05-08T23:18:25.253 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.253 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2024-05-08T23:18:25.253 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2024-05-08T23:18:25.253 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2024-05-08T23:18:25.253 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T23:18:25.254 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2024-05-08T23:18:25.254 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T23:18:25.254 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2024-05-08T23:18:25.254 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T23:18:25.254 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T23:18:25.254 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T23:18:25.254 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T23:18:25.255 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T23:18:25.255 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2024-05-08T23:18:25.255 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T23:18:25.255 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T23:18:25.255 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2024-05-08T23:18:25.255 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2024-05-08T23:18:25.255 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2024-05-08T23:18:25.255 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2024-05-08T23:18:25.256 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T23:18:25.256 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T23:18:25.256 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T23:18:25.256 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T23:18:25.256 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T23:18:25.256 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2024-05-08T23:18:25.256 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2024-05-08T23:18:25.256 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2024-05-08T23:18:25.256 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T23:18:25.256 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T23:18:25.256 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2024-05-08T23:18:25.256 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2024-05-08T23:18:25.256 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 221959, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 67, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2024-05-08T23:18:25.257 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 7720, 2024-05-08T23:18:25.258 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 162, 2024-05-08T23:18:25.258 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T23:18:25.258 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2024-05-08T23:18:25.258 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2024-05-08T23:18:25.258 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2024-05-08T23:18:25.258 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 79629, 2024-05-08T23:18:25.258 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 320, 2024-05-08T23:18:25.258 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2024-05-08T23:18:25.258 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2024-05-08T23:18:25.258 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2024-05-08T23:18:25.258 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2024-05-08T23:18:25.258 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.258 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2024-05-08T23:18:25.258 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 38, 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 11286, 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 33, 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 38, 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 38, 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.221995996, 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.005841999 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 38, 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 60 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.259 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 38, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 0, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 38, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 0, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 10, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 0, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 3, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 6, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 0, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 6, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2024-05-08T23:18:25.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2024-05-08T23:18:25.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2024-05-08T23:18:25.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 0, 2024-05-08T23:18:25.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 20, 2024-05-08T23:18:25.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2024-05-08T23:18:25.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2024-05-08T23:18:25.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2024-05-08T23:18:25.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2024-05-08T23:18:25.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2024-05-08T23:18:25.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2024-05-08T23:18:25.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T23:18:25.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2024-05-08T23:18:25.262 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2024-05-08T23:18:25.262 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2024-05-08T23:18:25.262 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2024-05-08T23:18:25.262 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2024-05-08T23:18:25.262 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2024-05-08T23:18:25.262 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2024-05-08T23:18:25.262 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2024-05-08T23:18:25.262 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2024-05-08T23:18:25.262 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2024-05-08T23:18:25.263 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2024-05-08T23:18:25.263 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2024-05-08T23:18:25.263 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2024-05-08T23:18:25.263 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2024-05-08T23:18:25.263 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2024-05-08T23:18:25.263 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2024-05-08T23:18:25.263 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2024-05-08T23:18:25.263 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2024-05-08T23:18:25.263 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2024-05-08T23:18:25.263 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 85, 2024-05-08T23:18:25.263 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2024-05-08T23:18:25.263 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 2, 2024-05-08T23:18:25.264 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 8, 2024-05-08T23:18:25.264 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 8, 2024-05-08T23:18:25.264 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 0, 2024-05-08T23:18:25.264 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2024-05-08T23:18:25.264 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 14, 2024-05-08T23:18:25.264 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 0, 2024-05-08T23:18:25.264 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 1 2024-05-08T23:18:25.264 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.264 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2024-05-08T23:18:25.264 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 1, 2024-05-08T23:18:25.265 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2024-05-08T23:18:25.265 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2024-05-08T23:18:25.265 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2024-05-08T23:18:25.265 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.265 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2024-05-08T23:18:25.265 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 0 2024-05-08T23:18:25.265 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.265 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2024-05-08T23:18:25.265 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2024-05-08T23:18:25.265 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T23:18:25.265 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2024-05-08T23:18:25.265 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 0, 2024-05-08T23:18:25.265 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 0, 2024-05-08T23:18:25.265 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2024-05-08T23:18:25.265 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.266 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T23:18:25.266 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:25.266 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-05-08T23:18:25.266 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:25.266 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 368, 2024-05-08T23:18:25.266 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 519571, 2024-05-08T23:18:25.266 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:25.266 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 368, 2024-05-08T23:18:25.266 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-05-08T23:18:25.266 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-05-08T23:18:25.266 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 368, 2024-05-08T23:18:25.266 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 519571, 2024-05-08T23:18:25.266 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:25.266 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.267 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.267 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.267 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:25.267 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.267 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2024-05-08T23:18:25.267 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:25.267 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-05-08T23:18:25.267 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:25.267 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-05-08T23:18:25.267 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-05-08T23:18:25.267 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:25.268 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:25.268 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 38, 2024-05-08T23:18:25.268 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 11286, 2024-05-08T23:18:25.268 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 38, 2024-05-08T23:18:25.268 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 11286, 2024-05-08T23:18:25.268 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:25.268 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.268 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.269 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.269 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:25.269 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.269 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2024-05-08T23:18:25.269 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:25.269 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2024-05-08T23:18:25.269 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:25.269 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-05-08T23:18:25.269 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-05-08T23:18:25.269 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:25.269 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:25.269 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 38, 2024-05-08T23:18:25.270 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 38, 2024-05-08T23:18:25.270 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 38, 2024-05-08T23:18:25.270 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 38, 2024-05-08T23:18:25.270 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:25.270 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.270 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.270 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.270 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:25.270 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.270 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2024-05-08T23:18:25.270 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:25.271 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-05-08T23:18:25.271 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:25.271 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-05-08T23:18:25.271 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-05-08T23:18:25.271 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:25.271 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-05-08T23:18:25.271 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-05-08T23:18:25.271 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-05-08T23:18:25.272 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 0, 2024-05-08T23:18:25.272 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 0, 2024-05-08T23:18:25.272 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:25.272 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.272 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.272 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.272 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:25.272 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T23:18:25.272 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x55e2d77200a0": { 2024-05-08T23:18:25.272 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-05-08T23:18:25.272 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-05-08T23:18:25.272 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-05-08T23:18:25.272 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 3, 2024-05-08T23:18:25.273 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 1074, 2024-05-08T23:18:25.273 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-05-08T23:18:25.273 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 3, 2024-05-08T23:18:25.273 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-05-08T23:18:25.273 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-05-08T23:18:25.273 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 3, 2024-05-08T23:18:25.273 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 1074, 2024-05-08T23:18:25.273 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-05-08T23:18:25.273 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-05-08T23:18:25.273 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-05-08T23:18:25.273 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-05-08T23:18:25.273 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:25.273 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T23:18:25.274 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-05-08T23:18:25.426 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:25 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:18:25.426 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:25 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:18:25.426 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:25 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:18:25.426 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:25 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:18:25.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:25 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:18:25.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:25 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:18:25.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:25 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:18:25.454 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:25 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:18:25.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:25 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:18:25.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:25 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:18:25.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:25 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:18:25.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:25 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' 2024-05-08T23:18:25.648 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-05-08T23:18:25.648 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-05-08T23:18:25.648 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-05-08T23:18:25.648 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=11 2024-05-08T23:18:25.648 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-08T23:18:25.659 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-08T23:18:25.659 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:18:25.660 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T23:18:25.680 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:18:25.680 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T23:18:25.739 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T23:18:25.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.906+0000 7fefad484700 1 -- 172.21.15.135:0/2931285107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa8106c00 msgr2=0x7fefa8108ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:25.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.906+0000 7fefad484700 1 --2- 172.21.15.135:0/2931285107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa8106c00 0x7fefa8108ff0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fefa000b0a0 tx=0x7fefa000b3b0 comp rx=0 tx=0).stop 2024-05-08T23:18:25.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.906+0000 7fefad484700 1 -- 172.21.15.135:0/2931285107 shutdown_connections 2024-05-08T23:18:25.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.906+0000 7fefad484700 1 --2- 172.21.15.135:0/2931285107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa8106c00 0x7fefa8108ff0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:25.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.906+0000 7fefad484700 1 --2- 172.21.15.135:0/2931285107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefa81019a0 0x7fefa8103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:25.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.906+0000 7fefad484700 1 --2- 172.21.15.135:0/2931285107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefa81042d0 0x7fefa81066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:25.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.906+0000 7fefad484700 1 -- 172.21.15.135:0/2931285107 >> 172.21.15.135:0/2931285107 conn(0x7fefa80fb2f0 msgr2=0x7fefa80fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:25.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.906+0000 7fefad484700 1 -- 172.21.15.135:0/2931285107 shutdown_connections 2024-05-08T23:18:25.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.906+0000 7fefad484700 1 -- 172.21.15.135:0/2931285107 wait complete. 2024-05-08T23:18:25.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefad484700 1 Processor -- start 2024-05-08T23:18:25.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefad484700 1 -- start start 2024-05-08T23:18:25.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefad484700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefa81019a0 0x7fefa81012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:25.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefad484700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa81042d0 0x7fefa80ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:25.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefad484700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefa8106c00 0x7fefa80ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:25.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefad484700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8100630 con 0x7fefa81042d0 2024-05-08T23:18:25.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefad484700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa81007a0 con 0x7fefa81019a0 2024-05-08T23:18:25.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefad484700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa81a0f00 con 0x7fefa8106c00 2024-05-08T23:18:25.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefa67fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa81042d0 0x7fefa80ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:25.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefa67fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa81042d0 0x7fefa80ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35362/0 (socket says 172.21.15.135:35362) 2024-05-08T23:18:25.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefa67fc700 1 -- 172.21.15.135:0/2596365305 learned_addr learned my addr 172.21.15.135:0/2596365305 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:25.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefa77fe700 1 --2- 172.21.15.135:0/2596365305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefa8106c00 0x7fefa80ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:25.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefa67fc700 1 -- 172.21.15.135:0/2596365305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefa8106c00 msgr2=0x7fefa80ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:25.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefa67fc700 1 --2- 172.21.15.135:0/2596365305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefa8106c00 0x7fefa80ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:25.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefa67fc700 1 -- 172.21.15.135:0/2596365305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefa81019a0 msgr2=0x7fefa81012c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:25.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefa67fc700 1 --2- 172.21.15.135:0/2596365305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefa81019a0 0x7fefa81012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:25.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefa67fc700 1 -- 172.21.15.135:0/2596365305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa0009d00 con 0x7fefa81042d0 2024-05-08T23:18:25.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.907+0000 7fefa77fe700 1 --2- 172.21.15.135:0/2596365305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefa8106c00 0x7fefa80ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:18:25.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.908+0000 7fefa67fc700 1 --2- 172.21.15.135:0/2596365305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa81042d0 0x7fefa80ff950 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00d980 tx=0x7fef9c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:25.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.908+0000 7fef8ffff700 1 -- 172.21.15.135:0/2596365305 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c004220 con 0x7fefa81042d0 2024-05-08T23:18:25.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.908+0000 7fef8ffff700 1 -- 172.21.15.135:0/2596365305 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef9c007640 con 0x7fefa81042d0 2024-05-08T23:18:25.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.908+0000 7fefad484700 1 -- 172.21.15.135:0/2596365305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa81a1190 con 0x7fefa81042d0 2024-05-08T23:18:25.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.908+0000 7fef8ffff700 1 -- 172.21.15.135:0/2596365305 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c004e20 con 0x7fefa81042d0 2024-05-08T23:18:25.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.908+0000 7fefad484700 1 -- 172.21.15.135:0/2596365305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa81a16a0 con 0x7fefa81042d0 2024-05-08T23:18:25.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.909+0000 7fefad484700 1 -- 172.21.15.135:0/2596365305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa80fce70 con 0x7fefa81042d0 2024-05-08T23:18:25.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.910+0000 7fef8ffff700 1 -- 172.21.15.135:0/2596365305 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fef9c00b900 con 0x7fefa81042d0 2024-05-08T23:18:25.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.911+0000 7fef8ffff700 1 --2- 172.21.15.135:0/2596365305 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fef900a1120 0x7fef900a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:25.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.911+0000 7fef8ffff700 1 -- 172.21.15.135:0/2596365305 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fef9c0ccd20 con 0x7fefa81042d0 2024-05-08T23:18:25.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.911+0000 7fefa6ffd700 1 --2- 172.21.15.135:0/2596365305 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fef900a1120 0x7fef900a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:25.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.911+0000 7fefa6ffd700 1 --2- 172.21.15.135:0/2596365305 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fef900a1120 0x7fef900a35e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fef9800a990 tx=0x7fef98005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:25.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:25.915+0000 7fef8ffff700 1 -- 172.21.15.135:0/2596365305 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fef9c096430 con 0x7fefa81042d0 2024-05-08T23:18:26.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.114+0000 7fefad484700 1 -- 172.21.15.135:0/2596365305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefa810c640 con 0x7fefa81042d0 2024-05-08T23:18:26.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.116+0000 7fef8ffff700 1 -- 172.21.15.135:0/2596365305 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22702 (secure 0 0 0) 0x7fef9c016090 con 0x7fefa81042d0 2024-05-08T23:18:26.116 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:18:26.116 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":85,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:15:22.121685+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T23:14:19.726838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T23:14:21.097732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:18:26.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.118+0000 7fefad484700 1 -- 172.21.15.135:0/2596365305 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fef900a1120 msgr2=0x7fef900a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:26.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.118+0000 7fefad484700 1 --2- 172.21.15.135:0/2596365305 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fef900a1120 0x7fef900a35e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fef9800a990 tx=0x7fef98005c80 comp rx=0 tx=0).stop 2024-05-08T23:18:26.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.118+0000 7fefad484700 1 -- 172.21.15.135:0/2596365305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa81042d0 msgr2=0x7fefa80ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:26.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.118+0000 7fefad484700 1 --2- 172.21.15.135:0/2596365305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa81042d0 0x7fefa80ff950 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00d980 tx=0x7fef9c00dd40 comp rx=0 tx=0).stop 2024-05-08T23:18:26.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.118+0000 7fefad484700 1 -- 172.21.15.135:0/2596365305 shutdown_connections 2024-05-08T23:18:26.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.118+0000 7fefad484700 1 --2- 172.21.15.135:0/2596365305 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fef900a1120 0x7fef900a35e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.118+0000 7fefad484700 1 --2- 172.21.15.135:0/2596365305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefa8106c00 0x7fefa80ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.118+0000 7fefad484700 1 --2- 172.21.15.135:0/2596365305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fefa81019a0 0x7fefa81012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.118+0000 7fefad484700 1 --2- 172.21.15.135:0/2596365305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefa81042d0 0x7fefa80ff950 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.118+0000 7fefad484700 1 -- 172.21.15.135:0/2596365305 >> 172.21.15.135:0/2596365305 conn(0x7fefa80fb2f0 msgr2=0x7fefa8102260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:26.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.118+0000 7fefad484700 1 -- 172.21.15.135:0/2596365305 shutdown_connections 2024-05-08T23:18:26.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.118+0000 7fefad484700 1 -- 172.21.15.135:0/2596365305 wait complete. 2024-05-08T23:18:26.130 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:11:11.282550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T23:14:19.726838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T23:14:21.097732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T23:18:26.131 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T23:18:26.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.258+0000 7f5e44a52700 1 -- 172.21.15.135:0/2410207644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e40100fb0 msgr2=0x7f5e40101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:26.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.258+0000 7f5e44a52700 1 --2- 172.21.15.135:0/2410207644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e40100fb0 0x7f5e40101430 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009990 tx=0x7f5e30009ca0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.258+0000 7f5e44a52700 1 -- 172.21.15.135:0/2410207644 shutdown_connections 2024-05-08T23:18:26.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.258+0000 7f5e44a52700 1 --2- 172.21.15.135:0/2410207644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e400ffe60 0x7f5e40100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.258+0000 7f5e44a52700 1 --2- 172.21.15.135:0/2410207644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e40101970 0x7f5e40108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.258+0000 7f5e44a52700 1 --2- 172.21.15.135:0/2410207644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e40100fb0 0x7f5e40101430 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.258+0000 7f5e44a52700 1 -- 172.21.15.135:0/2410207644 >> 172.21.15.135:0/2410207644 conn(0x7f5e400fb3f0 msgr2=0x7f5e400fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.258+0000 7f5e44a52700 1 -- 172.21.15.135:0/2410207644 shutdown_connections 2024-05-08T23:18:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.259+0000 7f5e44a52700 1 -- 172.21.15.135:0/2410207644 wait complete. 2024-05-08T23:18:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.259+0000 7f5e44a52700 1 Processor -- start 2024-05-08T23:18:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.259+0000 7f5e44a52700 1 -- start start 2024-05-08T23:18:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.259+0000 7f5e44a52700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e400ffe60 0x7f5e401990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.259+0000 7f5e44a52700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e40100fb0 0x7f5e40199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.259+0000 7f5e44a52700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e40101970 0x7f5e401a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.259+0000 7f5e44a52700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e401a0c20 con 0x7f5e40100fb0 2024-05-08T23:18:26.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.259+0000 7f5e44a52700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e401a0d60 con 0x7f5e400ffe60 2024-05-08T23:18:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.259+0000 7f5e44a52700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e401a0ef0 con 0x7f5e40101970 2024-05-08T23:18:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.260+0000 7f5e3dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e40100fb0 0x7f5e40199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.260+0000 7f5e3dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e40100fb0 0x7f5e40199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35376/0 (socket says 172.21.15.135:35376) 2024-05-08T23:18:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.260+0000 7f5e3dd9b700 1 -- 172.21.15.135:0/3963178340 learned_addr learned my addr 172.21.15.135:0/3963178340 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.260+0000 7f5e3e59c700 1 --2- 172.21.15.135:0/3963178340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e400ffe60 0x7f5e401990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.260+0000 7f5e3dd9b700 1 -- 172.21.15.135:0/3963178340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e40101970 msgr2=0x7f5e401a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.260+0000 7f5e3dd9b700 1 --2- 172.21.15.135:0/3963178340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e40101970 0x7f5e401a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.260+0000 7f5e3dd9b700 1 -- 172.21.15.135:0/3963178340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e400ffe60 msgr2=0x7f5e401990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.260+0000 7f5e3dd9b700 1 --2- 172.21.15.135:0/3963178340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e400ffe60 0x7f5e401990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.260+0000 7f5e3dd9b700 1 -- 172.21.15.135:0/3963178340 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e300095f0 con 0x7f5e40100fb0 2024-05-08T23:18:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.260+0000 7f5e3dd9b700 1 --2- 172.21.15.135:0/3963178340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e40100fb0 0x7f5e40199630 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000c010 tx=0x7f5e30005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.260+0000 7f5e2f7fe700 1 -- 172.21.15.135:0/3963178340 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3001d070 con 0x7f5e40100fb0 2024-05-08T23:18:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.260+0000 7f5e2f7fe700 1 -- 172.21.15.135:0/3963178340 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e30004ca0 con 0x7f5e40100fb0 2024-05-08T23:18:26.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.260+0000 7f5e44a52700 1 -- 172.21.15.135:0/3963178340 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e401a1170 con 0x7f5e40100fb0 2024-05-08T23:18:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.260+0000 7f5e2f7fe700 1 -- 172.21.15.135:0/3963178340 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30005610 con 0x7f5e40100fb0 2024-05-08T23:18:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.260+0000 7f5e44a52700 1 -- 172.21.15.135:0/3963178340 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e401a1590 con 0x7f5e40100fb0 2024-05-08T23:18:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.261+0000 7f5e44a52700 1 -- 172.21.15.135:0/3963178340 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e40067cf0 con 0x7f5e40100fb0 2024-05-08T23:18:26.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.262+0000 7f5e2f7fe700 1 -- 172.21.15.135:0/3963178340 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f5e3000fc70 con 0x7f5e40100fb0 2024-05-08T23:18:26.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.263+0000 7f5e2f7fe700 1 --2- 172.21.15.135:0/3963178340 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5e280a11a0 0x7f5e280a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:26.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.263+0000 7f5e2f7fe700 1 -- 172.21.15.135:0/3963178340 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5e300cdbc0 con 0x7f5e40100fb0 2024-05-08T23:18:26.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.263+0000 7f5e3e59c700 1 --2- 172.21.15.135:0/3963178340 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5e280a11a0 0x7f5e280a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:26.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.263+0000 7f5e3e59c700 1 --2- 172.21.15.135:0/3963178340 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5e280a11a0 0x7f5e280a3660 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009bf0 tx=0x7f5e34009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:26.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.267+0000 7f5e2f7fe700 1 -- 172.21.15.135:0/3963178340 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5e300973c0 con 0x7f5e40100fb0 2024-05-08T23:18:26.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:26 smithi135 ceph-mon[42440]: pgmap v347: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-08T23:18:26.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:26 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2596365305' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:18:26.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.464+0000 7f5e44a52700 1 -- 172.21.15.135:0/3963178340 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e401a1810 con 0x7f5e40100fb0 2024-05-08T23:18:26.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.465+0000 7f5e2f7fe700 1 -- 172.21.15.135:0/3963178340 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e3009a9e0 con 0x7f5e40100fb0 2024-05-08T23:18:26.464 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T23:18:26.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.467+0000 7f5e44a52700 1 -- 172.21.15.135:0/3963178340 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5e280a11a0 msgr2=0x7f5e280a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:26.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.467+0000 7f5e44a52700 1 --2- 172.21.15.135:0/3963178340 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5e280a11a0 0x7f5e280a3660 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009bf0 tx=0x7f5e34009260 comp rx=0 tx=0).stop 2024-05-08T23:18:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.467+0000 7f5e44a52700 1 -- 172.21.15.135:0/3963178340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e40100fb0 msgr2=0x7f5e40199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.467+0000 7f5e44a52700 1 --2- 172.21.15.135:0/3963178340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e40100fb0 0x7f5e40199630 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000c010 tx=0x7f5e30005e80 comp rx=0 tx=0).stop 2024-05-08T23:18:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.467+0000 7f5e44a52700 1 -- 172.21.15.135:0/3963178340 shutdown_connections 2024-05-08T23:18:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.467+0000 7f5e44a52700 1 --2- 172.21.15.135:0/3963178340 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f5e280a11a0 0x7f5e280a3660 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.467+0000 7f5e44a52700 1 --2- 172.21.15.135:0/3963178340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e40101970 0x7f5e401a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.467+0000 7f5e44a52700 1 --2- 172.21.15.135:0/3963178340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e400ffe60 0x7f5e401990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.467+0000 7f5e44a52700 1 --2- 172.21.15.135:0/3963178340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e40100fb0 0x7f5e40199630 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.467+0000 7f5e44a52700 1 -- 172.21.15.135:0/3963178340 >> 172.21.15.135:0/3963178340 conn(0x7f5e400fb3f0 msgr2=0x7f5e40068040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.467+0000 7f5e44a52700 1 -- 172.21.15.135:0/3963178340 shutdown_connections 2024-05-08T23:18:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.467+0000 7f5e44a52700 1 -- 172.21.15.135:0/3963178340 wait complete. 2024-05-08T23:18:26.479 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T23:18:26.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:26 smithi179 ceph-mon[46314]: pgmap v347: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-08T23:18:26.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:26 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2596365305' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:18:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.605+0000 7f2ca5e47700 1 -- 172.21.15.135:0/1584544109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca0101920 msgr2=0x7f2ca01081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.605+0000 7f2ca5e47700 1 --2- 172.21.15.135:0/1584544109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca0101920 0x7f2ca01081d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800b0d0 tx=0x7f2c9800b3e0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.605+0000 7f2ca5e47700 1 -- 172.21.15.135:0/1584544109 shutdown_connections 2024-05-08T23:18:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.605+0000 7f2ca5e47700 1 --2- 172.21.15.135:0/1584544109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ca00ffd90 0x7f2ca01001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.605+0000 7f2ca5e47700 1 --2- 172.21.15.135:0/1584544109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca0101920 0x7f2ca01081d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.605+0000 7f2ca5e47700 1 --2- 172.21.15.135:0/1584544109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca0100f80 0x7f2ca01013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.605+0000 7f2ca5e47700 1 -- 172.21.15.135:0/1584544109 >> 172.21.15.135:0/1584544109 conn(0x7f2ca00fb300 msgr2=0x7f2ca00fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.605+0000 7f2ca5e47700 1 -- 172.21.15.135:0/1584544109 shutdown_connections 2024-05-08T23:18:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.605+0000 7f2ca5e47700 1 -- 172.21.15.135:0/1584544109 wait complete. 2024-05-08T23:18:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.606+0000 7f2ca5e47700 1 Processor -- start 2024-05-08T23:18:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.606+0000 7f2ca5e47700 1 -- start start 2024-05-08T23:18:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.606+0000 7f2ca5e47700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca00ffd90 0x7f2ca01990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.606+0000 7f2ca5e47700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca0100f80 0x7f2ca01995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.606+0000 7f2ca5e47700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ca0101920 0x7f2ca01a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.606+0000 7f2ca5e47700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca01a0be0 con 0x7f2ca00ffd90 2024-05-08T23:18:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.606+0000 7f2ca5e47700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca01a0d20 con 0x7f2ca0100f80 2024-05-08T23:18:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.606+0000 7f2ca5e47700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca01a0eb0 con 0x7f2ca0101920 2024-05-08T23:18:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.606+0000 7f2c9f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca00ffd90 0x7f2ca01990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.606+0000 7f2c9f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca00ffd90 0x7f2ca01990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35400/0 (socket says 172.21.15.135:35400) 2024-05-08T23:18:26.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.606+0000 7f2c9f7fe700 1 -- 172.21.15.135:0/2700635767 learned_addr learned my addr 172.21.15.135:0/2700635767 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:26.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.607+0000 7f2c9ffff700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ca0101920 0x7f2ca01a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:26.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.607+0000 7f2c9effd700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca0100f80 0x7f2ca01995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:26.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.607+0000 7f2c9f7fe700 1 -- 172.21.15.135:0/2700635767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ca0101920 msgr2=0x7f2ca01a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:26.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.607+0000 7f2c9f7fe700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ca0101920 0x7f2ca01a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.607+0000 7f2c9f7fe700 1 -- 172.21.15.135:0/2700635767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca0100f80 msgr2=0x7f2ca01995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:26.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.607+0000 7f2c9f7fe700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca0100f80 0x7f2ca01995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.607+0000 7f2c9f7fe700 1 -- 172.21.15.135:0/2700635767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c98009d00 con 0x7f2ca00ffd90 2024-05-08T23:18:26.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.607+0000 7f2c9ffff700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ca0101920 0x7f2ca01a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:18:26.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.607+0000 7f2c9effd700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca0100f80 0x7f2ca01995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:18:26.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.607+0000 7f2c9f7fe700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca00ffd90 0x7f2ca01990b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000e970 tx=0x7f2c9000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:26.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.607+0000 7f2c9cff9700 1 -- 172.21.15.135:0/2700635767 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90009790 con 0x7f2ca00ffd90 2024-05-08T23:18:26.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.607+0000 7f2c9cff9700 1 -- 172.21.15.135:0/2700635767 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c900044e0 con 0x7f2ca00ffd90 2024-05-08T23:18:26.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.607+0000 7f2ca5e47700 1 -- 172.21.15.135:0/2700635767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca01a1190 con 0x7f2ca00ffd90 2024-05-08T23:18:26.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.607+0000 7f2c9cff9700 1 -- 172.21.15.135:0/2700635767 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90003e30 con 0x7f2ca00ffd90 2024-05-08T23:18:26.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.607+0000 7f2ca5e47700 1 -- 172.21.15.135:0/2700635767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca01a16f0 con 0x7f2ca00ffd90 2024-05-08T23:18:26.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.608+0000 7f2ca5e47700 1 -- 172.21.15.135:0/2700635767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca0107140 con 0x7f2ca00ffd90 2024-05-08T23:18:26.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.609+0000 7f2c9cff9700 1 -- 172.21.15.135:0/2700635767 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f2c90003f90 con 0x7f2ca00ffd90 2024-05-08T23:18:26.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.609+0000 7f2c9cff9700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c880a1200 0x7f2c880a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:26.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.610+0000 7f2c9effd700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c880a1200 0x7f2c880a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:26.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.610+0000 7f2c9cff9700 1 -- 172.21.15.135:0/2700635767 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2c90014070 con 0x7f2ca00ffd90 2024-05-08T23:18:26.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.610+0000 7f2c9effd700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c880a1200 0x7f2c880a36c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2c94005fd0 tx=0x7f2c94005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:26.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.613+0000 7f2c9cff9700 1 -- 172.21.15.135:0/2700635767 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2c900964b0 con 0x7f2ca00ffd90 2024-05-08T23:18:26.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:26 smithi195 ceph-mon[46516]: pgmap v347: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-08T23:18:26.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:26 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2596365305' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:18:26.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.811+0000 7f2ca5e47700 1 -- 172.21.15.135:0/2700635767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ca010ea40 con 0x7f2ca00ffd90 2024-05-08T23:18:26.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.811+0000 7f2c9cff9700 1 -- 172.21.15.135:0/2700635767 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2c90099ad0 con 0x7f2ca00ffd90 2024-05-08T23:18:26.811 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T23:18:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.813+0000 7f2ca5e47700 1 -- 172.21.15.135:0/2700635767 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c880a1200 msgr2=0x7f2c880a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.813+0000 7f2ca5e47700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c880a1200 0x7f2c880a36c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2c94005fd0 tx=0x7f2c94005dc0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.813+0000 7f2ca5e47700 1 -- 172.21.15.135:0/2700635767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca00ffd90 msgr2=0x7f2ca01990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.813+0000 7f2ca5e47700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca00ffd90 0x7f2ca01990b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000e970 tx=0x7f2c9000ed30 comp rx=0 tx=0).stop 2024-05-08T23:18:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.813+0000 7f2ca5e47700 1 -- 172.21.15.135:0/2700635767 shutdown_connections 2024-05-08T23:18:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.813+0000 7f2ca5e47700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f2c880a1200 0x7f2c880a36c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.813+0000 7f2ca5e47700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ca0101920 0x7f2ca01a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.813+0000 7f2ca5e47700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca00ffd90 0x7f2ca01990b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.813+0000 7f2ca5e47700 1 --2- 172.21.15.135:0/2700635767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ca0100f80 0x7f2ca01995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.813+0000 7f2ca5e47700 1 -- 172.21.15.135:0/2700635767 >> 172.21.15.135:0/2700635767 conn(0x7f2ca00fb300 msgr2=0x7f2ca0104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:26.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.813+0000 7f2ca5e47700 1 -- 172.21.15.135:0/2700635767 shutdown_connections 2024-05-08T23:18:26.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.814+0000 7f2ca5e47700 1 -- 172.21.15.135:0/2700635767 wait complete. 2024-05-08T23:18:26.826 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T23:18:26.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.952+0000 7f49852f7700 1 -- 172.21.15.135:0/425370803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49801022b0 msgr2=0x7f4980102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:26.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.952+0000 7f49852f7700 1 --2- 172.21.15.135:0/425370803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49801022b0 0x7f4980102710 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4970009990 tx=0x7f4970009ca0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.952+0000 7f49852f7700 1 -- 172.21.15.135:0/425370803 shutdown_connections 2024-05-08T23:18:26.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.952+0000 7f49852f7700 1 --2- 172.21.15.135:0/425370803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4980102c50 0x7f4980109500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.952+0000 7f49852f7700 1 --2- 172.21.15.135:0/425370803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49800ff240 0x7f49800ff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.952+0000 7f49852f7700 1 --2- 172.21.15.135:0/425370803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49801022b0 0x7f4980102710 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.952+0000 7f49852f7700 1 -- 172.21.15.135:0/425370803 >> 172.21.15.135:0/425370803 conn(0x7f49800fab50 msgr2=0x7f49800fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:26.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.952+0000 7f49852f7700 1 -- 172.21.15.135:0/425370803 shutdown_connections 2024-05-08T23:18:26.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.952+0000 7f49852f7700 1 -- 172.21.15.135:0/425370803 wait complete. 2024-05-08T23:18:26.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.952+0000 7f49852f7700 1 Processor -- start 2024-05-08T23:18:26.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f49852f7700 1 -- start start 2024-05-08T23:18:26.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f49852f7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49800ff240 0x7f4980198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:26.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f49852f7700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49801022b0 0x7f4980199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:26.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f49852f7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4980102c50 0x7f49801a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:26.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f49852f7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49801a0b10 con 0x7f4980102c50 2024-05-08T23:18:26.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f49852f7700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49801a0c50 con 0x7f49801022b0 2024-05-08T23:18:26.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f49852f7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49801a0de0 con 0x7f49800ff240 2024-05-08T23:18:26.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f497f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4980102c50 0x7f49801a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:26.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f497f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4980102c50 0x7f49801a0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35422/0 (socket says 172.21.15.135:35422) 2024-05-08T23:18:26.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f497f7fe700 1 -- 172.21.15.135:0/160418107 learned_addr learned my addr 172.21.15.135:0/160418107 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:26.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f497e7fc700 1 --2- 172.21.15.135:0/160418107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49801022b0 0x7f4980199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:26.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f497effd700 1 --2- 172.21.15.135:0/160418107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49800ff240 0x7f4980198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:26.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f497f7fe700 1 -- 172.21.15.135:0/160418107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49800ff240 msgr2=0x7f4980198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:26.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f497f7fe700 1 --2- 172.21.15.135:0/160418107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49800ff240 0x7f4980198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f497f7fe700 1 -- 172.21.15.135:0/160418107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49801022b0 msgr2=0x7f4980199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:26.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f497f7fe700 1 --2- 172.21.15.135:0/160418107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49801022b0 0x7f4980199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:26.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f497f7fe700 1 -- 172.21.15.135:0/160418107 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49700095f0 con 0x7f4980102c50 2024-05-08T23:18:26.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f497effd700 1 --2- 172.21.15.135:0/160418107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49800ff240 0x7f4980198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:18:26.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f497f7fe700 1 --2- 172.21.15.135:0/160418107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4980102c50 0x7f49801a0540 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4978007d70 tx=0x7f497800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:26.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f4967fff700 1 -- 172.21.15.135:0/160418107 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497800ad40 con 0x7f4980102c50 2024-05-08T23:18:26.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f4967fff700 1 -- 172.21.15.135:0/160418107 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49780128e0 con 0x7f4980102c50 2024-05-08T23:18:26.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.953+0000 7f49852f7700 1 -- 172.21.15.135:0/160418107 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49801a10c0 con 0x7f4980102c50 2024-05-08T23:18:26.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.954+0000 7f4967fff700 1 -- 172.21.15.135:0/160418107 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49780116b0 con 0x7f4980102c50 2024-05-08T23:18:26.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.954+0000 7f49852f7700 1 -- 172.21.15.135:0/160418107 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49801a15d0 con 0x7f4980102c50 2024-05-08T23:18:26.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.954+0000 7f49852f7700 1 -- 172.21.15.135:0/160418107 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4980067460 con 0x7f4980102c50 2024-05-08T23:18:26.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.956+0000 7f4967fff700 1 -- 172.21.15.135:0/160418107 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f4978012420 con 0x7f4980102c50 2024-05-08T23:18:26.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.956+0000 7f4967fff700 1 --2- 172.21.15.135:0/160418107 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f49680a11a0 0x7f49680a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:26.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.956+0000 7f497effd700 1 --2- 172.21.15.135:0/160418107 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f49680a11a0 0x7f49680a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:26.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.956+0000 7f4967fff700 1 -- 172.21.15.135:0/160418107 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f49780ccf00 con 0x7f4980102c50 2024-05-08T23:18:26.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.957+0000 7f497effd700 1 --2- 172.21.15.135:0/160418107 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f49680a11a0 0x7f49680a3660 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4974005fd0 tx=0x7f4974005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:26.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:26.960+0000 7f4967fff700 1 -- 172.21.15.135:0/160418107 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4978096670 con 0x7f4980102c50 2024-05-08T23:18:27.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.158+0000 7f49852f7700 1 -- 172.21.15.135:0/160418107 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49801a18f0 con 0x7f4980102c50 2024-05-08T23:18:27.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.158+0000 7f4967fff700 1 -- 172.21.15.135:0/160418107 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4978099c90 con 0x7f4980102c50 2024-05-08T23:18:27.158 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-08T23:18:27.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.160+0000 7f49852f7700 1 -- 172.21.15.135:0/160418107 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f49680a11a0 msgr2=0x7f49680a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:27.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.160+0000 7f49852f7700 1 --2- 172.21.15.135:0/160418107 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f49680a11a0 0x7f49680a3660 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4974005fd0 tx=0x7f4974005e40 comp rx=0 tx=0).stop 2024-05-08T23:18:27.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.160+0000 7f49852f7700 1 -- 172.21.15.135:0/160418107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4980102c50 msgr2=0x7f49801a0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:27.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.160+0000 7f49852f7700 1 --2- 172.21.15.135:0/160418107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4980102c50 0x7f49801a0540 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4978007d70 tx=0x7f497800a340 comp rx=0 tx=0).stop 2024-05-08T23:18:27.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.160+0000 7f49852f7700 1 -- 172.21.15.135:0/160418107 shutdown_connections 2024-05-08T23:18:27.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.160+0000 7f49852f7700 1 --2- 172.21.15.135:0/160418107 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f49680a11a0 0x7f49680a3660 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:27.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.160+0000 7f49852f7700 1 --2- 172.21.15.135:0/160418107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49800ff240 0x7f4980198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:27.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.160+0000 7f49852f7700 1 --2- 172.21.15.135:0/160418107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4980102c50 0x7f49801a0540 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:27.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.160+0000 7f49852f7700 1 --2- 172.21.15.135:0/160418107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49801022b0 0x7f4980199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:27.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.160+0000 7f49852f7700 1 -- 172.21.15.135:0/160418107 >> 172.21.15.135:0/160418107 conn(0x7f49800fab50 msgr2=0x7f49801000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:27.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.161+0000 7f49852f7700 1 -- 172.21.15.135:0/160418107 shutdown_connections 2024-05-08T23:18:27.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.161+0000 7f49852f7700 1 -- 172.21.15.135:0/160418107 wait complete. 2024-05-08T23:18:27.173 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T23:18:27.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.297+0000 7f73c2cad700 1 -- 172.21.15.135:0/3877849770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0ff220 msgr2=0x7f73bc0ff640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:27.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.297+0000 7f73c2cad700 1 --2- 172.21.15.135:0/3877849770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0ff220 0x7f73bc0ff640 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f73b0009990 tx=0x7f73b0009ca0 comp rx=0 tx=0).stop 2024-05-08T23:18:27.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.297+0000 7f73c2cad700 1 -- 172.21.15.135:0/3877849770 shutdown_connections 2024-05-08T23:18:27.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.297+0000 7f73c2cad700 1 --2- 172.21.15.135:0/3877849770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73bc100940 0x7f73bc1011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.297+0000 7f73c2cad700 1 --2- 172.21.15.135:0/3877849770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0ff220 0x7f73bc0ff640 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.297+0000 7f73c2cad700 1 --2- 172.21.15.135:0/3877849770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73bc0fff80 0x7f73bc100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.297+0000 7f73c2cad700 1 -- 172.21.15.135:0/3877849770 >> 172.21.15.135:0/3877849770 conn(0x7f73bc0fab50 msgr2=0x7f73bc0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.297+0000 7f73c2cad700 1 -- 172.21.15.135:0/3877849770 shutdown_connections 2024-05-08T23:18:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.297+0000 7f73c2cad700 1 -- 172.21.15.135:0/3877849770 wait complete. 2024-05-08T23:18:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73c2cad700 1 Processor -- start 2024-05-08T23:18:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73c2cad700 1 -- start start 2024-05-08T23:18:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73c2cad700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73bc0ff220 0x7f73bc1990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73c2cad700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0fff80 0x7f73bc199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73c2cad700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73bc100940 0x7f73bc1a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73c2cad700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc1a0c10 con 0x7f73bc0fff80 2024-05-08T23:18:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73c2cad700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc1a0d50 con 0x7f73bc0ff220 2024-05-08T23:18:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73c2cad700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc1a0ee0 con 0x7f73bc100940 2024-05-08T23:18:27.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73bbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0fff80 0x7f73bc199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:27.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73bbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0fff80 0x7f73bc199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35428/0 (socket says 172.21.15.135:35428) 2024-05-08T23:18:27.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73bbfff700 1 -- 172.21.15.135:0/1230780766 learned_addr learned my addr 172.21.15.135:0/1230780766 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:27.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73c0a49700 1 --2- 172.21.15.135:0/1230780766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73bc0ff220 0x7f73bc1990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:27.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73c124a700 1 --2- 172.21.15.135:0/1230780766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73bc100940 0x7f73bc1a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:27.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73bbfff700 1 -- 172.21.15.135:0/1230780766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73bc100940 msgr2=0x7f73bc1a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:27.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73bbfff700 1 --2- 172.21.15.135:0/1230780766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73bc100940 0x7f73bc1a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:27.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73bbfff700 1 -- 172.21.15.135:0/1230780766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73bc0ff220 msgr2=0x7f73bc1990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:27.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73bbfff700 1 --2- 172.21.15.135:0/1230780766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73bc0ff220 0x7f73bc1990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:27.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73bbfff700 1 -- 172.21.15.135:0/1230780766 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b00095f0 con 0x7f73bc0fff80 2024-05-08T23:18:27.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.298+0000 7f73c124a700 1 --2- 172.21.15.135:0/1230780766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73bc100940 0x7f73bc1a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:18:27.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.299+0000 7f73bbfff700 1 --2- 172.21.15.135:0/1230780766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0fff80 0x7f73bc199620 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f73a800b530 tx=0x7f73a800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:27.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.299+0000 7f73b9ffb700 1 -- 172.21.15.135:0/1230780766 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8011830 con 0x7f73bc0fff80 2024-05-08T23:18:27.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.299+0000 7f73c2cad700 1 -- 172.21.15.135:0/1230780766 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73bc1a11c0 con 0x7f73bc0fff80 2024-05-08T23:18:27.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.299+0000 7f73b9ffb700 1 -- 172.21.15.135:0/1230780766 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73a8011e50 con 0x7f73bc0fff80 2024-05-08T23:18:27.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.299+0000 7f73b9ffb700 1 -- 172.21.15.135:0/1230780766 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a800f2e0 con 0x7f73bc0fff80 2024-05-08T23:18:27.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.299+0000 7f73c2cad700 1 -- 172.21.15.135:0/1230780766 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73bc1a1720 con 0x7f73bc0fff80 2024-05-08T23:18:27.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.300+0000 7f73c2cad700 1 -- 172.21.15.135:0/1230780766 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73bc10b010 con 0x7f73bc0fff80 2024-05-08T23:18:27.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.301+0000 7f73b9ffb700 1 -- 172.21.15.135:0/1230780766 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f73a8010380 con 0x7f73bc0fff80 2024-05-08T23:18:27.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.301+0000 7f73b9ffb700 1 --2- 172.21.15.135:0/1230780766 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73ac0a1120 0x7f73ac0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:27.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.301+0000 7f73b9ffb700 1 -- 172.21.15.135:0/1230780766 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f73a80cc4a0 con 0x7f73bc0fff80 2024-05-08T23:18:27.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.301+0000 7f73c0a49700 1 --2- 172.21.15.135:0/1230780766 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73ac0a1120 0x7f73ac0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:27.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.302+0000 7f73c0a49700 1 --2- 172.21.15.135:0/1230780766 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73ac0a1120 0x7f73ac0a35e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f73b000b5c0 tx=0x7f73b0003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:27.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.306+0000 7f73b9ffb700 1 -- 172.21.15.135:0/1230780766 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f73a8095c10 con 0x7f73bc0fff80 2024-05-08T23:18:27.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:27 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3963178340' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:18:27.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:27 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2700635767' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:18:27.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:27 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/160418107' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:18:27.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.522+0000 7f73c2cad700 1 -- 172.21.15.135:0/1230780766 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f73bc10a9f0 con 0x7f73bc0fff80 2024-05-08T23:18:27.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.522+0000 7f73b9ffb700 1 -- 172.21.15.135:0/1230780766 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v85) v1 ==== 81+0+599 (secure 0 0 0) 0x7f73a8099230 con 0x7f73bc0fff80 2024-05-08T23:18:27.522 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/3516579563 2024-05-09T23:09:20.971548+0000 2024-05-08T23:18:27.522 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6801/3165594440 2024-05-09T23:09:20.971548+0000 2024-05-08T23:18:27.522 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6800/3165594440 2024-05-09T23:09:20.971548+0000 2024-05-08T23:18:27.522 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6800/104127578 2024-05-09T23:08:58.407759+0000 2024-05-08T23:18:27.522 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/804131600 2024-05-09T23:08:58.407759+0000 2024-05-08T23:18:27.522 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/2321849564 2024-05-09T23:08:58.407759+0000 2024-05-08T23:18:27.522 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6801/104127578 2024-05-09T23:08:58.407759+0000 2024-05-08T23:18:27.522 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/3418179245 2024-05-09T23:09:20.971548+0000 2024-05-08T23:18:27.522 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/1935141086 2024-05-09T23:08:58.407759+0000 2024-05-08T23:18:27.522 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/1985087492 2024-05-09T23:09:20.971548+0000 2024-05-08T23:18:27.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.524+0000 7f73c2cad700 1 -- 172.21.15.135:0/1230780766 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73ac0a1120 msgr2=0x7f73ac0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:27.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.524+0000 7f73c2cad700 1 --2- 172.21.15.135:0/1230780766 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73ac0a1120 0x7f73ac0a35e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f73b000b5c0 tx=0x7f73b0003790 comp rx=0 tx=0).stop 2024-05-08T23:18:27.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.524+0000 7f73c2cad700 1 -- 172.21.15.135:0/1230780766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0fff80 msgr2=0x7f73bc199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:27.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.524+0000 7f73c2cad700 1 --2- 172.21.15.135:0/1230780766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0fff80 0x7f73bc199620 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f73a800b530 tx=0x7f73a800b840 comp rx=0 tx=0).stop 2024-05-08T23:18:27.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.524+0000 7f73c2cad700 1 -- 172.21.15.135:0/1230780766 shutdown_connections 2024-05-08T23:18:27.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.524+0000 7f73c2cad700 1 --2- 172.21.15.135:0/1230780766 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f73ac0a1120 0x7f73ac0a35e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:27.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.524+0000 7f73c2cad700 1 --2- 172.21.15.135:0/1230780766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73bc100940 0x7f73bc1a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:27.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.524+0000 7f73c2cad700 1 --2- 172.21.15.135:0/1230780766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73bc0ff220 0x7f73bc1990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:27.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.524+0000 7f73c2cad700 1 --2- 172.21.15.135:0/1230780766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0fff80 0x7f73bc199620 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:27.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.524+0000 7f73c2cad700 1 -- 172.21.15.135:0/1230780766 >> 172.21.15.135:0/1230780766 conn(0x7f73bc0fab50 msgr2=0x7f73bc0fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:27.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.524+0000 7f73c2cad700 1 -- 172.21.15.135:0/1230780766 shutdown_connections 2024-05-08T23:18:27.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:27.524+0000 7f73c2cad700 1 -- 172.21.15.135:0/1230780766 wait complete. 2024-05-08T23:18:27.525 INFO:teuthology.orchestra.run.smithi135.stderr:listed 10 entries 2024-05-08T23:18:27.536 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-08T23:18:27.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:18:27.537 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-08T23:18:27.591 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T23:18:27.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:18:27.592 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T23:18:27.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:27 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3963178340' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:18:27.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:27 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2700635767' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:18:27.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:27 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/160418107' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:18:27.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:27 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3963178340' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T23:18:27.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:27 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2700635767' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T23:18:27.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:27 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/160418107' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T23:18:27.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:18:27.636 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-08T23:18:27.695 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T23:18:27.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:18:27.695 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T23:18:27.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T23:18:27.779 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-05-08T23:18:27.880 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-08T23:18:27.890 INFO:tasks.cephadm:Teardown begin 2024-05-08T23:18:27.890 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T23:18:27.890 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:18:28.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.016+0000 7f64ef7e6700 1 -- 172.21.15.135:0/1707213250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64e8102130 msgr2=0x7f64e8102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:28.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.016+0000 7f64ef7e6700 1 --2- 172.21.15.135:0/1707213250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64e8102130 0x7f64e8102590 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009990 tx=0x7f64d8009ca0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.016+0000 7f64ef7e6700 1 -- 172.21.15.135:0/1707213250 shutdown_connections 2024-05-08T23:18:28.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.016+0000 7f64ef7e6700 1 --2- 172.21.15.135:0/1707213250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64e8102ad0 0x7f64e8109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.016+0000 7f64ef7e6700 1 --2- 172.21.15.135:0/1707213250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64e80ff160 0x7f64e80ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.016+0000 7f64ef7e6700 1 --2- 172.21.15.135:0/1707213250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64e8102130 0x7f64e8102590 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.016+0000 7f64ef7e6700 1 -- 172.21.15.135:0/1707213250 >> 172.21.15.135:0/1707213250 conn(0x7f64e80faab0 msgr2=0x7f64e80fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:28.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.016+0000 7f64ef7e6700 1 -- 172.21.15.135:0/1707213250 shutdown_connections 2024-05-08T23:18:28.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.016+0000 7f64ef7e6700 1 -- 172.21.15.135:0/1707213250 wait complete. 2024-05-08T23:18:28.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.016+0000 7f64ef7e6700 1 Processor -- start 2024-05-08T23:18:28.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.016+0000 7f64ef7e6700 1 -- start start 2024-05-08T23:18:28.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ef7e6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64e80ff160 0x7f64e8196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:28.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ef7e6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64e8102130 0x7f64e8197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:28.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ef7e6700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64e8102ad0 0x7f64e819e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:28.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ef7e6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e819e8e0 con 0x7f64e8102130 2024-05-08T23:18:28.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ef7e6700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e819ea50 con 0x7f64e8102ad0 2024-05-08T23:18:28.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ef7e6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e819ec10 con 0x7f64e80ff160 2024-05-08T23:18:28.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ecd81700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64e8102130 0x7f64e8197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:28.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ecd81700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64e8102130 0x7f64e8197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35456/0 (socket says 172.21.15.135:35456) 2024-05-08T23:18:28.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ecd81700 1 -- 172.21.15.135:0/3339474179 learned_addr learned my addr 172.21.15.135:0/3339474179 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:28.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ed582700 1 --2- 172.21.15.135:0/3339474179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64e80ff160 0x7f64e8196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:28.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64edd83700 1 --2- 172.21.15.135:0/3339474179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64e8102ad0 0x7f64e819e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:28.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ecd81700 1 -- 172.21.15.135:0/3339474179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64e80ff160 msgr2=0x7f64e8196df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:28.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ecd81700 1 --2- 172.21.15.135:0/3339474179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64e80ff160 0x7f64e8196df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ecd81700 1 -- 172.21.15.135:0/3339474179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64e8102ad0 msgr2=0x7f64e819e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:28.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ecd81700 1 --2- 172.21.15.135:0/3339474179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64e8102ad0 0x7f64e819e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ecd81700 1 -- 172.21.15.135:0/3339474179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d80095f0 con 0x7f64e8102130 2024-05-08T23:18:28.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ed582700 1 --2- 172.21.15.135:0/3339474179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64e80ff160 0x7f64e8196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:18:28.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ecd81700 1 --2- 172.21.15.135:0/3339474179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64e8102130 0x7f64e8197330 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f64d80095c0 tx=0x7f64d800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:28.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64de7fc700 1 -- 172.21.15.135:0/3339474179 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d801d070 con 0x7f64e8102130 2024-05-08T23:18:28.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64de7fc700 1 -- 172.21.15.135:0/3339474179 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64d800fb80 con 0x7f64e8102130 2024-05-08T23:18:28.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ef7e6700 1 -- 172.21.15.135:0/3339474179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e819ee90 con 0x7f64e8102130 2024-05-08T23:18:28.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64de7fc700 1 -- 172.21.15.135:0/3339474179 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8017650 con 0x7f64e8102130 2024-05-08T23:18:28.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.017+0000 7f64ef7e6700 1 -- 172.21.15.135:0/3339474179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e819f250 con 0x7f64e8102130 2024-05-08T23:18:28.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.018+0000 7f64ef7e6700 1 -- 172.21.15.135:0/3339474179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e81083e0 con 0x7f64e8102130 2024-05-08T23:18:28.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.020+0000 7f64de7fc700 1 -- 172.21.15.135:0/3339474179 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f64d800fcf0 con 0x7f64e8102130 2024-05-08T23:18:28.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.020+0000 7f64de7fc700 1 --2- 172.21.15.135:0/3339474179 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f64d40a1120 0x7f64d40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:28.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.020+0000 7f64ed582700 1 --2- 172.21.15.135:0/3339474179 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f64d40a1120 0x7f64d40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:28.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.020+0000 7f64de7fc700 1 -- 172.21.15.135:0/3339474179 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f64d80cde30 con 0x7f64e8102130 2024-05-08T23:18:28.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.021+0000 7f64ed582700 1 --2- 172.21.15.135:0/3339474179 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f64d40a1120 0x7f64d40a35e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f64e4005fd0 tx=0x7f64e4005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:28.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.024+0000 7f64de7fc700 1 -- 172.21.15.135:0/3339474179 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f64d8097630 con 0x7f64e8102130 2024-05-08T23:18:28.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.269+0000 7f64ef7e6700 1 -- 172.21.15.135:0/3339474179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64e8068060 con 0x7f64e8102130 2024-05-08T23:18:28.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.270+0000 7f64de7fc700 1 -- 172.21.15.135:0/3339474179 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10927 (secure 0 0 0) 0x7f64d809ac50 con 0x7f64e8102130 2024-05-08T23:18:28.270 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:18:28.270 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2432614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2432614311},{"type":"v1","addr":"172.21.15.135:6837","nonce":2432614311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T23:14:21.921303+0000","modified":"2024-05-08T23:15:35.207792+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24500,"mds_2":24484,"mds_3":24439,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/360966092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":360966092},{"type":"v1","addr":"172.21.15.135:6839","nonce":360966092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6841/1831266531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":1831266531},{"type":"v1","addr":"172.21.15.135:6841","nonce":1831266531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1024532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1024532},{"type":"v1","addr":"172.21.15.179:6835","nonce":1024532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/2957410160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2957410160},{"type":"v1","addr":"172.21.15.179:6837","nonce":2957410160}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/4199708510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":4199708510},{"type":"v1","addr":"172.21.15.195:6835","nonce":4199708510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6837/2390721751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2390721751},{"type":"v1","addr":"172.21.15.195:6837","nonce":2390721751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.179:6839/1135239419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":1135239419},{"type":"v1","addr":"172.21.15.179:6839","nonce":1135239419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6839/1730571841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1730571841},{"type":"v1","addr":"172.21.15.195:6839","nonce":1730571841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T23:18:28.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.272+0000 7f64ef7e6700 1 -- 172.21.15.135:0/3339474179 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f64d40a1120 msgr2=0x7f64d40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:28.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.272+0000 7f64ef7e6700 1 --2- 172.21.15.135:0/3339474179 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f64d40a1120 0x7f64d40a35e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f64e4005fd0 tx=0x7f64e4005dd0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.272+0000 7f64ef7e6700 1 -- 172.21.15.135:0/3339474179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64e8102130 msgr2=0x7f64e8197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:28.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.272+0000 7f64ef7e6700 1 --2- 172.21.15.135:0/3339474179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64e8102130 0x7f64e8197330 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f64d80095c0 tx=0x7f64d800f690 comp rx=0 tx=0).stop 2024-05-08T23:18:28.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.272+0000 7f64ef7e6700 1 -- 172.21.15.135:0/3339474179 shutdown_connections 2024-05-08T23:18:28.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.272+0000 7f64ef7e6700 1 --2- 172.21.15.135:0/3339474179 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f64d40a1120 0x7f64d40a35e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.272+0000 7f64ef7e6700 1 --2- 172.21.15.135:0/3339474179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64e80ff160 0x7f64e8196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.272+0000 7f64ef7e6700 1 --2- 172.21.15.135:0/3339474179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64e8102ad0 0x7f64e819e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.272+0000 7f64ef7e6700 1 --2- 172.21.15.135:0/3339474179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64e8102130 0x7f64e8197330 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.273+0000 7f64ef7e6700 1 -- 172.21.15.135:0/3339474179 >> 172.21.15.135:0/3339474179 conn(0x7f64e80faab0 msgr2=0x7f64e8105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:28.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.273+0000 7f64ef7e6700 1 -- 172.21.15.135:0/3339474179 shutdown_connections 2024-05-08T23:18:28.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.273+0000 7f64ef7e6700 1 -- 172.21.15.135:0/3339474179 wait complete. 2024-05-08T23:18:28.273 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 28 2024-05-08T23:18:28.285 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T23:18:28.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.407+0000 7fcc7b9a0700 1 -- 172.21.15.135:0/3232536985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc74101920 msgr2=0x7fcc741081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:28.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.407+0000 7fcc7b9a0700 1 --2- 172.21.15.135:0/3232536985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc74101920 0x7fcc741081d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00b0d0 tx=0x7fcc6c00b3e0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.407+0000 7fcc7b9a0700 1 -- 172.21.15.135:0/3232536985 shutdown_connections 2024-05-08T23:18:28.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.407+0000 7fcc7b9a0700 1 --2- 172.21.15.135:0/3232536985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc74101920 0x7fcc741081d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.407+0000 7fcc7b9a0700 1 --2- 172.21.15.135:0/3232536985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc740ffd90 0x7fcc741001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.407+0000 7fcc7b9a0700 1 --2- 172.21.15.135:0/3232536985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc74100f80 0x7fcc741013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.407+0000 7fcc7b9a0700 1 -- 172.21.15.135:0/3232536985 >> 172.21.15.135:0/3232536985 conn(0x7fcc740fb300 msgr2=0x7fcc740fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.407+0000 7fcc7b9a0700 1 -- 172.21.15.135:0/3232536985 shutdown_connections 2024-05-08T23:18:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.407+0000 7fcc7b9a0700 1 -- 172.21.15.135:0/3232536985 wait complete. 2024-05-08T23:18:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.408+0000 7fcc7b9a0700 1 Processor -- start 2024-05-08T23:18:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.408+0000 7fcc7b9a0700 1 -- start start 2024-05-08T23:18:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.408+0000 7fcc7b9a0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc740ffd90 0x7fcc741970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.408+0000 7fcc7b9a0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc74100f80 0x7fcc74197600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.408+0000 7fcc7b9a0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc74101920 0x7fcc7419e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.408+0000 7fcc7b9a0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7419eb50 con 0x7fcc74101920 2024-05-08T23:18:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.408+0000 7fcc7b9a0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7419ec90 con 0x7fcc740ffd90 2024-05-08T23:18:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.408+0000 7fcc7b9a0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7419ee20 con 0x7fcc74100f80 2024-05-08T23:18:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.408+0000 7fcc79f3d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc74101920 0x7fcc7419e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.408+0000 7fcc79f3d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc74101920 0x7fcc7419e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43070/0 (socket says 172.21.15.135:43070) 2024-05-08T23:18:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.408+0000 7fcc79f3d700 1 -- 172.21.15.135:0/2176353814 learned_addr learned my addr 172.21.15.135:0/2176353814 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.408+0000 7fcc78f3b700 1 --2- 172.21.15.135:0/2176353814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc74100f80 0x7fcc74197600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.408+0000 7fcc7973c700 1 --2- 172.21.15.135:0/2176353814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc740ffd90 0x7fcc741970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.409+0000 7fcc79f3d700 1 -- 172.21.15.135:0/2176353814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc74100f80 msgr2=0x7fcc74197600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.409+0000 7fcc79f3d700 1 --2- 172.21.15.135:0/2176353814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc74100f80 0x7fcc74197600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.409+0000 7fcc79f3d700 1 -- 172.21.15.135:0/2176353814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc740ffd90 msgr2=0x7fcc741970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.409+0000 7fcc79f3d700 1 --2- 172.21.15.135:0/2176353814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc740ffd90 0x7fcc741970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.409+0000 7fcc79f3d700 1 -- 172.21.15.135:0/2176353814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c009d00 con 0x7fcc74101920 2024-05-08T23:18:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.409+0000 7fcc7973c700 1 --2- 172.21.15.135:0/2176353814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc740ffd90 0x7fcc741970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:18:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.409+0000 7fcc79f3d700 1 --2- 172.21.15.135:0/2176353814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc74101920 0x7fcc7419e580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c007bd0 tx=0x7fcc6c0094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.409+0000 7fcc6a7fc700 1 -- 172.21.15.135:0/2176353814 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00e040 con 0x7fcc74101920 2024-05-08T23:18:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.409+0000 7fcc6a7fc700 1 -- 172.21.15.135:0/2176353814 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc6c004e60 con 0x7fcc74101920 2024-05-08T23:18:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.409+0000 7fcc7b9a0700 1 -- 172.21.15.135:0/2176353814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7419f0a0 con 0x7fcc74101920 2024-05-08T23:18:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.409+0000 7fcc6a7fc700 1 -- 172.21.15.135:0/2176353814 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c012a60 con 0x7fcc74101920 2024-05-08T23:18:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.409+0000 7fcc7b9a0700 1 -- 172.21.15.135:0/2176353814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7419f540 con 0x7fcc74101920 2024-05-08T23:18:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.410+0000 7fcc7b9a0700 1 -- 172.21.15.135:0/2176353814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc74068060 con 0x7fcc74101920 2024-05-08T23:18:28.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.411+0000 7fcc6a7fc700 1 -- 172.21.15.135:0/2176353814 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fcc6c0056f0 con 0x7fcc74101920 2024-05-08T23:18:28.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.411+0000 7fcc6a7fc700 1 --2- 172.21.15.135:0/2176353814 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fcc600a1120 0x7fcc600a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:28.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.411+0000 7fcc7973c700 1 --2- 172.21.15.135:0/2176353814 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fcc600a1120 0x7fcc600a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:28.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.411+0000 7fcc6a7fc700 1 -- 172.21.15.135:0/2176353814 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fcc6c0ce1a0 con 0x7fcc74101920 2024-05-08T23:18:28.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.412+0000 7fcc7973c700 1 --2- 172.21.15.135:0/2176353814 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fcc600a1120 0x7fcc600a35e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcc74100de0 tx=0x7fcc64008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:28.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.415+0000 7fcc6a7fc700 1 -- 172.21.15.135:0/2176353814 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fcc6c0979a0 con 0x7fcc74101920 2024-05-08T23:18:28.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:28 smithi135 ceph-mon[42440]: pgmap v348: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T23:18:28.453 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:28 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1230780766' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T23:18:28.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:28 smithi179 ceph-mon[46314]: pgmap v348: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T23:18:28.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:28 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1230780766' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T23:18:28.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:28 smithi195 ceph-mon[46516]: pgmap v348: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T23:18:28.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:28 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1230780766' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T23:18:28.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.654+0000 7fcc7b9a0700 1 -- 172.21.15.135:0/2176353814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc7410b7b0 con 0x7fcc74101920 2024-05-08T23:18:28.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.655+0000 7fcc6a7fc700 1 -- 172.21.15.135:0/2176353814 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10927 (secure 0 0 0) 0x7fcc6c09afc0 con 0x7fcc74101920 2024-05-08T23:18:28.654 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:18:28.655 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/2842983323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2842983323},{"type":"v1","addr":"172.21.15.135:6835","nonce":2842983323}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2432614311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2432614311},{"type":"v1","addr":"172.21.15.135:6837","nonce":2432614311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T23:14:21.921303+0000","modified":"2024-05-08T23:15:35.207792+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24500,"mds_2":24484,"mds_3":24439,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/360966092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":360966092},{"type":"v1","addr":"172.21.15.135:6839","nonce":360966092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14622":{"gid":14622,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6841/1831266531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":1831266531},{"type":"v1","addr":"172.21.15.135:6841","nonce":1831266531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.179:6833/3953517264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3953517264},{"type":"v1","addr":"172.21.15.179:6833","nonce":3953517264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.195:6833/2264761272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2264761272},{"type":"v1","addr":"172.21.15.195:6833","nonce":2264761272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1024532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1024532},{"type":"v1","addr":"172.21.15.179:6835","nonce":1024532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6837/2957410160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2957410160},{"type":"v1","addr":"172.21.15.179:6837","nonce":2957410160}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/4199708510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":4199708510},{"type":"v1","addr":"172.21.15.195:6835","nonce":4199708510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6837/2390721751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2390721751},{"type":"v1","addr":"172.21.15.195:6837","nonce":2390721751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24500":{"gid":24500,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.179:6839/1135239419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":1135239419},{"type":"v1","addr":"172.21.15.179:6839","nonce":1135239419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6839/1730571841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1730571841},{"type":"v1","addr":"172.21.15.195:6839","nonce":1730571841}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T23:18:28.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.657+0000 7fcc7b9a0700 1 -- 172.21.15.135:0/2176353814 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fcc600a1120 msgr2=0x7fcc600a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:28.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.657+0000 7fcc7b9a0700 1 --2- 172.21.15.135:0/2176353814 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fcc600a1120 0x7fcc600a35e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcc74100de0 tx=0x7fcc64008040 comp rx=0 tx=0).stop 2024-05-08T23:18:28.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.657+0000 7fcc7b9a0700 1 -- 172.21.15.135:0/2176353814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc74101920 msgr2=0x7fcc7419e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:28.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.657+0000 7fcc7b9a0700 1 --2- 172.21.15.135:0/2176353814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc74101920 0x7fcc7419e580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c007bd0 tx=0x7fcc6c0094c0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.657+0000 7fcc7b9a0700 1 -- 172.21.15.135:0/2176353814 shutdown_connections 2024-05-08T23:18:28.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.657+0000 7fcc7b9a0700 1 --2- 172.21.15.135:0/2176353814 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fcc600a1120 0x7fcc600a35e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.657+0000 7fcc7b9a0700 1 --2- 172.21.15.135:0/2176353814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc74101920 0x7fcc7419e580 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.657+0000 7fcc7b9a0700 1 --2- 172.21.15.135:0/2176353814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc740ffd90 0x7fcc741970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.657+0000 7fcc7b9a0700 1 --2- 172.21.15.135:0/2176353814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc74100f80 0x7fcc74197600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.657+0000 7fcc7b9a0700 1 -- 172.21.15.135:0/2176353814 >> 172.21.15.135:0/2176353814 conn(0x7fcc740fb300 msgr2=0x7fcc740fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:28.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.657+0000 7fcc7b9a0700 1 -- 172.21.15.135:0/2176353814 shutdown_connections 2024-05-08T23:18:28.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.657+0000 7fcc7b9a0700 1 -- 172.21.15.135:0/2176353814 wait complete. 2024-05-08T23:18:28.658 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 28 2024-05-08T23:18:28.669 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T23:18:28.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.792+0000 7f4dea950700 1 -- 172.21.15.135:0/1953849694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4de41018f0 msgr2=0x7f4de4103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:28.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.792+0000 7f4dea950700 1 --2- 172.21.15.135:0/1953849694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4de41018f0 0x7f4de4103ce0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009990 tx=0x7f4dd4009ca0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.792+0000 7f4dea950700 1 -- 172.21.15.135:0/1953849694 shutdown_connections 2024-05-08T23:18:28.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.792+0000 7f4dea950700 1 --2- 172.21.15.135:0/1953849694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4de4106b50 0x7f4de4108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.792+0000 7f4dea950700 1 --2- 172.21.15.135:0/1953849694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4de41018f0 0x7f4de4103ce0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.792+0000 7f4dea950700 1 --2- 172.21.15.135:0/1953849694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4de4104220 0x7f4de4106610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.792+0000 7f4dea950700 1 -- 172.21.15.135:0/1953849694 >> 172.21.15.135:0/1953849694 conn(0x7f4de40fb2e0 msgr2=0x7f4de40fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:28.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.792+0000 7f4dea950700 1 -- 172.21.15.135:0/1953849694 shutdown_connections 2024-05-08T23:18:28.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.792+0000 7f4dea950700 1 -- 172.21.15.135:0/1953849694 wait complete. 2024-05-08T23:18:28.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.793+0000 7f4dea950700 1 Processor -- start 2024-05-08T23:18:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.793+0000 7f4dea950700 1 -- start start 2024-05-08T23:18:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.793+0000 7f4dea950700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4de41018f0 0x7f4de4196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.793+0000 7f4dea950700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4de4104220 0x7f4de41972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.793+0000 7f4dea950700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4de4106b50 0x7f4de419e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.793+0000 7f4dea950700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de419e890 con 0x7f4de4106b50 2024-05-08T23:18:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.793+0000 7f4dea950700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de419ea00 con 0x7f4de41018f0 2024-05-08T23:18:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.793+0000 7f4dea950700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de419ebc0 con 0x7f4de4104220 2024-05-08T23:18:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4de8eed700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4de4106b50 0x7f4de419e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4de8eed700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4de4106b50 0x7f4de419e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43096/0 (socket says 172.21.15.135:43096) 2024-05-08T23:18:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4de8eed700 1 -- 172.21.15.135:0/2242673952 learned_addr learned my addr 172.21.15.135:0/2242673952 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4de37fe700 1 --2- 172.21.15.135:0/2242673952 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4de4104220 0x7f4de41972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4de3fff700 1 --2- 172.21.15.135:0/2242673952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4de41018f0 0x7f4de4196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4de8eed700 1 -- 172.21.15.135:0/2242673952 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4de4104220 msgr2=0x7f4de41972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:28.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4de8eed700 1 --2- 172.21.15.135:0/2242673952 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4de4104220 0x7f4de41972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4de8eed700 1 -- 172.21.15.135:0/2242673952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4de41018f0 msgr2=0x7f4de4196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:28.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4de8eed700 1 --2- 172.21.15.135:0/2242673952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4de41018f0 0x7f4de4196da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:28.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4de8eed700 1 -- 172.21.15.135:0/2242673952 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd40095f0 con 0x7f4de4106b50 2024-05-08T23:18:28.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4de8eed700 1 --2- 172.21.15.135:0/2242673952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4de4106b50 0x7f4de419e2c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc007ee0 tx=0x7f4ddc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:28.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4de17fa700 1 -- 172.21.15.135:0/2242673952 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc017070 con 0x7f4de4106b50 2024-05-08T23:18:28.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4de17fa700 1 -- 172.21.15.135:0/2242673952 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ddc00f040 con 0x7f4de4106b50 2024-05-08T23:18:28.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4dea950700 1 -- 172.21.15.135:0/2242673952 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de419eea0 con 0x7f4de4106b50 2024-05-08T23:18:28.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4de17fa700 1 -- 172.21.15.135:0/2242673952 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc005580 con 0x7f4de4106b50 2024-05-08T23:18:28.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.794+0000 7f4dea950700 1 -- 172.21.15.135:0/2242673952 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de419f2c0 con 0x7f4de4106b50 2024-05-08T23:18:28.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.795+0000 7f4dea950700 1 -- 172.21.15.135:0/2242673952 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de40fce60 con 0x7f4de4106b50 2024-05-08T23:18:28.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.796+0000 7f4de17fa700 1 -- 172.21.15.135:0/2242673952 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f4ddc00db20 con 0x7f4de4106b50 2024-05-08T23:18:28.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.797+0000 7f4de17fa700 1 --2- 172.21.15.135:0/2242673952 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4dcc0a11a0 0x7f4dcc0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:28.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.797+0000 7f4de3fff700 1 --2- 172.21.15.135:0/2242673952 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4dcc0a11a0 0x7f4dcc0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:28.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.797+0000 7f4de17fa700 1 -- 172.21.15.135:0/2242673952 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4ddc0cc6b0 con 0x7f4de4106b50 2024-05-08T23:18:28.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.797+0000 7f4de3fff700 1 --2- 172.21.15.135:0/2242673952 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4dcc0a11a0 0x7f4dcc0a3660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400b680 tx=0x7f4dd4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:28.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:28.801+0000 7f4de17fa700 1 -- 172.21.15.135:0/2242673952 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4ddc095dc0 con 0x7f4de4106b50 2024-05-08T23:18:29.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.002+0000 7f4dea950700 1 -- 172.21.15.135:0/2242673952 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4de410c650 con 0x7f4de4106b50 2024-05-08T23:18:29.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.003+0000 7f4de17fa700 1 -- 172.21.15.135:0/2242673952 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22702 (secure 0 0 0) 0x7f4ddc0993e0 con 0x7f4de4106b50 2024-05-08T23:18:29.003 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:18:29.003 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":85,"fsid":"c804a50a-0d8f-11ef-bc97-c7b262605968","created":"2024-05-08T23:08:30.944912+0000","modified":"2024-05-08T23:15:22.121685+0000","last_up_change":"2024-05-08T23:13:48.980004+0000","last_in_change":"2024-05-08T23:13:32.432022+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:11:11.282550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T23:14:19.726838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T23:14:21.097732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2aafc0bf-d99a-4981-b7c4-a0e26072aab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6803","nonce":2658342982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6805","nonce":2658342982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6809","nonce":2658342982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2658342982},{"type":"v1","addr":"172.21.15.135:6807","nonce":2658342982}]},"public_addr":"172.21.15.135:6803/2658342982","cluster_addr":"172.21.15.135:6805/2658342982","heartbeat_back_addr":"172.21.15.135:6809/2658342982","heartbeat_front_addr":"172.21.15.135:6807/2658342982","state":["exists","up"]},{"osd":1,"uuid":"23d196fd-2c00-40a3-84d4-fa1acbf73426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6801","nonce":3883295152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6803","nonce":3883295152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6807","nonce":3883295152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3883295152},{"type":"v1","addr":"172.21.15.179:6805","nonce":3883295152}]},"public_addr":"172.21.15.179:6801/3883295152","cluster_addr":"172.21.15.179:6803/3883295152","heartbeat_back_addr":"172.21.15.179:6807/3883295152","heartbeat_front_addr":"172.21.15.179:6805/3883295152","state":["exists","up"]},{"osd":2,"uuid":"fb61be11-dbcf-45c7-b436-a00694480bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6801","nonce":1615315232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6803","nonce":1615315232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6807","nonce":1615315232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1615315232},{"type":"v1","addr":"172.21.15.195:6805","nonce":1615315232}]},"public_addr":"172.21.15.195:6801/1615315232","cluster_addr":"172.21.15.195:6803/1615315232","heartbeat_back_addr":"172.21.15.195:6807/1615315232","heartbeat_front_addr":"172.21.15.195:6805/1615315232","state":["exists","up"]},{"osd":3,"uuid":"6b31fd07-08f3-491b-b0ef-e898a7f4a2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6811","nonce":1328709817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6813","nonce":1328709817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6817","nonce":1328709817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":1328709817},{"type":"v1","addr":"172.21.15.135:6815","nonce":1328709817}]},"public_addr":"172.21.15.135:6811/1328709817","cluster_addr":"172.21.15.135:6813/1328709817","heartbeat_back_addr":"172.21.15.135:6817/1328709817","heartbeat_front_addr":"172.21.15.135:6815/1328709817","state":["exists","up"]},{"osd":4,"uuid":"b40ae169-2262-417d-958e-8903b16e89ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6809","nonce":1955171342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6811","nonce":1955171342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6815","nonce":1955171342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1955171342},{"type":"v1","addr":"172.21.15.179:6813","nonce":1955171342}]},"public_addr":"172.21.15.179:6809/1955171342","cluster_addr":"172.21.15.179:6811/1955171342","heartbeat_back_addr":"172.21.15.179:6815/1955171342","heartbeat_front_addr":"172.21.15.179:6813/1955171342","state":["exists","up"]},{"osd":5,"uuid":"26b4c6d5-5a0f-49e2-87cc-08618c3fd833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6809","nonce":1466056626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6811","nonce":1466056626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6815","nonce":1466056626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1466056626},{"type":"v1","addr":"172.21.15.195:6813","nonce":1466056626}]},"public_addr":"172.21.15.195:6809/1466056626","cluster_addr":"172.21.15.195:6811/1466056626","heartbeat_back_addr":"172.21.15.195:6815/1466056626","heartbeat_front_addr":"172.21.15.195:6813/1466056626","state":["exists","up"]},{"osd":6,"uuid":"e506e541-e401-4795-af36-65ef8f53c6a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6819","nonce":2493102578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6821","nonce":2493102578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6825","nonce":2493102578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2493102578},{"type":"v1","addr":"172.21.15.135:6823","nonce":2493102578}]},"public_addr":"172.21.15.135:6819/2493102578","cluster_addr":"172.21.15.135:6821/2493102578","heartbeat_back_addr":"172.21.15.135:6825/2493102578","heartbeat_front_addr":"172.21.15.135:6823/2493102578","state":["exists","up"]},{"osd":7,"uuid":"9cfe5c66-7d48-4a48-93c6-29781ad96581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6817","nonce":43006625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6819","nonce":43006625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6823","nonce":43006625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":43006625},{"type":"v1","addr":"172.21.15.179:6821","nonce":43006625}]},"public_addr":"172.21.15.179:6817/43006625","cluster_addr":"172.21.15.179:6819/43006625","heartbeat_back_addr":"172.21.15.179:6823/43006625","heartbeat_front_addr":"172.21.15.179:6821/43006625","state":["exists","up"]},{"osd":8,"uuid":"807e90e4-2d33-4038-952b-97d5203ce08d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6817","nonce":431240376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6819","nonce":431240376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6823","nonce":431240376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":431240376},{"type":"v1","addr":"172.21.15.195:6821","nonce":431240376}]},"public_addr":"172.21.15.195:6817/431240376","cluster_addr":"172.21.15.195:6819/431240376","heartbeat_back_addr":"172.21.15.195:6823/431240376","heartbeat_front_addr":"172.21.15.195:6821/431240376","state":["exists","up"]},{"osd":9,"uuid":"6d499d4b-5921-4bbb-8179-549ec18bbf21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6827","nonce":2141009951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6829","nonce":2141009951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6833","nonce":2141009951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2141009951},{"type":"v1","addr":"172.21.15.135:6831","nonce":2141009951}]},"public_addr":"172.21.15.135:6827/2141009951","cluster_addr":"172.21.15.135:6829/2141009951","heartbeat_back_addr":"172.21.15.135:6833/2141009951","heartbeat_front_addr":"172.21.15.135:6831/2141009951","state":["exists","up"]},{"osd":10,"uuid":"a22f21ea-57b8-4b21-8cd5-e06007c87c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6825","nonce":1119841864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6827","nonce":1119841864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6831","nonce":1119841864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1119841864},{"type":"v1","addr":"172.21.15.179:6829","nonce":1119841864}]},"public_addr":"172.21.15.179:6825/1119841864","cluster_addr":"172.21.15.179:6827/1119841864","heartbeat_back_addr":"172.21.15.179:6831/1119841864","heartbeat_front_addr":"172.21.15.179:6829/1119841864","state":["exists","up"]},{"osd":11,"uuid":"1cf992e4-6fcd-4c77-a726-4f111d2b9368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6825","nonce":3939527459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6827","nonce":3939527459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6831","nonce":3939527459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3939527459},{"type":"v1","addr":"172.21.15.195:6829","nonce":3939527459}]},"public_addr":"172.21.15.195:6825/3939527459","cluster_addr":"172.21.15.195:6827/3939527459","heartbeat_back_addr":"172.21.15.195:6831/3939527459","heartbeat_front_addr":"172.21.15.195:6829/3939527459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:32.198749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:10:50.020278+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:08.082542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:25.435355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:11:43.220057+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:00.745588+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:18.367868+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:35.979274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:12:54.048121+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:11.747581+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:29.381162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:13:46.992626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":5,"to":6}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/3516579563":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6801/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/3165594440":"2024-05-09T23:09:20.971548+0000","172.21.15.135:6800/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/804131600":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/2321849564":"2024-05-09T23:08:58.407759+0000","172.21.15.135:6801/104127578":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/3418179245":"2024-05-09T23:09:20.971548+0000","172.21.15.135:0/1935141086":"2024-05-09T23:08:58.407759+0000","172.21.15.135:0/1985087492":"2024-05-09T23:09:20.971548+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T23:18:29.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.006+0000 7f4dea950700 1 -- 172.21.15.135:0/2242673952 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4dcc0a11a0 msgr2=0x7f4dcc0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:29.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.006+0000 7f4dea950700 1 --2- 172.21.15.135:0/2242673952 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4dcc0a11a0 0x7f4dcc0a3660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400b680 tx=0x7f4dd4005fd0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.006+0000 7f4dea950700 1 -- 172.21.15.135:0/2242673952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4de4106b50 msgr2=0x7f4de419e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:29.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.006+0000 7f4dea950700 1 --2- 172.21.15.135:0/2242673952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4de4106b50 0x7f4de419e2c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc007ee0 tx=0x7f4ddc00d3b0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.006+0000 7f4dea950700 1 -- 172.21.15.135:0/2242673952 shutdown_connections 2024-05-08T23:18:29.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.006+0000 7f4dea950700 1 --2- 172.21.15.135:0/2242673952 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f4dcc0a11a0 0x7f4dcc0a3660 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.006+0000 7f4dea950700 1 --2- 172.21.15.135:0/2242673952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4de4106b50 0x7f4de419e2c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.006+0000 7f4dea950700 1 --2- 172.21.15.135:0/2242673952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4de41018f0 0x7f4de4196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.006+0000 7f4dea950700 1 --2- 172.21.15.135:0/2242673952 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4de4104220 0x7f4de41972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.006+0000 7f4dea950700 1 -- 172.21.15.135:0/2242673952 >> 172.21.15.135:0/2242673952 conn(0x7f4de40fb2e0 msgr2=0x7f4de41037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:29.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.006+0000 7f4dea950700 1 -- 172.21.15.135:0/2242673952 shutdown_connections 2024-05-08T23:18:29.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.006+0000 7f4dea950700 1 -- 172.21.15.135:0/2242673952 wait complete. 2024-05-08T23:18:29.018 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T23:18:29.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.142+0000 7ff78e3a8700 1 -- 172.21.15.135:0/2410594245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff788106c40 msgr2=0x7ff7881090b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:29.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.142+0000 7ff78e3a8700 1 --2- 172.21.15.135:0/2410594245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff788106c40 0x7ff7881090b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff78000b0a0 tx=0x7ff78000b3b0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.142+0000 7ff78e3a8700 1 -- 172.21.15.135:0/2410594245 shutdown_connections 2024-05-08T23:18:29.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.142+0000 7ff78e3a8700 1 --2- 172.21.15.135:0/2410594245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7881019e0 0x7ff788103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.142+0000 7ff78e3a8700 1 --2- 172.21.15.135:0/2410594245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff788106c40 0x7ff7881090b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.142+0000 7ff78e3a8700 1 --2- 172.21.15.135:0/2410594245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff788104310 0x7ff788106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.142+0000 7ff78e3a8700 1 -- 172.21.15.135:0/2410594245 >> 172.21.15.135:0/2410594245 conn(0x7ff7880fb3f0 msgr2=0x7ff7880fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:29.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.142+0000 7ff78e3a8700 1 -- 172.21.15.135:0/2410594245 shutdown_connections 2024-05-08T23:18:29.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.142+0000 7ff78e3a8700 1 -- 172.21.15.135:0/2410594245 wait complete. 2024-05-08T23:18:29.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff78e3a8700 1 Processor -- start 2024-05-08T23:18:29.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff78e3a8700 1 -- start start 2024-05-08T23:18:29.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff78e3a8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881019e0 0x7ff788101300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:29.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff78e3a8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff788104310 0x7ff7880ff990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:29.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff78e3a8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff788106c40 0x7ff7880ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:29.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff78e3a8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff788100670 con 0x7ff7881019e0 2024-05-08T23:18:29.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff78e3a8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7881007e0 con 0x7ff788104310 2024-05-08T23:18:29.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff78e3a8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7881a0fd0 con 0x7ff788106c40 2024-05-08T23:18:29.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff787fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881019e0 0x7ff788101300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:29.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff787fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881019e0 0x7ff788101300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43122/0 (socket says 172.21.15.135:43122) 2024-05-08T23:18:29.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff787fff700 1 -- 172.21.15.135:0/3572354568 learned_addr learned my addr 172.21.15.135:0/3572354568 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:29.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff78c945700 1 --2- 172.21.15.135:0/3572354568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff788106c40 0x7ff7880ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:29.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff787fff700 1 -- 172.21.15.135:0/3572354568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff788106c40 msgr2=0x7ff7880ffed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:29.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff787fff700 1 --2- 172.21.15.135:0/3572354568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff788106c40 0x7ff7880ffed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff787fff700 1 -- 172.21.15.135:0/3572354568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff788104310 msgr2=0x7ff7880ff990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:29.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff787fff700 1 --2- 172.21.15.135:0/3572354568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff788104310 0x7ff7880ff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff787fff700 1 -- 172.21.15.135:0/3572354568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780009d00 con 0x7ff7881019e0 2024-05-08T23:18:29.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.143+0000 7ff78c945700 1 --2- 172.21.15.135:0/3572354568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff788106c40 0x7ff7880ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T23:18:29.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.144+0000 7ff787fff700 1 --2- 172.21.15.135:0/3572354568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881019e0 0x7ff788101300 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00e9a0 tx=0x7ff77c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:29.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.144+0000 7ff7857fa700 1 -- 172.21.15.135:0/3572354568 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c009790 con 0x7ff7881019e0 2024-05-08T23:18:29.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.144+0000 7ff7857fa700 1 -- 172.21.15.135:0/3572354568 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff77c00cb70 con 0x7ff7881019e0 2024-05-08T23:18:29.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.144+0000 7ff78e3a8700 1 -- 172.21.15.135:0/3572354568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7881a1260 con 0x7ff7881019e0 2024-05-08T23:18:29.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.144+0000 7ff7857fa700 1 -- 172.21.15.135:0/3572354568 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c018680 con 0x7ff7881019e0 2024-05-08T23:18:29.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.144+0000 7ff78e3a8700 1 -- 172.21.15.135:0/3572354568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7881a1770 con 0x7ff7881019e0 2024-05-08T23:18:29.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.145+0000 7ff78e3a8700 1 -- 172.21.15.135:0/3572354568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7880fcf70 con 0x7ff7881019e0 2024-05-08T23:18:29.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.146+0000 7ff7857fa700 1 -- 172.21.15.135:0/3572354568 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7ff77c00cce0 con 0x7ff7881019e0 2024-05-08T23:18:29.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.146+0000 7ff7857fa700 1 --2- 172.21.15.135:0/3572354568 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff7700a1120 0x7ff7700a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:29.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.147+0000 7ff7877fe700 1 --2- 172.21.15.135:0/3572354568 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff7700a1120 0x7ff7700a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:29.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.147+0000 7ff7857fa700 1 -- 172.21.15.135:0/3572354568 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff77c014070 con 0x7ff7881019e0 2024-05-08T23:18:29.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.147+0000 7ff7877fe700 1 --2- 172.21.15.135:0/3572354568 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff7700a1120 0x7ff7700a35e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff778005950 tx=0x7ff7780058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:29.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.151+0000 7ff7857fa700 1 -- 172.21.15.135:0/3572354568 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff77c052d60 con 0x7ff7881019e0 2024-05-08T23:18:29.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.397+0000 7ff78e3a8700 1 -- 172.21.15.135:0/3572354568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff788067cc0 con 0x7ff7881019e0 2024-05-08T23:18:29.399 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:29 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3339474179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:18:29.399 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:29 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2176353814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:18:29.399 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:29 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2242673952' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:18:29.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.412+0000 7ff7857fa700 1 -- 172.21.15.135:0/3572354568 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff77c099e70 con 0x7ff7881019e0 2024-05-08T23:18:29.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.415+0000 7ff78e3a8700 1 -- 172.21.15.135:0/3572354568 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff7700a1120 msgr2=0x7ff7700a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:29.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.415+0000 7ff78e3a8700 1 --2- 172.21.15.135:0/3572354568 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff7700a1120 0x7ff7700a35e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff778005950 tx=0x7ff7780058e0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.415+0000 7ff78e3a8700 1 -- 172.21.15.135:0/3572354568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881019e0 msgr2=0x7ff788101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:29.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.415+0000 7ff78e3a8700 1 --2- 172.21.15.135:0/3572354568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881019e0 0x7ff788101300 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00e9a0 tx=0x7ff77c00ed60 comp rx=0 tx=0).stop 2024-05-08T23:18:29.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.415+0000 7ff78e3a8700 1 -- 172.21.15.135:0/3572354568 shutdown_connections 2024-05-08T23:18:29.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.415+0000 7ff78e3a8700 1 --2- 172.21.15.135:0/3572354568 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7ff7700a1120 0x7ff7700a35e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.415+0000 7ff78e3a8700 1 --2- 172.21.15.135:0/3572354568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff788106c40 0x7ff7880ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.415+0000 7ff78e3a8700 1 --2- 172.21.15.135:0/3572354568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881019e0 0x7ff788101300 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.415+0000 7ff78e3a8700 1 --2- 172.21.15.135:0/3572354568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff788104310 0x7ff7880ff990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.415+0000 7ff78e3a8700 1 -- 172.21.15.135:0/3572354568 >> 172.21.15.135:0/3572354568 conn(0x7ff7880fb3f0 msgr2=0x7ff788102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:29.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.415+0000 7ff78e3a8700 1 -- 172.21.15.135:0/3572354568 shutdown_connections 2024-05-08T23:18:29.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.415+0000 7ff78e3a8700 1 -- 172.21.15.135:0/3572354568 wait complete. 2024-05-08T23:18:29.416 INFO:teuthology.orchestra.run.smithi135.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T23:18:29.429 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T23:18:29.451 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:29 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3339474179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:18:29.451 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:29 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2176353814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:18:29.451 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:29 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2242673952' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:18:29.451 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:29 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3339474179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:18:29.451 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:29 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2176353814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T23:18:29.451 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:29 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2242673952' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T23:18:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.561+0000 7f55dde43700 1 -- 172.21.15.135:0/665478378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d8102ab0 msgr2=0x7f55d81093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.561+0000 7f55dde43700 1 --2- 172.21.15.135:0/665478378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d8102ab0 0x7f55d81093d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f55d000b0a0 tx=0x7f55d000b3b0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.561+0000 7f55dde43700 1 -- 172.21.15.135:0/665478378 shutdown_connections 2024-05-08T23:18:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.561+0000 7f55dde43700 1 --2- 172.21.15.135:0/665478378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55d8100f20 0x7f55d8101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.561+0000 7f55dde43700 1 --2- 172.21.15.135:0/665478378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d8102ab0 0x7f55d81093d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.561+0000 7f55dde43700 1 --2- 172.21.15.135:0/665478378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55d81020f0 0x7f55d8102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.561+0000 7f55dde43700 1 -- 172.21.15.135:0/665478378 >> 172.21.15.135:0/665478378 conn(0x7f55d80fc500 msgr2=0x7f55d80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.561+0000 7f55dde43700 1 -- 172.21.15.135:0/665478378 shutdown_connections 2024-05-08T23:18:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.561+0000 7f55dde43700 1 -- 172.21.15.135:0/665478378 wait complete. 2024-05-08T23:18:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.561+0000 7f55dde43700 1 Processor -- start 2024-05-08T23:18:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55dde43700 1 -- start start 2024-05-08T23:18:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55dde43700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d8100f20 0x7f55d8196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55dde43700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55d81020f0 0x7f55d8197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55dde43700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55d8102ab0 0x7f55d819e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55dde43700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d819ea80 con 0x7f55d8100f20 2024-05-08T23:18:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55dde43700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d819ebc0 con 0x7f55d81020f0 2024-05-08T23:18:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55dde43700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d819ed50 con 0x7f55d8102ab0 2024-05-08T23:18:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55d77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d8100f20 0x7f55d8196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55d77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d8100f20 0x7f55d8196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43170/0 (socket says 172.21.15.135:43170) 2024-05-08T23:18:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55d77fe700 1 -- 172.21.15.135:0/1431222467 learned_addr learned my addr 172.21.15.135:0/1431222467 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55d7fff700 1 --2- 172.21.15.135:0/1431222467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55d8102ab0 0x7f55d819e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55d6ffd700 1 --2- 172.21.15.135:0/1431222467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55d81020f0 0x7f55d8197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55d77fe700 1 -- 172.21.15.135:0/1431222467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55d8102ab0 msgr2=0x7f55d819e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55d77fe700 1 --2- 172.21.15.135:0/1431222467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55d8102ab0 0x7f55d819e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55d77fe700 1 -- 172.21.15.135:0/1431222467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55d81020f0 msgr2=0x7f55d8197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55d77fe700 1 --2- 172.21.15.135:0/1431222467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55d81020f0 0x7f55d8197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55d77fe700 1 -- 172.21.15.135:0/1431222467 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d0009d00 con 0x7f55d8100f20 2024-05-08T23:18:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55d77fe700 1 --2- 172.21.15.135:0/1431222467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d8100f20 0x7f55d8196f50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00c990 tx=0x7f55cc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55d4ff9700 1 -- 172.21.15.135:0/1431222467 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc007b00 con 0x7f55d8100f20 2024-05-08T23:18:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.562+0000 7f55dde43700 1 -- 172.21.15.135:0/1431222467 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d819efd0 con 0x7f55d8100f20 2024-05-08T23:18:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.563+0000 7f55d4ff9700 1 -- 172.21.15.135:0/1431222467 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f55cc007c60 con 0x7f55d8100f20 2024-05-08T23:18:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.563+0000 7f55d4ff9700 1 -- 172.21.15.135:0/1431222467 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc00fea0 con 0x7f55d8100f20 2024-05-08T23:18:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.563+0000 7f55dde43700 1 -- 172.21.15.135:0/1431222467 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d819f4a0 con 0x7f55d8100f20 2024-05-08T23:18:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.563+0000 7f55dde43700 1 -- 172.21.15.135:0/1431222467 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d81082e0 con 0x7f55d8100f20 2024-05-08T23:18:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.564+0000 7f55d4ff9700 1 -- 172.21.15.135:0/1431222467 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f55cc00f450 con 0x7f55d8100f20 2024-05-08T23:18:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.565+0000 7f55d4ff9700 1 --2- 172.21.15.135:0/1431222467 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f55c00a1120 0x7f55c00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.565+0000 7f55d6ffd700 1 --2- 172.21.15.135:0/1431222467 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f55c00a1120 0x7f55c00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.565+0000 7f55d4ff9700 1 -- 172.21.15.135:0/1431222467 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8699+0+0 (secure 0 0 0) 0x7f55cc0cca10 con 0x7f55d8100f20 2024-05-08T23:18:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.565+0000 7f55d6ffd700 1 --2- 172.21.15.135:0/1431222467 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f55c00a1120 0x7f55c00a35e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009bf0 tx=0x7f55c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:29.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.569+0000 7f55d4ff9700 1 -- 172.21.15.135:0/1431222467 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f55cc095fd0 con 0x7f55d8100f20 2024-05-08T23:18:29.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:29 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mon-a[42416]: 2024-05-08T23:18:29.398+0000 7feee05a4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T23:18:29.704 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 08 23:18:29 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-a[93089]: ignoring --setuser ceph since I am not root 2024-05-08T23:18:29.704 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 08 23:18:29 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-a[93089]: ignoring --setgroup ceph since I am not root 2024-05-08T23:18:29.704 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 08 23:18:29 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-a[93089]: starting mds.a at 2024-05-08T23:18:29.704 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 08 23:18:29 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-g[92725]: ignoring --setuser ceph since I am not root 2024-05-08T23:18:29.704 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 08 23:18:29 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-g[92725]: ignoring --setgroup ceph since I am not root 2024-05-08T23:18:29.704 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 08 23:18:29 smithi135 ceph-mds[92768]: -- 172.21.15.135:0/772256798 <== mon.0 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55995215a1a0 con 0x559952130800 2024-05-08T23:18:29.704 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 08 23:18:29 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-g[92725]: starting mds.g at 2024-05-08T23:18:29.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:29.816+0000 7f55dde43700 1 -- 172.21.15.135:0/1431222467 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f55d802cda0 con 0x7f55d8100f20 2024-05-08T23:18:29.849 INFO:journalctl@ceph.mds.b.smithi179.stdout:May 08 23:18:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-b[83229]: ignoring --setuser ceph since I am not root 2024-05-08T23:18:29.849 INFO:journalctl@ceph.mds.b.smithi179.stdout:May 08 23:18:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-b[83229]: ignoring --setgroup ceph since I am not root 2024-05-08T23:18:29.849 INFO:journalctl@ceph.mds.b.smithi179.stdout:May 08 23:18:29 smithi179 ceph-mds[83251]: -- 172.21.15.179:0/3519097211 <== mon.0 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555e9a8281a0 con 0x555e9a7fe800 2024-05-08T23:18:29.850 INFO:journalctl@ceph.mds.b.smithi179.stdout:May 08 23:18:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-b[83229]: starting mds.b at 2024-05-08T23:18:29.850 INFO:journalctl@ceph.mds.e.smithi179.stdout:May 08 23:18:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-e[82541]: ignoring --setuser ceph since I am not root 2024-05-08T23:18:29.850 INFO:journalctl@ceph.mds.e.smithi179.stdout:May 08 23:18:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-e[82541]: ignoring --setgroup ceph since I am not root 2024-05-08T23:18:29.850 INFO:journalctl@ceph.mds.e.smithi179.stdout:May 08 23:18:29 smithi179 ceph-mds[82564]: -- 172.21.15.179:0/3276670074 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564b4bd381a0 con 0x564b4bd0e800 2024-05-08T23:18:29.850 INFO:journalctl@ceph.mds.e.smithi179.stdout:May 08 23:18:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-e[82541]: starting mds.e at 2024-05-08T23:18:29.850 INFO:journalctl@ceph.mds.k.smithi179.stdout:May 08 23:18:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-k[82197]: ignoring --setuser ceph since I am not root 2024-05-08T23:18:29.850 INFO:journalctl@ceph.mds.k.smithi179.stdout:May 08 23:18:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-k[82197]: ignoring --setgroup ceph since I am not root 2024-05-08T23:18:29.851 INFO:journalctl@ceph.mds.k.smithi179.stdout:May 08 23:18:29 smithi179 ceph-mds[82220]: -- 172.21.15.179:0/1915662742 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56506aa0e1a0 con 0x56506a9e5000 2024-05-08T23:18:29.851 INFO:journalctl@ceph.mds.k.smithi179.stdout:May 08 23:18:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-k[82197]: starting mds.k at 2024-05-08T23:18:29.851 INFO:journalctl@ceph.mds.h.smithi179.stdout:May 08 23:18:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-h[82885]: ignoring --setuser ceph since I am not root 2024-05-08T23:18:29.851 INFO:journalctl@ceph.mds.h.smithi179.stdout:May 08 23:18:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-h[82885]: ignoring --setgroup ceph since I am not root 2024-05-08T23:18:29.851 INFO:journalctl@ceph.mds.h.smithi179.stdout:May 08 23:18:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-h[82885]: starting mds.h at 2024-05-08T23:18:29.880 INFO:journalctl@ceph.mds.l.smithi195.stdout:May 08 23:18:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-l[83583]: ignoring --setuser ceph since I am not root 2024-05-08T23:18:29.880 INFO:journalctl@ceph.mds.l.smithi195.stdout:May 08 23:18:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-l[83583]: ignoring --setgroup ceph since I am not root 2024-05-08T23:18:29.880 INFO:journalctl@ceph.mds.l.smithi195.stdout:May 08 23:18:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-l[83583]: starting mds.l at 2024-05-08T23:18:29.881 INFO:journalctl@ceph.mds.f.smithi195.stdout:May 08 23:18:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-f[83923]: ignoring --setuser ceph since I am not root 2024-05-08T23:18:29.881 INFO:journalctl@ceph.mds.f.smithi195.stdout:May 08 23:18:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-f[83923]: ignoring --setgroup ceph since I am not root 2024-05-08T23:18:29.881 INFO:journalctl@ceph.mds.f.smithi195.stdout:May 08 23:18:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-f[83923]: starting mds.f at 2024-05-08T23:18:29.881 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:18:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-i[84605]: ignoring --setuser ceph since I am not root 2024-05-08T23:18:29.881 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:18:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-i[84605]: ignoring --setgroup ceph since I am not root 2024-05-08T23:18:29.881 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:18:29 smithi195 ceph-mds[84629]: -- 172.21.15.195:0/3455113457 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561bc6ea81a0 con 0x561bc6e7e800 2024-05-08T23:18:29.882 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:18:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-i[84605]: starting mds.i at 2024-05-08T23:18:29.882 INFO:journalctl@ceph.mds.c.smithi195.stdout:May 08 23:18:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-c[84266]: ignoring --setuser ceph since I am not root 2024-05-08T23:18:29.882 INFO:journalctl@ceph.mds.c.smithi195.stdout:May 08 23:18:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-c[84266]: ignoring --setgroup ceph since I am not root 2024-05-08T23:18:29.882 INFO:journalctl@ceph.mds.c.smithi195.stdout:May 08 23:18:29 smithi195 ceph-mds[84289]: -- 172.21.15.195:0/2794419084 <== mon.0 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5579bbcf01a0 con 0x5579bbcc6800 2024-05-08T23:18:29.882 INFO:journalctl@ceph.mds.c.smithi195.stdout:May 08 23:18:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-c[84266]: starting mds.c at 2024-05-08T23:18:30.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.414+0000 7f55d4ff9700 1 -- 172.21.15.135:0/1431222467 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) v1 ==== 104+0+0 (secure 0 0 0) 0x7f55cc0995f0 con 0x7f55d8100f20 2024-05-08T23:18:30.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.417+0000 7f55dde43700 1 -- 172.21.15.135:0/1431222467 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f55c00a1120 msgr2=0x7f55c00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:30.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.417+0000 7f55dde43700 1 --2- 172.21.15.135:0/1431222467 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f55c00a1120 0x7f55c00a35e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009bf0 tx=0x7f55c8009260 comp rx=0 tx=0).stop 2024-05-08T23:18:30.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.417+0000 7f55dde43700 1 -- 172.21.15.135:0/1431222467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d8100f20 msgr2=0x7f55d8196f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:30.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.417+0000 7f55dde43700 1 --2- 172.21.15.135:0/1431222467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d8100f20 0x7f55d8196f50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00c990 tx=0x7f55cc00cca0 comp rx=0 tx=0).stop 2024-05-08T23:18:30.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.420+0000 7f55dde43700 1 -- 172.21.15.135:0/1431222467 shutdown_connections 2024-05-08T23:18:30.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.420+0000 7f55dde43700 1 --2- 172.21.15.135:0/1431222467 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f55c00a1120 0x7f55c00a35e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:30.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.420+0000 7f55dde43700 1 --2- 172.21.15.135:0/1431222467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55d8102ab0 0x7f55d819e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:30.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.420+0000 7f55dde43700 1 --2- 172.21.15.135:0/1431222467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d8100f20 0x7f55d8196f50 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:30.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.420+0000 7f55dde43700 1 --2- 172.21.15.135:0/1431222467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55d81020f0 0x7f55d8197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:30.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.420+0000 7f55dde43700 1 -- 172.21.15.135:0/1431222467 >> 172.21.15.135:0/1431222467 conn(0x7f55d80fc500 msgr2=0x7f55d8105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:30.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.420+0000 7f55dde43700 1 -- 172.21.15.135:0/1431222467 shutdown_connections 2024-05-08T23:18:30.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.420+0000 7f55dde43700 1 -- 172.21.15.135:0/1431222467 wait complete. 2024-05-08T23:18:30.432 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:30 smithi135 ceph-mon[42440]: pgmap v349: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-08T23:18:30.432 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:30 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3572354568' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T23:18:30.432 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:30 smithi135 ceph-mon[42440]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-08T23:18:30.432 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:30 smithi135 ceph-mon[42440]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T23:18:30.432 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:30 smithi135 ceph-mon[42440]: osdmap e86: 12 total, 12 up, 12 in 2024-05-08T23:18:30.433 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:30 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3572354568' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-08T23:18:30.433 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:30 smithi135 ceph-mon[42440]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-08T23:18:30.433 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:30 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1431222467' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T23:18:30.434 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T23:18:30.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.563+0000 7f075a5f5700 1 -- 172.21.15.135:0/1828271272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102ab0 msgr2=0x7f07541093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:30.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.563+0000 7f075a5f5700 1 --2- 172.21.15.135:0/1828271272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102ab0 0x7f07541093d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f074c00b0a0 tx=0x7f074c00b3b0 comp rx=0 tx=0).stop 2024-05-08T23:18:30.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.564+0000 7f075a5f5700 1 -- 172.21.15.135:0/1828271272 shutdown_connections 2024-05-08T23:18:30.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.564+0000 7f075a5f5700 1 --2- 172.21.15.135:0/1828271272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102ab0 0x7f07541093d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:30.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.564+0000 7f075a5f5700 1 --2- 172.21.15.135:0/1828271272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0754100f20 0x7f0754101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:30.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.564+0000 7f075a5f5700 1 --2- 172.21.15.135:0/1828271272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07541020f0 0x7f0754102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:30.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.564+0000 7f075a5f5700 1 -- 172.21.15.135:0/1828271272 >> 172.21.15.135:0/1828271272 conn(0x7f07540fc4e0 msgr2=0x7f07540fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:30.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.564+0000 7f075a5f5700 1 -- 172.21.15.135:0/1828271272 shutdown_connections 2024-05-08T23:18:30.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.564+0000 7f075a5f5700 1 -- 172.21.15.135:0/1828271272 wait complete. 2024-05-08T23:18:30.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.564+0000 7f075a5f5700 1 Processor -- start 2024-05-08T23:18:30.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.564+0000 7f075a5f5700 1 -- start start 2024-05-08T23:18:30.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.564+0000 7f075a5f5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0754100f20 0x7f0754197050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:30.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.564+0000 7f075a5f5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07541020f0 0x7f0754197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:30.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.564+0000 7f075a5f5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102ab0 0x7f075419e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:30.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.564+0000 7f075a5f5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075419eb80 con 0x7f0754102ab0 2024-05-08T23:18:30.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.564+0000 7f075a5f5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075419ecc0 con 0x7f07541020f0 2024-05-08T23:18:30.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.564+0000 7f075a5f5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075419ee50 con 0x7f0754100f20 2024-05-08T23:18:30.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f0758b92700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102ab0 0x7f075419e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:30.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f0758b92700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102ab0 0x7f075419e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43184/0 (socket says 172.21.15.135:43184) 2024-05-08T23:18:30.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f0758b92700 1 -- 172.21.15.135:0/2208198573 learned_addr learned my addr 172.21.15.135:0/2208198573 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:30.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f07537fe700 1 --2- 172.21.15.135:0/2208198573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07541020f0 0x7f0754197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:30.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f0753fff700 1 --2- 172.21.15.135:0/2208198573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0754100f20 0x7f0754197050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:30.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f0758b92700 1 -- 172.21.15.135:0/2208198573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0754100f20 msgr2=0x7f0754197050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:30.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f0758b92700 1 --2- 172.21.15.135:0/2208198573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0754100f20 0x7f0754197050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:30.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f0758b92700 1 -- 172.21.15.135:0/2208198573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07541020f0 msgr2=0x7f0754197590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:30.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f0758b92700 1 --2- 172.21.15.135:0/2208198573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07541020f0 0x7f0754197590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:30.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f0758b92700 1 -- 172.21.15.135:0/2208198573 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c009d00 con 0x7f0754102ab0 2024-05-08T23:18:30.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f0753fff700 1 --2- 172.21.15.135:0/2208198573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0754100f20 0x7f0754197050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:18:30.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f0758b92700 1 --2- 172.21.15.135:0/2208198573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102ab0 0x7f075419e5b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f074c006070 tx=0x7f074c004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:30.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f07517fa700 1 -- 172.21.15.135:0/2208198573 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c00e040 con 0x7f0754102ab0 2024-05-08T23:18:30.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f075a5f5700 1 -- 172.21.15.135:0/2208198573 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075419f0d0 con 0x7f0754102ab0 2024-05-08T23:18:30.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f07517fa700 1 -- 172.21.15.135:0/2208198573 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f074c01db50 con 0x7f0754102ab0 2024-05-08T23:18:30.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f07517fa700 1 -- 172.21.15.135:0/2208198573 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c01bc00 con 0x7f0754102ab0 2024-05-08T23:18:30.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.565+0000 7f075a5f5700 1 -- 172.21.15.135:0/2208198573 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075419f5a0 con 0x7f0754102ab0 2024-05-08T23:18:30.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.566+0000 7f075a5f5700 1 -- 172.21.15.135:0/2208198573 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0754108340 con 0x7f0754102ab0 2024-05-08T23:18:30.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.567+0000 7f07517fa700 1 -- 172.21.15.135:0/2208198573 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f074c01dcc0 con 0x7f0754102ab0 2024-05-08T23:18:30.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.568+0000 7f07517fa700 1 --2- 172.21.15.135:0/2208198573 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f073c0a11a0 0x7f073c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:30.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.568+0000 7f0753fff700 1 --2- 172.21.15.135:0/2208198573 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f073c0a11a0 0x7f073c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:30.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.568+0000 7f07517fa700 1 -- 172.21.15.135:0/2208198573 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8699+0+0 (secure 0 0 0) 0x7f074c0ced50 con 0x7f0754102ab0 2024-05-08T23:18:30.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.568+0000 7f0753fff700 1 --2- 172.21.15.135:0/2208198573 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f073c0a11a0 0x7f073c0a3660 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0754100c40 tx=0x7f0744008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:30.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.572+0000 7f07517fa700 1 -- 172.21.15.135:0/2208198573 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f074c098340 con 0x7f0754102ab0 2024-05-08T23:18:30.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:30 smithi179 ceph-mon[46314]: pgmap v349: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-08T23:18:30.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:30 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3572354568' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T23:18:30.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:30 smithi179 ceph-mon[46314]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-08T23:18:30.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:30 smithi179 ceph-mon[46314]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T23:18:30.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:30 smithi179 ceph-mon[46314]: osdmap e86: 12 total, 12 up, 12 in 2024-05-08T23:18:30.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:30 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3572354568' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-08T23:18:30.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:30 smithi179 ceph-mon[46314]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-08T23:18:30.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:30 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1431222467' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T23:18:30.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:30 smithi195 ceph-mon[46516]: pgmap v349: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-08T23:18:30.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:30 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3572354568' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T23:18:30.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:30 smithi195 ceph-mon[46516]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-08T23:18:30.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:30 smithi195 ceph-mon[46516]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T23:18:30.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:30 smithi195 ceph-mon[46516]: osdmap e86: 12 total, 12 up, 12 in 2024-05-08T23:18:30.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:30 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3572354568' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-08T23:18:30.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:30 smithi195 ceph-mon[46516]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-08T23:18:30.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:30 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1431222467' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T23:18:30.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:30.769+0000 7f075a5f5700 1 -- 172.21.15.135:0/2208198573 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f075410ca20 con 0x7f0754102ab0 2024-05-08T23:18:31.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.418+0000 7f07517fa700 1 -- 172.21.15.135:0/2208198573 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) v1 ==== 181+0+0 (secure 0 0 0) 0x7f075410ca20 con 0x7f0754102ab0 2024-05-08T23:18:31.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.422+0000 7f075a5f5700 1 -- 172.21.15.135:0/2208198573 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f073c0a11a0 msgr2=0x7f073c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:31.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.422+0000 7f075a5f5700 1 --2- 172.21.15.135:0/2208198573 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f073c0a11a0 0x7f073c0a3660 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0754100c40 tx=0x7f0744008040 comp rx=0 tx=0).stop 2024-05-08T23:18:31.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.423+0000 7f075a5f5700 1 -- 172.21.15.135:0/2208198573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102ab0 msgr2=0x7f075419e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:31.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.423+0000 7f075a5f5700 1 --2- 172.21.15.135:0/2208198573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102ab0 0x7f075419e5b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f074c006070 tx=0x7f074c004d00 comp rx=0 tx=0).stop 2024-05-08T23:18:31.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.423+0000 7f075a5f5700 1 -- 172.21.15.135:0/2208198573 shutdown_connections 2024-05-08T23:18:31.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.423+0000 7f075a5f5700 1 --2- 172.21.15.135:0/2208198573 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7f073c0a11a0 0x7f073c0a3660 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:31.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.423+0000 7f075a5f5700 1 --2- 172.21.15.135:0/2208198573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0754100f20 0x7f0754197050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:31.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.423+0000 7f075a5f5700 1 --2- 172.21.15.135:0/2208198573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0754102ab0 0x7f075419e5b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:31.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.423+0000 7f075a5f5700 1 --2- 172.21.15.135:0/2208198573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07541020f0 0x7f0754197590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:31.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.423+0000 7f075a5f5700 1 -- 172.21.15.135:0/2208198573 >> 172.21.15.135:0/2208198573 conn(0x7f07540fc4e0 msgr2=0x7f0754105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:31.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.423+0000 7f075a5f5700 1 -- 172.21.15.135:0/2208198573 shutdown_connections 2024-05-08T23:18:31.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.423+0000 7f075a5f5700 1 -- 172.21.15.135:0/2208198573 wait complete. 2024-05-08T23:18:31.423 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_metadata' removed 2024-05-08T23:18:31.435 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-08T23:18:31.435 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-08T23:18:31.435 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: Cluster is now healthy 2024-05-08T23:18:31.435 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.179:6833/3881482858,v1:172.21.15.179:6835/3881482858] up:boot 2024-05-08T23:18:31.436 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.135:6838/341200898,v1:172.21.15.135:6840/341200898] up:boot 2024-05-08T23:18:31.436 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.195:6832/1772004268,v1:172.21.15.195:6833/1772004268] up:boot 2024-05-08T23:18:31.436 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.195:6836/1363924676,v1:172.21.15.195:6838/1363924676] up:boot 2024-05-08T23:18:31.436 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.179:6832/3477244168,v1:172.21.15.179:6834/3477244168] up:boot 2024-05-08T23:18:31.436 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.195:6837/3843237431,v1:172.21.15.195:6839/3843237431] up:boot 2024-05-08T23:18:31.436 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.135:6839/1778851851,v1:172.21.15.135:6841/1778851851] up:boot 2024-05-08T23:18:31.436 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.179:6837/1460148926,v1:172.21.15.179:6839/1460148926] up:boot 2024-05-08T23:18:31.436 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.195:6834/1353052391,v1:172.21.15.195:6835/1353052391] up:boot 2024-05-08T23:18:31.436 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: mds.? [v2:172.21.15.179:6836/3297287425,v1:172.21.15.179:6838/3297287425] up:boot 2024-05-08T23:18:31.436 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/1431222467' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-08T23:18:31.436 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: fsmap 12 up:standby 2024-05-08T23:18:31.436 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T23:18:31.436 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T23:18:31.436 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T23:18:31.436 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T23:18:31.437 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T23:18:31.437 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T23:18:31.437 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T23:18:31.437 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T23:18:31.437 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T23:18:31.437 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T23:18:31.437 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:31 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2208198573' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T23:18:31.438 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T23:18:31.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.575+0000 7fb9f16a8700 1 -- 172.21.15.135:0/2466089129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9ec100f20 msgr2=0x7fb9ec101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:31.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.575+0000 7fb9f16a8700 1 --2- 172.21.15.135:0/2466089129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9ec100f20 0x7fb9ec101360 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009990 tx=0x7fb9dc009ca0 comp rx=0 tx=0).stop 2024-05-08T23:18:31.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.575+0000 7fb9f16a8700 1 -- 172.21.15.135:0/2466089129 shutdown_connections 2024-05-08T23:18:31.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.575+0000 7fb9f16a8700 1 --2- 172.21.15.135:0/2466089129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9ec102ab0 0x7fb9ec1093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:31.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.575+0000 7fb9f16a8700 1 --2- 172.21.15.135:0/2466089129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9ec100f20 0x7fb9ec101360 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.575+0000 7fb9f16a8700 1 --2- 172.21.15.135:0/2466089129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9ec1020f0 0x7fb9ec102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.575+0000 7fb9f16a8700 1 -- 172.21.15.135:0/2466089129 >> 172.21.15.135:0/2466089129 conn(0x7fb9ec0fc500 msgr2=0x7fb9ec0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.575+0000 7fb9f16a8700 1 -- 172.21.15.135:0/2466089129 shutdown_connections 2024-05-08T23:18:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.575+0000 7fb9f16a8700 1 -- 172.21.15.135:0/2466089129 wait complete. 2024-05-08T23:18:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9f16a8700 1 Processor -- start 2024-05-08T23:18:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9f16a8700 1 -- start start 2024-05-08T23:18:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9f16a8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9ec100f20 0x7fb9ec196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9f16a8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9ec1020f0 0x7fb9ec197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9f16a8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9ec102ab0 0x7fb9ec19e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9f16a8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec19ea80 con 0x7fb9ec102ab0 2024-05-08T23:18:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9f16a8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec19ebc0 con 0x7fb9ec1020f0 2024-05-08T23:18:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9f16a8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec19ed50 con 0x7fb9ec100f20 2024-05-08T23:18:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9eb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9ec102ab0 0x7fb9ec19e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9eb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9ec102ab0 0x7fb9ec19e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43202/0 (socket says 172.21.15.135:43202) 2024-05-08T23:18:31.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9eb7fe700 1 -- 172.21.15.135:0/3988505438 learned_addr learned my addr 172.21.15.135:0/3988505438 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:18:31.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9eaffd700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9ec100f20 0x7fb9ec196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:31.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9eb7fe700 1 -- 172.21.15.135:0/3988505438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9ec100f20 msgr2=0x7fb9ec196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:31.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9eb7fe700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9ec100f20 0x7fb9ec196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:31.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9eb7fe700 1 -- 172.21.15.135:0/3988505438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9ec1020f0 msgr2=0x7fb9ec197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:31.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9e3fff700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9ec1020f0 0x7fb9ec197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:31.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9eb7fe700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9ec1020f0 0x7fb9ec197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:31.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9eb7fe700 1 -- 172.21.15.135:0/3988505438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc0095f0 con 0x7fb9ec102ab0 2024-05-08T23:18:31.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9eaffd700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9ec100f20 0x7fb9ec196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:18:31.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9e3fff700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9ec1020f0 0x7fb9ec197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T23:18:31.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9eb7fe700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9ec102ab0 0x7fb9ec19e4b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400ef30 tx=0x7fb9e400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:31.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.576+0000 7fb9e8ff9700 1 -- 172.21.15.135:0/3988505438 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4018070 con 0x7fb9ec102ab0 2024-05-08T23:18:31.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.577+0000 7fb9e8ff9700 1 -- 172.21.15.135:0/3988505438 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9e400f040 con 0x7fb9ec102ab0 2024-05-08T23:18:31.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.577+0000 7fb9e8ff9700 1 -- 172.21.15.135:0/3988505438 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4003dc0 con 0x7fb9ec102ab0 2024-05-08T23:18:31.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.577+0000 7fb9f16a8700 1 -- 172.21.15.135:0/3988505438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ec19efd0 con 0x7fb9ec102ab0 2024-05-08T23:18:31.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.577+0000 7fb9f16a8700 1 -- 172.21.15.135:0/3988505438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ec19f400 con 0x7fb9ec102ab0 2024-05-08T23:18:31.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.578+0000 7fb9f16a8700 1 -- 172.21.15.135:0/3988505438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ec1084b0 con 0x7fb9ec102ab0 2024-05-08T23:18:31.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.578+0000 7fb9e8ff9700 1 -- 172.21.15.135:0/3988505438 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fb9e400caa0 con 0x7fb9ec102ab0 2024-05-08T23:18:31.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.579+0000 7fb9e8ff9700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb9d80a11a0 0x7fb9d80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:18:31.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.579+0000 7fb9eaffd700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb9d80a11a0 0x7fb9d80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:18:31.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.579+0000 7fb9e8ff9700 1 -- 172.21.15.135:0/3988505438 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8145+0+0 (secure 0 0 0) 0x7fb9e40cc430 con 0x7fb9ec102ab0 2024-05-08T23:18:31.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.579+0000 7fb9eaffd700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb9d80a11a0 0x7fb9d80a3660 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00b2e0 tx=0x7fb9dc005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:18:31.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.584+0000 7fb9e8ff9700 1 -- 172.21.15.135:0/3988505438 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb9e4095cf0 con 0x7fb9ec102ab0 2024-05-08T23:18:31.599 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-08T23:18:31.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-08T23:18:31.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: Cluster is now healthy 2024-05-08T23:18:31.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.179:6833/3881482858,v1:172.21.15.179:6835/3881482858] up:boot 2024-05-08T23:18:31.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.135:6838/341200898,v1:172.21.15.135:6840/341200898] up:boot 2024-05-08T23:18:31.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.195:6832/1772004268,v1:172.21.15.195:6833/1772004268] up:boot 2024-05-08T23:18:31.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.195:6836/1363924676,v1:172.21.15.195:6838/1363924676] up:boot 2024-05-08T23:18:31.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.179:6832/3477244168,v1:172.21.15.179:6834/3477244168] up:boot 2024-05-08T23:18:31.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.195:6837/3843237431,v1:172.21.15.195:6839/3843237431] up:boot 2024-05-08T23:18:31.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.135:6839/1778851851,v1:172.21.15.135:6841/1778851851] up:boot 2024-05-08T23:18:31.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.179:6837/1460148926,v1:172.21.15.179:6839/1460148926] up:boot 2024-05-08T23:18:31.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.195:6834/1353052391,v1:172.21.15.195:6835/1353052391] up:boot 2024-05-08T23:18:31.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: mds.? [v2:172.21.15.179:6836/3297287425,v1:172.21.15.179:6838/3297287425] up:boot 2024-05-08T23:18:31.600 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/1431222467' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-08T23:18:31.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: fsmap 12 up:standby 2024-05-08T23:18:31.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T23:18:31.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T23:18:31.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T23:18:31.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T23:18:31.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T23:18:31.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T23:18:31.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T23:18:31.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T23:18:31.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T23:18:31.601 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T23:18:31.602 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:31 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2208198573' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T23:18:31.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-08T23:18:31.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-08T23:18:31.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: Cluster is now healthy 2024-05-08T23:18:31.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.179:6833/3881482858,v1:172.21.15.179:6835/3881482858] up:boot 2024-05-08T23:18:31.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.135:6838/341200898,v1:172.21.15.135:6840/341200898] up:boot 2024-05-08T23:18:31.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.195:6832/1772004268,v1:172.21.15.195:6833/1772004268] up:boot 2024-05-08T23:18:31.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.195:6836/1363924676,v1:172.21.15.195:6838/1363924676] up:boot 2024-05-08T23:18:31.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.179:6832/3477244168,v1:172.21.15.179:6834/3477244168] up:boot 2024-05-08T23:18:31.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.195:6837/3843237431,v1:172.21.15.195:6839/3843237431] up:boot 2024-05-08T23:18:31.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.135:6839/1778851851,v1:172.21.15.135:6841/1778851851] up:boot 2024-05-08T23:18:31.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.179:6837/1460148926,v1:172.21.15.179:6839/1460148926] up:boot 2024-05-08T23:18:31.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.195:6834/1353052391,v1:172.21.15.195:6835/1353052391] up:boot 2024-05-08T23:18:31.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: mds.? [v2:172.21.15.179:6836/3297287425,v1:172.21.15.179:6838/3297287425] up:boot 2024-05-08T23:18:31.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/1431222467' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-08T23:18:31.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: fsmap 12 up:standby 2024-05-08T23:18:31.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T23:18:31.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T23:18:31.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T23:18:31.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T23:18:31.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T23:18:31.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T23:18:31.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T23:18:31.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T23:18:31.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T23:18:31.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: from='mgr.14152 172.21.15.135:0/1325021046' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T23:18:31.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:31 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2208198573' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T23:18:31.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:31.782+0000 7fb9f16a8700 1 -- 172.21.15.135:0/3988505438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9ec107e90 con 0x7fb9ec102ab0 2024-05-08T23:18:32.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:32.421+0000 7fb9e8ff9700 1 -- 172.21.15.135:0/3988505438 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb9e4099310 con 0x7fb9ec102ab0 2024-05-08T23:18:32.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:32.426+0000 7fb9f16a8700 1 -- 172.21.15.135:0/3988505438 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb9d80a11a0 msgr2=0x7fb9d80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:32.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:32.426+0000 7fb9f16a8700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb9d80a11a0 0x7fb9d80a3660 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00b2e0 tx=0x7fb9dc005e80 comp rx=0 tx=0).stop 2024-05-08T23:18:32.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:32.426+0000 7fb9f16a8700 1 -- 172.21.15.135:0/3988505438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9ec102ab0 msgr2=0x7fb9ec19e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:18:32.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:32.426+0000 7fb9f16a8700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9ec102ab0 0x7fb9ec19e4b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400ef30 tx=0x7fb9e400c450 comp rx=0 tx=0).stop 2024-05-08T23:18:32.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:32.426+0000 7fb9f16a8700 1 -- 172.21.15.135:0/3988505438 shutdown_connections 2024-05-08T23:18:32.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:32.426+0000 7fb9f16a8700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.135:6800/1743116941,v1:172.21.15.135:6801/1743116941] conn(0x7fb9d80a11a0 0x7fb9d80a3660 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:32.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:32.426+0000 7fb9f16a8700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9ec100f20 0x7fb9ec196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:32.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:32.426+0000 7fb9f16a8700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9ec102ab0 0x7fb9ec19e4b0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:32.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:32.426+0000 7fb9f16a8700 1 --2- 172.21.15.135:0/3988505438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9ec1020f0 0x7fb9ec197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:18:32.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:32.426+0000 7fb9f16a8700 1 -- 172.21.15.135:0/3988505438 >> 172.21.15.135:0/3988505438 conn(0x7fb9ec0fc500 msgr2=0x7fb9ec1055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:18:32.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:32.426+0000 7fb9f16a8700 1 -- 172.21.15.135:0/3988505438 shutdown_connections 2024-05-08T23:18:32.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:18:32.426+0000 7fb9f16a8700 1 -- 172.21.15.135:0/3988505438 wait complete. 2024-05-08T23:18:32.427 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data' removed 2024-05-08T23:18:32.439 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:32 smithi135 ceph-mon[42440]: pgmap v351: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-08T23:18:32.440 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:32 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/2208198573' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T23:18:32.440 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:32 smithi135 ceph-mon[42440]: osdmap e87: 12 total, 12 up, 12 in 2024-05-08T23:18:32.440 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:32 smithi135 ceph-mon[42440]: from='client.? 172.21.15.135:0/3988505438' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T23:18:32.441 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T23:18:32.471 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T23:18:32.503 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:32 smithi179 ceph-mon[46314]: pgmap v351: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-08T23:18:32.504 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:32 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/2208198573' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T23:18:32.504 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:32 smithi179 ceph-mon[46314]: osdmap e87: 12 total, 12 up, 12 in 2024-05-08T23:18:32.504 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:32 smithi179 ceph-mon[46314]: from='client.? 172.21.15.135:0/3988505438' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T23:18:32.508 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T23:18:32.540 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:32 smithi195 ceph-mon[46516]: pgmap v351: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-05-08T23:18:32.540 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:32 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/2208198573' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T23:18:32.541 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:32 smithi195 ceph-mon[46516]: osdmap e87: 12 total, 12 up, 12 in 2024-05-08T23:18:32.541 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:32 smithi195 ceph-mon[46516]: from='client.? 172.21.15.135:0/3988505438' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T23:18:32.546 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-08T23:18:32.546 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-08T23:18:32.564 DEBUG:teuthology.orchestra.run.smithi179:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-08T23:18:32.584 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-08T23:18:32.605 INFO:tasks.cephadm:Stopping all daemons... 2024-05-08T23:18:32.605 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-08T23:18:32.606 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mon.a 2024-05-08T23:18:32.703 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:32 smithi135 systemd[1]: Stopping Ceph mon.a for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:18:33.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:32 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mon-a[42416]: 2024-05-08T23:18:32.838+0000 7feee5daf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:18:33.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:32 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mon-a[42416]: 2024-05-08T23:18:32.838+0000 7feee5daf700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-08T23:18:33.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:May 08 23:18:33 smithi135 bash[109651]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mon-a 2024-05-08T23:18:33.280 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mon.a.service' 2024-05-08T23:18:33.355 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:18:33.355 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-08T23:18:33.356 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-08T23:18:33.356 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mon.b 2024-05-08T23:18:33.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:33 smithi179 systemd[1]: Stopping Ceph mon.b for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:18:33.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:33 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mon-b[46291]: 2024-05-08T23:18:33.612+0000 7f8cc9472700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:18:33.850 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:33 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mon-b[46291]: 2024-05-08T23:18:33.612+0000 7f8cc9472700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-08T23:18:34.329 INFO:journalctl@ceph.mon.b.smithi179.stdout:May 08 23:18:34 smithi179 bash[86386]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mon-b 2024-05-08T23:18:34.336 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mon.b.service' 2024-05-08T23:18:34.382 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:18:34.382 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-08T23:18:34.382 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-08T23:18:34.382 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mon.c 2024-05-08T23:18:34.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:34 smithi195 systemd[1]: Stopping Ceph mon.c for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:18:34.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:34 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mon-c[46493]: 2024-05-08T23:18:34.637+0000 7f4096db2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:18:34.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:34 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mon-c[46493]: 2024-05-08T23:18:34.637+0000 7f4096db2700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-08T23:18:35.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:May 08 23:18:35 smithi195 bash[87835]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mon-c 2024-05-08T23:18:35.441 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mon.c.service' 2024-05-08T23:18:35.516 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:18:35.516 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-08T23:18:35.517 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-08T23:18:35.517 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mgr.x 2024-05-08T23:18:35.858 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:18:35 smithi135 systemd[1]: Stopping Ceph mgr.x for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:18:35.858 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:18:35 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:18:35.753+0000 7f6d31bbf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:18:35.858 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:18:35 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x[42691]: 2024-05-08T23:18:35.753+0000 7f6d31bbf700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-08T23:18:36.203 INFO:journalctl@ceph.mgr.x.smithi135.stdout:May 08 23:18:35 smithi135 bash[109789]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-x 2024-05-08T23:18:36.248 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mgr.x.service' 2024-05-08T23:18:36.287 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:18:36.287 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-08T23:18:36.287 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-08T23:18:36.287 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mgr.y 2024-05-08T23:18:36.600 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:18:36 smithi179 systemd[1]: Stopping Ceph mgr.y for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:18:37.028 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:18:36 smithi179 bash[86535]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-y 2024-05-08T23:18:37.028 INFO:journalctl@ceph.mgr.y.smithi179.stdout:May 08 23:18:36 smithi179 systemd[1]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-08T23:18:37.034 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mgr.y.service' 2024-05-08T23:18:37.070 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:18:37.071 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-08T23:18:37.071 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-08T23:18:37.071 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mgr.z 2024-05-08T23:18:37.380 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:18:37 smithi195 systemd[1]: Stopping Ceph mgr.z for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:18:37.880 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:18:37 smithi195 bash[87987]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mgr-z 2024-05-08T23:18:38.021 INFO:journalctl@ceph.mgr.z.smithi195.stdout:May 08 23:18:37 smithi195 systemd[1]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-05-08T23:18:38.022 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mgr.z.service' 2024-05-08T23:18:38.060 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:18:38.060 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-08T23:18:38.060 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-08T23:18:38.060 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.0 2024-05-08T23:18:38.203 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:18:38 smithi135 systemd[1]: Stopping Ceph osd.0 for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:18:38.703 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:18:38 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-0[60145]: 2024-05-08T23:18:38.303+0000 7fd516df0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:18:38.703 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:18:38 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-0[60145]: 2024-05-08T23:18:38.303+0000 7fd516df0700 -1 osd.0 88 *** Got signal Terminated *** 2024-05-08T23:18:38.703 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:18:38 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-0[60145]: 2024-05-08T23:18:38.303+0000 7fd516df0700 -1 osd.0 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T23:18:44.203 INFO:journalctl@ceph.osd.0.smithi135.stdout:May 08 23:18:43 smithi135 bash[109930]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-0 2024-05-08T23:18:45.075 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.0.service' 2024-05-08T23:18:45.118 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:18:45.119 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-08T23:18:45.119 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-08T23:18:45.119 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.1 2024-05-08T23:18:45.599 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:18:45 smithi179 systemd[1]: Stopping Ceph osd.1 for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:18:45.600 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:18:45 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-1[51237]: 2024-05-08T23:18:45.385+0000 7eff42dbc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:18:45.600 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:18:45 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-1[51237]: 2024-05-08T23:18:45.385+0000 7eff42dbc700 -1 osd.1 88 *** Got signal Terminated *** 2024-05-08T23:18:45.600 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:18:45 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-1[51237]: 2024-05-08T23:18:45.385+0000 7eff42dbc700 -1 osd.1 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T23:18:51.350 INFO:journalctl@ceph.osd.1.smithi179.stdout:May 08 23:18:51 smithi179 bash[86675]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-1 2024-05-08T23:18:52.231 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.1.service' 2024-05-08T23:18:52.272 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:18:52.272 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-08T23:18:52.273 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-08T23:18:52.273 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.2 2024-05-08T23:18:52.630 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:18:52 smithi195 systemd[1]: Stopping Ceph osd.2 for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:18:52.630 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:18:52 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-2[52283]: 2024-05-08T23:18:52.517+0000 7f479850e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:18:52.631 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:18:52 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-2[52283]: 2024-05-08T23:18:52.517+0000 7f479850e700 -1 osd.2 88 *** Got signal Terminated *** 2024-05-08T23:18:52.631 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:18:52 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-2[52283]: 2024-05-08T23:18:52.517+0000 7f479850e700 -1 osd.2 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T23:18:58.631 INFO:journalctl@ceph.osd.2.smithi195.stdout:May 08 23:18:58 smithi195 bash[88134]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-2 2024-05-08T23:18:59.719 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.2.service' 2024-05-08T23:18:59.759 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:18:59.760 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-08T23:18:59.760 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-08T23:18:59.760 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.3 2024-05-08T23:19:00.203 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 08 23:18:59 smithi135 systemd[1]: Stopping Ceph osd.3 for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:19:00.204 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 08 23:19:00 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-3[68042]: 2024-05-08T23:19:00.007+0000 7fa88cd7a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:19:00.204 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 08 23:19:00 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-3[68042]: 2024-05-08T23:19:00.007+0000 7fa88cd7a700 -1 osd.3 88 *** Got signal Terminated *** 2024-05-08T23:19:00.204 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 08 23:19:00 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-3[68042]: 2024-05-08T23:19:00.007+0000 7fa88cd7a700 -1 osd.3 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T23:19:04.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:04 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:04.113+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:05.132 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:04 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:04.840+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.726029+0000 front 2024-05-08T23:18:41.725896+0000 (oldest deadline 2024-05-08T23:19:04.625850+0000) 2024-05-08T23:19:05.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:05 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:05.159+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:05.953 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 08 23:19:05 smithi135 bash[110186]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-3 2024-05-08T23:19:06.130 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:05 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:05.798+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.726029+0000 front 2024-05-08T23:18:41.725896+0000 (oldest deadline 2024-05-08T23:19:04.625850+0000) 2024-05-08T23:19:06.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:06 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:06.166+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:06.630 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:06 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:06.180+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:06.862 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:06 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:06.773+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:06.869 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.3.service' 2024-05-08T23:19:06.910 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:19:06.910 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-08T23:19:06.910 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-08T23:19:06.910 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.4 2024-05-08T23:19:07.130 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:06 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:06.779+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.726029+0000 front 2024-05-08T23:18:41.725896+0000 (oldest deadline 2024-05-08T23:19:04.625850+0000) 2024-05-08T23:19:07.350 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:07 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:07.170+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:07.350 INFO:journalctl@ceph.osd.4.smithi179.stdout:May 08 23:19:06 smithi179 systemd[1]: Stopping Ceph osd.4 for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:19:07.350 INFO:journalctl@ceph.osd.4.smithi179.stdout:May 08 23:19:07 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-4[59309]: 2024-05-08T23:19:07.157+0000 7ff2901f9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:19:07.350 INFO:journalctl@ceph.osd.4.smithi179.stdout:May 08 23:19:07 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-4[59309]: 2024-05-08T23:19:07.157+0000 7ff2901f9700 -1 osd.4 88 *** Got signal Terminated *** 2024-05-08T23:19:07.350 INFO:journalctl@ceph.osd.4.smithi179.stdout:May 08 23:19:07 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-4[59309]: 2024-05-08T23:19:07.157+0000 7ff2901f9700 -1 osd.4 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T23:19:07.630 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:07 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:07.132+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:07.703 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:07 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:07.405+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:08.130 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:07 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:07.756+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.726029+0000 front 2024-05-08T23:18:41.725896+0000 (oldest deadline 2024-05-08T23:19:04.625850+0000) 2024-05-08T23:19:08.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:07 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:07.751+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:08.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:08 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:08.183+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:08.673 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:08 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:08.141+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:08.703 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:08 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:08.428+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:09.112 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:08 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:08.729+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.726029+0000 front 2024-05-08T23:18:41.725896+0000 (oldest deadline 2024-05-08T23:19:04.625850+0000) 2024-05-08T23:19:09.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:08 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:08.771+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:09.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:09 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:09.111+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:09.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:09 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:09.201+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:09.703 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:09 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:09.430+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:10.130 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:09 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:09.775+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.726029+0000 front 2024-05-08T23:18:41.725896+0000 (oldest deadline 2024-05-08T23:19:04.625850+0000) 2024-05-08T23:19:10.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:09 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:09.737+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:10.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:10 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:10.164+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:10.630 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:10 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:10.133+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:10.764 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:10 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:10.469+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:11.130 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:10 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:10.773+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.726029+0000 front 2024-05-08T23:18:41.725896+0000 (oldest deadline 2024-05-08T23:19:04.625850+0000) 2024-05-08T23:19:11.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:10 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:10.765+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:11.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:11 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:11.164+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:11.630 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:11 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:11.169+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:11.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:11 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:11.484+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:11.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:11 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:11.734+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:12.130 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:11 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:11.761+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.726029+0000 front 2024-05-08T23:18:41.725896+0000 (oldest deadline 2024-05-08T23:19:04.625850+0000) 2024-05-08T23:19:12.463 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:12 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:12.154+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:12.630 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:12 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:12.179+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:12.630 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:12 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:12.179+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:12.778 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:12 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:12.464+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:12.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:12 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:12.457+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:12.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:12 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:12.703+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:13.099 INFO:journalctl@ceph.osd.4.smithi179.stdout:May 08 23:19:12 smithi179 bash[86935]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-4 2024-05-08T23:19:13.130 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:12 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:12.714+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.726029+0000 front 2024-05-08T23:18:41.725896+0000 (oldest deadline 2024-05-08T23:19:04.625850+0000) 2024-05-08T23:19:13.440 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:13 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:13.186+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:13.630 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:13 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:13.186+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:13.630 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:13 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:13.186+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:13.750 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:13 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:13.479+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:13.790 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:13 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:13.510+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:14.130 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:13 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:13.750+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.726029+0000 front 2024-05-08T23:18:41.725896+0000 (oldest deadline 2024-05-08T23:19:04.625850+0000) 2024-05-08T23:19:14.137 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.4.service' 2024-05-08T23:19:14.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:19:14.178 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-08T23:19:14.178 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-08T23:19:14.179 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.5 2024-05-08T23:19:14.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:13 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:13.751+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:14.431 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:14 smithi195 systemd[1]: Stopping Ceph osd.5 for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:19:14.432 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:14 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:14.247+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:14.432 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:14 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:14.140+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:14.432 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:14 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:14.140+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:14.510 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:14 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:14.159+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:14.510 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:14 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:14.159+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:14.766 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:14 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:14.516+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:14.766 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:14 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:14.516+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.611155+0000 front 2024-05-08T23:18:49.611163+0000 (oldest deadline 2024-05-08T23:19:13.711088+0000) 2024-05-08T23:19:14.783 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:14 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:14.431+0000 7f716277b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:19:14.783 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:14 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:14.431+0000 7f716277b700 -1 osd.5 88 *** Got signal Terminated *** 2024-05-08T23:19:14.783 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:14 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:14.431+0000 7f716277b700 -1 osd.5 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T23:19:14.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:14 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:14.510+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:15.096 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:14 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:14.782+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.726029+0000 front 2024-05-08T23:18:41.725896+0000 (oldest deadline 2024-05-08T23:19:04.625850+0000) 2024-05-08T23:19:15.096 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:14 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:14.782+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.326985+0000 front 2024-05-08T23:18:49.327088+0000 (oldest deadline 2024-05-08T23:19:14.626735+0000) 2024-05-08T23:19:15.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:14 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:14.766+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:15.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:15 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:15.221+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:15.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:15 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:15.097+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:15.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:15 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:15.097+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:15.525 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:15 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:15.166+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:15.525 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:15 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:15.166+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:15.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:15 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:15.526+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:15.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:15 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:15.543+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:15.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:15 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:15.543+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.611155+0000 front 2024-05-08T23:18:49.611163+0000 (oldest deadline 2024-05-08T23:19:13.711088+0000) 2024-05-08T23:19:15.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:15 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:15.779+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:15.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:15 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:15.779+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:16.101 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:15 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:15.799+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.726029+0000 front 2024-05-08T23:18:41.725896+0000 (oldest deadline 2024-05-08T23:19:04.625850+0000) 2024-05-08T23:19:16.101 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:15 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:15.799+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.326985+0000 front 2024-05-08T23:18:49.327088+0000 (oldest deadline 2024-05-08T23:19:14.626735+0000) 2024-05-08T23:19:16.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:16 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:16.236+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:16.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:16 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:16.102+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:16.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:16 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:16.102+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:16.545 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:16 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:16.166+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:16.546 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:16 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:16.166+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:16.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:16 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:16.545+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:16.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:16 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:16.739+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:16.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:16 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:16.739+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:16.954 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:16 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:16.504+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:16.954 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:16 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:16.504+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.611155+0000 front 2024-05-08T23:18:49.611163+0000 (oldest deadline 2024-05-08T23:19:13.711088+0000) 2024-05-08T23:19:17.130 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:16 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:16.757+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.726029+0000 front 2024-05-08T23:18:41.725896+0000 (oldest deadline 2024-05-08T23:19:04.625850+0000) 2024-05-08T23:19:17.130 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:16 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:16.757+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.326985+0000 front 2024-05-08T23:18:49.327088+0000 (oldest deadline 2024-05-08T23:19:14.626735+0000) 2024-05-08T23:19:17.576 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:17 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:17.120+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:17.576 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:17 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:17.120+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:17.630 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:17 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:17.141+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:17.630 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:17 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:17.141+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:17.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:17 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:17.285+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:17.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:17 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:17.576+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:17.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:17 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:17.514+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:17.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:17 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:17.514+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.611155+0000 front 2024-05-08T23:18:49.611163+0000 (oldest deadline 2024-05-08T23:19:13.711088+0000) 2024-05-08T23:19:17.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:17 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:17.719+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:17.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:17 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:17.719+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:18.093 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:17 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:17.710+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.726029+0000 front 2024-05-08T23:18:41.725896+0000 (oldest deadline 2024-05-08T23:19:04.625850+0000) 2024-05-08T23:19:18.093 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:17 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:17.710+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.326985+0000 front 2024-05-08T23:18:49.327088+0000 (oldest deadline 2024-05-08T23:19:14.626735+0000) 2024-05-08T23:19:18.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:18 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:18.297+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:18.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:18 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:18.093+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:18.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:18 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:18.093+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:18.539 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:18 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:18.169+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:18.539 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:18 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:18.169+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:18.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:18 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:18.538+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:18.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:18 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:18.546+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:18.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:18 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:18.546+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.611155+0000 front 2024-05-08T23:18:49.611163+0000 (oldest deadline 2024-05-08T23:19:13.711088+0000) 2024-05-08T23:19:18.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:18 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:18.715+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:18.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:18 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:18.715+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:19.090 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:18 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:18.735+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.726029+0000 front 2024-05-08T23:18:41.725896+0000 (oldest deadline 2024-05-08T23:19:04.625850+0000) 2024-05-08T23:19:19.090 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:18 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5[60242]: 2024-05-08T23:19:18.735+0000 7f715ed71700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.326985+0000 front 2024-05-08T23:18:49.327088+0000 (oldest deadline 2024-05-08T23:19:14.626735+0000) 2024-05-08T23:19:19.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:19 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:19.312+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:19.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:19 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:19.312+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:19.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:19 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:19.091+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:19.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:19 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:19.091+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:19.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:19 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:19.091+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:19.562 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:19 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:19.162+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:19.562 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:19 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:19.162+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:19.562 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:19 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:19.162+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:19.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:19 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:19.562+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:19.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:19 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:19.570+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:19.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:19 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:19.570+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.611155+0000 front 2024-05-08T23:18:49.611163+0000 (oldest deadline 2024-05-08T23:19:13.711088+0000) 2024-05-08T23:19:19.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:19 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:19.734+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:19.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:19 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:19.734+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:20.335 INFO:journalctl@ceph.osd.5.smithi195.stdout:May 08 23:19:20 smithi195 bash[88390]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-5 2024-05-08T23:19:20.335 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:20 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:20.118+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:20.335 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:20 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:20.118+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:20.335 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:20 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:20.118+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:20.537 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:20 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:20.156+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:20.537 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:20 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:20.156+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:20.537 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:20 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:20.156+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:20.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:20 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:20.334+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:20.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:20 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:20.335+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:20.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:20 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:20.536+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:20.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:20 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:20.582+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:20.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:20 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:20.582+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.611155+0000 front 2024-05-08T23:18:49.611163+0000 (oldest deadline 2024-05-08T23:19:13.711088+0000) 2024-05-08T23:19:20.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:20 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:20.744+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:20.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:20 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:20.744+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:21.334 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:21 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:21.077+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:21.335 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:21 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:21.077+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:21.335 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:21 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:21.077+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:21.442 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.5.service' 2024-05-08T23:19:21.484 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:19:21.484 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-08T23:19:21.485 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-08T23:19:21.485 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.6 2024-05-08T23:19:21.535 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:21 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:21.119+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:21.536 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:21 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:21.119+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:21.536 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:21 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:21.119+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:21.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:21 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:21.335+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:21.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:21 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:21.335+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:21.770 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:21 smithi135 systemd[1]: Stopping Ceph osd.6 for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:19:21.771 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:21 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:21.566+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:21.771 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:21 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:21.566+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.611155+0000 front 2024-05-08T23:18:49.611163+0000 (oldest deadline 2024-05-08T23:19:13.711088+0000) 2024-05-08T23:19:21.771 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:21 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:21.566+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.612337+0000 front 2024-05-08T23:18:56.612275+0000 (oldest deadline 2024-05-08T23:19:20.712247+0000) 2024-05-08T23:19:21.771 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:21 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:21.722+0000 7f22fc5fa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:19:21.771 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:21 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:21.722+0000 7f22fc5fa700 -1 osd.6 88 *** Got signal Terminated *** 2024-05-08T23:19:21.771 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:21 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:21.722+0000 7f22fc5fa700 -1 osd.6 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T23:19:21.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:21 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:21.535+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:22.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:21 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:21.770+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:22.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:21 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:21.770+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:22.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:21 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:21.770+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:22.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:22 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:22.299+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:22.381 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:22 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:22.299+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:22.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:22 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:22.077+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:22.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:22 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:22.077+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:22.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:22 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:22.077+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:22.510 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:22 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:22.103+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:22.511 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:22 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:22.103+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:22.511 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:22 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:22.103+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:22.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:22 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:22.510+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:22.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:22 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:22.577+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:22.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:22 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:22.577+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.611155+0000 front 2024-05-08T23:18:49.611163+0000 (oldest deadline 2024-05-08T23:19:13.711088+0000) 2024-05-08T23:19:22.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:22 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:22.577+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.612337+0000 front 2024-05-08T23:18:56.612275+0000 (oldest deadline 2024-05-08T23:19:20.712247+0000) 2024-05-08T23:19:22.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:22 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:22.740+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:22.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:22 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:22.740+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:22.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:22 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:22.740+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:23.349 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:23 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:23.095+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:23.350 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:23 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:23.095+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:23.350 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:23 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:23.095+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:23.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:23 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:23.275+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:23.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:23 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:23.275+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:23.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:23 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:23.064+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:23.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:23 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:23.064+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:23.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:23 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:23.064+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:23.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:23 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:23.463+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:23.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:23 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:23.463+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.931265+0000 front 2024-05-08T23:18:56.931428+0000 (oldest deadline 2024-05-08T23:19:22.831408+0000) 2024-05-08T23:19:23.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:23 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:23.568+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:23.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:23 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:23.568+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.611155+0000 front 2024-05-08T23:18:49.611163+0000 (oldest deadline 2024-05-08T23:19:13.711088+0000) 2024-05-08T23:19:23.954 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:23 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:23.568+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.612337+0000 front 2024-05-08T23:18:56.612275+0000 (oldest deadline 2024-05-08T23:19:20.712247+0000) 2024-05-08T23:19:23.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:23 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:23.712+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:23.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:23 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:23.712+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:23.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:23 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:23.712+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:24.381 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:24 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:24.239+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:24.381 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:24 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:24.239+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:24.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:24 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:24.037+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:24.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:24 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:24.037+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:24.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:24 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:24.037+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:24.497 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:24 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:24.113+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:24.498 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:24 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:24.113+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:24.498 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:24 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:24.113+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:24.850 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:24 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:24.496+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:24.850 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:24 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:24.496+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.931265+0000 front 2024-05-08T23:18:56.931428+0000 (oldest deadline 2024-05-08T23:19:22.831408+0000) 2024-05-08T23:19:24.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:24 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:24.593+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:24.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:24 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:24.593+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.611155+0000 front 2024-05-08T23:18:49.611163+0000 (oldest deadline 2024-05-08T23:19:13.711088+0000) 2024-05-08T23:19:24.954 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:24 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:24.593+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.612337+0000 front 2024-05-08T23:18:56.612275+0000 (oldest deadline 2024-05-08T23:19:20.712247+0000) 2024-05-08T23:19:24.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:24 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:24.720+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:24.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:24 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:24.720+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:24.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:24 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:24.720+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:25.277 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:25 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:25.022+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:25.278 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:25 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:25.022+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:25.278 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:25 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:25.022+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:25.532 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:25 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:25.110+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:25.532 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:25 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:25.110+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:25.532 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:25 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:25.110+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:25.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:25 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:25.278+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:25.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:25 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:25.278+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:25.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:25 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:25.532+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:25.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:25 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:25.532+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.931265+0000 front 2024-05-08T23:18:56.931428+0000 (oldest deadline 2024-05-08T23:19:22.831408+0000) 2024-05-08T23:19:25.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:25 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:25.561+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:25.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:25 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:25.561+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.611155+0000 front 2024-05-08T23:18:49.611163+0000 (oldest deadline 2024-05-08T23:19:13.711088+0000) 2024-05-08T23:19:25.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:25 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:25.561+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.612337+0000 front 2024-05-08T23:18:56.612275+0000 (oldest deadline 2024-05-08T23:19:20.712247+0000) 2024-05-08T23:19:25.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:25 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:25.747+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:25.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:25 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:25.747+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:25.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:25 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:25.747+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:26.272 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:26 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:26.006+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:26.272 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:26 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:26.006+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:26.272 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:26 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:26.006+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:26.498 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:26 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:26.104+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:26.498 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:26 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:26.104+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:26.498 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:26 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:26.104+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:26.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:26 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:26.272+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:26.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:26 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:26.272+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:26.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:26 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:26.272+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:18:59.808844+0000 front 2024-05-08T23:18:59.808809+0000 (oldest deadline 2024-05-08T23:19:25.609454+0000) 2024-05-08T23:19:26.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:26 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:26.497+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:26.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:26 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:26.497+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.931265+0000 front 2024-05-08T23:18:56.931428+0000 (oldest deadline 2024-05-08T23:19:22.831408+0000) 2024-05-08T23:19:26.953 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:26 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:26.606+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.409821+0000 front 2024-05-08T23:18:41.409866+0000 (oldest deadline 2024-05-08T23:19:07.309985+0000) 2024-05-08T23:19:26.954 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:26 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:26.606+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.611155+0000 front 2024-05-08T23:18:49.611163+0000 (oldest deadline 2024-05-08T23:19:13.711088+0000) 2024-05-08T23:19:26.954 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:26 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6[76606]: 2024-05-08T23:19:26.606+0000 7f22f4be8700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.612337+0000 front 2024-05-08T23:18:56.612275+0000 (oldest deadline 2024-05-08T23:19:20.712247+0000) 2024-05-08T23:19:26.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:26 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:26.706+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:26.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:26 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:26.706+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:26.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:26 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:26.706+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:26.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:26 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:26.706+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:27.317 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:26 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:26.962+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:27.317 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:26 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:26.962+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:27.317 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:26 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:26.962+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:27.453 INFO:journalctl@ceph.osd.6.smithi135.stdout:May 08 23:19:27 smithi135 bash[110449]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-6 2024-05-08T23:19:27.479 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:27 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:27.148+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:27.479 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:27 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:27.148+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:27.479 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:27 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:27.148+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:27.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:27 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:27.317+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:27.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:27 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:27.317+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:27.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:27 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:27.317+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:18:59.808844+0000 front 2024-05-08T23:18:59.808809+0000 (oldest deadline 2024-05-08T23:19:25.609454+0000) 2024-05-08T23:19:27.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:27 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:27.478+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:27.850 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:27 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:27.478+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.931265+0000 front 2024-05-08T23:18:56.931428+0000 (oldest deadline 2024-05-08T23:19:22.831408+0000) 2024-05-08T23:19:28.123 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:27 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:27.740+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:28.123 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:27 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:27.740+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:28.123 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:27 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:27.740+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:28.123 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:27 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:27.740+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:28.315 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:27 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:27.968+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:28.315 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:27 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:27.968+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:28.315 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:27 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:27.968+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:28.450 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.6.service' 2024-05-08T23:19:28.491 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:19:28.492 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-08T23:19:28.492 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-08T23:19:28.492 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.7 2024-05-08T23:19:28.500 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:28 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:28.117+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:28.500 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:28 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:28.117+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:28.500 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:28 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:28.117+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:28.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:28 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:28.315+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:28.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:28 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:28.315+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:28.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:28 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:28.315+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:18:59.808844+0000 front 2024-05-08T23:18:59.808809+0000 (oldest deadline 2024-05-08T23:19:25.609454+0000) 2024-05-08T23:19:28.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:28 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:28.500+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:28.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:28 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:28.500+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.931265+0000 front 2024-05-08T23:18:56.931428+0000 (oldest deadline 2024-05-08T23:19:22.831408+0000) 2024-05-08T23:19:28.850 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:28 smithi179 systemd[1]: Stopping Ceph osd.7 for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:19:28.850 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:28 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:28.736+0000 7fd5eb9c1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:19:28.850 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:28 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:28.736+0000 7fd5eb9c1700 -1 osd.7 88 *** Got signal Terminated *** 2024-05-08T23:19:28.850 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:28 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:28.736+0000 7fd5eb9c1700 -1 osd.7 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T23:19:28.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:28 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:28.700+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:28.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:28 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:28.700+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:28.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:28 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:28.700+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:28.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:28 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:28.700+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:29.270 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:28 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:28.959+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:29.270 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:28 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:28.959+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:29.271 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:28 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:28.959+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:29.349 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:29.086+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:29.350 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:29.086+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:29.350 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:29.086+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:29.350 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:29.086+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:29.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:29.271+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:29.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:29.271+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:29.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:29.271+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:18:59.808844+0000 front 2024-05-08T23:18:59.808809+0000 (oldest deadline 2024-05-08T23:19:25.609454+0000) 2024-05-08T23:19:29.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:29.512+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:29.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:29.512+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.931265+0000 front 2024-05-08T23:18:56.931428+0000 (oldest deadline 2024-05-08T23:19:22.831408+0000) 2024-05-08T23:19:29.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:29 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:29.512+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:02.832026+0000 front 2024-05-08T23:19:02.831911+0000 (oldest deadline 2024-05-08T23:19:28.731802+0000) 2024-05-08T23:19:30.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:29 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:29.725+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:30.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:29 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:29.725+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:30.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:29 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:29.725+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:30.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:29 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:29.725+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:30.295 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:29.963+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:30.295 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:29.963+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:30.295 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:29 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:29.963+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:30.349 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:30 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:30.059+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:30.350 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:30 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:30.059+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:30.350 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:30 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:30.059+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:30.350 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:30 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:30.060+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:30.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:30 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:30.295+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:30.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:30 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:30.295+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:30.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:30 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:30.295+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:18:59.808844+0000 front 2024-05-08T23:18:59.808809+0000 (oldest deadline 2024-05-08T23:19:25.609454+0000) 2024-05-08T23:19:30.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:30 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:30.477+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:30.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:30 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:30.477+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.931265+0000 front 2024-05-08T23:18:56.931428+0000 (oldest deadline 2024-05-08T23:19:22.831408+0000) 2024-05-08T23:19:30.850 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:30 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:30.477+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:02.832026+0000 front 2024-05-08T23:19:02.831911+0000 (oldest deadline 2024-05-08T23:19:28.731802+0000) 2024-05-08T23:19:30.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:30 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:30.677+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:30.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:30 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:30.677+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:30.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:30 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:30.677+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:30.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:30 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:30.677+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:31.320 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:30 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:30.984+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:31.321 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:30 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:30.984+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:31.321 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:30 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:30.984+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:31.523 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:31 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:31.102+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:31.523 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:31 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:31.102+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:31.523 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:31 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:31.102+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:31.523 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:31 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:31.102+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:31.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:31 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:31.321+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:31.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:31 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:31.321+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:31.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:31 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:31.321+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:18:59.808844+0000 front 2024-05-08T23:18:59.808809+0000 (oldest deadline 2024-05-08T23:19:25.609454+0000) 2024-05-08T23:19:31.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:31 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:31.523+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:31.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:31 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:31.523+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.931265+0000 front 2024-05-08T23:18:56.931428+0000 (oldest deadline 2024-05-08T23:19:22.831408+0000) 2024-05-08T23:19:31.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:31 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:31.523+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:02.832026+0000 front 2024-05-08T23:19:02.831911+0000 (oldest deadline 2024-05-08T23:19:28.731802+0000) 2024-05-08T23:19:32.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:31 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:31.718+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:32.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:31 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:31.718+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:32.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:31 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:31.718+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:32.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:31 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:31.718+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:32.363 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:31 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:31.949+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:32.363 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:31 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:31.949+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:32.363 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:31 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:31.949+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:32.531 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:32 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:32.149+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:32.531 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:32 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:32.149+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:32.531 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:32 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:32.149+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:32.531 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:32 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:32.149+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:32.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:32 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:32.363+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:32.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:32 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:32.363+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:32.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:32 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:32.363+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:18:59.808844+0000 front 2024-05-08T23:18:59.808809+0000 (oldest deadline 2024-05-08T23:19:25.609454+0000) 2024-05-08T23:19:32.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:32 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:32.531+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:32.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:32 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:32.531+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.931265+0000 front 2024-05-08T23:18:56.931428+0000 (oldest deadline 2024-05-08T23:19:22.831408+0000) 2024-05-08T23:19:32.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:32 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:32.531+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:02.832026+0000 front 2024-05-08T23:19:02.831911+0000 (oldest deadline 2024-05-08T23:19:28.731802+0000) 2024-05-08T23:19:33.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:32 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:32.703+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:33.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:32 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:32.703+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:33.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:32 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:32.703+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:33.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:32 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:32.703+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:33.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:32 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:32.988+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:33.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:32 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:32.988+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:33.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:32 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:32.988+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:33.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:32 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:32.988+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:33.484 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:33 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:33.144+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:33.484 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:33 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:33.144+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:33.484 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:33 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:33.144+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:33.484 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:33 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:33.144+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:33.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:33 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:33.484+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.930267+0000 front 2024-05-08T23:18:49.930355+0000 (oldest deadline 2024-05-08T23:19:12.230422+0000) 2024-05-08T23:19:33.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:33 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:33.484+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.931265+0000 front 2024-05-08T23:18:56.931428+0000 (oldest deadline 2024-05-08T23:19:22.831408+0000) 2024-05-08T23:19:33.850 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:33 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7[67440]: 2024-05-08T23:19:33.484+0000 7fd5e7fb7700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:02.832026+0000 front 2024-05-08T23:19:02.831911+0000 (oldest deadline 2024-05-08T23:19:28.731802+0000) 2024-05-08T23:19:33.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:33 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:33.410+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:33.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:33 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:33.410+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:33.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:33 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:33.410+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:18:59.808844+0000 front 2024-05-08T23:18:59.808809+0000 (oldest deadline 2024-05-08T23:19:25.609454+0000) 2024-05-08T23:19:33.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:33 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:33.410+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:07.310442+0000 front 2024-05-08T23:19:07.310453+0000 (oldest deadline 2024-05-08T23:19:33.210487+0000) 2024-05-08T23:19:34.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:33 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:33.724+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:34.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:33 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:33.724+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:34.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:33 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:33.724+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:34.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:33 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:33.724+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:34.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:33 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:33.987+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:34.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:33 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:33.987+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:34.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:33 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:33.987+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:34.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:33 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:33.987+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:34.473 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:34 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:34.182+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:34.473 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:34 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:34.182+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:34.474 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:34 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:34.182+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:34.474 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:34 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:34.182+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:34.849 INFO:journalctl@ceph.osd.7.smithi179.stdout:May 08 23:19:34 smithi179 bash[87198]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-7 2024-05-08T23:19:34.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:34 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:34.407+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:34.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:34 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:34.407+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:34.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:34 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:34.407+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:18:59.808844+0000 front 2024-05-08T23:18:59.808809+0000 (oldest deadline 2024-05-08T23:19:25.609454+0000) 2024-05-08T23:19:34.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:34 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:34.407+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:07.310442+0000 front 2024-05-08T23:19:07.310453+0000 (oldest deadline 2024-05-08T23:19:33.210487+0000) 2024-05-08T23:19:34.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:34 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:34.699+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:34.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:34 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:34.699+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:34.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:34 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:34.699+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:34.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:34 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:34.699+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:35.350 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:35 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:35.177+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:35.350 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:35 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:35.177+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:35.351 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:35 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:35.177+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:35.351 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:35 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:35.177+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:35.351 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:35 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:35.177+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:35.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:34 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:34.995+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:35.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:34 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:34.995+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:35.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:34 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:34.995+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:35.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:34 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:34.995+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:35.774 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.7.service' 2024-05-08T23:19:35.854 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:19:35.855 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-08T23:19:35.855 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-08T23:19:35.855 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.8 2024-05-08T23:19:35.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:35 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:35.454+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:35.881 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:35 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:35.454+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:35.881 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:35 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:35.455+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:18:59.808844+0000 front 2024-05-08T23:18:59.808809+0000 (oldest deadline 2024-05-08T23:19:25.609454+0000) 2024-05-08T23:19:35.881 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:35 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:35.455+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:07.310442+0000 front 2024-05-08T23:19:07.310453+0000 (oldest deadline 2024-05-08T23:19:33.210487+0000) 2024-05-08T23:19:35.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:35 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:35.659+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:35.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:35 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:35.659+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:35.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:35 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:35.659+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:35.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:35 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:35.659+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:36.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:35 smithi195 systemd[1]: Stopping Ceph osd.8 for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:19:36.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:36 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:36.104+0000 7f9db964c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:19:36.381 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:36 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:36.104+0000 7f9db964c700 -1 osd.8 88 *** Got signal Terminated *** 2024-05-08T23:19:36.381 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:36 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:36.104+0000 7f9db964c700 -1 osd.8 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T23:19:36.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:36 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:36.020+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:36.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:36 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:36.020+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:36.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:36 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:36.020+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:36.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:36 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:36.020+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:36.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:36 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:36.216+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:36.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:36 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:36.216+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:36.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:36 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:36.216+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:36.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:36 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:36.216+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:36.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:36 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:36.216+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:36.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:36 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:36.437+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:36.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:36 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:36.437+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:36.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:36 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:36.437+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:18:59.808844+0000 front 2024-05-08T23:18:59.808809+0000 (oldest deadline 2024-05-08T23:19:25.609454+0000) 2024-05-08T23:19:36.881 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:36 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:36.437+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:07.310442+0000 front 2024-05-08T23:19:07.310453+0000 (oldest deadline 2024-05-08T23:19:33.210487+0000) 2024-05-08T23:19:36.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:36 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:36.695+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:36.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:36 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:36.695+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:36.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:36 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:36.695+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:36.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:36 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:36.695+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:37.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:37 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:37.022+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:37.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:37 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:37.022+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:37.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:37 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:37.022+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:37.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:37 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:37.022+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:37.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:37 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:37.227+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:37.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:37 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:37.227+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:37.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:37 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:37.227+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:37.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:37 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:37.227+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:37.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:37 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:37.227+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:37.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:37 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:37.395+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:37.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:37 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:37.395+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:37.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:37 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:37.395+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:18:59.808844+0000 front 2024-05-08T23:18:59.808809+0000 (oldest deadline 2024-05-08T23:19:25.609454+0000) 2024-05-08T23:19:37.881 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:37 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:37.395+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:07.310442+0000 front 2024-05-08T23:19:07.310453+0000 (oldest deadline 2024-05-08T23:19:33.210487+0000) 2024-05-08T23:19:37.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:37 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:37.675+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:37.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:37 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:37.675+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:37.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:37 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:37.675+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:37.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:37 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:37.675+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:38.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:38 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:38.007+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:38.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:38 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:38.007+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:38.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:38 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:38.007+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:38.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:38 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:38.007+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:38.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:38 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:38.212+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:38.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:38 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:38.212+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:38.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:38 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:38.212+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:38.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:38 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:38.212+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:38.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:38 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:38.212+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:38.881 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:38 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:38.433+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:38.882 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:38 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:38.433+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:38.882 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:38 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:38.433+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:18:59.808844+0000 front 2024-05-08T23:18:59.808809+0000 (oldest deadline 2024-05-08T23:19:25.609454+0000) 2024-05-08T23:19:38.882 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:38 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:38.433+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:07.310442+0000 front 2024-05-08T23:19:07.310453+0000 (oldest deadline 2024-05-08T23:19:33.210487+0000) 2024-05-08T23:19:38.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:38 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:38.674+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:38.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:38 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:38.674+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:38.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:38 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:38.674+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:38.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:38 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:38.674+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:39.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:38 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:38.971+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:39.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:38 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:38.971+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:39.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:38 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:38.971+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:39.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:38 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:38.971+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:39.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:39 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:39.237+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:39.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:39 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:39.237+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:39.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:39 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:39.237+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:39.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:39 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:39.237+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:39.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:39 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:39.237+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:39.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:39 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:39.425+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:39.883 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:39 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:39.425+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:39.883 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:39 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:39.425+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:18:59.808844+0000 front 2024-05-08T23:18:59.808809+0000 (oldest deadline 2024-05-08T23:19:25.609454+0000) 2024-05-08T23:19:39.883 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:39 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:39.425+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:07.310442+0000 front 2024-05-08T23:19:07.310453+0000 (oldest deadline 2024-05-08T23:19:33.210487+0000) 2024-05-08T23:19:39.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:39 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:39.672+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:39.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:39 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:39.672+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:39.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:39 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:39.672+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:39.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:39 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:39.672+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:40.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:39 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:39.955+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:40.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:39 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:39.955+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:40.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:39 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:39.955+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:40.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:39 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:39.955+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:40.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:40 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:40.264+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:40.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:40 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:40.264+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:40.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:40 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:40.264+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:40.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:40 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:40.264+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:40.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:40 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:40.264+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:40.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:40 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:40.471+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:48.206755+0000 front 2024-05-08T23:18:48.206826+0000 (oldest deadline 2024-05-08T23:19:13.506918+0000) 2024-05-08T23:19:40.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:40 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:40.471+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.607851+0000 front 2024-05-08T23:18:54.607887+0000 (oldest deadline 2024-05-08T23:19:19.307981+0000) 2024-05-08T23:19:40.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:40 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:40.471+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:18:59.808844+0000 front 2024-05-08T23:18:59.808809+0000 (oldest deadline 2024-05-08T23:19:25.609454+0000) 2024-05-08T23:19:40.880 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:40 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8[68819]: 2024-05-08T23:19:40.471+0000 7f9db5c42700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:07.310442+0000 front 2024-05-08T23:19:07.310453+0000 (oldest deadline 2024-05-08T23:19:33.210487+0000) 2024-05-08T23:19:40.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:40 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:40.645+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:40.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:40 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:40.645+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:40.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:40 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:40.645+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:40.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:40 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:40.645+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:40.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:40 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:40.645+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:15.402779+0000 front 2024-05-08T23:19:15.402803+0000 (oldest deadline 2024-05-08T23:19:40.102848+0000) 2024-05-08T23:19:41.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:41 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:41.000+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:41.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:41 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:41.000+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:41.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:41 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:41.000+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:41.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:41 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:41.000+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:41.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:41 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:41.304+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:41.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:41 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:41.304+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:41.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:41 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:41.304+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:41.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:41 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:41.304+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:41.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:41 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:41.304+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:41.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:41 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:41.661+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:41.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:41 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:41.661+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:41.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:41 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:41.661+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:41.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:41 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:41.661+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:41.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:41 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:41.661+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:15.402779+0000 front 2024-05-08T23:19:15.402803+0000 (oldest deadline 2024-05-08T23:19:40.102848+0000) 2024-05-08T23:19:42.007 INFO:journalctl@ceph.osd.8.smithi195.stdout:May 08 23:19:41 smithi195 bash[88653]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-8 2024-05-08T23:19:42.266 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:42 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:42.006+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:42.267 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:42 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:42.006+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:42.267 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:42 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:42.006+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:42.267 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:42 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:42.006+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:42.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:42 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:42.330+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:42.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:42 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:42.330+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:42.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:42 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:42.330+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:42.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:42 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:42.330+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:42.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:42 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:42.330+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:42.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:42 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:42.673+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:42.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:42 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:42.673+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:42.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:42 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:42.673+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:42.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:42 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:42.673+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:42.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:42 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:42.673+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:15.402779+0000 front 2024-05-08T23:19:15.402803+0000 (oldest deadline 2024-05-08T23:19:40.102848+0000) 2024-05-08T23:19:42.997 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.8.service' 2024-05-08T23:19:43.078 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:19:43.079 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-08T23:19:43.079 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-08T23:19:43.079 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.9 2024-05-08T23:19:43.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:42 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:42.968+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:43.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:42 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:42.968+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:43.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:42 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:42.968+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:43.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:42 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:42.968+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:43.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:42 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:42.968+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:43.453 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:43 smithi135 systemd[1]: Stopping Ceph osd.9 for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:19:43.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:43 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:43.309+0000 7f81db34b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:19:43.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:43 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:43.309+0000 7f81db34b700 -1 osd.9 88 *** Got signal Terminated *** 2024-05-08T23:19:43.454 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:43 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:43.309+0000 7f81db34b700 -1 osd.9 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T23:19:43.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:43 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:43.294+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:43.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:43 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:43.294+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:43.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:43 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:43.294+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:43.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:43 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:43.294+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:43.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:43 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:43.294+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:43.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:43 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:43.294+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.967958+0000 front 2024-05-08T23:19:18.967983+0000 (oldest deadline 2024-05-08T23:19:43.067776+0000) 2024-05-08T23:19:43.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:43 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:43.698+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:43.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:43 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:43.698+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:43.953 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:43 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:43.698+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:43.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:43 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:43.698+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:43.954 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:43 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:43.698+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:15.402779+0000 front 2024-05-08T23:19:15.402803+0000 (oldest deadline 2024-05-08T23:19:40.102848+0000) 2024-05-08T23:19:44.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:43 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:43.980+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:44.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:43 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:43.980+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:44.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:43 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:43.980+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:44.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:43 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:43.980+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:44.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:43 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:43.980+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:44.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:44 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:44.342+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:44.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:44 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:44.342+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:44.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:44 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:44.342+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:44.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:44 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:44.342+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:44.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:44 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:44.342+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:44.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:44 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:44.342+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.967958+0000 front 2024-05-08T23:19:18.967983+0000 (oldest deadline 2024-05-08T23:19:43.067776+0000) 2024-05-08T23:19:45.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:44 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:44.738+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:45.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:44 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:44.738+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:45.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:44 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:44.738+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:45.205 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:44 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:44.738+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:45.205 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:44 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:44.738+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:15.402779+0000 front 2024-05-08T23:19:15.402803+0000 (oldest deadline 2024-05-08T23:19:40.102848+0000) 2024-05-08T23:19:45.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:45 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:45.017+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:45.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:45 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:45.017+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:45.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:45 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:45.017+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:45.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:45 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:45.017+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:45.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:45 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:45.017+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:45.849 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:45 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:45.377+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:45.850 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:45 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:45.377+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:45.850 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:45 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:45.377+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:45.850 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:45 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:45.377+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:45.850 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:45 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:45.377+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:45.850 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:45 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:45.377+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.967958+0000 front 2024-05-08T23:19:18.967983+0000 (oldest deadline 2024-05-08T23:19:43.067776+0000) 2024-05-08T23:19:46.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:45 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:45.755+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:46.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:45 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:45.755+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:46.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:45 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:45.755+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:46.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:45 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:45.755+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:46.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:45 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:45.755+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:15.402779+0000 front 2024-05-08T23:19:15.402803+0000 (oldest deadline 2024-05-08T23:19:40.102848+0000) 2024-05-08T23:19:46.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:46 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:46.036+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:46.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:46 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:46.036+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:46.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:46 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:46.036+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:46.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:46 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:46.036+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:46.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:46 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:46.036+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:46.849 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:46 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:46.355+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:46.849 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:46 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:46.355+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:46.849 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:46 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:46.355+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:46.850 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:46 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:46.355+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:46.850 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:46 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:46.355+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:46.850 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:46 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:46.355+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.967958+0000 front 2024-05-08T23:19:18.967983+0000 (oldest deadline 2024-05-08T23:19:43.067776+0000) 2024-05-08T23:19:47.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:46 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:46.728+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:47.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:46 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:46.728+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:47.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:46 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:46.728+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:47.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:46 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:46.728+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:47.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:46 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:46.728+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:15.402779+0000 front 2024-05-08T23:19:15.402803+0000 (oldest deadline 2024-05-08T23:19:40.102848+0000) 2024-05-08T23:19:47.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:46 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:46.988+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:47.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:46 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:46.988+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:47.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:46 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:46.988+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:47.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:46 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:46.988+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:47.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:46 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:46.988+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:47.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:47 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:47.336+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:47.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:47 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:47.336+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:47.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:47 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:47.336+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:47.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:47 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:47.336+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:47.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:47 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:47.336+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:47.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:47 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:47.336+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.967958+0000 front 2024-05-08T23:19:18.967983+0000 (oldest deadline 2024-05-08T23:19:43.067776+0000) 2024-05-08T23:19:47.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:47 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:47.336+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.068286+0000 front 2024-05-08T23:19:23.068273+0000 (oldest deadline 2024-05-08T23:19:47.168268+0000) 2024-05-08T23:19:48.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:47 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:47.770+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:41.998114+0000 front 2024-05-08T23:18:41.998077+0000 (oldest deadline 2024-05-08T23:19:06.098282+0000) 2024-05-08T23:19:48.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:47 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:47.770+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:49.500040+0000 front 2024-05-08T23:18:49.499964+0000 (oldest deadline 2024-05-08T23:19:15.399871+0000) 2024-05-08T23:19:48.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:47 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:47.770+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:55.400573+0000 front 2024-05-08T23:18:55.400432+0000 (oldest deadline 2024-05-08T23:19:21.300394+0000) 2024-05-08T23:19:48.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:47 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:47.770+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:01.300969+0000 front 2024-05-08T23:19:01.301017+0000 (oldest deadline 2024-05-08T23:19:26.601064+0000) 2024-05-08T23:19:48.204 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:47 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9[84576]: 2024-05-08T23:19:47.770+0000 7f81d3939700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:15.402779+0000 front 2024-05-08T23:19:15.402803+0000 (oldest deadline 2024-05-08T23:19:40.102848+0000) 2024-05-08T23:19:48.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:47 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:47.939+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:48.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:47 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:47.939+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:48.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:47 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:47.939+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:48.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:47 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:47.939+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:48.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:47 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:47.939+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:48.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:48 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:48.298+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:48.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:48 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:48.298+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:48.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:48 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:48.298+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:48.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:48 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:48.298+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:48.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:48 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:48.298+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:48.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:48 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:48.298+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.967958+0000 front 2024-05-08T23:19:18.967983+0000 (oldest deadline 2024-05-08T23:19:43.067776+0000) 2024-05-08T23:19:48.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:48 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:48.298+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.068286+0000 front 2024-05-08T23:19:23.068273+0000 (oldest deadline 2024-05-08T23:19:47.168268+0000) 2024-05-08T23:19:49.203 INFO:journalctl@ceph.osd.9.smithi135.stdout:May 08 23:19:48 smithi135 bash[110703]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-9 2024-05-08T23:19:49.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:48 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:48.955+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:49.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:48 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:48.955+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:49.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:48 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:48.955+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:49.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:48 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:48.955+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:49.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:48 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:48.955+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:49.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:49 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:49.252+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:49.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:49 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:49.252+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:49.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:49 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:49.252+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:49.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:49 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:49.252+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:49.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:49 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:49.252+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:49.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:49 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:49.252+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.967958+0000 front 2024-05-08T23:19:18.967983+0000 (oldest deadline 2024-05-08T23:19:43.067776+0000) 2024-05-08T23:19:49.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:49 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:49.252+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.068286+0000 front 2024-05-08T23:19:23.068273+0000 (oldest deadline 2024-05-08T23:19:47.168268+0000) 2024-05-08T23:19:50.148 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.9.service' 2024-05-08T23:19:50.190 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:19:50.190 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-08T23:19:50.190 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-08T23:19:50.190 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.10 2024-05-08T23:19:50.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:49 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:49.946+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:50.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:49 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:49.946+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:50.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:49 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:49.946+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:50.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:49 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:49.946+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:50.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:49 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:49.946+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:50.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:49 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:49.946+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.640841+0000 front 2024-05-08T23:19:23.640888+0000 (oldest deadline 2024-05-08T23:19:49.540583+0000) 2024-05-08T23:19:50.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:50 smithi179 systemd[1]: Stopping Ceph osd.10 for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:19:50.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:50 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:50.239+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:50.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:50 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:50.239+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:50.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:50 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:50.239+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:50.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:50 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:50.239+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:50.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:50 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:50.239+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:50.601 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:50 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:50.239+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.967958+0000 front 2024-05-08T23:19:18.967983+0000 (oldest deadline 2024-05-08T23:19:43.067776+0000) 2024-05-08T23:19:50.601 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:50 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:50.239+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.068286+0000 front 2024-05-08T23:19:23.068273+0000 (oldest deadline 2024-05-08T23:19:47.168268+0000) 2024-05-08T23:19:50.601 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:50 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:50.443+0000 7f19c2bfb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:19:50.601 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:50 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:50.443+0000 7f19c2bfb700 -1 osd.10 88 *** Got signal Terminated *** 2024-05-08T23:19:50.601 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:50 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:50.443+0000 7f19c2bfb700 -1 osd.10 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T23:19:51.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:50 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:50.966+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:51.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:50 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:50.966+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:51.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:50 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:50.966+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:51.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:50 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:50.966+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:51.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:50 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:50.966+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:51.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:50 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:50.966+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.640841+0000 front 2024-05-08T23:19:23.640888+0000 (oldest deadline 2024-05-08T23:19:49.540583+0000) 2024-05-08T23:19:51.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:51 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:51.196+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:51.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:51 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:51.196+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:51.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:51 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:51.196+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:51.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:51 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:51.196+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:51.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:51 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:51.196+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:51.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:51 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:51.196+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.967958+0000 front 2024-05-08T23:19:18.967983+0000 (oldest deadline 2024-05-08T23:19:43.067776+0000) 2024-05-08T23:19:51.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:51 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:51.196+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.068286+0000 front 2024-05-08T23:19:23.068273+0000 (oldest deadline 2024-05-08T23:19:47.168268+0000) 2024-05-08T23:19:52.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:51 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:51.921+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:52.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:51 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:51.921+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:52.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:51 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:51.921+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:52.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:51 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:51.921+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:52.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:51 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:51.921+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:52.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:51 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:51.921+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.640841+0000 front 2024-05-08T23:19:23.640888+0000 (oldest deadline 2024-05-08T23:19:49.540583+0000) 2024-05-08T23:19:52.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:52 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:52.187+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:52.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:52 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:52.187+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:52.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:52 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:52.187+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:52.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:52 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:52.187+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:52.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:52 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:52.187+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:52.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:52 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:52.187+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.967958+0000 front 2024-05-08T23:19:18.967983+0000 (oldest deadline 2024-05-08T23:19:43.067776+0000) 2024-05-08T23:19:52.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:52 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:52.187+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.068286+0000 front 2024-05-08T23:19:23.068273+0000 (oldest deadline 2024-05-08T23:19:47.168268+0000) 2024-05-08T23:19:53.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:52 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:52.947+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:53.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:52 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:52.947+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:53.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:52 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:52.947+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:53.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:52 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:52.947+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:53.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:52 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:52.947+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:53.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:52 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:52.947+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.640841+0000 front 2024-05-08T23:19:23.640888+0000 (oldest deadline 2024-05-08T23:19:49.540583+0000) 2024-05-08T23:19:53.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:53 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:53.184+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:53.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:53 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:53.184+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:53.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:53 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:53.184+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:53.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:53 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:53.184+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:53.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:53 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:53.184+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:53.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:53 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:53.184+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.967958+0000 front 2024-05-08T23:19:18.967983+0000 (oldest deadline 2024-05-08T23:19:43.067776+0000) 2024-05-08T23:19:53.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:53 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:53.184+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.068286+0000 front 2024-05-08T23:19:23.068273+0000 (oldest deadline 2024-05-08T23:19:47.168268+0000) 2024-05-08T23:19:54.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:53 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:53.897+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:54.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:53 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:53.897+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:54.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:53 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:53.897+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:54.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:53 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:53.897+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:54.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:53 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:53.897+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:54.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:53 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:53.897+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.640841+0000 front 2024-05-08T23:19:23.640888+0000 (oldest deadline 2024-05-08T23:19:49.540583+0000) 2024-05-08T23:19:54.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:54 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:54.175+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:54.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:54 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:54.175+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:54.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:54 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:54.175+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:54.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:54 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:54.175+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:54.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:54 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:54.175+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:54.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:54 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:54.175+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.967958+0000 front 2024-05-08T23:19:18.967983+0000 (oldest deadline 2024-05-08T23:19:43.067776+0000) 2024-05-08T23:19:54.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:54 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:54.175+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.068286+0000 front 2024-05-08T23:19:23.068273+0000 (oldest deadline 2024-05-08T23:19:47.168268+0000) 2024-05-08T23:19:55.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:54 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:54.907+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:55.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:54 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:54.907+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:55.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:54 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:54.907+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:55.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:54 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:54.907+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:55.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:54 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:54.907+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:55.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:54 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:54.907+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.640841+0000 front 2024-05-08T23:19:23.640888+0000 (oldest deadline 2024-05-08T23:19:49.540583+0000) 2024-05-08T23:19:55.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:54 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:54.907+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-05-08T23:19:31.841821+0000 front 2024-05-08T23:19:31.841751+0000 (oldest deadline 2024-05-08T23:19:54.741589+0000) 2024-05-08T23:19:55.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:55 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:55.141+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:38.061731+0000 front 2024-05-08T23:18:38.061683+0000 (oldest deadline 2024-05-08T23:19:03.862238+0000) 2024-05-08T23:19:55.599 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:55 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:55.141+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:50.263764+0000 front 2024-05-08T23:18:50.263811+0000 (oldest deadline 2024-05-08T23:19:13.763980+0000) 2024-05-08T23:19:55.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:55 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:55.141+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:56.665002+0000 front 2024-05-08T23:18:56.665135+0000 (oldest deadline 2024-05-08T23:19:18.365022+0000) 2024-05-08T23:19:55.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:55 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:55.141+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-05-08T23:19:04.266057+0000 front 2024-05-08T23:19:04.266080+0000 (oldest deadline 2024-05-08T23:19:28.366302+0000) 2024-05-08T23:19:55.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:55 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:55.141+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.366670+0000 front 2024-05-08T23:19:08.366653+0000 (oldest deadline 2024-05-08T23:19:34.266656+0000) 2024-05-08T23:19:55.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:55 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:55.141+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.967958+0000 front 2024-05-08T23:19:18.967983+0000 (oldest deadline 2024-05-08T23:19:43.067776+0000) 2024-05-08T23:19:55.600 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:55 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10[76183]: 2024-05-08T23:19:55.141+0000 7f19bb1e9700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.068286+0000 front 2024-05-08T23:19:23.068273+0000 (oldest deadline 2024-05-08T23:19:47.168268+0000) 2024-05-08T23:19:56.349 INFO:journalctl@ceph.osd.10.smithi179.stdout:May 08 23:19:56 smithi179 bash[87454]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-10 2024-05-08T23:19:56.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:55 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:55.903+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:56.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:55 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:55.903+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:56.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:55 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:55.903+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:56.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:55 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:55.903+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:56.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:55 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:55.903+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:56.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:55 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:55.903+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.640841+0000 front 2024-05-08T23:19:23.640888+0000 (oldest deadline 2024-05-08T23:19:49.540583+0000) 2024-05-08T23:19:56.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:55 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:55.903+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-05-08T23:19:31.841821+0000 front 2024-05-08T23:19:31.841751+0000 (oldest deadline 2024-05-08T23:19:54.741589+0000) 2024-05-08T23:19:57.365 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.10.service' 2024-05-08T23:19:57.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:56 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:56.885+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:57.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:56 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:56.885+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:57.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:56 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:56.885+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:57.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:56 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:56.885+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:57.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:56 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:56.885+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:57.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:56 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:56.885+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.640841+0000 front 2024-05-08T23:19:23.640888+0000 (oldest deadline 2024-05-08T23:19:49.540583+0000) 2024-05-08T23:19:57.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:56 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:56.885+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-05-08T23:19:31.841821+0000 front 2024-05-08T23:19:31.841751+0000 (oldest deadline 2024-05-08T23:19:54.741589+0000) 2024-05-08T23:19:57.405 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:19:57.406 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-08T23:19:57.406 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-08T23:19:57.406 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.11 2024-05-08T23:19:57.849 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:57 smithi195 systemd[1]: Stopping Ceph osd.11 for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:19:57.849 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:57 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:57.657+0000 7f8ae2e22700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:19:57.849 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:57 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:57.657+0000 7f8ae2e22700 -1 osd.11 88 *** Got signal Terminated *** 2024-05-08T23:19:57.849 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:57 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:57.657+0000 7f8ae2e22700 -1 osd.11 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T23:19:57.849 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:57 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:57.848+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:57.849 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:57 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:57.848+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:57.849 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:57 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:57.848+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:57.849 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:57 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:57.848+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:57.849 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:57 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:57.848+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:57.849 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:57 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:57.848+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.640841+0000 front 2024-05-08T23:19:23.640888+0000 (oldest deadline 2024-05-08T23:19:49.540583+0000) 2024-05-08T23:19:58.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:57 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:57.848+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-05-08T23:19:31.841821+0000 front 2024-05-08T23:19:31.841751+0000 (oldest deadline 2024-05-08T23:19:54.741589+0000) 2024-05-08T23:19:59.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:58 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:58.888+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:19:59.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:58 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:58.888+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:19:59.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:58 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:58.888+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:19:59.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:58 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:58.888+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:19:59.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:58 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:58.888+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:19:59.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:58 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:58.888+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.640841+0000 front 2024-05-08T23:19:23.640888+0000 (oldest deadline 2024-05-08T23:19:49.540583+0000) 2024-05-08T23:19:59.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:58 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:58.888+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-05-08T23:19:31.841821+0000 front 2024-05-08T23:19:31.841751+0000 (oldest deadline 2024-05-08T23:19:54.741589+0000) 2024-05-08T23:20:00.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:59 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:59.879+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:20:00.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:59 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:59.879+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:20:00.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:59 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:59.879+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:20:00.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:59 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:59.879+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:20:00.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:59 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:59.879+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:20:00.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:59 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:59.879+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.640841+0000 front 2024-05-08T23:19:23.640888+0000 (oldest deadline 2024-05-08T23:19:49.540583+0000) 2024-05-08T23:20:00.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:19:59 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:19:59.879+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-05-08T23:19:31.841821+0000 front 2024-05-08T23:19:31.841751+0000 (oldest deadline 2024-05-08T23:19:54.741589+0000) 2024-05-08T23:20:01.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:20:00 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:20:00.864+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:20:01.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:20:00 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:20:00.864+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:20:01.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:20:00 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:20:00.864+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:20:01.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:20:00 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:20:00.864+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:20:01.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:20:00 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:20:00.864+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:20:01.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:20:00 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:20:00.864+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.640841+0000 front 2024-05-08T23:19:23.640888+0000 (oldest deadline 2024-05-08T23:19:49.540583+0000) 2024-05-08T23:20:01.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:20:00 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:20:00.864+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-05-08T23:19:31.841821+0000 front 2024-05-08T23:19:31.841751+0000 (oldest deadline 2024-05-08T23:19:54.741589+0000) 2024-05-08T23:20:02.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:20:01 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:20:01.890+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-05-08T23:18:40.232526+0000 front 2024-05-08T23:18:40.232493+0000 (oldest deadline 2024-05-08T23:19:06.132490+0000) 2024-05-08T23:20:02.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:20:01 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:20:01.890+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-05-08T23:18:47.233563+0000 front 2024-05-08T23:18:47.233700+0000 (oldest deadline 2024-05-08T23:19:11.333512+0000) 2024-05-08T23:20:02.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:20:01 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:20:01.890+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-05-08T23:18:54.635368+0000 front 2024-05-08T23:18:54.635447+0000 (oldest deadline 2024-05-08T23:19:18.135662+0000) 2024-05-08T23:20:02.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:20:01 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:20:01.890+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-05-08T23:19:08.037815+0000 front 2024-05-08T23:19:08.037760+0000 (oldest deadline 2024-05-08T23:19:32.737809+0000) 2024-05-08T23:20:02.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:20:01 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:20:01.890+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-05-08T23:19:18.539224+0000 front 2024-05-08T23:19:18.539309+0000 (oldest deadline 2024-05-08T23:19:42.039406+0000) 2024-05-08T23:20:02.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:20:01 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:20:01.890+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-05-08T23:19:23.640841+0000 front 2024-05-08T23:19:23.640888+0000 (oldest deadline 2024-05-08T23:19:49.540583+0000) 2024-05-08T23:20:02.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:20:01 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11[77442]: 2024-05-08T23:20:01.890+0000 7f8adb410700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-05-08T23:19:31.841821+0000 front 2024-05-08T23:19:31.841751+0000 (oldest deadline 2024-05-08T23:19:54.741589+0000) 2024-05-08T23:20:03.630 INFO:journalctl@ceph.osd.11.smithi195.stdout:May 08 23:20:03 smithi195 bash[88909]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-osd-11 2024-05-08T23:20:04.445 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@osd.11.service' 2024-05-08T23:20:04.485 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:20:04.486 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-08T23:20:04.486 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-08T23:20:04.486 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.a 2024-05-08T23:20:04.766 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 08 23:20:04 smithi135 systemd[1]: Stopping Ceph mds.a for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:20:05.203 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 08 23:20:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-a[93089]: 2024-05-08T23:20:04.765+0000 7f74060ac700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:20:05.203 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 08 23:20:04 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-a[93089]: 2024-05-08T23:20:04.765+0000 7f74060ac700 -1 mds.a *** got signal Terminated *** 2024-05-08T23:20:09.203 INFO:journalctl@ceph.mds.a.smithi135.stdout:May 08 23:20:08 smithi135 bash[110963]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-a 2024-05-08T23:20:09.223 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.a.service' 2024-05-08T23:20:09.261 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:20:09.261 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-08T23:20:09.262 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-08T23:20:09.262 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.d 2024-05-08T23:20:09.531 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 08 23:20:09 smithi135 systemd[1]: Stopping Ceph mds.d for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:20:09.953 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 08 23:20:09 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-d[92182]: 2024-05-08T23:20:09.531+0000 7f2837aa0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:20:09.954 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 08 23:20:09 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-d[92182]: 2024-05-08T23:20:09.531+0000 7f2837aa0700 -1 mds.d *** got signal Terminated *** 2024-05-08T23:20:13.953 INFO:journalctl@ceph.mds.d.smithi135.stdout:May 08 23:20:13 smithi135 bash[111102]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-d 2024-05-08T23:20:14.014 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.d.service' 2024-05-08T23:20:14.052 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:20:14.052 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-08T23:20:14.052 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-08T23:20:14.053 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.g 2024-05-08T23:20:14.314 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 08 23:20:14 smithi135 systemd[1]: Stopping Ceph mds.g for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:20:14.703 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 08 23:20:14 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-g[92725]: 2024-05-08T23:20:14.314+0000 7f925f916700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:20:14.703 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 08 23:20:14 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-g[92725]: 2024-05-08T23:20:14.314+0000 7f925f916700 -1 mds.g *** got signal Terminated *** 2024-05-08T23:20:17.831 INFO:journalctl@ceph.mds.g.smithi135.stdout:May 08 23:20:17 smithi135 bash[111241]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-g 2024-05-08T23:20:17.837 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.g.service' 2024-05-08T23:20:17.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:20:17.871 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-08T23:20:17.871 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-08T23:20:17.871 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.j 2024-05-08T23:20:18.129 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 08 23:20:17 smithi135 systemd[1]: Stopping Ceph mds.j for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:20:18.453 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 08 23:20:18 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-j[91794]: 2024-05-08T23:20:18.129+0000 7f7a25a89700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:20:18.453 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 08 23:20:18 smithi135 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-j[91794]: 2024-05-08T23:20:18.129+0000 7f7a25a89700 -1 mds.j *** got signal Terminated *** 2024-05-08T23:20:20.453 INFO:journalctl@ceph.mds.j.smithi135.stdout:May 08 23:20:20 smithi135 bash[111381]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-j 2024-05-08T23:20:20.477 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.j.service' 2024-05-08T23:20:20.514 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:20:20.515 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-08T23:20:20.515 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-08T23:20:20.515 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.b 2024-05-08T23:20:20.849 INFO:journalctl@ceph.mds.b.smithi179.stdout:May 08 23:20:20 smithi179 systemd[1]: Stopping Ceph mds.b for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:20:20.849 INFO:journalctl@ceph.mds.b.smithi179.stdout:May 08 23:20:20 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-b[83229]: 2024-05-08T23:20:20.763+0000 7f1fbb7f8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:20:20.849 INFO:journalctl@ceph.mds.b.smithi179.stdout:May 08 23:20:20 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-b[83229]: 2024-05-08T23:20:20.763+0000 7f1fbb7f8700 -1 mds.b *** got signal Terminated *** 2024-05-08T23:20:25.275 INFO:journalctl@ceph.mds.b.smithi179.stdout:May 08 23:20:25 smithi179 bash[87715]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-b 2024-05-08T23:20:25.281 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.b.service' 2024-05-08T23:20:25.319 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:20:25.320 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-08T23:20:25.320 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-08T23:20:25.320 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.e 2024-05-08T23:20:25.599 INFO:journalctl@ceph.mds.e.smithi179.stdout:May 08 23:20:25 smithi179 systemd[1]: Stopping Ceph mds.e for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:20:26.099 INFO:journalctl@ceph.mds.e.smithi179.stdout:May 08 23:20:25 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-e[82541]: 2024-05-08T23:20:25.612+0000 7ff3309b0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:20:26.099 INFO:journalctl@ceph.mds.e.smithi179.stdout:May 08 23:20:25 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-e[82541]: 2024-05-08T23:20:25.612+0000 7ff3309b0700 -1 mds.e *** got signal Terminated *** 2024-05-08T23:20:30.030 INFO:journalctl@ceph.mds.e.smithi179.stdout:May 08 23:20:29 smithi179 bash[87861]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-e 2024-05-08T23:20:30.035 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.e.service' 2024-05-08T23:20:30.071 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:20:30.072 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-08T23:20:30.072 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-08T23:20:30.072 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.h 2024-05-08T23:20:30.344 INFO:journalctl@ceph.mds.h.smithi179.stdout:May 08 23:20:30 smithi179 systemd[1]: Stopping Ceph mds.h for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:20:30.599 INFO:journalctl@ceph.mds.h.smithi179.stdout:May 08 23:20:30 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-h[82885]: 2024-05-08T23:20:30.344+0000 7fd250fa8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:20:30.599 INFO:journalctl@ceph.mds.h.smithi179.stdout:May 08 23:20:30 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-h[82885]: 2024-05-08T23:20:30.344+0000 7fd250fa8700 -1 mds.h *** got signal Terminated *** 2024-05-08T23:20:34.023 INFO:journalctl@ceph.mds.h.smithi179.stdout:May 08 23:20:33 smithi179 bash[88000]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-h 2024-05-08T23:20:34.029 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.h.service' 2024-05-08T23:20:34.063 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:20:34.064 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-08T23:20:34.064 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-08T23:20:34.064 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.k 2024-05-08T23:20:34.327 INFO:journalctl@ceph.mds.k.smithi179.stdout:May 08 23:20:34 smithi179 systemd[1]: Stopping Ceph mds.k for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:20:34.599 INFO:journalctl@ceph.mds.k.smithi179.stdout:May 08 23:20:34 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-k[82197]: 2024-05-08T23:20:34.328+0000 7f75119bc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:20:34.599 INFO:journalctl@ceph.mds.k.smithi179.stdout:May 08 23:20:34 smithi179 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-k[82197]: 2024-05-08T23:20:34.328+0000 7f75119bc700 -1 mds.k *** got signal Terminated *** 2024-05-08T23:20:38.020 INFO:journalctl@ceph.mds.k.smithi179.stdout:May 08 23:20:37 smithi179 bash[88140]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-k 2024-05-08T23:20:38.026 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.k.service' 2024-05-08T23:20:38.061 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:20:38.061 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-08T23:20:38.062 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-08T23:20:38.062 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.c 2024-05-08T23:20:38.344 INFO:journalctl@ceph.mds.c.smithi195.stdout:May 08 23:20:38 smithi195 systemd[1]: Stopping Ceph mds.c for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:20:38.630 INFO:journalctl@ceph.mds.c.smithi195.stdout:May 08 23:20:38 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-c[84266]: 2024-05-08T23:20:38.343+0000 7f11f0d5e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:20:38.630 INFO:journalctl@ceph.mds.c.smithi195.stdout:May 08 23:20:38 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-c[84266]: 2024-05-08T23:20:38.343+0000 7f11f0d5e700 -1 mds.c *** got signal Terminated *** 2024-05-08T23:20:42.033 INFO:journalctl@ceph.mds.c.smithi195.stdout:May 08 23:20:41 smithi195 bash[89178]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-c 2024-05-08T23:20:42.039 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.c.service' 2024-05-08T23:20:42.077 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:20:42.078 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-08T23:20:42.078 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-08T23:20:42.078 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.f 2024-05-08T23:20:42.369 INFO:journalctl@ceph.mds.f.smithi195.stdout:May 08 23:20:42 smithi195 systemd[1]: Stopping Ceph mds.f for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:20:42.630 INFO:journalctl@ceph.mds.f.smithi195.stdout:May 08 23:20:42 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-f[83923]: 2024-05-08T23:20:42.369+0000 7f93659af700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:20:42.630 INFO:journalctl@ceph.mds.f.smithi195.stdout:May 08 23:20:42 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-f[83923]: 2024-05-08T23:20:42.369+0000 7f93659af700 -1 mds.f *** got signal Terminated *** 2024-05-08T23:20:45.880 INFO:journalctl@ceph.mds.f.smithi195.stdout:May 08 23:20:45 smithi195 bash[89318]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-f 2024-05-08T23:20:45.955 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.f.service' 2024-05-08T23:20:45.990 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:20:45.991 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-08T23:20:45.991 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-08T23:20:45.991 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.i 2024-05-08T23:20:46.258 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:20:46 smithi195 systemd[1]: Stopping Ceph mds.i for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:20:46.630 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:20:46 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-i[84605]: 2024-05-08T23:20:46.257+0000 7f33c4f18700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:20:46.630 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:20:46 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-i[84605]: 2024-05-08T23:20:46.257+0000 7f33c4f18700 -1 mds.i *** got signal Terminated *** 2024-05-08T23:20:49.880 INFO:journalctl@ceph.mds.i.smithi195.stdout:May 08 23:20:49 smithi195 bash[89455]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-i 2024-05-08T23:20:49.889 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.i.service' 2024-05-08T23:20:49.924 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:20:49.924 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-08T23:20:49.924 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-08T23:20:49.924 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.l 2024-05-08T23:20:50.182 INFO:journalctl@ceph.mds.l.smithi195.stdout:May 08 23:20:49 smithi195 systemd[1]: Stopping Ceph mds.l for c804a50a-0d8f-11ef-bc97-c7b262605968... 2024-05-08T23:20:50.630 INFO:journalctl@ceph.mds.l.smithi195.stdout:May 08 23:20:50 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-l[83583]: 2024-05-08T23:20:50.182+0000 7f5d783fb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:20:50.630 INFO:journalctl@ceph.mds.l.smithi195.stdout:May 08 23:20:50 smithi195 ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-l[83583]: 2024-05-08T23:20:50.182+0000 7f5d783fb700 -1 mds.l *** got signal Terminated *** 2024-05-08T23:20:54.063 INFO:journalctl@ceph.mds.l.smithi195.stdout:May 08 23:20:53 smithi195 bash[89594]: ceph-c804a50a-0d8f-11ef-bc97-c7b262605968-mds-l 2024-05-08T23:20:54.070 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c804a50a-0d8f-11ef-bc97-c7b262605968@mds.l.service' 2024-05-08T23:20:54.104 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T23:20:54.104 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-08T23:20:54.104 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-08T23:20:54.295 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:20:55.667 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-08T23:20:55.856 INFO:teuthology.orchestra.run.smithi179.stdout:Deleting cluster with fsid: c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:20:57.281 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-08T23:20:57.465 INFO:teuthology.orchestra.run.smithi195.stdout:Deleting cluster with fsid: c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:20:58.849 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T23:20:58.885 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T23:20:58.921 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T23:20:58.952 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-08T23:20:58.953 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698146/remote/smithi135/crash 2024-05-08T23:20:58.954 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/crash -- . 2024-05-08T23:20:59.001 INFO:teuthology.orchestra.run.smithi135.stderr:tar: /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-08T23:20:59.001 INFO:teuthology.orchestra.run.smithi135.stderr:tar: Error is not recoverable: exiting now 2024-05-08T23:20:59.003 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698146/remote/smithi179/crash 2024-05-08T23:20:59.004 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/crash -- . 2024-05-08T23:20:59.045 INFO:teuthology.orchestra.run.smithi179.stderr:tar: /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-08T23:20:59.046 INFO:teuthology.orchestra.run.smithi179.stderr:tar: Error is not recoverable: exiting now 2024-05-08T23:20:59.047 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698146/remote/smithi195/crash 2024-05-08T23:20:59.048 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/crash -- . 2024-05-08T23:20:59.080 INFO:teuthology.orchestra.run.smithi195.stderr:tar: /var/lib/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-08T23:20:59.080 INFO:teuthology.orchestra.run.smithi195.stderr:tar: Error is not recoverable: exiting now 2024-05-08T23:20:59.081 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-08T23:20:59.081 DEBUG:teuthology.orchestra.run.smithi135:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-05-08T23:20:59.115 INFO:teuthology.orchestra.run.smithi135.stderr:grep: /var/log/ceph/c804a50a-0d8f-11ef-bc97-c7b262605968/ceph.log: No such file or directory 2024-05-08T23:20:59.117 INFO:tasks.cephadm:Compressing logs... 2024-05-08T23:20:59.118 DEBUG:teuthology.orchestra.run.smithi135:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T23:20:59.161 DEBUG:teuthology.orchestra.run.smithi179:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T23:20:59.165 DEBUG:teuthology.orchestra.run.smithi195:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T23:20:59.187 INFO:teuthology.orchestra.run.smithi135.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-08T23:20:59.191 INFO:teuthology.orchestra.run.smithi179.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-08T23:20:59.192 INFO:teuthology.orchestra.run.smithi195.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-08T23:21:03.118 INFO:tasks.cephadm:Archiving logs... 2024-05-08T23:21:03.118 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698146/remote/smithi135/log 2024-05-08T23:21:03.119 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T23:21:03.689 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698146/remote/smithi179/log 2024-05-08T23:21:03.690 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T23:21:04.148 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698146/remote/smithi195/log 2024-05-08T23:21:04.148 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T23:21:04.560 INFO:tasks.cephadm:Removing cluster... 2024-05-08T23:21:04.561 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 --force 2024-05-08T23:21:04.747 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:21:04.984 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 --force 2024-05-08T23:21:05.168 INFO:teuthology.orchestra.run.smithi179.stdout:Deleting cluster with fsid: c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:21:05.405 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c804a50a-0d8f-11ef-bc97-c7b262605968 --force 2024-05-08T23:21:05.591 INFO:teuthology.orchestra.run.smithi195.stdout:Deleting cluster with fsid: c804a50a-0d8f-11ef-bc97-c7b262605968 2024-05-08T23:21:05.823 INFO:tasks.cephadm:Removing cephadm ... 2024-05-08T23:21:05.823 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-08T23:21:05.844 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-08T23:21:05.864 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-08T23:21:05.881 INFO:tasks.cephadm:Teardown complete 2024-05-08T23:21:05.881 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T23:21:05.893 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T23:21:05.893 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T23:21:05.896 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T23:21:05.906 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T23:21:06.022 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T23:21:06.038 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T23:21:06.038 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T23:21:06.041 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T23:21:06.044 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T23:21:06.058 INFO:teuthology.orchestra.run.smithi179.stderr:bash: ntpq: command not found 2024-05-08T23:21:06.058 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2024-05-08T23:21:06.059 INFO:teuthology.orchestra.run.smithi195.stderr:bash: ntpq: command not found 2024-05-08T23:21:06.062 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T23:21:06.063 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-05-08T23:21:06.063 INFO:teuthology.orchestra.run.smithi179.stdout:^* hv01.front.sepia.ceph.com 3 6 377 55 +1291us[+1308us] +/- 50ms 2024-05-08T23:21:06.063 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 -1245us[-1245us] +/- 58ms 2024-05-08T23:21:06.063 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 -352us[ -335us] +/- 89ms 2024-05-08T23:21:06.063 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:21:06.063 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T23:21:06.064 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-05-08T23:21:06.064 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv01.front.sepia.ceph.com 3 6 377 54 +1248us[+1191us] +/- 50ms 2024-05-08T23:21:06.064 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 -1249us[-1249us] +/- 58ms 2024-05-08T23:21:06.064 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -366us[ -366us] +/- 89ms 2024-05-08T23:21:06.064 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:21:06.066 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T23:21:06.066 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-05-08T23:21:06.066 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv01.front.sepia.ceph.com 3 6 377 54 +1290us[+1290us] +/- 50ms 2024-05-08T23:21:06.066 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 55 -1260us[-1259us] +/- 58ms 2024-05-08T23:21:06.066 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 -348us[ -348us] +/- 89ms 2024-05-08T23:21:06.066 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:21:06.066 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T23:21:06.077 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T23:21:06.078 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T23:21:06.088 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T23:21:06.184 DEBUG:teuthology.orchestra.run.smithi179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T23:21:06.254 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T23:21:06.320 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T23:21:06.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:21:06.353 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T23:21:06.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:21:06.384 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T23:21:06.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:21:06.413 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T23:21:06.424 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T23:21:06.455 INFO:teuthology.task.internal:Duration was 1645.232131 seconds 2024-05-08T23:21:06.456 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T23:21:06.466 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T23:21:06.467 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T23:21:06.469 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T23:21:06.471 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T23:21:06.516 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T23:21:06.517 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T23:21:06.518 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T23:21:06.971 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T23:21:06.971 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T23:21:06.972 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T23:21:06.996 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2024-05-08T23:21:06.996 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T23:21:07.019 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T23:21:07.019 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T23:21:07.043 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T23:21:07.043 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T23:21:07.045 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T23:21:07.062 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T23:21:07.134 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T23:21:07.134 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T23:21:07.137 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T23:21:07.139 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T23:21:07.240 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T23:21:07.252 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T23:21:07.253 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T23:21:07.280 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T23:21:07.308 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T23:21:07.335 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T23:21:07.347 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T23:21:07.349 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T23:21:07.351 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T23:21:07.373 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-05-08T23:21:07.378 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2024-05-08T23:21:07.404 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-05-08T23:21:07.421 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T23:21:07.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:21:07.444 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T23:21:07.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:21:07.461 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T23:21:07.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:21:07.477 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T23:21:07.488 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T23:21:07.489 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698146/remote/smithi135 2024-05-08T23:21:07.489 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T23:21:07.533 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698146/remote/smithi179 2024-05-08T23:21:07.533 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T23:21:07.576 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698146/remote/smithi195 2024-05-08T23:21:07.576 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T23:21:07.833 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T23:21:07.833 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T23:21:07.836 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T23:21:07.838 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T23:21:07.886 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T23:21:07.899 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T23:21:07.900 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T23:21:07.912 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T23:21:07.912 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T23:21:07.914 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T23:21:07.917 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T23:21:07.929 INFO:teuthology.orchestra.run.smithi135.stdout: 262179 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 23:21 /home/ubuntu/cephtest 2024-05-08T23:21:07.931 INFO:teuthology.orchestra.run.smithi179.stdout: 262164 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 23:21 /home/ubuntu/cephtest 2024-05-08T23:21:07.943 INFO:teuthology.orchestra.run.smithi195.stdout: 262164 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 23:21 /home/ubuntu/cephtest 2024-05-08T23:21:07.944 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T23:21:07.956 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T23:21:07.982 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsync-tester}} duration: 1645.2321305274963 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-08T23:21:07.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T23:21:08.077 INFO:teuthology.run:pass